[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:07:21.597353 23430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.225.190:39761
I20260709 13:07:21.598829 23430 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:07:21.599937 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:21.616191 23439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:21.616181 23437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:21.616480 23436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:22.795866 23438 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:07:22.795996 23430 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:07:22.800717 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:22.800956 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:22.801189 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602442801168 us; error 0 us; skew 500 ppm
I20260709 13:07:22.801975 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:22.808586 23430 webserver.cc:533] Webserver started at http://127.22.225.190:43735/ using document root <none> and password file <none>
I20260709 13:07:22.809489 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:22.809688 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:22.810096 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:22.815764 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/master-0-root/instance:
uuid: "0e3c9e59da42443dac1ad4dd49c25820"
format_stamp: "Formatted at 2026-07-09 13:07:22 on dist-test-slave-fx0m"
I20260709 13:07:22.823431 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:07:22.828511 23445 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.829734 23430 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:07:22.830108 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/master-0-root
uuid: "0e3c9e59da42443dac1ad4dd49c25820"
format_stamp: "Formatted at 2026-07-09 13:07:22 on dist-test-slave-fx0m"
I20260709 13:07:22.830401 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:22.903896 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:22.905529 23430 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:07:22.905997 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:22.978614 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.190:39761
I20260709 13:07:22.978693 23496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.190:39761 every 8 connection(s)
I20260709 13:07:22.986225 23497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.007628 23497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820: Bootstrap starting.
I20260709 13:07:23.013581 23497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.015400 23497 log.cc:826] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820: Log is configured to *not* fsync() on all Append() calls
I20260709 13:07:23.019816 23497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820: No bootstrap required, opened a new log
I20260709 13:07:23.040095 23497 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3c9e59da42443dac1ad4dd49c25820" member_type: VOTER }
I20260709 13:07:23.040639 23497 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:23.040959 23497 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e3c9e59da42443dac1ad4dd49c25820, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.041951 23497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3c9e59da42443dac1ad4dd49c25820" member_type: VOTER }
I20260709 13:07:23.042464 23497 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:23.042779 23497 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:23.043115 23497 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:23.047284 23497 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3c9e59da42443dac1ad4dd49c25820" member_type: VOTER }
I20260709 13:07:23.048038 23497 leader_election.cc:304] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e3c9e59da42443dac1ad4dd49c25820; no voters: 
I20260709 13:07:23.049829 23497 leader_election.cc:290] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:23.050153 23500 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:23.052917 23500 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 1 LEADER]: Becoming Leader. State: Replica: 0e3c9e59da42443dac1ad4dd49c25820, State: Running, Role: LEADER
I20260709 13:07:23.053964 23500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3c9e59da42443dac1ad4dd49c25820" member_type: VOTER }
I20260709 13:07:23.055052 23497 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:23.064483 23502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e3c9e59da42443dac1ad4dd49c25820. Latest consensus state: current_term: 1 leader_uuid: "0e3c9e59da42443dac1ad4dd49c25820" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3c9e59da42443dac1ad4dd49c25820" member_type: VOTER } }
I20260709 13:07:23.064465 23501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e3c9e59da42443dac1ad4dd49c25820" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3c9e59da42443dac1ad4dd49c25820" member_type: VOTER } }
I20260709 13:07:23.065236 23502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:23.065312 23501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:23.068428 23508 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:23.081298 23508 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:23.083580 23430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:23.098331 23508 catalog_manager.cc:1383] Generated new cluster ID: 0590720004964e398b54824ee40f2b80
I20260709 13:07:23.098608 23508 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:23.121835 23508 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:23.123360 23508 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:23.136466 23508 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820: Generated new TSK 0
I20260709 13:07:23.137427 23508 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:23.150627 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:23.159965 23519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.161305 23520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.165547 23430 server_base.cc:1061] running on GCE node
W20260709 13:07:23.166033 23522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.167177 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:23.167462 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:23.167699 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602443167678 us; error 0 us; skew 500 ppm
I20260709 13:07:23.168516 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:23.172695 23430 webserver.cc:533] Webserver started at http://127.22.225.129:36285/ using document root <none> and password file <none>
I20260709 13:07:23.173417 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:23.173681 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:23.174077 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:23.175598 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-0-root/instance:
uuid: "4f7e30f0201146468490efe5819d092f"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-fx0m"
I20260709 13:07:23.182593 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:07:23.187741 23527 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.188647 23430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:23.189008 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "4f7e30f0201146468490efe5819d092f"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-fx0m"
I20260709 13:07:23.189419 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:23.231444 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:23.233265 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:23.236056 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:23.241523 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:23.241847 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.242161 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:23.242393 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.331769 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:36643
I20260709 13:07:23.331914 23589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:36643 every 8 connection(s)
I20260709 13:07:23.339092 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:23.348537 23594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.350585 23595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.357136 23430 server_base.cc:1061] running on GCE node
W20260709 13:07:23.358597 23597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.359586 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:23.359822 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:23.360049 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602443360027 us; error 0 us; skew 500 ppm
I20260709 13:07:23.360847 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:23.363986 23430 webserver.cc:533] Webserver started at http://127.22.225.130:46279/ using document root <none> and password file <none>
I20260709 13:07:23.364567 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:23.364670 23590 heartbeater.cc:344] Connected to a master server at 127.22.225.190:39761
I20260709 13:07:23.364867 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:23.365159 23590 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:23.365236 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:23.366365 23590 heartbeater.cc:507] Master 127.22.225.190:39761 requested a full tablet report, sending...
I20260709 13:07:23.366765 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-1-root/instance:
uuid: "9e91bac5684b472d91ae44a39b8ddd84"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-fx0m"
I20260709 13:07:23.369903 23462 ts_manager.cc:194] Registered new tserver with Master: 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643)
I20260709 13:07:23.372972 23462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45330
I20260709 13:07:23.373236 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:23.379031 23602 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.379851 23430 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:23.380136 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-1-root
uuid: "9e91bac5684b472d91ae44a39b8ddd84"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-fx0m"
I20260709 13:07:23.380403 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:23.395473 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:23.396685 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:23.399260 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:23.402094 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:23.402268 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.402549 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:23.402684 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.505175 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.130:42451
I20260709 13:07:23.505332 23664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.130:42451 every 8 connection(s)
I20260709 13:07:23.511962 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:23.521632 23668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.523121 23669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.526377 23671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.527170 23430 server_base.cc:1061] running on GCE node
I20260709 13:07:23.528210 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:23.528469 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:23.528656 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602443528641 us; error 0 us; skew 500 ppm
I20260709 13:07:23.529253 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:23.530126 23665 heartbeater.cc:344] Connected to a master server at 127.22.225.190:39761
I20260709 13:07:23.530609 23665 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:23.531477 23665 heartbeater.cc:507] Master 127.22.225.190:39761 requested a full tablet report, sending...
I20260709 13:07:23.532263 23430 webserver.cc:533] Webserver started at http://127.22.225.131:41043/ using document root <none> and password file <none>
I20260709 13:07:23.532872 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:23.533136 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:23.533473 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:23.533995 23462 ts_manager.cc:194] Registered new tserver with Master: 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:23.535056 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-2-root/instance:
uuid: "066542278f484f31b91e98245490cc17"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-fx0m"
I20260709 13:07:23.535744 23462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45346
I20260709 13:07:23.540692 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 13:07:23.544340 23676 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.545301 23430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:23.545678 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-2-root
uuid: "066542278f484f31b91e98245490cc17"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-fx0m"
I20260709 13:07:23.546041 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602441430441-23430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:23.564464 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:23.565850 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:23.567387 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:23.569643 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:23.569864 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.570103 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:23.570287 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:23.650442 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.131:33133
I20260709 13:07:23.650586 23738 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.131:33133 every 8 connection(s)
I20260709 13:07:23.667498 23739 heartbeater.cc:344] Connected to a master server at 127.22.225.190:39761
I20260709 13:07:23.667913 23739 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:23.668687 23739 heartbeater.cc:507] Master 127.22.225.190:39761 requested a full tablet report, sending...
I20260709 13:07:23.670667 23462 ts_manager.cc:194] Registered new tserver with Master: 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:23.671403 23430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013194323s
I20260709 13:07:23.672219 23462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44618
I20260709 13:07:23.719794 23462 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44628:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:23.723311 23462 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:23.824002 23555 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3d6035829544f58eba5cc5cd135b2a (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.824074 23554 tablet_service.cc:1511] Processing CreateTablet for tablet 531fdc2d8d264dab826f4a24b6c17c46 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.826011 23554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531fdc2d8d264dab826f4a24b6c17c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.826256 23553 tablet_service.cc:1511] Processing CreateTablet for tablet 9104db74d70646e4900c8d19c6b3d62d (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.826674 23548 tablet_service.cc:1511] Processing CreateTablet for tablet ecafe41085834960bb73cd6a518908b2 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.827618 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9104db74d70646e4900c8d19c6b3d62d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.829643 23555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3d6035829544f58eba5cc5cd135b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.831064 23550 tablet_service.cc:1511] Processing CreateTablet for tablet 7acb6229f0ac4ffe94143d061484fa45 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.832330 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acb6229f0ac4ffe94143d061484fa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.834375 23552 tablet_service.cc:1511] Processing CreateTablet for tablet 135f4593794b439b8558f0ecc06c6472 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.835743 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135f4593794b439b8558f0ecc06c6472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.834368 23551 tablet_service.cc:1511] Processing CreateTablet for tablet 87e944c4c28f47a58af9f59395888e5e (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.837298 23551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e944c4c28f47a58af9f59395888e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.829178 23549 tablet_service.cc:1511] Processing CreateTablet for tablet 5f60f8dc80304e14b6e0039bf8f7a00a (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.838740 23549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f60f8dc80304e14b6e0039bf8f7a00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.841465 23548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecafe41085834960bb73cd6a518908b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.846884 23547 tablet_service.cc:1511] Processing CreateTablet for tablet 9ef1960bed654dda8f0ee9e09ff1efd9 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.848157 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ef1960bed654dda8f0ee9e09ff1efd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.893005 23757 tablet_bootstrap.cc:492] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:23.908314 23757 tablet_bootstrap.cc:654] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:23.915999 23630 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3d6035829544f58eba5cc5cd135b2a (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.920177 23626 tablet_service.cc:1511] Processing CreateTablet for tablet 87e944c4c28f47a58af9f59395888e5e (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.920204 23629 tablet_service.cc:1511] Processing CreateTablet for tablet 531fdc2d8d264dab826f4a24b6c17c46 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.924341 23627 tablet_service.cc:1511] Processing CreateTablet for tablet 135f4593794b439b8558f0ecc06c6472 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.926798 23624 tablet_service.cc:1511] Processing CreateTablet for tablet 5f60f8dc80304e14b6e0039bf8f7a00a (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.925515 23625 tablet_service.cc:1511] Processing CreateTablet for tablet 7acb6229f0ac4ffe94143d061484fa45 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.930981 23630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3d6035829544f58eba5cc5cd135b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.924242 23628 tablet_service.cc:1511] Processing CreateTablet for tablet 9104db74d70646e4900c8d19c6b3d62d (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.930119 23623 tablet_service.cc:1511] Processing CreateTablet for tablet ecafe41085834960bb73cd6a518908b2 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.934672 23622 tablet_service.cc:1511] Processing CreateTablet for tablet 9ef1960bed654dda8f0ee9e09ff1efd9 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.936757 23625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acb6229f0ac4ffe94143d061484fa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.937502 23628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9104db74d70646e4900c8d19c6b3d62d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.938211 23623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecafe41085834960bb73cd6a518908b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.939730 23704 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3d6035829544f58eba5cc5cd135b2a (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:23.940125 23703 tablet_service.cc:1511] Processing CreateTablet for tablet 531fdc2d8d264dab826f4a24b6c17c46 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:23.942417 23702 tablet_service.cc:1511] Processing CreateTablet for tablet 9104db74d70646e4900c8d19c6b3d62d (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:23.942487 23699 tablet_service.cc:1511] Processing CreateTablet for tablet 7acb6229f0ac4ffe94143d061484fa45 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:23.946089 23696 tablet_service.cc:1511] Processing CreateTablet for tablet 9ef1960bed654dda8f0ee9e09ff1efd9 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:23.946378 23700 tablet_service.cc:1511] Processing CreateTablet for tablet 87e944c4c28f47a58af9f59395888e5e (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:23.944779 23697 tablet_service.cc:1511] Processing CreateTablet for tablet ecafe41085834960bb73cd6a518908b2 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:23.948596 23622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ef1960bed654dda8f0ee9e09ff1efd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.948295 23698 tablet_service.cc:1511] Processing CreateTablet for tablet 5f60f8dc80304e14b6e0039bf8f7a00a (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:23.944737 23701 tablet_service.cc:1511] Processing CreateTablet for tablet 135f4593794b439b8558f0ecc06c6472 (DEFAULT_TABLE table=test-workload [id=b27e14832e92420c97a70e368f0dbdd5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:23.950171 23704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3d6035829544f58eba5cc5cd135b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.953434 23696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ef1960bed654dda8f0ee9e09ff1efd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.954236 23701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135f4593794b439b8558f0ecc06c6472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.954701 23629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531fdc2d8d264dab826f4a24b6c17c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.956892 23697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecafe41085834960bb73cd6a518908b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.957530 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135f4593794b439b8558f0ecc06c6472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.957644 23700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e944c4c28f47a58af9f59395888e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.958808 23624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f60f8dc80304e14b6e0039bf8f7a00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.961381 23698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f60f8dc80304e14b6e0039bf8f7a00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.965775 23703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 531fdc2d8d264dab826f4a24b6c17c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.970073 23702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9104db74d70646e4900c8d19c6b3d62d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.969681 23626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e944c4c28f47a58af9f59395888e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.973625 23699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acb6229f0ac4ffe94143d061484fa45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:23.997008 23757 tablet_bootstrap.cc:492] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.019176 23757 ts_tablet_manager.cc:1403] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.127s	user 0.007s	sys 0.008s
I20260709 13:07:24.025493 23757 raft_consensus.cc:359] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.043905 23757 raft_consensus.cc:385] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.044909 23757 raft_consensus.cc:740] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.045713 23757 consensus_queue.cc:260] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.076538 23760 tablet_bootstrap.cc:492] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17: Bootstrap starting.
I20260709 13:07:24.074368 23759 tablet_bootstrap.cc:492] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
W20260709 13:07:24.078081 23510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:24.095832 23757 ts_tablet_manager.cc:1434] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.076s	user 0.015s	sys 0.006s
I20260709 13:07:24.099593 23760 tablet_bootstrap.cc:654] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.102335 23590 heartbeater.cc:499] Master 127.22.225.190:39761 was elected leader, sending a full tablet report...
I20260709 13:07:24.118589 23757 tablet_bootstrap.cc:492] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:24.120966 23759 tablet_bootstrap.cc:654] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.133996 23757 tablet_bootstrap.cc:654] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.132699 23760 tablet_bootstrap.cc:492] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.141582 23759 tablet_bootstrap.cc:492] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.141546 23760 ts_tablet_manager.cc:1403] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.020s
I20260709 13:07:24.143963 23760 raft_consensus.cc:359] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.144465 23760 raft_consensus.cc:385] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.144641 23760 raft_consensus.cc:740] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.145284 23760 consensus_queue.cc:260] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.146880 23759 ts_tablet_manager.cc:1403] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.006s
I20260709 13:07:24.151008 23739 heartbeater.cc:499] Master 127.22.225.190:39761 was elected leader, sending a full tablet report...
I20260709 13:07:24.150802 23759 raft_consensus.cc:359] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.151611 23759 raft_consensus.cc:385] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.151911 23759 raft_consensus.cc:740] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.152716 23757 tablet_bootstrap.cc:492] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.152627 23759 consensus_queue.cc:260] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.154420 23760 ts_tablet_manager.cc:1434] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:07:24.155608 23760 tablet_bootstrap.cc:492] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17: Bootstrap starting.
W20260709 13:07:24.159183 23740 tablet.cc:2406] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:24.161284 23757 ts_tablet_manager.cc:1403] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.009s
I20260709 13:07:24.165190 23665 heartbeater.cc:499] Master 127.22.225.190:39761 was elected leader, sending a full tablet report...
I20260709 13:07:24.164956 23757 raft_consensus.cc:359] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.165710 23757 raft_consensus.cc:385] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.166213 23759 ts_tablet_manager.cc:1434] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:07:24.167342 23759 tablet_bootstrap.cc:492] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
I20260709 13:07:24.168708 23760 tablet_bootstrap.cc:654] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.166013 23757 raft_consensus.cc:740] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.173879 23757 consensus_queue.cc:260] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.179584 23757 ts_tablet_manager.cc:1434] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:07:24.182104 23757 tablet_bootstrap.cc:492] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:24.186295 23759 tablet_bootstrap.cc:654] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.189056 23761 raft_consensus.cc:493] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.189608 23761 raft_consensus.cc:515] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.193233 23761 leader_election.cc:290] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.194343 23760 tablet_bootstrap.cc:492] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.210532 23760 ts_tablet_manager.cc:1403] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.010s
I20260709 13:07:24.213740 23760 raft_consensus.cc:359] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.214751 23760 raft_consensus.cc:385] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.215150 23760 raft_consensus.cc:740] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.216109 23760 consensus_queue.cc:260] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.219878 23757 tablet_bootstrap.cc:654] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.228523 23759 tablet_bootstrap.cc:492] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.229007 23759 ts_tablet_manager.cc:1403] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.010s
I20260709 13:07:24.229785 23760 ts_tablet_manager.cc:1434] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:07:24.231817 23759 raft_consensus.cc:359] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.232548 23759 raft_consensus.cc:385] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.232836 23759 raft_consensus.cc:740] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.233114 23760 tablet_bootstrap.cc:492] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17: Bootstrap starting.
I20260709 13:07:24.233578 23759 consensus_queue.cc:260] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.240479 23760 tablet_bootstrap.cc:654] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.242024 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.242770 23759 ts_tablet_manager.cc:1434] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
W20260709 13:07:24.244344 23531 leader_election.cc:343] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.245899 23765 raft_consensus.cc:493] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.246517 23765 raft_consensus.cc:515] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.249611 23765 leader_election.cc:290] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:24.258744 23759 tablet_bootstrap.cc:492] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
I20260709 13:07:24.267987 23757 tablet_bootstrap.cc:492] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.268483 23757 ts_tablet_manager.cc:1403] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.014s
I20260709 13:07:24.271347 23757 raft_consensus.cc:359] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.276237 23757 raft_consensus.cc:385] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.277292 23757 raft_consensus.cc:740] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.277364 23759 tablet_bootstrap.cc:654] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.280267 23714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
I20260709 13:07:24.286403 23760 tablet_bootstrap.cc:492] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.286886 23760 ts_tablet_manager.cc:1403] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.054s	user 0.004s	sys 0.022s
I20260709 13:07:24.291688 23757 consensus_queue.cc:260] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.294663 23757 ts_tablet_manager.cc:1434] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.002s
I20260709 13:07:24.295598 23757 tablet_bootstrap.cc:492] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:24.296342 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acb6229f0ac4ffe94143d061484fa45" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f" is_pre_election: true
I20260709 13:07:24.297585 23765 raft_consensus.cc:493] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.298032 23765 raft_consensus.cc:515] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.299134 23759 tablet_bootstrap.cc:492] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.299561 23759 ts_tablet_manager.cc:1403] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.004s
I20260709 13:07:24.300021 23765 leader_election.cc:290] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
W20260709 13:07:24.301810 23678 leader_election.cc:343] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.302642 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f" is_pre_election: true
W20260709 13:07:24.304018 23678 leader_election.cc:343] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.303719 23760 raft_consensus.cc:359] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.307791 23760 raft_consensus.cc:385] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.308116 23760 raft_consensus.cc:740] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.308948 23760 consensus_queue.cc:260] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
W20260709 13:07:24.309741 23530 leader_election.cc:343] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 066542278f484f31b91e98245490cc17 (127.22.225.131:33133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.310173 23530 leader_election.cc:304] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f7e30f0201146468490efe5819d092f; no voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:24.311074 23760 ts_tablet_manager.cc:1434] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:07:24.311939 23760 tablet_bootstrap.cc:492] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17: Bootstrap starting.
I20260709 13:07:24.312354 23761 raft_consensus.cc:2749] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.312465 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acb6229f0ac4ffe94143d061484fa45" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.313149 23640 raft_consensus.cc:2468] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 0.
I20260709 13:07:24.314994 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.316190 23680 leader_election.cc:304] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 4f7e30f0201146468490efe5819d092f
I20260709 13:07:24.302414 23759 raft_consensus.cc:359] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.317245 23759 raft_consensus.cc:385] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.317564 23759 raft_consensus.cc:740] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.318275 23759 consensus_queue.cc:260] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.318684 23765 raft_consensus.cc:2804] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.319105 23765 raft_consensus.cc:493] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.319459 23765 raft_consensus.cc:3060] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.319653 23640 raft_consensus.cc:2468] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 0.
I20260709 13:07:24.321316 23759 ts_tablet_manager.cc:1434] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.005s
I20260709 13:07:24.322314 23759 tablet_bootstrap.cc:492] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
I20260709 13:07:24.326689 23765 raft_consensus.cc:515] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.327252 23757 tablet_bootstrap.cc:654] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.328676 23759 tablet_bootstrap.cc:654] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.328824 23765 leader_election.cc:290] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:24.330415 23760 tablet_bootstrap.cc:654] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.335570 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acb6229f0ac4ffe94143d061484fa45" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f"
W20260709 13:07:24.336978 23678 leader_election.cc:343] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.328038 23680 leader_election.cc:304] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 4f7e30f0201146468490efe5819d092f
I20260709 13:07:24.338315 23765 raft_consensus.cc:2804] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.338675 23765 raft_consensus.cc:493] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.339005 23765 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.342733 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acb6229f0ac4ffe94143d061484fa45" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:24.343427 23640 raft_consensus.cc:3060] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.345916 23765 raft_consensus.cc:515] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.348693 23765 leader_election.cc:290] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:24.349393 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:24.349992 23757 tablet_bootstrap.cc:492] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.350556 23757 ts_tablet_manager.cc:1403] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.007s
W20260709 13:07:24.350637 23678 leader_election.cc:343] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.351975 23640 raft_consensus.cc:2468] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 1.
I20260709 13:07:24.353309 23680 leader_election.cc:304] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 4f7e30f0201146468490efe5819d092f
I20260709 13:07:24.353682 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:24.354327 23640 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.354350 23765 raft_consensus.cc:2804] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.354360 23757 raft_consensus.cc:359] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.357242 23757 raft_consensus.cc:385] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.357647 23757 raft_consensus.cc:740] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.358505 23757 consensus_queue.cc:260] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.359314 23760 tablet_bootstrap.cc:492] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.359740 23760 ts_tablet_manager.cc:1403] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.004s
I20260709 13:07:24.360982 23757 ts_tablet_manager.cc:1434] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:07:24.361912 23757 tablet_bootstrap.cc:492] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:24.362520 23760 raft_consensus.cc:359] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.363197 23760 raft_consensus.cc:385] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.363474 23760 raft_consensus.cc:740] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.364180 23760 consensus_queue.cc:260] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.368251 23759 tablet_bootstrap.cc:492] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.368713 23757 tablet_bootstrap.cc:654] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.369179 23759 ts_tablet_manager.cc:1403] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.011s
I20260709 13:07:24.372133 23759 raft_consensus.cc:359] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.372790 23759 raft_consensus.cc:385] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.373060 23759 raft_consensus.cc:740] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.381826 23765 raft_consensus.cc:697] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Becoming Leader. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:24.380007 23759 consensus_queue.cc:260] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.384682 23761 raft_consensus.cc:493] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.385210 23761 raft_consensus.cc:515] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.384209 23765 consensus_queue.cc:237] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.384541 23640 raft_consensus.cc:2468] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 1.
I20260709 13:07:24.387472 23761 leader_election.cc:290] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.389429 23639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.390251 23639 raft_consensus.cc:2468] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 0.
I20260709 13:07:24.390280 23714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
I20260709 13:07:24.390949 23760 ts_tablet_manager.cc:1434] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 13:07:24.391574 23759 ts_tablet_manager.cc:1434] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
W20260709 13:07:24.391850 23530 leader_election.cc:343] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 066542278f484f31b91e98245490cc17 (127.22.225.131:33133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.392491 23759 tablet_bootstrap.cc:492] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
I20260709 13:07:24.391968 23760 tablet_bootstrap.cc:492] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17: Bootstrap starting.
I20260709 13:07:24.396044 23531 leader_election.cc:304] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 066542278f484f31b91e98245490cc17
I20260709 13:07:24.397660 23680 leader_election.cc:304] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 4f7e30f0201146468490efe5819d092f
I20260709 13:07:24.401882 23759 tablet_bootstrap.cc:654] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.396986 23761 raft_consensus.cc:2804] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.406167 23761 raft_consensus.cc:493] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.406548 23761 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.406713 23779 raft_consensus.cc:2804] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.407361 23779 raft_consensus.cc:697] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Becoming Leader. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:24.420611 23760 tablet_bootstrap.cc:654] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.408506 23779 consensus_queue.cc:237] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.434145 23761 raft_consensus.cc:515] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.441452 23757 tablet_bootstrap.cc:492] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.440399 23714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:24.442204 23757 ts_tablet_manager.cc:1403] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.003s
W20260709 13:07:24.443589 23530 leader_election.cc:343] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 066542278f484f31b91e98245490cc17 (127.22.225.131:33133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.441286 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:24.444710 23640 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.437016 23761 leader_election.cc:290] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.448086 23759 tablet_bootstrap.cc:492] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.448534 23759 ts_tablet_manager.cc:1403] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.005s
I20260709 13:07:24.453647 23757 raft_consensus.cc:359] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.453819 23759 raft_consensus.cc:359] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.454501 23757 raft_consensus.cc:385] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.454556 23759 raft_consensus.cc:385] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.454957 23757 raft_consensus.cc:740] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.455008 23759 raft_consensus.cc:740] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.454216 23640 raft_consensus.cc:2468] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 1.
I20260709 13:07:24.455946 23759 consensus_queue.cc:260] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.457683 23531 leader_election.cc:304] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 066542278f484f31b91e98245490cc17
I20260709 13:07:24.462158 23761 raft_consensus.cc:2804] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.462543 23759 ts_tablet_manager.cc:1434] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:07:24.466068 23759 tablet_bootstrap.cc:492] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
I20260709 13:07:24.455946 23757 consensus_queue.cc:260] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.465495 23462 catalog_manager.cc:5697] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066542278f484f31b91e98245490cc17 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "066542278f484f31b91e98245490cc17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.471077 23761 raft_consensus.cc:697] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:24.473743 23761 consensus_queue.cc:237] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.474545 23757 ts_tablet_manager.cc:1434] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.001s
I20260709 13:07:24.474864 23759 tablet_bootstrap.cc:654] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.475633 23757 tablet_bootstrap.cc:492] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:24.494558 23760 tablet_bootstrap.cc:492] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.495250 23760 ts_tablet_manager.cc:1403] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.009s
I20260709 13:07:24.507906 23760 raft_consensus.cc:359] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.508924 23760 raft_consensus.cc:385] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.509359 23760 raft_consensus.cc:740] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.514106 23461 catalog_manager.cc:5697] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 1 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.514125 23760 consensus_queue.cc:260] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.519403 23760 ts_tablet_manager.cc:1434] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 13:07:24.520390 23760 tablet_bootstrap.cc:492] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17: Bootstrap starting.
I20260709 13:07:24.522668 23757 tablet_bootstrap.cc:654] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.529807 23760 tablet_bootstrap.cc:654] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.532121 23759 tablet_bootstrap.cc:492] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.532596 23759 ts_tablet_manager.cc:1403] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.020s
I20260709 13:07:24.533541 23462 catalog_manager.cc:5697] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066542278f484f31b91e98245490cc17 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "066542278f484f31b91e98245490cc17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.535415 23759 raft_consensus.cc:359] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.536121 23759 raft_consensus.cc:385] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.536414 23759 raft_consensus.cc:740] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.542274 23759 consensus_queue.cc:260] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.544979 23759 ts_tablet_manager.cc:1434] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:07:24.545989 23759 tablet_bootstrap.cc:492] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
I20260709 13:07:24.553252 23759 tablet_bootstrap.cc:654] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.555410 23760 tablet_bootstrap.cc:492] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.555899 23760 ts_tablet_manager.cc:1403] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 13:07:24.564689 23759 tablet_bootstrap.cc:492] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.565191 23759 ts_tablet_manager.cc:1403] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:07:24.565744 23757 tablet_bootstrap.cc:492] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.566197 23757 ts_tablet_manager.cc:1403] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.008s
I20260709 13:07:24.567955 23759 raft_consensus.cc:359] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.568720 23759 raft_consensus.cc:385] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.569010 23759 raft_consensus.cc:740] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.568989 23757 raft_consensus.cc:359] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.569761 23757 raft_consensus.cc:385] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.570063 23757 raft_consensus.cc:740] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.569886 23759 consensus_queue.cc:260] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.572409 23759 ts_tablet_manager.cc:1434] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:07:24.570796 23757 consensus_queue.cc:260] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.573350 23759 tablet_bootstrap.cc:492] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
I20260709 13:07:24.574163 23760 raft_consensus.cc:359] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.574846 23760 raft_consensus.cc:385] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.575115 23760 raft_consensus.cc:740] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.576826 23757 ts_tablet_manager.cc:1434] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:07:24.577577 23760 consensus_queue.cc:260] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.580464 23760 ts_tablet_manager.cc:1434] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:07:24.580847 23759 tablet_bootstrap.cc:654] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.581427 23760 tablet_bootstrap.cc:492] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17: Bootstrap starting.
I20260709 13:07:24.582224 23757 tablet_bootstrap.cc:492] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:24.593796 23760 tablet_bootstrap.cc:654] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.598029 23757 tablet_bootstrap.cc:654] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.606344 23759 tablet_bootstrap.cc:492] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.606822 23759 ts_tablet_manager.cc:1403] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.014s
I20260709 13:07:24.607859 23757 tablet_bootstrap.cc:492] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.608316 23757 ts_tablet_manager.cc:1403] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 13:07:24.609411 23759 raft_consensus.cc:359] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.610154 23759 raft_consensus.cc:385] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.610304 23760 tablet_bootstrap.cc:492] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.610440 23759 raft_consensus.cc:740] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.610975 23757 raft_consensus.cc:359] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.611250 23760 ts_tablet_manager.cc:1403] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.007s
I20260709 13:07:24.611289 23759 consensus_queue.cc:260] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.611793 23757 raft_consensus.cc:385] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.612301 23757 raft_consensus.cc:740] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.613636 23759 ts_tablet_manager.cc:1434] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:07:24.613317 23757 consensus_queue.cc:260] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.614459 23759 tablet_bootstrap.cc:492] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84: Bootstrap starting.
I20260709 13:07:24.615751 23757 ts_tablet_manager.cc:1434] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:07:24.616639 23757 tablet_bootstrap.cc:492] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:24.620500 23759 tablet_bootstrap.cc:654] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.621243 23760 raft_consensus.cc:359] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.621997 23760 raft_consensus.cc:385] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.622311 23760 raft_consensus.cc:740] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.623135 23757 tablet_bootstrap.cc:654] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.623060 23760 consensus_queue.cc:260] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.631945 23757 tablet_bootstrap.cc:492] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.632361 23757 ts_tablet_manager.cc:1403] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 13:07:24.634322 23759 tablet_bootstrap.cc:492] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84: No bootstrap required, opened a new log
I20260709 13:07:24.634714 23759 ts_tablet_manager.cc:1403] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.009s
I20260709 13:07:24.634740 23757 raft_consensus.cc:359] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.635483 23757 raft_consensus.cc:385] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.635761 23757 raft_consensus.cc:740] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.636371 23757 consensus_queue.cc:260] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.637243 23759 raft_consensus.cc:359] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.637866 23759 raft_consensus.cc:385] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.638192 23759 raft_consensus.cc:740] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.638631 23757 ts_tablet_manager.cc:1434] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:24.638943 23759 consensus_queue.cc:260] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.639693 23757 tablet_bootstrap.cc:492] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f: Bootstrap starting.
I20260709 13:07:24.640955 23760 ts_tablet_manager.cc:1434] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:07:24.641883 23760 tablet_bootstrap.cc:492] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17: Bootstrap starting.
I20260709 13:07:24.645711 23757 tablet_bootstrap.cc:654] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.648310 23760 tablet_bootstrap.cc:654] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.648833 23761 raft_consensus.cc:493] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.649350 23761 raft_consensus.cc:515] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.651583 23761 leader_election.cc:290] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.652171 23759 ts_tablet_manager.cc:1434] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:07:24.652884 23779 raft_consensus.cc:493] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.653548 23714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
I20260709 13:07:24.653389 23779 raft_consensus.cc:515] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.654126 23714 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 0.
I20260709 13:07:24.655414 23779 leader_election.cc:290] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:24.655932 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.656713 23640 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 0.
I20260709 13:07:24.658481 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef1960bed654dda8f0ee9e09ff1efd9" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f" is_pre_election: true
I20260709 13:07:24.659313 23565 raft_consensus.cc:2468] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 0.
I20260709 13:07:24.660678 23530 leader_election.cc:304] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:24.661721 23786 raft_consensus.cc:2804] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.662189 23786 raft_consensus.cc:493] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.662628 23786 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.666229 23678 leader_election.cc:304] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:24.666999 23779 raft_consensus.cc:2804] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.667358 23779 raft_consensus.cc:493] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.667363 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef1960bed654dda8f0ee9e09ff1efd9" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.667726 23779 raft_consensus.cc:3060] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.668126 23640 raft_consensus.cc:2468] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 0.
I20260709 13:07:24.672899 23786 raft_consensus.cc:515] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.674252 23779 raft_consensus.cc:515] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.675781 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:24.676239 23779 leader_election.cc:290] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:24.676331 23640 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.681917 23639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef1960bed654dda8f0ee9e09ff1efd9" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:24.682464 23639 raft_consensus.cc:3060] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.685587 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef1960bed654dda8f0ee9e09ff1efd9" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:24.686167 23565 raft_consensus.cc:3060] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.686479 23766 raft_consensus.cc:493] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.686924 23766 raft_consensus.cc:515] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.690793 23766 leader_election.cc:290] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.691514 23766 raft_consensus.cc:493] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.691915 23766 raft_consensus.cc:515] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.703192 23766 leader_election.cc:290] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.702092 23760 tablet_bootstrap.cc:492] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.704309 23760 ts_tablet_manager.cc:1403] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.020s
I20260709 13:07:24.703644 23761 raft_consensus.cc:493] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.709774 23565 raft_consensus.cc:2468] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 1.
I20260709 13:07:24.711364 23678 leader_election.cc:304] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:24.712378 23779 raft_consensus.cc:2804] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.709733 23639 raft_consensus.cc:2468] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 1.
I20260709 13:07:24.712858 23779 raft_consensus.cc:697] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Becoming Leader. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:24.741634 23761 raft_consensus.cc:515] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.742909 23779 consensus_queue.cc:237] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.705214 23640 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 1.
I20260709 13:07:24.745041 23766 raft_consensus.cc:493] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.747797 23786 leader_election.cc:290] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.750584 23714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:24.749235 23780 raft_consensus.cc:493] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.749015 23766 raft_consensus.cc:515] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.754125 23714 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.755529 23761 leader_election.cc:290] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.752669 23780 raft_consensus.cc:515] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.755714 23766 leader_election.cc:290] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.764034 23757 tablet_bootstrap.cc:492] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f: No bootstrap required, opened a new log
I20260709 13:07:24.764427 23757 ts_tablet_manager.cc:1403] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.019s
I20260709 13:07:24.765666 23713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
W20260709 13:07:24.768254 23530 leader_election.cc:343] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 066542278f484f31b91e98245490cc17 (127.22.225.131:33133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:24.768400 23760 raft_consensus.cc:359] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.769104 23760 raft_consensus.cc:385] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.769389 23760 raft_consensus.cc:740] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.769202 23757 raft_consensus.cc:359] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.770364 23757 raft_consensus.cc:385] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.770128 23760 consensus_queue.cc:260] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.770609 23757 raft_consensus.cc:740] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.772789 23760 ts_tablet_manager.cc:1434] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.013s
I20260709 13:07:24.772827 23757 consensus_queue.cc:260] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.776815 23760 tablet_bootstrap.cc:492] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17: Bootstrap starting.
I20260709 13:07:24.776561 23565 raft_consensus.cc:3060] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.777101 23761 raft_consensus.cc:493] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.782183 23531 leader_election.cc:304] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:24.783288 23757 ts_tablet_manager.cc:1434] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:07:24.783023 23786 raft_consensus.cc:2804] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.781924 23761 raft_consensus.cc:515] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.785143 23564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f" is_pre_election: true
I20260709 13:07:24.790068 23564 raft_consensus.cc:2468] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 0.
I20260709 13:07:24.787288 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f" is_pre_election: true
I20260709 13:07:24.792670 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.787395 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f" is_pre_election: true
I20260709 13:07:24.794204 23640 raft_consensus.cc:2468] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 0.
I20260709 13:07:24.794436 23563 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 0.
I20260709 13:07:24.794204 23562 raft_consensus.cc:2468] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 0.
I20260709 13:07:24.795917 23604 leader_election.cc:304] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:24.797147 23604 leader_election.cc:304] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:24.797629 23713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
I20260709 13:07:24.797899 23766 raft_consensus.cc:2804] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.798243 23766 raft_consensus.cc:493] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.799202 23802 raft_consensus.cc:2804] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.798223 23713 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 0.
I20260709 13:07:24.795372 23761 leader_election.cc:290] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.805168 23760 tablet_bootstrap.cc:654] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.804710 23802 raft_consensus.cc:493] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.804394 23786 raft_consensus.cc:697] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:24.806586 23802 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.805356 23766 raft_consensus.cc:3060] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.807262 23640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.807286 23531 leader_election.cc:304] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 066542278f484f31b91e98245490cc17
I20260709 13:07:24.808570 23714 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 1.
I20260709 13:07:24.807830 23604 leader_election.cc:304] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:24.809878 23530 leader_election.cc:304] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:24.814916 23761 raft_consensus.cc:2804] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.815951 23761 raft_consensus.cc:493] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.816385 23761 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.819229 23806 raft_consensus.cc:2804] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.809459 23786 consensus_queue.cc:237] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.820253 23806 raft_consensus.cc:493] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.820668 23806 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.825817 23807 raft_consensus.cc:2804] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.826246 23807 raft_consensus.cc:493] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.826102 23779 consensus_queue.cc:1048] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.826578 23807 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.828786 23714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
I20260709 13:07:24.829221 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
I20260709 13:07:24.829697 23714 raft_consensus.cc:2468] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 0.
I20260709 13:07:24.829855 23712 raft_consensus.cc:2468] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 0.
I20260709 13:07:24.826570 23713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
I20260709 13:07:24.832957 23713 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 0.
I20260709 13:07:24.835930 23761 raft_consensus.cc:515] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.837143 23809 raft_consensus.cc:493] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.839877 23760 tablet_bootstrap.cc:492] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17: No bootstrap required, opened a new log
I20260709 13:07:24.840535 23760 ts_tablet_manager.cc:1403] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.002s
I20260709 13:07:24.837770 23802 raft_consensus.cc:515] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.844122 23640 raft_consensus.cc:2393] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f7e30f0201146468490efe5819d092f in current term 1: Already voted for candidate 9e91bac5684b472d91ae44a39b8ddd84 in this term.
I20260709 13:07:24.844919 23802 leader_election.cc:290] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.845897 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:24.846220 23761 leader_election.cc:290] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.847311 23562 raft_consensus.cc:2393] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e91bac5684b472d91ae44a39b8ddd84 in current term 1: Already voted for candidate 4f7e30f0201146468490efe5819d092f in this term.
I20260709 13:07:24.849267 23639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:24.854113 23713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:24.855515 23713 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.843762 23766 raft_consensus.cc:515] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.840000 23809 raft_consensus.cc:515] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.859555 23760 raft_consensus.cc:359] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.859436 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:24.862656 23760 raft_consensus.cc:385] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.862293 23779 raft_consensus.cc:493] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.857846 23806 raft_consensus.cc:515] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.863615 23760 raft_consensus.cc:740] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.863168 23779 raft_consensus.cc:515] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.864849 23760 consensus_queue.cc:260] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.867357 23760 ts_tablet_manager.cc:1434] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 13:07:24.863657 23807 raft_consensus.cc:515] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.871708 23605 leader_election.cc:304] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e91bac5684b472d91ae44a39b8ddd84; no voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f
I20260709 13:07:24.871865 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f" is_pre_election: true
I20260709 13:07:24.870855 23779 leader_election.cc:290] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:24.873766 23802 raft_consensus.cc:2749] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.874166 23562 raft_consensus.cc:2468] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 0.
I20260709 13:07:24.874576 23766 leader_election.cc:290] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.875689 23678 leader_election.cc:304] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:24.877046 23779 raft_consensus.cc:2804] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:24.877470 23639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.877507 23779 raft_consensus.cc:493] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.879822 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.877437 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:24.881852 23638 raft_consensus.cc:2393] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f7e30f0201146468490efe5819d092f in current term 1: Already voted for candidate 066542278f484f31b91e98245490cc17 in this term.
I20260709 13:07:24.877516 23713 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 1.
I20260709 13:07:24.878818 23806 leader_election.cc:290] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.883487 23807 leader_election.cc:290] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.883414 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:24.882973 23714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17" is_pre_election: true
I20260709 13:07:24.881135 23779 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.881172 23639 raft_consensus.cc:2468] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 0.
I20260709 13:07:24.885565 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:24.879501 23809 leader_election.cc:290] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:24.881603 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:24.884085 23562 raft_consensus.cc:3060] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.883358 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:24.887347 23712 raft_consensus.cc:3060] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.887984 23563 raft_consensus.cc:2393] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e91bac5684b472d91ae44a39b8ddd84 in current term 1: Already voted for candidate 4f7e30f0201146468490efe5819d092f in this term.
I20260709 13:07:24.887745 23711 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.888890 23637 raft_consensus.cc:2393] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f7e30f0201146468490efe5819d092f in current term 1: Already voted for candidate 9e91bac5684b472d91ae44a39b8ddd84 in this term.
I20260709 13:07:24.887173 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:24.889838 23530 leader_election.cc:304] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:24.891602 23530 leader_election.cc:304] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f7e30f0201146468490efe5819d092f; no voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:24.893050 23809 raft_consensus.cc:2804] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.897264 23806 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.897466 23712 raft_consensus.cc:2468] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 1.
I20260709 13:07:24.900489 23779 raft_consensus.cc:515] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.901912 23806 raft_consensus.cc:2749] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.902532 23809 raft_consensus.cc:697] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:24.903734 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:24.903524 23809 consensus_queue.cc:237] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.904270 23779 leader_election.cc:290] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:24.904373 23563 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.903824 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:24.905423 23637 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.911398 23780 leader_election.cc:290] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:24.912107 23564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7e30f0201146468490efe5819d092f" is_pre_election: true
I20260709 13:07:24.915221 23639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84" is_pre_election: true
I20260709 13:07:24.918725 23639 raft_consensus.cc:2393] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 066542278f484f31b91e98245490cc17 in current term 1: Already voted for candidate 9e91bac5684b472d91ae44a39b8ddd84 in this term.
I20260709 13:07:24.906124 23605 leader_election.cc:304] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e91bac5684b472d91ae44a39b8ddd84; no voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f
I20260709 13:07:24.921612 23680 leader_election.cc:304] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 066542278f484f31b91e98245490cc17; no voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:24.923031 23779 raft_consensus.cc:2749] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.923949 23712 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.922593 23807 raft_consensus.cc:2749] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:24.927474 23711 raft_consensus.cc:2468] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 1.
I20260709 13:07:24.918097 23765 consensus_queue.cc:1048] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:07:24.931990 23637 raft_consensus.cc:2468] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 1.
I20260709 13:07:24.928956 23530 leader_election.cc:304] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:24.932099 23461 catalog_manager.cc:5697] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066542278f484f31b91e98245490cc17 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "066542278f484f31b91e98245490cc17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:24.934909 23806 raft_consensus.cc:2804] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.933866 23605 leader_election.cc:304] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:24.936053 23807 raft_consensus.cc:2804] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.936210 23680 leader_election.cc:304] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:24.936758 23807 raft_consensus.cc:697] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:24.937620 23765 raft_consensus.cc:2804] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.938426 23806 raft_consensus.cc:697] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:24.938485 23765 raft_consensus.cc:697] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Becoming Leader. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:24.941187 23806 consensus_queue.cc:237] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.941493 23765 consensus_queue.cc:237] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.936064 23562 raft_consensus.cc:2468] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 1.
I20260709 13:07:24.937598 23807 consensus_queue.cc:237] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:24.950491 23809 consensus_queue.cc:1048] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:24.951006 23563 raft_consensus.cc:2468] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 1.
I20260709 13:07:24.959280 23460 catalog_manager.cc:5697] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 1 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.968623 23460 catalog_manager.cc:5697] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 1 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.977695 23461 catalog_manager.cc:5697] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 1 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.980043 23765 consensus_queue.cc:1048] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.006649 23462 catalog_manager.cc:5697] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 reported cstate change: term changed from 0 to 1, leader changed from <none> to 066542278f484f31b91e98245490cc17 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "066542278f484f31b91e98245490cc17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.036464 23461 catalog_manager.cc:5697] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 1 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.064815 23780 consensus_queue.cc:1048] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.068490 23761 consensus_queue.cc:1048] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:25.257505 23761 consensus_queue.cc:1048] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.261821 23711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a"
dest_uuid: "066542278f484f31b91e98245490cc17"
mode: GRACEFUL
new_leader_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:07:25.262504 23711 raft_consensus.cc:606] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Received request to transfer leadership to TS 4f7e30f0201146468490efe5819d092f
I20260709 13:07:25.270033 23810 consensus_queue.cc:1048] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:25.284416 23712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472"
dest_uuid: "066542278f484f31b91e98245490cc17"
mode: GRACEFUL
new_leader_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:07:25.285034 23712 raft_consensus.cc:606] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Received request to transfer leadership to TS 4f7e30f0201146468490efe5819d092f
I20260709 13:07:25.293470 23712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7acb6229f0ac4ffe94143d061484fa45"
dest_uuid: "066542278f484f31b91e98245490cc17"
mode: GRACEFUL
new_leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:07:25.294078 23712 raft_consensus.cc:606] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Received request to transfer leadership to TS 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:25.308629 23563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
mode: GRACEFUL
new_leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:07:25.309175 23563 raft_consensus.cc:606] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Received request to transfer leadership to TS 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:25.313944 23563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
mode: GRACEFUL
new_leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:07:25.314412 23563 raft_consensus.cc:606] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Received request to transfer leadership to TS 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:25.327347 23761 consensus_queue.cc:1048] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.330109 23765 consensus_queue.cc:1048] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.339668 23779 raft_consensus.cc:993] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17: : Instructing follower 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:25.340122 23813 raft_consensus.cc:1081] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Signalling peer 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:25.341045 23813 consensus_queue.cc:1048] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.342206 23637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7acb6229f0ac4ffe94143d061484fa45"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:07:25.342754 23637 raft_consensus.cc:493] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.343096 23637 raft_consensus.cc:3060] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.346591 23779 consensus_queue.cc:1048] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.353801 23761 consensus_queue.cc:1048] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.357780 23765 consensus_queue.cc:1048] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.370175 23761 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.372659 23637 raft_consensus.cc:515] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.375671 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acb6229f0ac4ffe94143d061484fa45" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:25.376401 23565 raft_consensus.cc:3060] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.377458 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acb6229f0ac4ffe94143d061484fa45" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:25.378170 23711 raft_consensus.cc:3055] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.378558 23711 raft_consensus.cc:740] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:25.379554 23711 consensus_queue.cc:260] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.387079 23711 raft_consensus.cc:3060] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.388173 23786 raft_consensus.cc:993] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f: : Instructing follower 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:25.388620 23786 raft_consensus.cc:1081] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Signalling peer 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:25.391058 23639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:37828
I20260709 13:07:25.391597 23639 raft_consensus.cc:493] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.392095 23639 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.393420 23637 leader_election.cc:290] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 2 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:25.383993 23565 raft_consensus.cc:2468] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 2.
I20260709 13:07:25.395665 23711 raft_consensus.cc:2468] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 2.
I20260709 13:07:25.396787 23605 leader_election.cc:304] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:25.397591 23807 raft_consensus.cc:2804] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.398051 23807 raft_consensus.cc:697] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:25.398531 23639 raft_consensus.cc:515] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.398828 23807 consensus_queue.cc:237] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.406119 23779 raft_consensus.cc:993] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17: : Instructing follower 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:25.406551 23780 raft_consensus.cc:1081] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Signalling peer 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:25.408461 23565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:50010
I20260709 13:07:25.409015 23565 raft_consensus.cc:493] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.409401 23565 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.417634 23565 raft_consensus.cc:515] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.420250 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:25.420825 23637 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.422709 23462 catalog_manager.cc:5697] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 1 to 2, leader changed from 066542278f484f31b91e98245490cc17 (127.22.225.131) to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.427639 23637 raft_consensus.cc:2468] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 2.
I20260709 13:07:25.428877 23531 leader_election.cc:304] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:25.429697 23761 raft_consensus.cc:2804] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.430138 23761 raft_consensus.cc:697] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:25.430918 23761 consensus_queue.cc:237] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.435416 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:25.435968 23712 raft_consensus.cc:3055] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.436299 23712 raft_consensus.cc:740] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:25.437152 23712 consensus_queue.cc:260] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.438278 23712 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.439226 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:25.439850 23563 raft_consensus.cc:3055] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.440320 23563 raft_consensus.cc:740] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:25.441296 23563 consensus_queue.cc:260] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.442407 23563 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.445005 23712 raft_consensus.cc:2468] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 2.
I20260709 13:07:25.449112 23761 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.452267 23565 leader_election.cc:290] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 2 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:25.451635 23460 catalog_manager.cc:5697] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 1 to 2, leader changed from 066542278f484f31b91e98245490cc17 (127.22.225.131) to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 2 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.453716 23639 leader_election.cc:290] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 2 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:25.448799 23563 raft_consensus.cc:2468] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 2.
I20260709 13:07:25.455619 23604 leader_election.cc:304] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:25.455829 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:25.456382 23807 raft_consensus.cc:2804] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.456933 23807 raft_consensus.cc:697] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:25.457736 23807 consensus_queue.cc:237] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.461138 23712 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.471973 23712 raft_consensus.cc:2468] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 2.
I20260709 13:07:25.473776 23810 raft_consensus.cc:993] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f: : Instructing follower 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:25.474198 23810 raft_consensus.cc:1081] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Signalling peer 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:25.475695 23637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:37828
I20260709 13:07:25.476177 23637 raft_consensus.cc:493] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.476552 23637 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.479360 23461 catalog_manager.cc:5697] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 1 to 2, leader changed from 4f7e30f0201146468490efe5819d092f (127.22.225.129) to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.481129 23637 raft_consensus.cc:515] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.483104 23637 leader_election.cc:290] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 2 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:25.483855 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:25.484391 23563 raft_consensus.cc:3055] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.484690 23563 raft_consensus.cc:740] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:25.485456 23563 consensus_queue.cc:260] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.485774 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:25.486304 23712 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.486474 23563 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.492159 23712 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 2.
I20260709 13:07:25.493311 23563 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 2.
I20260709 13:07:25.493446 23605 leader_election.cc:304] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:25.494377 23807 raft_consensus.cc:2804] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.494868 23807 raft_consensus.cc:697] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:25.495800 23807 consensus_queue.cc:237] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.504372 23461 catalog_manager.cc:5697] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 1 to 2, leader changed from 4f7e30f0201146468490efe5819d092f (127.22.225.129) to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.506613 23807 consensus_queue.cc:1048] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.519945 23766 consensus_queue.cc:1048] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.571532 23765 raft_consensus.cc:993] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17: : Instructing follower 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:25.572001 23779 raft_consensus.cc:1081] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Signalling peer 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:25.573791 23563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:50010
I20260709 13:07:25.574345 23563 raft_consensus.cc:493] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:25.574708 23563 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.581326 23563 raft_consensus.cc:515] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.583392 23563 leader_election.cc:290] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 2 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:25.584139 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:25.584422 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:25.584717 23637 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.584988 23712 raft_consensus.cc:3055] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:25.585390 23712 raft_consensus.cc:740] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:25.586174 23712 consensus_queue.cc:260] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.587387 23712 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.590114 23637 raft_consensus.cc:2468] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 2.
I20260709 13:07:25.591128 23531 leader_election.cc:304] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:25.591831 23810 raft_consensus.cc:2804] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:25.592283 23810 raft_consensus.cc:697] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:25.592957 23810 consensus_queue.cc:237] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:25.594475 23712 raft_consensus.cc:2468] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 2.
I20260709 13:07:25.599304 23460 catalog_manager.cc:5697] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 1 to 2, leader changed from 066542278f484f31b91e98245490cc17 (127.22.225.131) to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 2 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.798801 23712 raft_consensus.cc:1275] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.800092 23841 consensus_queue.cc:1048] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.808777 23563 raft_consensus.cc:1275] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.810148 23807 consensus_queue.cc:1048] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.904232 23563 raft_consensus.cc:1275] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.905514 23807 consensus_queue.cc:1048] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.916939 23712 raft_consensus.cc:1275] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.919442 23807 consensus_queue.cc:1048] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.930779 23711 raft_consensus.cc:1275] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.932305 23810 consensus_queue.cc:1048] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:25.943931 23637 raft_consensus.cc:1275] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:25.945714 23761 consensus_queue.cc:1048] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:26.013801 23637 raft_consensus.cc:1275] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:26.015270 23761 consensus_queue.cc:1048] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:26.023337 23711 raft_consensus.cc:1275] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:26.025223 23809 consensus_queue.cc:1048] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:26.070174 23712 raft_consensus.cc:1275] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:26.072227 23807 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:26.085667 23563 raft_consensus.cc:1275] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:26.087271 23766 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.343673 23430 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:07:28.344578 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:28.359280 23563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
mode: GRACEFUL
new_leader_uuid: "066542278f484f31b91e98245490cc17"
 from {username='slave'} at 127.0.0.1:50036
I20260709 13:07:28.359797 23563 raft_consensus.cc:606] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Received request to transfer leadership to TS 066542278f484f31b91e98245490cc17
I20260709 13:07:28.369750 23637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
mode: GRACEFUL
new_leader_uuid: "066542278f484f31b91e98245490cc17"
 from {username='slave'} at 127.0.0.1:37848
I20260709 13:07:28.370198 23637 raft_consensus.cc:606] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Received request to transfer leadership to TS 066542278f484f31b91e98245490cc17
I20260709 13:07:28.371274 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:28.371716 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:28.655031 23845 raft_consensus.cc:993] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84: : Instructing follower 066542278f484f31b91e98245490cc17 to start an election
I20260709 13:07:28.655424 23807 raft_consensus.cc:1081] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Signalling peer 066542278f484f31b91e98245490cc17 to start an election
I20260709 13:07:28.656790 23712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2"
dest_uuid: "066542278f484f31b91e98245490cc17"
 from {username='slave'} at 127.0.0.1:56104
I20260709 13:07:28.657310 23712 raft_consensus.cc:493] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:28.657615 23712 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.661891 23712 raft_consensus.cc:515] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:28.663486 23712 leader_election.cc:290] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 3 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:28.664147 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:28.664532 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:28.664666 23563 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.665019 23637 raft_consensus.cc:3055] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:28.665344 23637 raft_consensus.cc:740] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:28.665984 23637 consensus_queue.cc:260] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:28.666883 23637 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:28.669445 23563 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 3.
I20260709 13:07:28.670472 23678 leader_election.cc:304] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:28.671262 23765 raft_consensus.cc:2804] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:28.671535 23637 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 3.
I20260709 13:07:28.672433 23765 raft_consensus.cc:697] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Becoming Leader. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:28.673257 23765 consensus_queue.cc:237] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:28.681299 23461 catalog_manager.cc:5697] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 reported cstate change: term changed from 2 to 3, leader changed from 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130) to 066542278f484f31b91e98245490cc17 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "066542278f484f31b91e98245490cc17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.727401 23810 raft_consensus.cc:993] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f: : Instructing follower 066542278f484f31b91e98245490cc17 to start an election
I20260709 13:07:28.727806 23855 raft_consensus.cc:1081] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Signalling peer 066542278f484f31b91e98245490cc17 to start an election
I20260709 13:07:28.729457 23712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46"
dest_uuid: "066542278f484f31b91e98245490cc17"
 from {username='slave'} at 127.0.0.1:56094
I20260709 13:07:28.729879 23712 raft_consensus.cc:493] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:28.730122 23712 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.733862 23712 raft_consensus.cc:515] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:28.735198 23712 leader_election.cc:290] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 2 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:28.735981 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:28.736117 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:28.736455 23563 raft_consensus.cc:3055] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:28.736701 23637 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.736843 23563 raft_consensus.cc:740] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:28.737620 23563 consensus_queue.cc:260] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:28.738394 23563 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.741300 23637 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 2.
I20260709 13:07:28.742360 23680 leader_election.cc:304] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:28.743105 23563 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 2.
I20260709 13:07:28.743139 23765 raft_consensus.cc:2804] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:28.743652 23765 raft_consensus.cc:697] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 2 LEADER]: Becoming Leader. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:28.744398 23765 consensus_queue.cc:237] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:28.751209 23459 catalog_manager.cc:5697] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 reported cstate change: term changed from 1 to 2, leader changed from 4f7e30f0201146468490efe5819d092f (127.22.225.129) to 066542278f484f31b91e98245490cc17 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "066542278f484f31b91e98245490cc17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.172188 23563 raft_consensus.cc:1275] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Refusing update from remote peer 066542278f484f31b91e98245490cc17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.173520 23765 consensus_queue.cc:1048] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.182910 23637 raft_consensus.cc:1275] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Refusing update from remote peer 066542278f484f31b91e98245490cc17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.186096 23859 consensus_queue.cc:1048] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.190022 23563 raft_consensus.cc:1275] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Refusing update from remote peer 066542278f484f31b91e98245490cc17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.191265 23859 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:29.202903 23637 raft_consensus.cc:1275] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Refusing update from remote peer 066542278f484f31b91e98245490cc17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:29.205957 23859 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:29.372555 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:29.381776 23563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
mode: GRACEFUL
new_leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:07:29.382287 23563 raft_consensus.cc:606] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Received request to transfer leadership to TS 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:29.386524 23712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46"
dest_uuid: "066542278f484f31b91e98245490cc17"
mode: GRACEFUL
new_leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:07:29.386981 23712 raft_consensus.cc:606] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 2 LEADER]: Received request to transfer leadership to TS 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:29.391139 23563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
mode: GRACEFUL
new_leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:07:29.391542 23563 raft_consensus.cc:606] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Received request to transfer leadership to TS 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:29.395501 23563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
mode: GRACEFUL
new_leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:50022
I20260709 13:07:29.395891 23563 raft_consensus.cc:606] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Received request to transfer leadership to TS 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:29.406456 23712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2"
dest_uuid: "066542278f484f31b91e98245490cc17"
mode: GRACEFUL
new_leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:07:29.406848 23712 raft_consensus.cc:606] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Received request to transfer leadership to TS 9e91bac5684b472d91ae44a39b8ddd84
I20260709 13:07:29.495885 23855 raft_consensus.cc:993] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f: : Instructing follower 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.496362 23865 raft_consensus.cc:1081] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Signalling peer 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.497882 23637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:37828
I20260709 13:07:29.498420 23637 raft_consensus.cc:493] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.498778 23637 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.503634 23637 raft_consensus.cc:515] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.505385 23637 leader_election.cc:290] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 2 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:29.506235 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:29.506422 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:29.506861 23563 raft_consensus.cc:3055] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:29.506995 23712 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.507184 23563 raft_consensus.cc:740] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:29.507957 23563 consensus_queue.cc:260] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.508824 23563 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:29.511252 23712 raft_consensus.cc:2468] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 2.
I20260709 13:07:29.512290 23605 leader_election.cc:304] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:29.513041 23807 raft_consensus.cc:2804] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:29.513156 23563 raft_consensus.cc:2468] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 2.
I20260709 13:07:29.514184 23807 raft_consensus.cc:697] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:29.515017 23807 consensus_queue.cc:237] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.521740 23462 catalog_manager.cc:5697] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 1 to 2, leader changed from 4f7e30f0201146468490efe5819d092f (127.22.225.129) to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.641588 23765 raft_consensus.cc:993] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17: : Instructing follower 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.642040 23859 raft_consensus.cc:1081] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Signalling peer 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.643570 23639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:07:29.644145 23639 raft_consensus.cc:493] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.644519 23639 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.644767 23865 raft_consensus.cc:993] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f: : Instructing follower 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.645241 23855 raft_consensus.cc:1081] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Signalling peer 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.646752 23637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:37828
I20260709 13:07:29.647251 23637 raft_consensus.cc:493] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.647617 23637 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.650906 23639 raft_consensus.cc:515] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.652933 23639 leader_election.cc:290] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 4 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:29.653604 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:29.653913 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:29.654191 23563 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.653982 23637 raft_consensus.cc:515] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.654492 23712 raft_consensus.cc:3055] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:29.654803 23712 raft_consensus.cc:740] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:29.655790 23637 leader_election.cc:290] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 3 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:29.655458 23712 consensus_queue.cc:260] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.656625 23712 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.656874 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:29.657419 23711 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.657853 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3d6035829544f58eba5cc5cd135b2a" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:29.658357 23565 raft_consensus.cc:3055] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:29.658643 23565 raft_consensus.cc:740] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:29.659372 23565 consensus_queue.cc:260] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.660290 23563 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 4.
I20260709 13:07:29.660504 23565 raft_consensus.cc:3060] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.661329 23604 leader_election.cc:304] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:29.662127 23807 raft_consensus.cc:2804] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:29.662580 23807 raft_consensus.cc:697] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:29.663497 23711 raft_consensus.cc:2468] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 3.
I20260709 13:07:29.663682 23712 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 4.
I20260709 13:07:29.663354 23807 consensus_queue.cc:237] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.664485 23605 leader_election.cc:304] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:29.666347 23866 raft_consensus.cc:2804] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.666775 23866 raft_consensus.cc:697] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:29.667681 23565 raft_consensus.cc:2468] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 3.
I20260709 13:07:29.667583 23866 consensus_queue.cc:237] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.674733 23462 catalog_manager.cc:5697] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 3 to 4, leader changed from 066542278f484f31b91e98245490cc17 (127.22.225.131) to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 4 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.675781 23462 catalog_manager.cc:5697] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 2 to 3, leader changed from 4f7e30f0201146468490efe5819d092f (127.22.225.129) to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 3 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.690017 23849 raft_consensus.cc:993] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17: : Instructing follower 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.690485 23859 raft_consensus.cc:1081] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 2 LEADER]: Signalling peer 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.691924 23637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:37840
I20260709 13:07:29.692489 23637 raft_consensus.cc:493] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.692821 23637 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.696607 23637 raft_consensus.cc:515] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.697897 23637 leader_election.cc:290] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 3 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:29.698853 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:29.698585 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:29.699409 23712 raft_consensus.cc:3055] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:29.699492 23563 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.699662 23712 raft_consensus.cc:740] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:29.700348 23712 consensus_queue.cc:260] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.701200 23712 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.703511 23563 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 3.
I20260709 13:07:29.704450 23604 leader_election.cc:304] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7e30f0201146468490efe5819d092f, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:29.705211 23866 raft_consensus.cc:2804] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.705231 23712 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 3.
I20260709 13:07:29.705736 23866 raft_consensus.cc:697] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:29.706558 23866 consensus_queue.cc:237] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.711697 23462 catalog_manager.cc:5697] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 2 to 3, leader changed from 066542278f484f31b91e98245490cc17 (127.22.225.131) to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 3 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.733326 23865 raft_consensus.cc:993] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f: : Instructing follower 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.733738 23865 raft_consensus.cc:1081] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Signalling peer 9e91bac5684b472d91ae44a39b8ddd84 to start an election
I20260709 13:07:29.735026 23637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
 from {username='slave'} at 127.0.0.1:37828
I20260709 13:07:29.735443 23637 raft_consensus.cc:493] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:29.735708 23637 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.739395 23637 raft_consensus.cc:515] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.740757 23637 leader_election.cc:290] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 3 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:29.741495 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:29.741679 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135f4593794b439b8558f0ecc06c6472" candidate_uuid: "9e91bac5684b472d91ae44a39b8ddd84" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:29.741989 23563 raft_consensus.cc:3055] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:29.742151 23712 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.742288 23563 raft_consensus.cc:740] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:29.742985 23563 consensus_queue.cc:260] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.743752 23563 raft_consensus.cc:3060] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:29.745982 23712 raft_consensus.cc:2468] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 3.
I20260709 13:07:29.746834 23605 leader_election.cc:304] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 9e91bac5684b472d91ae44a39b8ddd84; no voters: 
I20260709 13:07:29.747473 23866 raft_consensus.cc:2804] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:29.747538 23563 raft_consensus.cc:2468] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e91bac5684b472d91ae44a39b8ddd84 in term 3.
I20260709 13:07:29.748183 23866 raft_consensus.cc:697] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Becoming Leader. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:29.748971 23866 consensus_queue.cc:237] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:29.754451 23462 catalog_manager.cc:5697] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 reported cstate change: term changed from 2 to 3, leader changed from 4f7e30f0201146468490efe5819d092f (127.22.225.129) to 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130). New cstate: current_term: 3 leader_uuid: "9e91bac5684b472d91ae44a39b8ddd84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.896430 23563 raft_consensus.cc:1275] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.897847 23866 consensus_queue.cc:1048] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:29.901000 23712 raft_consensus.cc:1275] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:29.902419 23866 consensus_queue.cc:1048] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.089327 23563 raft_consensus.cc:1275] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 4 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:30.090454 23807 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:30.096871 23712 raft_consensus.cc:1275] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 4 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:30.098198 23871 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:30.128196 23563 raft_consensus.cc:1275] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:30.129647 23871 consensus_queue.cc:1048] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:30.136057 23563 raft_consensus.cc:1275] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:30.137742 23866 consensus_queue.cc:1048] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:30.140620 23711 raft_consensus.cc:1275] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:30.138365 23712 raft_consensus.cc:1275] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:30.142184 23807 consensus_queue.cc:1048] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:30.145381 23871 consensus_queue.cc:1048] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:30.233943 23712 raft_consensus.cc:1275] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:30.235230 23807 consensus_queue.cc:1048] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:30.243930 23565 raft_consensus.cc:1275] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Refusing update from remote peer 9e91bac5684b472d91ae44a39b8ddd84: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:30.246163 23807 consensus_queue.cc:1048] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:32.412021 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:32.419790 23637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
mode: GRACEFUL
new_leader_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:37848
I20260709 13:07:32.420631 23637 raft_consensus.cc:606] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Received request to transfer leadership to TS 4f7e30f0201146468490efe5819d092f
I20260709 13:07:32.423684 23637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
mode: GRACEFUL
new_leader_uuid: "066542278f484f31b91e98245490cc17"
 from {username='slave'} at 127.0.0.1:37848
I20260709 13:07:32.424039 23637 raft_consensus.cc:606] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Received request to transfer leadership to TS 066542278f484f31b91e98245490cc17
I20260709 13:07:32.425887 23637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
mode: GRACEFUL
new_leader_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:37848
I20260709 13:07:32.426214 23637 raft_consensus.cc:606] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 LEADER]: Received request to transfer leadership to TS 4f7e30f0201146468490efe5819d092f
I20260709 13:07:32.428045 23637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
mode: GRACEFUL
new_leader_uuid: "066542278f484f31b91e98245490cc17"
 from {username='slave'} at 127.0.0.1:37848
I20260709 13:07:32.428380 23637 raft_consensus.cc:606] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Received request to transfer leadership to TS 066542278f484f31b91e98245490cc17
I20260709 13:07:32.430209 23637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2"
dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
mode: GRACEFUL
new_leader_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:37848
I20260709 13:07:32.430528 23637 raft_consensus.cc:606] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 LEADER]: Received request to transfer leadership to TS 4f7e30f0201146468490efe5819d092f
I20260709 13:07:32.431434 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:32.431794 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:32.572693 23885 raft_consensus.cc:993] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84: : Instructing follower 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:32.573287 23866 raft_consensus.cc:1081] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Signalling peer 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:32.574687 23565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:50014
I20260709 13:07:32.575152 23565 raft_consensus.cc:493] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.575489 23565 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.581133 23565 raft_consensus.cc:515] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.583063 23565 leader_election.cc:290] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 4 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:32.583963 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:32.584312 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "531fdc2d8d264dab826f4a24b6c17c46" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:32.584667 23637 raft_consensus.cc:3055] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.584844 23711 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.584975 23637 raft_consensus.cc:740] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:32.585824 23637 consensus_queue.cc:260] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.586704 23637 raft_consensus.cc:3060] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.589767 23711 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 4.
I20260709 13:07:32.590951 23637 raft_consensus.cc:2468] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 4.
I20260709 13:07:32.590971 23530 leader_election.cc:304] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:32.592701 23886 raft_consensus.cc:2804] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.593508 23886 raft_consensus.cc:697] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 4 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:32.594444 23886 consensus_queue.cc:237] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.602046 23459 catalog_manager.cc:5697] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 3 to 4, leader changed from 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130) to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 4 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.663031 23885 raft_consensus.cc:993] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84: : Instructing follower 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:32.663439 23866 raft_consensus.cc:1081] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 LEADER]: Signalling peer 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:32.664906 23565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:50014
I20260709 13:07:32.665450 23565 raft_consensus.cc:493] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.665745 23565 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.670171 23565 raft_consensus.cc:515] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.671705 23565 leader_election.cc:290] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 5 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:32.672479 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:32.672763 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecafe41085834960bb73cd6a518908b2" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:32.673015 23637 raft_consensus.cc:3055] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:32.673303 23711 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.673334 23637 raft_consensus.cc:740] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:32.674206 23637 consensus_queue.cc:260] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.675318 23637 raft_consensus.cc:3060] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:32.679661 23711 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 5.
I20260709 13:07:32.680684 23885 raft_consensus.cc:993] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84: : Instructing follower 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:32.680616 23530 leader_election.cc:304] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:32.681182 23866 raft_consensus.cc:1081] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 LEADER]: Signalling peer 4f7e30f0201146468490efe5819d092f to start an election
I20260709 13:07:32.681411 23886 raft_consensus.cc:2804] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:32.682091 23886 raft_consensus.cc:697] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 5 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:32.682231 23637 raft_consensus.cc:2468] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 5.
I20260709 13:07:32.682873 23565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e"
dest_uuid: "4f7e30f0201146468490efe5819d092f"
 from {username='slave'} at 127.0.0.1:50014
I20260709 13:07:32.683410 23565 raft_consensus.cc:493] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.683102 23886 consensus_queue.cc:237] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.683728 23565 raft_consensus.cc:3060] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.689179 23565 raft_consensus.cc:515] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.689769 23459 catalog_manager.cc:5697] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 4 to 5, leader changed from 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130) to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 5 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.690728 23565 leader_election.cc:290] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 2 election: Requested vote from peers 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451), 066542278f484f31b91e98245490cc17 (127.22.225.131:33133)
I20260709 13:07:32.691807 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "066542278f484f31b91e98245490cc17"
I20260709 13:07:32.691867 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e944c4c28f47a58af9f59395888e5e" candidate_uuid: "4f7e30f0201146468490efe5819d092f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:32.693117 23711 raft_consensus.cc:3060] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.693200 23637 raft_consensus.cc:3055] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:32.693588 23637 raft_consensus.cc:740] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:32.694320 23637 consensus_queue.cc:260] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.695209 23637 raft_consensus.cc:3060] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.699414 23711 raft_consensus.cc:2468] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 2.
I20260709 13:07:32.700297 23530 leader_election.cc:304] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:32.700887 23637 raft_consensus.cc:2468] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f7e30f0201146468490efe5819d092f in term 2.
I20260709 13:07:32.700971 23886 raft_consensus.cc:2804] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:32.701548 23886 raft_consensus.cc:697] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Becoming Leader. State: Replica: 4f7e30f0201146468490efe5819d092f, State: Running, Role: LEADER
I20260709 13:07:32.702443 23886 consensus_queue.cc:237] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.708132 23459 catalog_manager.cc:5697] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f reported cstate change: term changed from 1 to 2, leader changed from 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130) to 4f7e30f0201146468490efe5819d092f (127.22.225.129). New cstate: current_term: 2 leader_uuid: "4f7e30f0201146468490efe5819d092f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.791632 23885 raft_consensus.cc:993] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84: : Instructing follower 066542278f484f31b91e98245490cc17 to start an election
I20260709 13:07:32.792074 23866 raft_consensus.cc:1081] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Signalling peer 066542278f484f31b91e98245490cc17 to start an election
I20260709 13:07:32.793458 23711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a"
dest_uuid: "066542278f484f31b91e98245490cc17"
 from {username='slave'} at 127.0.0.1:56104
I20260709 13:07:32.793964 23711 raft_consensus.cc:493] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.794270 23711 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.798914 23711 raft_consensus.cc:515] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.800678 23711 leader_election.cc:290] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 3 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:32.801838 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:32.801833 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f60f8dc80304e14b6e0039bf8f7a00a" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:32.802532 23565 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.802548 23637 raft_consensus.cc:3055] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.803112 23637 raft_consensus.cc:740] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:32.803857 23637 consensus_queue.cc:260] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.804960 23637 raft_consensus.cc:3060] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.809309 23565 raft_consensus.cc:2468] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 3.
I20260709 13:07:32.810766 23678 leader_election.cc:304] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:32.811127 23637 raft_consensus.cc:2468] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 3.
I20260709 13:07:32.811734 23859 raft_consensus.cc:2804] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.812795 23859 raft_consensus.cc:697] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Becoming Leader. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:32.813632 23859 consensus_queue.cc:237] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.819814 23459 catalog_manager.cc:5697] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 reported cstate change: term changed from 2 to 3, leader changed from 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130) to 066542278f484f31b91e98245490cc17 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "066542278f484f31b91e98245490cc17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.954591 23885 raft_consensus.cc:993] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84: : Instructing follower 066542278f484f31b91e98245490cc17 to start an election
I20260709 13:07:32.955060 23866 raft_consensus.cc:1081] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Signalling peer 066542278f484f31b91e98245490cc17 to start an election
I20260709 13:07:32.956509 23711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d"
dest_uuid: "066542278f484f31b91e98245490cc17"
 from {username='slave'} at 127.0.0.1:56104
I20260709 13:07:32.956982 23711 raft_consensus.cc:493] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.957268 23711 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.961494 23711 raft_consensus.cc:515] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.962996 23711 leader_election.cc:290] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 3 election: Requested vote from peers 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643), 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130:42451)
I20260709 13:07:32.963690 23565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f7e30f0201146468490efe5819d092f"
I20260709 13:07:32.963902 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9104db74d70646e4900c8d19c6b3d62d" candidate_uuid: "066542278f484f31b91e98245490cc17" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e91bac5684b472d91ae44a39b8ddd84"
I20260709 13:07:32.964246 23565 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.964361 23637 raft_consensus.cc:3055] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.964668 23637 raft_consensus.cc:740] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e91bac5684b472d91ae44a39b8ddd84, State: Running, Role: LEADER
I20260709 13:07:32.965379 23637 consensus_queue.cc:260] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.966418 23637 raft_consensus.cc:3060] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.970079 23565 raft_consensus.cc:2468] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 3.
I20260709 13:07:32.971130 23678 leader_election.cc:304] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 066542278f484f31b91e98245490cc17, 4f7e30f0201146468490efe5819d092f; no voters: 
I20260709 13:07:32.971894 23859 raft_consensus.cc:2804] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.972311 23637 raft_consensus.cc:2468] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 066542278f484f31b91e98245490cc17 in term 3.
I20260709 13:07:32.972319 23859 raft_consensus.cc:697] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Becoming Leader. State: Replica: 066542278f484f31b91e98245490cc17, State: Running, Role: LEADER
I20260709 13:07:32.973381 23859 consensus_queue.cc:237] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } }
I20260709 13:07:32.980186 23459 catalog_manager.cc:5697] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 reported cstate change: term changed from 2 to 3, leader changed from 9e91bac5684b472d91ae44a39b8ddd84 (127.22.225.130) to 066542278f484f31b91e98245490cc17 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "066542278f484f31b91e98245490cc17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.052487 23637 raft_consensus.cc:1275] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.053669 23886 consensus_queue.cc:1048] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:33.065192 23711 raft_consensus.cc:1275] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 4 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:33.066758 23900 consensus_queue.cc:1048] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:33.084815 23637 raft_consensus.cc:1275] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:33.085899 23900 consensus_queue.cc:1048] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:33.095130 23711 raft_consensus.cc:1275] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:33.096489 23886 consensus_queue.cc:1048] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:33.181694 23711 raft_consensus.cc:1275] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 5 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:33.182807 23886 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "066542278f484f31b91e98245490cc17" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:33.192204 23637 raft_consensus.cc:1275] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 5 FOLLOWER]: Refusing update from remote peer 4f7e30f0201146468490efe5819d092f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:33.193575 23886 consensus_queue.cc:1048] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:33.233346 23565 raft_consensus.cc:1275] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Refusing update from remote peer 066542278f484f31b91e98245490cc17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.234400 23859 consensus_queue.cc:1048] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.242683 23637 raft_consensus.cc:1275] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Refusing update from remote peer 066542278f484f31b91e98245490cc17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.244346 23909 consensus_queue.cc:1048] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:33.368458 23637 raft_consensus.cc:1275] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Refusing update from remote peer 066542278f484f31b91e98245490cc17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.369652 23859 consensus_queue.cc:1048] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e91bac5684b472d91ae44a39b8ddd84" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.378930 23565 raft_consensus.cc:1275] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Refusing update from remote peer 066542278f484f31b91e98245490cc17: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.380125 23909 consensus_queue.cc:1048] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7e30f0201146468490efe5819d092f" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 36643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:33.432642 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.437832 23430 tablet_server.cc:179] TabletServer@127.22.225.129:0 shutting down...
W20260709 13:07:33.451285 23678 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:33.455276 23678 consensus_peers.cc:597] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 -> Peer 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643): Couldn't send request to peer 4f7e30f0201146468490efe5819d092f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:33.464054 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:33.464748 23430 tablet_replica.cc:333] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.465534 23430 raft_consensus.cc:2243] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.466037 23430 raft_consensus.cc:2272] T 7acb6229f0ac4ffe94143d061484fa45 P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.468214 23430 tablet_replica.cc:333] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.468765 23430 raft_consensus.cc:2243] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.469502 23430 raft_consensus.cc:2272] T ecafe41085834960bb73cd6a518908b2 P 4f7e30f0201146468490efe5819d092f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.471256 23430 tablet_replica.cc:333] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.471779 23430 raft_consensus.cc:2243] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.472169 23430 raft_consensus.cc:2272] T 5f60f8dc80304e14b6e0039bf8f7a00a P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.474079 23430 tablet_replica.cc:333] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.474685 23430 raft_consensus.cc:2243] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.475193 23430 raft_consensus.cc:2272] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 4f7e30f0201146468490efe5819d092f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.477255 23430 tablet_replica.cc:333] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.477782 23430 raft_consensus.cc:2243] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.478405 23430 raft_consensus.cc:2272] T 87e944c4c28f47a58af9f59395888e5e P 4f7e30f0201146468490efe5819d092f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.480176 23430 tablet_replica.cc:333] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.480645 23430 raft_consensus.cc:2243] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.481035 23430 raft_consensus.cc:2272] T 9104db74d70646e4900c8d19c6b3d62d P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.483354 23430 tablet_replica.cc:333] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.483810 23430 raft_consensus.cc:2243] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.484321 23430 raft_consensus.cc:2272] T 5e3d6035829544f58eba5cc5cd135b2a P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.485809 23430 tablet_replica.cc:333] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.486272 23430 raft_consensus.cc:2243] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.487015 23430 raft_consensus.cc:2272] T 531fdc2d8d264dab826f4a24b6c17c46 P 4f7e30f0201146468490efe5819d092f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.488792 23430 tablet_replica.cc:333] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f: stopping tablet replica
I20260709 13:07:33.489226 23430 raft_consensus.cc:2243] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.489544 23430 raft_consensus.cc:2272] T 135f4593794b439b8558f0ecc06c6472 P 4f7e30f0201146468490efe5819d092f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.582759 23430 tablet_server.cc:196] TabletServer@127.22.225.129:0 shutdown complete.
I20260709 13:07:33.600661 23430 tablet_server.cc:179] TabletServer@127.22.225.130:0 shutting down...
I20260709 13:07:33.628247 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:33.628959 23430 tablet_replica.cc:333] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.629575 23430 raft_consensus.cc:2243] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.630007 23430 raft_consensus.cc:2272] T 87e944c4c28f47a58af9f59395888e5e P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.631922 23430 tablet_replica.cc:333] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.632414 23430 raft_consensus.cc:2243] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.633147 23430 raft_consensus.cc:2272] T 135f4593794b439b8558f0ecc06c6472 P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.634706 23430 tablet_replica.cc:333] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.635170 23430 raft_consensus.cc:2243] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.635548 23430 raft_consensus.cc:2272] T ecafe41085834960bb73cd6a518908b2 P 9e91bac5684b472d91ae44a39b8ddd84 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.637895 23430 tablet_replica.cc:333] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.638370 23430 raft_consensus.cc:2243] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.638738 23430 raft_consensus.cc:2272] T 5f60f8dc80304e14b6e0039bf8f7a00a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.640568 23430 tablet_replica.cc:333] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.641031 23430 raft_consensus.cc:2243] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.641469 23430 raft_consensus.cc:2272] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 9e91bac5684b472d91ae44a39b8ddd84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.643005 23430 tablet_replica.cc:333] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.643441 23430 raft_consensus.cc:2243] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.643805 23430 raft_consensus.cc:2272] T 531fdc2d8d264dab826f4a24b6c17c46 P 9e91bac5684b472d91ae44a39b8ddd84 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.645713 23430 tablet_replica.cc:333] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.646166 23430 raft_consensus.cc:2243] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.646835 23430 raft_consensus.cc:2272] T 5e3d6035829544f58eba5cc5cd135b2a P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.648393 23430 tablet_replica.cc:333] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.648808 23430 raft_consensus.cc:2243] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.649219 23430 raft_consensus.cc:2272] T 9104db74d70646e4900c8d19c6b3d62d P 9e91bac5684b472d91ae44a39b8ddd84 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.650954 23430 tablet_replica.cc:333] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84: stopping tablet replica
I20260709 13:07:33.651363 23430 raft_consensus.cc:2243] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.652043 23430 raft_consensus.cc:2272] T 7acb6229f0ac4ffe94143d061484fa45 P 9e91bac5684b472d91ae44a39b8ddd84 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.677873 23430 tablet_server.cc:196] TabletServer@127.22.225.130:0 shutdown complete.
I20260709 13:07:33.693251 23430 tablet_server.cc:179] TabletServer@127.22.225.131:0 shutting down...
I20260709 13:07:33.716681 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:33.717473 23430 tablet_replica.cc:333] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.718379 23430 raft_consensus.cc:2243] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:07:33.719039 23678 consensus_peers.cc:597] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 -> Peer 4f7e30f0201146468490efe5819d092f (127.22.225.129:36643): Couldn't send request to peer 4f7e30f0201146468490efe5819d092f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:36643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:33.719447 23430 raft_consensus.cc:2272] T 9ef1960bed654dda8f0ee9e09ff1efd9 P 066542278f484f31b91e98245490cc17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.721068 23430 tablet_replica.cc:333] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.721581 23430 raft_consensus.cc:2243] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.722198 23430 raft_consensus.cc:2272] T 5f60f8dc80304e14b6e0039bf8f7a00a P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.724026 23430 tablet_replica.cc:333] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.724454 23430 raft_consensus.cc:2243] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.724807 23430 raft_consensus.cc:2272] T ecafe41085834960bb73cd6a518908b2 P 066542278f484f31b91e98245490cc17 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.726676 23430 tablet_replica.cc:333] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.727097 23430 raft_consensus.cc:2243] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.727443 23430 raft_consensus.cc:2272] T 135f4593794b439b8558f0ecc06c6472 P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.729123 23430 tablet_replica.cc:333] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.729537 23430 raft_consensus.cc:2243] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.729846 23430 raft_consensus.cc:2272] T 87e944c4c28f47a58af9f59395888e5e P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.731479 23430 tablet_replica.cc:333] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.731881 23430 raft_consensus.cc:2243] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.732205 23430 raft_consensus.cc:2272] T 531fdc2d8d264dab826f4a24b6c17c46 P 066542278f484f31b91e98245490cc17 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.733906 23430 tablet_replica.cc:333] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.734428 23430 raft_consensus.cc:2243] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.735095 23430 raft_consensus.cc:2272] T 9104db74d70646e4900c8d19c6b3d62d P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.736666 23430 tablet_replica.cc:333] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.737164 23430 raft_consensus.cc:2243] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.737534 23430 raft_consensus.cc:2272] T 5e3d6035829544f58eba5cc5cd135b2a P 066542278f484f31b91e98245490cc17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.739020 23430 tablet_replica.cc:333] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17: stopping tablet replica
I20260709 13:07:33.739444 23430 raft_consensus.cc:2243] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:33.739818 23430 raft_consensus.cc:2272] T 7acb6229f0ac4ffe94143d061484fa45 P 066542278f484f31b91e98245490cc17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.765700 23430 tablet_server.cc:196] TabletServer@127.22.225.131:0 shutdown complete.
I20260709 13:07:33.781070 23430 master.cc:562] Master@127.22.225.190:39761 shutting down...
I20260709 13:07:33.926667 23430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:33.927241 23430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:33.927608 23430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0e3c9e59da42443dac1ad4dd49c25820: stopping tablet replica
I20260709 13:07:33.947592 23430 master.cc:584] Master@127.22.225.190:39761 shutdown complete.
066542278f484f31b91e98245490cc17  1
4f7e30f0201146468490efe5819d092f  4
9e91bac5684b472d91ae44a39b8ddd84  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12394 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:07:33.988629 23430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.225.190:40245
I20260709 13:07:33.990170 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:33.995695 23916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:33.996315 23917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:33.997134 23919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:33.997905 23430 server_base.cc:1061] running on GCE node
I20260709 13:07:33.998732 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:33.998904 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:33.999020 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602453999009 us; error 0 us; skew 500 ppm
I20260709 13:07:33.999552 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:34.002882 23430 webserver.cc:533] Webserver started at http://127.22.225.190:38535/ using document root <none> and password file <none>
I20260709 13:07:34.003446 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:34.003674 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:34.003986 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:34.005136 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/master-0-root/instance:
uuid: "678c697893c445128983655fb98218e5"
format_stamp: "Formatted at 2026-07-09 13:07:33 on dist-test-slave-fx0m"
I20260709 13:07:34.009498 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:07:34.012657 23924 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.013531 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:34.013806 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/master-0-root
uuid: "678c697893c445128983655fb98218e5"
format_stamp: "Formatted at 2026-07-09 13:07:33 on dist-test-slave-fx0m"
I20260709 13:07:34.014051 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:34.033738 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:34.034981 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:34.071292 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.190:40245
I20260709 13:07:34.071382 23975 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.190:40245 every 8 connection(s)
I20260709 13:07:34.075028 23976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.083770 23976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5: Bootstrap starting.
I20260709 13:07:34.088387 23976 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.092218 23976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5: No bootstrap required, opened a new log
I20260709 13:07:34.094167 23976 raft_consensus.cc:359] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678c697893c445128983655fb98218e5" member_type: VOTER }
I20260709 13:07:34.094516 23976 raft_consensus.cc:385] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.094689 23976 raft_consensus.cc:740] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 678c697893c445128983655fb98218e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.095237 23976 consensus_queue.cc:260] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678c697893c445128983655fb98218e5" member_type: VOTER }
I20260709 13:07:34.095630 23976 raft_consensus.cc:399] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:34.095827 23976 raft_consensus.cc:493] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:34.096026 23976 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.099920 23976 raft_consensus.cc:515] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678c697893c445128983655fb98218e5" member_type: VOTER }
I20260709 13:07:34.100366 23976 leader_election.cc:304] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 678c697893c445128983655fb98218e5; no voters: 
I20260709 13:07:34.101457 23976 leader_election.cc:290] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:34.101826 23979 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:34.103055 23979 raft_consensus.cc:697] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 1 LEADER]: Becoming Leader. State: Replica: 678c697893c445128983655fb98218e5, State: Running, Role: LEADER
I20260709 13:07:34.103753 23979 consensus_queue.cc:237] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678c697893c445128983655fb98218e5" member_type: VOTER }
I20260709 13:07:34.104283 23976 sys_catalog.cc:565] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:34.108806 23980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "678c697893c445128983655fb98218e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678c697893c445128983655fb98218e5" member_type: VOTER } }
I20260709 13:07:34.108842 23981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 678c697893c445128983655fb98218e5. Latest consensus state: current_term: 1 leader_uuid: "678c697893c445128983655fb98218e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "678c697893c445128983655fb98218e5" member_type: VOTER } }
I20260709 13:07:34.109573 23980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:34.109812 23981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:34.112649 23987 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:34.120831 23987 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:34.121740 23430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:34.129495 23987 catalog_manager.cc:1383] Generated new cluster ID: 89d05fa616574c51875516577987d41e
I20260709 13:07:34.129853 23987 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:34.157217 23987 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:34.158452 23987 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:34.172501 23987 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5: Generated new TSK 0
I20260709 13:07:34.173090 23987 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:34.188185 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:34.193765 23997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:34.194730 23998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:34.196554 24000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:34.196609 23430 server_base.cc:1061] running on GCE node
I20260709 13:07:34.197666 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:34.197881 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:34.198052 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602454198036 us; error 0 us; skew 500 ppm
I20260709 13:07:34.198580 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:34.200867 23430 webserver.cc:533] Webserver started at http://127.22.225.129:40453/ using document root <none> and password file <none>
I20260709 13:07:34.201392 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:34.201601 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:34.201872 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:34.202899 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-0-root/instance:
uuid: "ed62d27738a6442f9c06b53fc2e60129"
format_stamp: "Formatted at 2026-07-09 13:07:34 on dist-test-slave-fx0m"
I20260709 13:07:34.207243 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:07:34.210389 24005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.211238 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:34.211567 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "ed62d27738a6442f9c06b53fc2e60129"
format_stamp: "Formatted at 2026-07-09 13:07:34 on dist-test-slave-fx0m"
I20260709 13:07:34.211833 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:34.230556 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:34.231767 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:34.233209 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:34.235363 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:34.235574 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.235882 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:34.236081 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.274288 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:35375
I20260709 13:07:34.274381 24067 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:35375 every 8 connection(s)
I20260709 13:07:34.279178 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:34.287851 24073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:34.288254 24072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:34.291579 23430 server_base.cc:1061] running on GCE node
W20260709 13:07:34.291718 24075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:34.292585 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:34.292770 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:34.292891 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602454292880 us; error 0 us; skew 500 ppm
I20260709 13:07:34.293398 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:34.295994 23430 webserver.cc:533] Webserver started at http://127.22.225.130:45365/ using document root <none> and password file <none>
I20260709 13:07:34.296687 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:34.296923 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:34.297261 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:34.297813 24068 heartbeater.cc:344] Connected to a master server at 127.22.225.190:40245
I20260709 13:07:34.298164 24068 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:34.298460 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-1-root/instance:
uuid: "107d690694944a0db9d7541fc7d672db"
format_stamp: "Formatted at 2026-07-09 13:07:34 on dist-test-slave-fx0m"
I20260709 13:07:34.298852 24068 heartbeater.cc:507] Master 127.22.225.190:40245 requested a full tablet report, sending...
I20260709 13:07:34.300832 23941 ts_manager.cc:194] Registered new tserver with Master: ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375)
I20260709 13:07:34.302919 23941 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53764
I20260709 13:07:34.303145 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:34.306420 24080 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.307132 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:34.307413 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-1-root
uuid: "107d690694944a0db9d7541fc7d672db"
format_stamp: "Formatted at 2026-07-09 13:07:34 on dist-test-slave-fx0m"
I20260709 13:07:34.307693 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:34.323568 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:34.324752 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:34.326200 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:34.328301 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:34.328536 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.328773 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:34.328938 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.367020 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.130:34309
I20260709 13:07:34.367126 24142 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.130:34309 every 8 connection(s)
I20260709 13:07:34.371546 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:34.385295 24147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:34.385532 24149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:34.386119 24146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:34.389031 23430 server_base.cc:1061] running on GCE node
I20260709 13:07:34.390085 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:34.390244 24143 heartbeater.cc:344] Connected to a master server at 127.22.225.190:40245
W20260709 13:07:34.390369 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:34.390661 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602454390641 us; error 0 us; skew 500 ppm
I20260709 13:07:34.390705 24143 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:34.391247 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:34.391502 24143 heartbeater.cc:507] Master 127.22.225.190:40245 requested a full tablet report, sending...
I20260709 13:07:34.393759 23941 ts_manager.cc:194] Registered new tserver with Master: 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:34.393929 23430 webserver.cc:533] Webserver started at http://127.22.225.131:43701/ using document root <none> and password file <none>
I20260709 13:07:34.394559 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:34.394790 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:34.395112 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:34.395535 23941 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53774
I20260709 13:07:34.396524 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-2-root/instance:
uuid: "b9fcec07431c47adb184dc91ad9069a3"
format_stamp: "Formatted at 2026-07-09 13:07:34 on dist-test-slave-fx0m"
I20260709 13:07:34.400794 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:34.403864 24154 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.404570 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:34.404861 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-2-root
uuid: "b9fcec07431c47adb184dc91ad9069a3"
format_stamp: "Formatted at 2026-07-09 13:07:34 on dist-test-slave-fx0m"
I20260709 13:07:34.405161 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602441430441-23430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:34.422557 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:34.423728 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:34.425207 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:34.427277 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:34.427500 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.427749 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:34.427948 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:34.465448 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.131:44147
I20260709 13:07:34.465538 24216 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.131:44147 every 8 connection(s)
I20260709 13:07:34.478253 24217 heartbeater.cc:344] Connected to a master server at 127.22.225.190:40245
I20260709 13:07:34.478574 24217 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:34.479209 24217 heartbeater.cc:507] Master 127.22.225.190:40245 requested a full tablet report, sending...
I20260709 13:07:34.481015 23941 ts_manager.cc:194] Registered new tserver with Master: b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:34.481777 23430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013241144s
I20260709 13:07:34.482633 23941 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53784
I20260709 13:07:34.505674 23941 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53800:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:34.508457 23941 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:34.578635 24108 tablet_service.cc:1511] Processing CreateTablet for tablet 17f158725451402bb9cc7a8ef31bd326 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:34.580238 24108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f158725451402bb9cc7a8ef31bd326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.582212 24106 tablet_service.cc:1511] Processing CreateTablet for tablet 28e0e796d2d647d3a27da79e0c852568 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:34.583592 24106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e0e796d2d647d3a27da79e0c852568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.591519 24104 tablet_service.cc:1511] Processing CreateTablet for tablet c98b0326ba8c4edeb148bb8618f8d7f6 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:34.592221 24105 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7875b090eb42268d9ea12bff690af6 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:34.576750 24107 tablet_service.cc:1511] Processing CreateTablet for tablet 41aea863779546f5955735458a1178d3 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:34.597903 24104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b0326ba8c4edeb148bb8618f8d7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.602293 24107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41aea863779546f5955735458a1178d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.604841 24105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7875b090eb42268d9ea12bff690af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.607194 24103 tablet_service.cc:1511] Processing CreateTablet for tablet d6f8d25f2334413fb0fa7bfc06b5670a (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:34.614118 24103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f8d25f2334413fb0fa7bfc06b5670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.625119 24102 tablet_service.cc:1511] Processing CreateTablet for tablet 719558de58d441c59275f27353019719 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:34.626865 24102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719558de58d441c59275f27353019719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.642278 24032 tablet_service.cc:1511] Processing CreateTablet for tablet 41aea863779546f5955735458a1178d3 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:34.643746 24182 tablet_service.cc:1511] Processing CreateTablet for tablet 17f158725451402bb9cc7a8ef31bd326 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:34.646087 24106 tablet_service.cc:1511] Processing CreateTablet for tablet fc19280eec3a4864b53c5cbd4a7d0b55 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:34.646189 24181 tablet_service.cc:1511] Processing CreateTablet for tablet 41aea863779546f5955735458a1178d3 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:34.647322 24029 tablet_service.cc:1511] Processing CreateTablet for tablet c98b0326ba8c4edeb148bb8618f8d7f6 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:34.649221 24025 tablet_service.cc:1511] Processing CreateTablet for tablet 05aa17ebe1f24f18ac072293c54b485e (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:34.649608 24028 tablet_service.cc:1511] Processing CreateTablet for tablet d6f8d25f2334413fb0fa7bfc06b5670a (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:34.650177 24179 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7875b090eb42268d9ea12bff690af6 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:34.650739 24106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc19280eec3a4864b53c5cbd4a7d0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.652267 24178 tablet_service.cc:1511] Processing CreateTablet for tablet c98b0326ba8c4edeb148bb8618f8d7f6 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:34.654603 24177 tablet_service.cc:1511] Processing CreateTablet for tablet d6f8d25f2334413fb0fa7bfc06b5670a (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:34.657023 24176 tablet_service.cc:1511] Processing CreateTablet for tablet 719558de58d441c59275f27353019719 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:34.658223 24027 tablet_service.cc:1511] Processing CreateTablet for tablet 719558de58d441c59275f27353019719 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:34.659283 24101 tablet_service.cc:1511] Processing CreateTablet for tablet 05aa17ebe1f24f18ac072293c54b485e (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:34.660550 24101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05aa17ebe1f24f18ac072293c54b485e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.660392 24026 tablet_service.cc:1511] Processing CreateTablet for tablet fc19280eec3a4864b53c5cbd4a7d0b55 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:34.662177 24100 tablet_service.cc:1511] Processing CreateTablet for tablet 09fec738c86b43ec9c0696fdb3161451 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:34.663326 24100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fec738c86b43ec9c0696fdb3161451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.648540 24180 tablet_service.cc:1511] Processing CreateTablet for tablet 28e0e796d2d647d3a27da79e0c852568 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:34.646189 24030 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7875b090eb42268d9ea12bff690af6 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:34.665686 24182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f158725451402bb9cc7a8ef31bd326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.643746 24032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41aea863779546f5955735458a1178d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.680997 24033 tablet_service.cc:1511] Processing CreateTablet for tablet 17f158725451402bb9cc7a8ef31bd326 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:34.680997 24024 tablet_service.cc:1511] Processing CreateTablet for tablet 09fec738c86b43ec9c0696fdb3161451 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:34.682843 24025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05aa17ebe1f24f18ac072293c54b485e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.683507 24030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7875b090eb42268d9ea12bff690af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.644870 24031 tablet_service.cc:1511] Processing CreateTablet for tablet 28e0e796d2d647d3a27da79e0c852568 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:34.684504 24024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fec738c86b43ec9c0696fdb3161451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.685109 24027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719558de58d441c59275f27353019719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.685860 24028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f8d25f2334413fb0fa7bfc06b5670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.686290 24175 tablet_service.cc:1511] Processing CreateTablet for tablet fc19280eec3a4864b53c5cbd4a7d0b55 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:34.690048 24026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc19280eec3a4864b53c5cbd4a7d0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.693428 24031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e0e796d2d647d3a27da79e0c852568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.696769 24033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17f158725451402bb9cc7a8ef31bd326. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.701346 24177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f8d25f2334413fb0fa7bfc06b5670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.702013 24178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b0326ba8c4edeb148bb8618f8d7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.704157 24174 tablet_service.cc:1511] Processing CreateTablet for tablet 05aa17ebe1f24f18ac072293c54b485e (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:34.705525 24174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05aa17ebe1f24f18ac072293c54b485e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.706300 24176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719558de58d441c59275f27353019719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.706845 24173 tablet_service.cc:1511] Processing CreateTablet for tablet 09fec738c86b43ec9c0696fdb3161451 (DEFAULT_TABLE table=test-workload [id=a1aa7ea2837a42189ce49d04c5839ae3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:34.708184 24029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b0326ba8c4edeb148bb8618f8d7f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.712674 24181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41aea863779546f5955735458a1178d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.713397 24179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7875b090eb42268d9ea12bff690af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.715951 24175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc19280eec3a4864b53c5cbd4a7d0b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.716554 24173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fec738c86b43ec9c0696fdb3161451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.719597 24180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e0e796d2d647d3a27da79e0c852568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:34.741544 24231 tablet_bootstrap.cc:492] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:34.772092 24231 tablet_bootstrap.cc:654] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.818730 24233 tablet_bootstrap.cc:492] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:34.818806 24232 tablet_bootstrap.cc:492] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:34.821424 24231 tablet_bootstrap.cc:492] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:34.821805 24231 ts_tablet_manager.cc:1403] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.009s
I20260709 13:07:34.823908 24231 raft_consensus.cc:359] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:34.824437 24231 raft_consensus.cc:385] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.824685 24231 raft_consensus.cc:740] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.825352 24231 consensus_queue.cc:260] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:34.825644 24233 tablet_bootstrap.cc:654] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.826918 24232 tablet_bootstrap.cc:654] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.832415 24231 ts_tablet_manager.cc:1434] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:07:34.832589 24232 tablet_bootstrap.cc:492] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:34.832695 24233 tablet_bootstrap.cc:492] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:34.833258 24233 ts_tablet_manager.cc:1403] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:07:34.833225 24143 heartbeater.cc:499] Master 127.22.225.190:40245 was elected leader, sending a full tablet report...
I20260709 13:07:34.833822 24232 ts_tablet_manager.cc:1403] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 13:07:34.836318 24231 tablet_bootstrap.cc:492] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:34.836175 24233 raft_consensus.cc:359] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.836549 24232 raft_consensus.cc:359] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.836931 24233 raft_consensus.cc:385] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.837267 24232 raft_consensus.cc:385] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.837416 24233 raft_consensus.cc:740] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.837594 24232 raft_consensus.cc:740] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.838297 24232 consensus_queue.cc:260] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.838406 24233 consensus_queue.cc:260] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.843199 24231 tablet_bootstrap.cc:654] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.847523 24217 heartbeater.cc:499] Master 127.22.225.190:40245 was elected leader, sending a full tablet report...
I20260709 13:07:34.847653 24233 ts_tablet_manager.cc:1434] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:07:34.848301 24068 heartbeater.cc:499] Master 127.22.225.190:40245 was elected leader, sending a full tablet report...
I20260709 13:07:34.847848 24232 ts_tablet_manager.cc:1434] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:07:34.849368 24232 tablet_bootstrap.cc:492] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:34.854815 24231 tablet_bootstrap.cc:492] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:34.855342 24233 tablet_bootstrap.cc:492] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:34.857429 24232 tablet_bootstrap.cc:654] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.862648 24233 tablet_bootstrap.cc:654] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.865304 24231 ts_tablet_manager.cc:1403] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:07:34.868203 24231 raft_consensus.cc:359] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.868943 24231 raft_consensus.cc:385] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.869236 24231 raft_consensus.cc:740] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.869457 24232 tablet_bootstrap.cc:492] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:34.869887 24232 ts_tablet_manager.cc:1403] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.013s
I20260709 13:07:34.870178 24233 tablet_bootstrap.cc:492] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:34.869992 24231 consensus_queue.cc:260] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.870618 24233 ts_tablet_manager.cc:1403] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.005s
I20260709 13:07:34.871975 24231 ts_tablet_manager.cc:1434] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:34.872854 24231 tablet_bootstrap.cc:492] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:34.873931 24232 raft_consensus.cc:359] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.874697 24232 raft_consensus.cc:385] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.874656 24238 raft_consensus.cc:493] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.875263 24232 raft_consensus.cc:740] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.875373 24238 raft_consensus.cc:515] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.876278 24232 consensus_queue.cc:260] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.877245 24233 raft_consensus.cc:359] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.877978 24233 raft_consensus.cc:385] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.878260 24233 raft_consensus.cc:740] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.879129 24232 ts_tablet_manager.cc:1434] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:07:34.879820 24231 tablet_bootstrap.cc:654] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.879702 24235 raft_consensus.cc:493] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.878989 24233 consensus_queue.cc:260] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.880267 24235 raft_consensus.cc:515] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:34.886124 24235 leader_election.cc:290] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147), ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375)
I20260709 13:07:34.898428 24238 leader_election.cc:290] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:34.880254 24232 tablet_bootstrap.cc:492] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:34.915693 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41aea863779546f5955735458a1178d3" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:34.916673 24043 raft_consensus.cc:2468] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 0.
I20260709 13:07:34.918576 24157 leader_election.cc:304] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:34.921743 24232 tablet_bootstrap.cc:654] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.924126 24238 raft_consensus.cc:2804] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.926424 24238 raft_consensus.cc:493] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.926885 24238 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.927301 24231 tablet_bootstrap.cc:492] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:34.927891 24231 ts_tablet_manager.cc:1403] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.036s
I20260709 13:07:34.931638 24231 raft_consensus.cc:359] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.932590 24231 raft_consensus.cc:385] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.932988 24231 raft_consensus.cc:740] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.933881 24231 consensus_queue.cc:260] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.936908 24231 ts_tablet_manager.cc:1434] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:34.938213 24231 tablet_bootstrap.cc:492] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:34.946322 24231 tablet_bootstrap.cc:654] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.959018 24231 tablet_bootstrap.cc:492] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:34.959700 24231 ts_tablet_manager.cc:1403] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:07:34.963181 24231 raft_consensus.cc:359] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.964250 24231 raft_consensus.cc:385] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.964663 24231 raft_consensus.cc:740] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.965734 24231 consensus_queue.cc:260] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:34.968844 24231 ts_tablet_manager.cc:1434] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:34.970079 24231 tablet_bootstrap.cc:492] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:34.978169 24231 tablet_bootstrap.cc:654] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.985504 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41aea863779546f5955735458a1178d3" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
W20260709 13:07:34.987771 24155 leader_election.cc:343] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.991472 24231 tablet_bootstrap.cc:492] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:34.992137 24231 ts_tablet_manager.cc:1403] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:07:34.992105 24238 raft_consensus.cc:515] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.001166 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.001907 24192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
W20260709 13:07:35.003572 24083 leader_election.cc:343] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.994418 24235 raft_consensus.cc:493] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.011925 24235 raft_consensus.cc:515] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.014880 24235 leader_election.cc:290] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.015573 24235 raft_consensus.cc:493] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.995977 24231 raft_consensus.cc:359] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.017700 24231 raft_consensus.cc:385] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.018007 24231 raft_consensus.cc:740] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
W20260709 13:07:35.019153 24083 leader_election.cc:343] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.019584 24192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.019604 24083 leader_election.cc:304] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 107d690694944a0db9d7541fc7d672db; no voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129
W20260709 13:07:35.021826 24083 leader_election.cc:343] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.022696 24231 consensus_queue.cc:260] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.023187 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.025386 24251 raft_consensus.cc:2749] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.026491 24233 ts_tablet_manager.cc:1434] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.152s	user 0.058s	sys 0.076s
I20260709 13:07:35.027709 24233 tablet_bootstrap.cc:492] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:35.031648 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41aea863779546f5955735458a1178d3" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:35.032197 24043 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.035822 24233 tablet_bootstrap.cc:654] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:35.024410 24083 leader_election.cc:343] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.036588 24083 leader_election.cc:304] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 107d690694944a0db9d7541fc7d672db; no voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:35.038312 24251 raft_consensus.cc:2749] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.039193 24238 leader_election.cc:290] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:35.040218 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41aea863779546f5955735458a1178d3" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:35.040833 24118 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.041693 24232 tablet_bootstrap.cc:492] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:35.042121 24232 ts_tablet_manager.cc:1403] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.041s
I20260709 13:07:35.042882 24231 ts_tablet_manager.cc:1434] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.016s
I20260709 13:07:35.043819 24231 tablet_bootstrap.cc:492] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:35.024528 24235 raft_consensus.cc:515] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.044924 24232 raft_consensus.cc:359] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.046396 24232 raft_consensus.cc:385] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.046730 24232 raft_consensus.cc:740] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.047683 24118 raft_consensus.cc:2468] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 1.
I20260709 13:07:35.047483 24232 consensus_queue.cc:260] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.047976 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.048839 24155 leader_election.cc:304] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:35.053941 24231 tablet_bootstrap.cc:654] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.055229 24232 ts_tablet_manager.cc:1434] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:07:35.056195 24232 tablet_bootstrap.cc:492] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:35.050978 24192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.057657 24238 raft_consensus.cc:2804] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.058202 24238 raft_consensus.cc:697] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:35.059002 24238 consensus_queue.cc:237] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
W20260709 13:07:35.061920 24083 leader_election.cc:343] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:35.062666 24083 leader_election.cc:343] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.051658 24235 leader_election.cc:290] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.065393 24083 leader_election.cc:304] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 107d690694944a0db9d7541fc7d672db; no voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:35.066045 24235 raft_consensus.cc:2749] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.068935 24043 raft_consensus.cc:2468] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 1.
I20260709 13:07:35.071986 24233 tablet_bootstrap.cc:492] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:35.072398 24233 ts_tablet_manager.cc:1403] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.022s
I20260709 13:07:35.075291 24232 tablet_bootstrap.cc:654] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.075107 24233 raft_consensus.cc:359] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.075860 24233 raft_consensus.cc:385] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.076207 24233 raft_consensus.cc:740] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.075932 23940 catalog_manager.cc:5697] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.077337 24231 tablet_bootstrap.cc:492] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:35.076930 24233 consensus_queue.cc:260] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.078377 24231 ts_tablet_manager.cc:1403] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 13:07:35.079317 24233 ts_tablet_manager.cc:1434] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:07:35.080188 24233 tablet_bootstrap.cc:492] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:35.081403 24231 raft_consensus.cc:359] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.082131 24231 raft_consensus.cc:385] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.082484 24231 raft_consensus.cc:740] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.083376 24231 consensus_queue.cc:260] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.084995 24239 raft_consensus.cc:493] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.085461 24239 raft_consensus.cc:515] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.086185 24231 ts_tablet_manager.cc:1434] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:07:35.086880 24233 tablet_bootstrap.cc:654] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.087285 24231 tablet_bootstrap.cc:492] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:35.095599 24231 tablet_bootstrap.cc:654] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.097996 24239 leader_election.cc:290] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.117835 24232 tablet_bootstrap.cc:492] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:35.118456 24232 ts_tablet_manager.cc:1403] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.005s
I20260709 13:07:35.120299 24238 raft_consensus.cc:493] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.120808 24238 raft_consensus.cc:515] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.122875 24238 leader_election.cc:290] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:35.125447 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05aa17ebe1f24f18ac072293c54b485e" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.125964 24232 raft_consensus.cc:359] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.126631 24232 raft_consensus.cc:385] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.126909 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05aa17ebe1f24f18ac072293c54b485e" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
W20260709 13:07:35.128685 24157 leader_election.cc:343] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:35.129995 24155 leader_election.cc:343] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.130530 24155 leader_election.cc:304] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3; no voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:35.131487 24238 raft_consensus.cc:2749] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.126920 24232 raft_consensus.cc:740] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.138796 24232 consensus_queue.cc:260] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.158317 24232 ts_tablet_manager.cc:1434] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:07:35.159653 24232 tablet_bootstrap.cc:492] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:35.174542 24233 tablet_bootstrap.cc:492] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:35.175262 24233 ts_tablet_manager.cc:1403] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.095s	user 0.032s	sys 0.053s
I20260709 13:07:35.186988 24233 raft_consensus.cc:359] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.188022 24233 raft_consensus.cc:385] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.188416 24233 raft_consensus.cc:740] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.189538 24233 consensus_queue.cc:260] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.192178 24232 tablet_bootstrap.cc:654] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.192516 24233 ts_tablet_manager.cc:1434] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:07:35.193848 24233 tablet_bootstrap.cc:492] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:35.211823 24232 tablet_bootstrap.cc:492] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:35.213060 24232 ts_tablet_manager.cc:1403] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.007s
I20260709 13:07:35.213586 24233 tablet_bootstrap.cc:654] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.216506 24232 raft_consensus.cc:359] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.217885 24232 raft_consensus.cc:385] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.218269 24232 raft_consensus.cc:740] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.218988 24232 consensus_queue.cc:260] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.219636 24231 tablet_bootstrap.cc:492] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:35.220099 24231 ts_tablet_manager.cc:1403] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.133s	user 0.022s	sys 0.050s
I20260709 13:07:35.221467 24232 ts_tablet_manager.cc:1434] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:07:35.222429 24232 tablet_bootstrap.cc:492] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:35.222898 24231 raft_consensus.cc:359] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.223577 24231 raft_consensus.cc:385] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.223863 24231 raft_consensus.cc:740] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.224562 24231 consensus_queue.cc:260] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.226939 24231 ts_tablet_manager.cc:1434] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:35.227538 24239 raft_consensus.cc:493] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.227998 24239 raft_consensus.cc:515] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.229364 24232 tablet_bootstrap.cc:654] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.230038 24239 leader_election.cc:290] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.231619 24231 tablet_bootstrap.cc:492] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:35.232513 24192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7875b090eb42268d9ea12bff690af6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.233747 24191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.234015 24117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.234577 24117 raft_consensus.cc:2468] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 0.
W20260709 13:07:35.235514 24008 leader_election.cc:343] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:35.236202 24008 leader_election.cc:343] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.238662 24006 leader_election.cc:304] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:35.239713 24239 raft_consensus.cc:2804] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.240154 24239 raft_consensus.cc:493] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.240654 24239 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.241838 24231 tablet_bootstrap.cc:654] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.247223 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7875b090eb42268d9ea12bff690af6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.247893 24118 raft_consensus.cc:2468] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 0.
I20260709 13:07:35.247925 24239 raft_consensus.cc:515] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.250550 24006 leader_election.cc:304] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:35.254554 24231 tablet_bootstrap.cc:492] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:35.255120 24231 ts_tablet_manager.cc:1403] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:07:35.258276 24191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:35.258533 24231 raft_consensus.cc:359] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.259419 24231 raft_consensus.cc:385] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:35.259720 24008 leader_election.cc:343] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.259758 24231 raft_consensus.cc:740] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.260763 24231 consensus_queue.cc:260] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.262217 24239 leader_election.cc:290] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.262795 24239 raft_consensus.cc:2804] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.263139 24239 raft_consensus.cc:493] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.263491 24239 raft_consensus.cc:3060] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.263697 24231 ts_tablet_manager.cc:1434] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:07:35.264882 24231 tablet_bootstrap.cc:492] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:35.272483 24231 tablet_bootstrap.cc:654] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.274082 24239 raft_consensus.cc:515] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.277043 24117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7875b090eb42268d9ea12bff690af6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:35.277657 24117 raft_consensus.cc:3060] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:35.284324 23989 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:35.284651 24117 raft_consensus.cc:2468] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 1.
I20260709 13:07:35.285346 24231 tablet_bootstrap.cc:492] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:35.285907 24231 ts_tablet_manager.cc:1403] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:07:35.285902 24006 leader_election.cc:304] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.286962 24268 raft_consensus.cc:2804] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.289947 24231 raft_consensus.cc:359] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.290833 24231 raft_consensus.cc:385] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.291258 24231 raft_consensus.cc:740] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.292098 24231 consensus_queue.cc:260] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.294656 24231 ts_tablet_manager.cc:1434] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:35.295727 24231 tablet_bootstrap.cc:492] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db: Bootstrap starting.
I20260709 13:07:35.295778 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:35.296499 24118 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.302868 24233 tablet_bootstrap.cc:492] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:35.305965 24233 ts_tablet_manager.cc:1403] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.005s
I20260709 13:07:35.306067 24118 raft_consensus.cc:2468] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 1.
I20260709 13:07:35.316638 24268 raft_consensus.cc:697] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:35.352064 24270 raft_consensus.cc:493] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.364845 24270 raft_consensus.cc:515] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.365343 24006 leader_election.cc:304] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:35.365613 24268 consensus_queue.cc:237] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.367136 24271 raft_consensus.cc:2804] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.367575 24270 leader_election.cc:290] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.369650 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.371148 24233 raft_consensus.cc:359] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.382530 24233 raft_consensus.cc:385] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.382432 24118 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 0.
I20260709 13:07:35.382795 24233 raft_consensus.cc:740] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.383397 24233 consensus_queue.cc:260] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.383662 24006 leader_election.cc:304] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.384599 24272 raft_consensus.cc:2804] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.384949 24272 raft_consensus.cc:493] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.385258 24233 ts_tablet_manager.cc:1434] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 13:07:35.385360 24272 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.389047 24232 tablet_bootstrap.cc:492] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:35.389535 24232 ts_tablet_manager.cc:1403] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.167s	user 0.036s	sys 0.046s
I20260709 13:07:35.389765 24233 tablet_bootstrap.cc:492] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:35.392346 24232 raft_consensus.cc:359] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.386178 24239 leader_election.cc:290] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.386744 24271 raft_consensus.cc:697] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:35.393144 24232 raft_consensus.cc:385] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.393821 24232 raft_consensus.cc:740] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.394340 24271 consensus_queue.cc:237] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.396502 24233 tablet_bootstrap.cc:654] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.398031 24272 raft_consensus.cc:515] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.401715 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:35.402520 24118 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.407912 24233 tablet_bootstrap.cc:492] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:35.408423 24233 ts_tablet_manager.cc:1403] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:07:35.408783 24118 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 1.
I20260709 13:07:35.410015 24006 leader_election.cc:304] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.410372 24272 leader_election.cc:290] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.410890 24272 raft_consensus.cc:2804] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.411450 24272 raft_consensus.cc:697] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:35.411302 24233 raft_consensus.cc:359] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.412060 24233 raft_consensus.cc:385] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.412392 24233 raft_consensus.cc:740] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.412348 24272 consensus_queue.cc:237] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.413250 24233 consensus_queue.cc:260] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.414369 24191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.414947 24191 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 0.
I20260709 13:07:35.415789 24233 ts_tablet_manager.cc:1434] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:07:35.415993 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:35.416513 24190 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.416733 24233 tablet_bootstrap.cc:492] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:35.416749 24235 raft_consensus.cc:493] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.417464 24235 raft_consensus.cc:515] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.419977 24235 leader_election.cc:290] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.421561 24192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7875b090eb42268d9ea12bff690af6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:35.422130 24192 raft_consensus.cc:3060] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.422382 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.423159 24043 raft_consensus.cc:2468] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 0.
I20260709 13:07:35.423477 24233 tablet_bootstrap.cc:654] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.424906 24083 leader_election.cc:304] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.426708 24235 raft_consensus.cc:2804] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.427814 24235 raft_consensus.cc:493] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.428344 24235 raft_consensus.cc:3060] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.429306 24191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.396502 24231 tablet_bootstrap.cc:654] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:35.430681 24083 leader_election.cc:343] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.439983 23940 catalog_manager.cc:5697] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.442121 24233 tablet_bootstrap.cc:492] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:35.442117 24192 raft_consensus.cc:2468] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 1.
I20260709 13:07:35.442728 24233 ts_tablet_manager.cc:1403] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:07:35.445480 24233 raft_consensus.cc:359] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.446125 24233 raft_consensus.cc:385] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.445356 24232 consensus_queue.cc:260] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.449479 24233 raft_consensus.cc:740] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.446252 23940 catalog_manager.cc:5697] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.450421 24233 consensus_queue.cc:260] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.451184 24232 ts_tablet_manager.cc:1434] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.002s
I20260709 13:07:35.452165 24232 tablet_bootstrap.cc:492] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:35.452790 24233 ts_tablet_manager.cc:1434] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:07:35.453909 24233 tablet_bootstrap.cc:492] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:35.444866 24190 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 1.
I20260709 13:07:35.463150 24233 tablet_bootstrap.cc:654] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.467038 24231 tablet_bootstrap.cc:492] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db: No bootstrap required, opened a new log
I20260709 13:07:35.467587 24231 ts_tablet_manager.cc:1403] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db: Time spent bootstrapping tablet: real 0.172s	user 0.015s	sys 0.003s
I20260709 13:07:35.467293 24232 tablet_bootstrap.cc:654] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.467195 24235 raft_consensus.cc:515] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.470451 24231 raft_consensus.cc:359] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.470877 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:35.471077 24231 raft_consensus.cc:385] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.471362 24231 raft_consensus.cc:740] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.471411 24043 raft_consensus.cc:3060] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.472215 24231 consensus_queue.cc:260] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.477588 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:35.478811 24252 raft_consensus.cc:493] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.476699 24235 leader_election.cc:290] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.479411 24231 ts_tablet_manager.cc:1434] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:07:35.479416 24252 raft_consensus.cc:515] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.489723 24252 leader_election.cc:290] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
W20260709 13:07:35.488353 24083 leader_election.cc:343] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.495812 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc19280eec3a4864b53c5cbd4a7d0b55" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.496043 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc19280eec3a4864b53c5cbd4a7d0b55" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.496431 24042 raft_consensus.cc:2468] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 0.
I20260709 13:07:35.496593 24190 raft_consensus.cc:2468] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 0.
I20260709 13:07:35.497644 24083 leader_election.cc:304] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:35.498298 24252 raft_consensus.cc:2804] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.504884 24252 raft_consensus.cc:493] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.505326 24252 raft_consensus.cc:3060] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.506848 24238 raft_consensus.cc:493] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.507342 24233 tablet_bootstrap.cc:492] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:35.507304 24238 raft_consensus.cc:515] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.507872 24233 ts_tablet_manager.cc:1403] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.019s
I20260709 13:07:35.509488 24238 leader_election.cc:290] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:35.504143 24043 raft_consensus.cc:2468] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 1.
I20260709 13:07:35.510507 24233 raft_consensus.cc:359] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.511161 24233 raft_consensus.cc:385] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.510979 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.511514 24233 raft_consensus.cc:740] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.511767 24118 raft_consensus.cc:2468] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 0.
I20260709 13:07:35.510104 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.513069 24155 leader_election.cc:304] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:35.513950 24238 raft_consensus.cc:2804] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.513767 24252 raft_consensus.cc:515] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
W20260709 13:07:35.514170 24157 leader_election.cc:343] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.514430 24238 raft_consensus.cc:493] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.515009 24238 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.515683 24083 leader_election.cc:304] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:35.515947 24252 leader_election.cc:290] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.516429 24235 raft_consensus.cc:2804] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.516912 24235 raft_consensus.cc:697] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Becoming Leader. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:35.516857 24233 consensus_queue.cc:260] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.517956 24235 consensus_queue.cc:237] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.518994 24233 ts_tablet_manager.cc:1434] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:35.519858 24233 tablet_bootstrap.cc:492] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:35.522132 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc19280eec3a4864b53c5cbd4a7d0b55" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:35.522732 24042 raft_consensus.cc:3060] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.522603 24238 raft_consensus.cc:515] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.524956 24233 tablet_bootstrap.cc:654] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.525295 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
W20260709 13:07:35.526645 24157 leader_election.cc:343] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.530057 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:35.530612 24118 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.530889 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc19280eec3a4864b53c5cbd4a7d0b55" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:35.531579 24190 raft_consensus.cc:3060] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.535077 23939 catalog_manager.cc:5697] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.539203 24042 raft_consensus.cc:2468] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 1.
I20260709 13:07:35.541231 24238 leader_election.cc:290] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:35.541235 24118 raft_consensus.cc:2468] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 1.
I20260709 13:07:35.545529 24083 leader_election.cc:304] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.546478 24235 raft_consensus.cc:2804] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.547067 24235 raft_consensus.cc:697] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Becoming Leader. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:35.547857 24235 consensus_queue.cc:237] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.548538 24155 leader_election.cc:304] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:35.548770 24190 raft_consensus.cc:2468] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 1.
I20260709 13:07:35.549649 24238 raft_consensus.cc:2804] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.546643 24233 tablet_bootstrap.cc:492] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:35.550114 24238 raft_consensus.cc:697] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:35.550295 24233 ts_tablet_manager.cc:1403] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.013s
I20260709 13:07:35.550861 24238 consensus_queue.cc:237] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.553463 24233 raft_consensus.cc:359] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:35.554112 24233 raft_consensus.cc:385] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.554386 24233 raft_consensus.cc:740] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.554996 24233 consensus_queue.cc:260] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:35.555583 23941 catalog_manager.cc:5697] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db reported cstate change: term changed from 0 to 1, leader changed from <none> to 107d690694944a0db9d7541fc7d672db (127.22.225.130). New cstate: current_term: 1 leader_uuid: "107d690694944a0db9d7541fc7d672db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.557098 24233 ts_tablet_manager.cc:1434] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:07:35.557886 24233 tablet_bootstrap.cc:492] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3: Bootstrap starting.
I20260709 13:07:35.553463 24232 tablet_bootstrap.cc:492] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:35.558745 24232 ts_tablet_manager.cc:1403] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.013s
I20260709 13:07:35.560822 23939 catalog_manager.cc:5697] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.561664 24232 raft_consensus.cc:359] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.562371 24232 raft_consensus.cc:385] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.562664 24232 raft_consensus.cc:740] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.563280 24233 tablet_bootstrap.cc:654] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.563491 24232 consensus_queue.cc:260] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.568049 24232 ts_tablet_manager.cc:1434] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:07:35.569351 24232 tablet_bootstrap.cc:492] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:35.577045 23940 catalog_manager.cc:5697] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db reported cstate change: term changed from 0 to 1, leader changed from <none> to 107d690694944a0db9d7541fc7d672db (127.22.225.130). New cstate: current_term: 1 leader_uuid: "107d690694944a0db9d7541fc7d672db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.579300 24238 consensus_queue.cc:1048] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:35.585602 24238 consensus_queue.cc:1048] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.590054 24232 tablet_bootstrap.cc:654] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.596094 24233 tablet_bootstrap.cc:492] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3: No bootstrap required, opened a new log
I20260709 13:07:35.596210 24232 tablet_bootstrap.cc:492] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:35.596552 24233 ts_tablet_manager.cc:1403] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.020s
I20260709 13:07:35.596580 24232 ts_tablet_manager.cc:1403] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:07:35.599287 24232 raft_consensus.cc:359] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.599956 24232 raft_consensus.cc:385] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.600232 24232 raft_consensus.cc:740] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.601699 24233 raft_consensus.cc:359] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.602356 24233 raft_consensus.cc:385] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.602631 24233 raft_consensus.cc:740] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.603400 24232 consensus_queue.cc:260] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.603657 24233 consensus_queue.cc:260] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.605362 24232 ts_tablet_manager.cc:1434] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:35.612001 24233 ts_tablet_manager.cc:1434] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:07:35.613531 24232 tablet_bootstrap.cc:492] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:35.621410 24232 tablet_bootstrap.cc:654] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.625368 24232 tablet_bootstrap.cc:492] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:35.625782 24232 ts_tablet_manager.cc:1403] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:07:35.627635 24232 raft_consensus.cc:359] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:35.628115 24232 raft_consensus.cc:385] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.628363 24232 raft_consensus.cc:740] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.628911 24232 consensus_queue.cc:260] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:35.630537 24232 ts_tablet_manager.cc:1434] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:35.631462 24232 tablet_bootstrap.cc:492] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129: Bootstrap starting.
I20260709 13:07:35.636322 24232 tablet_bootstrap.cc:654] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.640413 24232 tablet_bootstrap.cc:492] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129: No bootstrap required, opened a new log
I20260709 13:07:35.640861 24232 ts_tablet_manager.cc:1403] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:35.642611 24232 raft_consensus.cc:359] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.643078 24232 raft_consensus.cc:385] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.643302 24232 raft_consensus.cc:740] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.643886 24232 consensus_queue.cc:260] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.645498 24232 ts_tablet_manager.cc:1434] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:35.678359 24238 raft_consensus.cc:493] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.678860 24238 raft_consensus.cc:515] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.680473 24238 leader_election.cc:290] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:35.681233 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.681406 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.682078 24118 raft_consensus.cc:2393] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9fcec07431c47adb184dc91ad9069a3 in current term 1: Already voted for candidate ed62d27738a6442f9c06b53fc2e60129 in this term.
I20260709 13:07:35.682914 24155 leader_election.cc:304] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3; no voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:35.683548 24238 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.688288 24238 raft_consensus.cc:2749] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.753029 24272 consensus_queue.cc:1048] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.762681 24271 consensus_queue.cc:1048] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.765481 24235 raft_consensus.cc:493] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.765892 24235 raft_consensus.cc:515] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.768208 24235 leader_election.cc:290] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.768544 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05aa17ebe1f24f18ac072293c54b485e" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.769294 24042 raft_consensus.cc:2468] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 0.
I20260709 13:07:35.772267 24083 leader_election.cc:304] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.771193 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05aa17ebe1f24f18ac072293c54b485e" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.773064 24235 raft_consensus.cc:2804] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.773197 24190 raft_consensus.cc:2468] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 0.
I20260709 13:07:35.773488 24235 raft_consensus.cc:493] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.773893 24235 raft_consensus.cc:3060] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.780055 24235 raft_consensus.cc:515] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.782083 24235 leader_election.cc:290] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.782732 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05aa17ebe1f24f18ac072293c54b485e" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:35.782994 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05aa17ebe1f24f18ac072293c54b485e" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:35.783245 24042 raft_consensus.cc:3060] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.783551 24190 raft_consensus.cc:3060] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.787999 24042 raft_consensus.cc:2468] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 1.
I20260709 13:07:35.788502 24190 raft_consensus.cc:2468] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 1.
I20260709 13:07:35.789028 24083 leader_election.cc:304] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.789819 24235 raft_consensus.cc:2804] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.790226 24235 raft_consensus.cc:697] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Becoming Leader. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:35.790979 24235 consensus_queue.cc:237] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.797989 24271 consensus_queue.cc:1048] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.798491 23940 catalog_manager.cc:5697] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db reported cstate change: term changed from 0 to 1, leader changed from <none> to 107d690694944a0db9d7541fc7d672db (127.22.225.130). New cstate: current_term: 1 leader_uuid: "107d690694944a0db9d7541fc7d672db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.810010 24272 consensus_queue.cc:1048] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.811306 24238 raft_consensus.cc:493] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.811761 24238 raft_consensus.cc:515] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.813800 24238 leader_election.cc:290] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:35.814584 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.815290 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.815954 24042 raft_consensus.cc:2468] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 0.
I20260709 13:07:35.816079 24118 raft_consensus.cc:2468] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 0.
I20260709 13:07:35.817140 24157 leader_election.cc:304] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.818226 24238 raft_consensus.cc:2804] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.818578 24238 raft_consensus.cc:493] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.818912 24238 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.824388 24238 raft_consensus.cc:515] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.826753 24238 leader_election.cc:290] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:35.827109 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:35.827670 24042 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.828871 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:35.829380 24118 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.832154 24042 raft_consensus.cc:2468] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 1.
I20260709 13:07:35.833022 24157 leader_election.cc:304] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.833735 24238 raft_consensus.cc:2804] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.833920 24118 raft_consensus.cc:2468] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 1.
I20260709 13:07:35.834004 24291 raft_consensus.cc:493] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.834235 24238 raft_consensus.cc:697] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:35.834528 24291 raft_consensus.cc:515] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:35.835041 24238 consensus_queue.cc:237] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.836421 24291 leader_election.cc:290] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375)
I20260709 13:07:35.837061 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.837646 24118 raft_consensus.cc:2468] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 0.
I20260709 13:07:35.837836 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.838449 24042 raft_consensus.cc:2468] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 0.
I20260709 13:07:35.838662 24155 leader_election.cc:304] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:35.839581 24291 raft_consensus.cc:2804] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.839910 24291 raft_consensus.cc:493] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.840212 24291 raft_consensus.cc:3060] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.840839 24272 consensus_queue.cc:1048] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.846428 24291 raft_consensus.cc:515] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:35.848626 24291 leader_election.cc:290] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375)
I20260709 13:07:35.849167 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:35.849323 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:35.849721 24042 raft_consensus.cc:3060] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.849793 24118 raft_consensus.cc:3060] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.854262 23939 catalog_manager.cc:5697] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.856345 24042 raft_consensus.cc:2468] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 1.
I20260709 13:07:35.856877 24118 raft_consensus.cc:2468] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 1.
I20260709 13:07:35.857932 24157 leader_election.cc:304] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:35.858592 24239 consensus_queue.cc:1048] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.862399 24238 raft_consensus.cc:2804] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.862893 24238 raft_consensus.cc:697] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:35.863669 24238 consensus_queue.cc:237] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:35.875061 23940 catalog_manager.cc:5697] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.900730 24238 raft_consensus.cc:493] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.901226 24238 raft_consensus.cc:515] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.901813 24272 raft_consensus.cc:493] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.902213 24272 raft_consensus.cc:515] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:35.903364 24238 leader_election.cc:290] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:35.903720 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed62d27738a6442f9c06b53fc2e60129" is_pre_election: true
I20260709 13:07:35.904081 24272 leader_election.cc:290] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:35.904713 24042 raft_consensus.cc:2393] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9fcec07431c47adb184dc91ad9069a3 in current term 1: Already voted for candidate 107d690694944a0db9d7541fc7d672db in this term.
I20260709 13:07:35.904780 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.905217 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9fcec07431c47adb184dc91ad9069a3" is_pre_election: true
I20260709 13:07:35.904047 24117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "107d690694944a0db9d7541fc7d672db" is_pre_election: true
I20260709 13:07:35.905771 24118 raft_consensus.cc:2393] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed62d27738a6442f9c06b53fc2e60129 in current term 1: Already voted for candidate b9fcec07431c47adb184dc91ad9069a3 in this term.
I20260709 13:07:35.906716 24155 leader_election.cc:304] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3; no voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:35.906765 24006 leader_election.cc:304] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed62d27738a6442f9c06b53fc2e60129; no voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:35.907640 24272 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.907640 24238 raft_consensus.cc:3060] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.914265 24272 raft_consensus.cc:2749] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.914270 24238 raft_consensus.cc:2749] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.959712 24235 consensus_queue.cc:1048] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.970819 24305 consensus_queue.cc:1048] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.063329 24238 consensus_queue.cc:1048] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.073791 24243 consensus_queue.cc:1048] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.109458 24190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
mode: GRACEFUL
new_leader_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:07:36.110008 24190 raft_consensus.cc:606] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Received request to transfer leadership to TS ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:36.114801 24190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41aea863779546f5955735458a1178d3"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
mode: GRACEFUL
new_leader_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:07:36.115312 24190 raft_consensus.cc:606] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Received request to transfer leadership to TS ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:36.126436 24190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
mode: GRACEFUL
new_leader_uuid: "107d690694944a0db9d7541fc7d672db"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:07:36.126924 24190 raft_consensus.cc:606] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Received request to transfer leadership to TS 107d690694944a0db9d7541fc7d672db
I20260709 13:07:36.130970 24190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "719558de58d441c59275f27353019719"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
mode: GRACEFUL
new_leader_uuid: "107d690694944a0db9d7541fc7d672db"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:07:36.131433 24190 raft_consensus.cc:606] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Received request to transfer leadership to TS 107d690694944a0db9d7541fc7d672db
I20260709 13:07:36.148852 24117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451"
dest_uuid: "107d690694944a0db9d7541fc7d672db"
mode: GRACEFUL
new_leader_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:07:36.149427 24117 raft_consensus.cc:606] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Received request to transfer leadership to TS b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:36.150513 24305 consensus_queue.cc:1048] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.161790 24252 consensus_queue.cc:1048] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.185523 24252 consensus_queue.cc:1048] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.196249 24235 consensus_queue.cc:1048] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.229351 24291 consensus_queue.cc:1048] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.239327 24243 consensus_queue.cc:1048] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.246634 24238 raft_consensus.cc:993] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3: : Instructing follower 107d690694944a0db9d7541fc7d672db to start an election
I20260709 13:07:36.247113 24243 raft_consensus.cc:1081] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Signalling peer 107d690694944a0db9d7541fc7d672db to start an election
I20260709 13:07:36.248494 24117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a"
dest_uuid: "107d690694944a0db9d7541fc7d672db"
 from {username='slave'} at 127.0.0.1:41272
I20260709 13:07:36.248939 24117 raft_consensus.cc:493] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.249337 24117 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.253943 24117 raft_consensus.cc:515] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.255405 24117 leader_election.cc:290] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 2 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:36.256608 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:36.256752 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:36.257259 24190 raft_consensus.cc:3055] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.257305 24042 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.257584 24190 raft_consensus.cc:740] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:36.258390 24190 consensus_queue.cc:260] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.259258 24190 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.262748 24042 raft_consensus.cc:2468] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 2.
I20260709 13:07:36.264148 24083 leader_election.cc:304] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:36.264492 24190 raft_consensus.cc:2468] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 2.
I20260709 13:07:36.265004 24251 raft_consensus.cc:2804] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.265511 24251 raft_consensus.cc:697] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Becoming Leader. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:36.266196 24251 consensus_queue.cc:237] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.271487 23939 catalog_manager.cc:5697] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db reported cstate change: term changed from 1 to 2, leader changed from b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131) to 107d690694944a0db9d7541fc7d672db (127.22.225.130). New cstate: current_term: 2 leader_uuid: "107d690694944a0db9d7541fc7d672db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.307595 24243 consensus_queue.cc:1048] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:36.312064 24139 debug-util.cc:398] Leaking SignalData structure 0x7b08001b99e0 after lost signal to thread 23433
W20260709 13:07:36.313136 24139 debug-util.cc:398] Leaking SignalData structure 0x7b0800184c40 after lost signal to thread 23975
W20260709 13:07:36.314194 24139 debug-util.cc:398] Leaking SignalData structure 0x7b08000b75e0 after lost signal to thread 24067
I20260709 13:07:36.319633 24291 consensus_queue.cc:1048] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.332237 24238 raft_consensus.cc:993] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3: : Instructing follower ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:36.332683 24238 raft_consensus.cc:1081] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Signalling peer ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:36.334380 24043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:47544
I20260709 13:07:36.334986 24043 raft_consensus.cc:493] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.335389 24043 raft_consensus.cc:3060] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.343935 24043 raft_consensus.cc:515] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:36.347976 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:36.348621 24190 raft_consensus.cc:3055] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.348987 24190 raft_consensus.cc:740] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:36.349426 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17f158725451402bb9cc7a8ef31bd326" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:36.350001 24118 raft_consensus.cc:3060] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.349838 24190 consensus_queue.cc:260] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:36.351042 24190 raft_consensus.cc:3060] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.357863 24190 raft_consensus.cc:2468] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 2.
I20260709 13:07:36.359324 24008 leader_election.cc:304] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:36.356812 24118 raft_consensus.cc:2468] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 2.
I20260709 13:07:36.358325 24043 leader_election.cc:290] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 2 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:36.360061 24272 raft_consensus.cc:2804] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.360534 24272 raft_consensus.cc:697] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:36.361364 24272 consensus_queue.cc:237] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } }
I20260709 13:07:36.368144 23940 catalog_manager.cc:5697] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 1 to 2, leader changed from b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131) to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 2 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.485303 24291 raft_consensus.cc:993] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3: : Instructing follower 107d690694944a0db9d7541fc7d672db to start an election
I20260709 13:07:36.485787 24291 raft_consensus.cc:1081] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Signalling peer 107d690694944a0db9d7541fc7d672db to start an election
I20260709 13:07:36.487471 24118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "719558de58d441c59275f27353019719"
dest_uuid: "107d690694944a0db9d7541fc7d672db"
 from {username='slave'} at 127.0.0.1:41272
I20260709 13:07:36.488121 24118 raft_consensus.cc:493] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.488548 24118 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.496742 24118 raft_consensus.cc:515] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.499397 24118 leader_election.cc:290] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 2 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:36.500644 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:36.500825 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:36.501461 24190 raft_consensus.cc:3055] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.501397 24043 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.501888 24190 raft_consensus.cc:740] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:36.502596 24190 consensus_queue.cc:260] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.503460 24190 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.508183 24190 raft_consensus.cc:2468] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 2.
I20260709 13:07:36.509217 24083 leader_election.cc:304] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:36.509967 24251 raft_consensus.cc:2804] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.509768 24043 raft_consensus.cc:2468] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 2.
I20260709 13:07:36.510434 24251 raft_consensus.cc:697] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Becoming Leader. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:36.511262 24251 consensus_queue.cc:237] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.516784 24235 raft_consensus.cc:993] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db: : Instructing follower b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:36.517217 24251 raft_consensus.cc:1081] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Signalling peer b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:36.518647 24190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:37482
I20260709 13:07:36.519254 24190 raft_consensus.cc:493] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.519675 24190 raft_consensus.cc:3060] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.519841 23940 catalog_manager.cc:5697] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db reported cstate change: term changed from 1 to 2, leader changed from b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131) to 107d690694944a0db9d7541fc7d672db (127.22.225.130). New cstate: current_term: 2 leader_uuid: "107d690694944a0db9d7541fc7d672db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.528492 24190 raft_consensus.cc:515] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.530999 24190 leader_election.cc:290] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 2 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:36.532549 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:36.533238 24118 raft_consensus.cc:3055] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.533576 24118 raft_consensus.cc:740] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:36.534400 24118 consensus_queue.cc:260] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.535368 24118 raft_consensus.cc:3060] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.540148 24118 raft_consensus.cc:2468] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 2.
I20260709 13:07:36.540845 24043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fec738c86b43ec9c0696fdb3161451" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:36.541524 24043 raft_consensus.cc:3060] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.541424 24155 leader_election.cc:304] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:36.542375 24291 raft_consensus.cc:2804] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.542970 24291 raft_consensus.cc:697] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:36.543924 24291 consensus_queue.cc:237] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.547351 24043 raft_consensus.cc:2468] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 2.
I20260709 13:07:36.552676 23940 catalog_manager.cc:5697] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 1 to 2, leader changed from 107d690694944a0db9d7541fc7d672db (127.22.225.130) to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.643093 24238 raft_consensus.cc:993] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3: : Instructing follower ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:36.643591 24238 raft_consensus.cc:1081] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Signalling peer ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:36.646874 24043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41aea863779546f5955735458a1178d3"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:47544
I20260709 13:07:36.647532 24043 raft_consensus.cc:493] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.647959 24043 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.655423 24043 raft_consensus.cc:515] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.657835 24043 leader_election.cc:290] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 2 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:36.658432 24118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41aea863779546f5955735458a1178d3" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:36.658851 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41aea863779546f5955735458a1178d3" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:36.659330 24118 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.659494 24190 raft_consensus.cc:3055] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.659860 24190 raft_consensus.cc:740] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:36.660727 24190 consensus_queue.cc:260] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.661994 24190 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.664335 24118 raft_consensus.cc:2468] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 2.
I20260709 13:07:36.665316 24006 leader_election.cc:304] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:36.666003 24272 raft_consensus.cc:2804] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.666496 24272 raft_consensus.cc:697] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:36.667272 24272 consensus_queue.cc:237] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:36.669109 24190 raft_consensus.cc:2468] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 2.
I20260709 13:07:36.676015 23940 catalog_manager.cc:5697] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 1 to 2, leader changed from b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131) to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 2 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.730680 24043 raft_consensus.cc:1275] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Refusing update from remote peer 107d690694944a0db9d7541fc7d672db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.732002 24235 consensus_queue.cc:1048] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.741190 24190 raft_consensus.cc:1275] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Refusing update from remote peer 107d690694944a0db9d7541fc7d672db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.742801 24251 consensus_queue.cc:1048] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.874132 24190 raft_consensus.cc:1275] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.875367 24272 consensus_queue.cc:1048] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.883087 24118 raft_consensus.cc:1275] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.884619 24268 consensus_queue.cc:1048] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.927623 24043 raft_consensus.cc:1275] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Refusing update from remote peer 107d690694944a0db9d7541fc7d672db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.928987 24251 consensus_queue.cc:1048] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.936215 24190 raft_consensus.cc:1275] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Refusing update from remote peer 107d690694944a0db9d7541fc7d672db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.940697 24235 consensus_queue.cc:1048] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.085532 24118 raft_consensus.cc:1275] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.085940 24117 raft_consensus.cc:1275] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.086838 24238 consensus_queue.cc:1048] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.087479 24268 consensus_queue.cc:1048] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.089236 24191 raft_consensus.cc:1275] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.090843 24268 consensus_queue.cc:1048] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.199545 24043 raft_consensus.cc:1275] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.201865 24238 consensus_queue.cc:1048] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.184127 23430 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:07:39.184862 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:39.203565 24043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
mode: GRACEFUL
new_leader_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:47564
I20260709 13:07:39.204224 24043 raft_consensus.cc:606] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Received request to transfer leadership to TS b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:39.207470 24042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
mode: GRACEFUL
new_leader_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:47564
I20260709 13:07:39.208034 24042 raft_consensus.cc:606] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Received request to transfer leadership to TS b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:39.209165 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:39.209604 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:39.336438 24331 raft_consensus.cc:993] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129: : Instructing follower b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:39.336944 24327 raft_consensus.cc:1081] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Signalling peer b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:39.338658 24191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:37484
I20260709 13:07:39.339195 24191 raft_consensus.cc:493] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.339573 24191 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.344144 24191 raft_consensus.cc:515] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:39.345707 24191 leader_election.cc:290] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 2 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:39.346745 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:39.346694 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:39.347343 24116 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.347497 24042 raft_consensus.cc:3055] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.347839 24042 raft_consensus.cc:740] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:39.348613 24042 consensus_queue.cc:260] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:39.350034 24042 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.354223 24116 raft_consensus.cc:2468] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 2.
I20260709 13:07:39.355413 24155 leader_election.cc:304] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:39.356191 24238 raft_consensus.cc:2804] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.356557 24042 raft_consensus.cc:2468] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 2.
I20260709 13:07:39.357280 24238 raft_consensus.cc:697] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:39.358168 24238 consensus_queue.cc:237] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:39.365799 23940 catalog_manager.cc:5697] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 1 to 2, leader changed from ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129) to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.565474 24327 raft_consensus.cc:993] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129: : Instructing follower b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:39.565927 24331 raft_consensus.cc:1081] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Signalling peer b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:39.567621 24190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:37484
I20260709 13:07:39.568238 24190 raft_consensus.cc:493] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.568645 24190 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.576475 24190 raft_consensus.cc:515] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:39.578749 24190 leader_election.cc:290] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 2 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:39.579819 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:39.580389 24042 raft_consensus.cc:3055] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:39.580709 24042 raft_consensus.cc:740] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:39.581063 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:39.581629 24116 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.581497 24042 consensus_queue.cc:260] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:39.582728 24042 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:39.588351 24116 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 2.
I20260709 13:07:39.589330 24042 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 2.
I20260709 13:07:39.589509 24155 leader_election.cc:304] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:39.590821 24238 raft_consensus.cc:2804] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:39.591279 24238 raft_consensus.cc:697] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:39.592061 24238 consensus_queue.cc:237] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:39.602943 23940 catalog_manager.cc:5697] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 1 to 2, leader changed from ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129) to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.755313 24116 raft_consensus.cc:1275] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.756481 24238 consensus_queue.cc:1048] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.765763 24042 raft_consensus.cc:1275] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.767324 24332 consensus_queue.cc:1048] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:40.088694 24042 raft_consensus.cc:1275] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:40.089969 24332 consensus_queue.cc:1048] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:40.098984 24116 raft_consensus.cc:1275] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:40.100814 24238 consensus_queue.cc:1048] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:40.210377 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:40.224792 24190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
mode: GRACEFUL
new_leader_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:07:40.225273 24190 raft_consensus.cc:606] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Received request to transfer leadership to TS ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:40.232547 24190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
mode: GRACEFUL
new_leader_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:37486
I20260709 13:07:40.232980 24190 raft_consensus.cc:606] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Received request to transfer leadership to TS ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:40.237239 24116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a"
dest_uuid: "107d690694944a0db9d7541fc7d672db"
mode: GRACEFUL
new_leader_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:07:40.237986 24116 raft_consensus.cc:606] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Received request to transfer leadership to TS ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:40.242774 24116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "719558de58d441c59275f27353019719"
dest_uuid: "107d690694944a0db9d7541fc7d672db"
mode: GRACEFUL
new_leader_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:07:40.243346 24116 raft_consensus.cc:606] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Received request to transfer leadership to TS ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:40.247898 24116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc19280eec3a4864b53c5cbd4a7d0b55"
dest_uuid: "107d690694944a0db9d7541fc7d672db"
mode: GRACEFUL
new_leader_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:07:40.248423 24116 raft_consensus.cc:606] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Received request to transfer leadership to TS ed62d27738a6442f9c06b53fc2e60129
I20260709 13:07:40.297206 24346 raft_consensus.cc:993] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3: : Instructing follower ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.297705 24238 raft_consensus.cc:1081] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Signalling peer ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.299274 24042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:47544
I20260709 13:07:40.299824 24042 raft_consensus.cc:493] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.300243 24042 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.304800 24042 raft_consensus.cc:515] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.306386 24042 leader_election.cc:290] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 3 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:40.307194 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:40.307367 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e0e796d2d647d3a27da79e0c852568" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:40.307760 24116 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.307853 24190 raft_consensus.cc:3055] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:40.308158 24190 raft_consensus.cc:740] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:40.308872 24190 consensus_queue.cc:260] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.309954 24190 raft_consensus.cc:3060] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.314180 24116 raft_consensus.cc:2468] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 3.
I20260709 13:07:40.315258 24006 leader_election.cc:304] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:40.316035 24190 raft_consensus.cc:2468] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 3.
I20260709 13:07:40.316056 24331 raft_consensus.cc:2804] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:40.316609 24331 raft_consensus.cc:697] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:40.317363 24331 consensus_queue.cc:237] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.322954 23941 catalog_manager.cc:5697] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 2 to 3, leader changed from b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131) to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 3 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.416715 24328 raft_consensus.cc:993] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db: : Instructing follower ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.417171 24351 raft_consensus.cc:1081] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Signalling peer ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.418534 24042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:47556
I20260709 13:07:40.418998 24042 raft_consensus.cc:493] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.419287 24042 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.423650 24042 raft_consensus.cc:515] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.425398 24042 leader_election.cc:290] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 3 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:40.426051 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:40.426275 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f8d25f2334413fb0fa7bfc06b5670a" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:40.426669 24116 raft_consensus.cc:3055] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:40.426769 24190 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.426978 24116 raft_consensus.cc:740] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:40.427747 24116 consensus_queue.cc:260] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.428620 24116 raft_consensus.cc:3060] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.431241 24190 raft_consensus.cc:2468] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 3.
I20260709 13:07:40.432183 24008 leader_election.cc:304] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:40.432860 24331 raft_consensus.cc:2804] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:40.433022 24116 raft_consensus.cc:2468] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 3.
I20260709 13:07:40.433370 24331 raft_consensus.cc:697] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:40.434209 24331 consensus_queue.cc:237] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.440340 23941 catalog_manager.cc:5697] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 2 to 3, leader changed from 107d690694944a0db9d7541fc7d672db (127.22.225.130) to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 3 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.486317 24328 raft_consensus.cc:993] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db: : Instructing follower ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.486778 24351 raft_consensus.cc:1081] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Signalling peer ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.488171 24042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "719558de58d441c59275f27353019719"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:47556
I20260709 13:07:40.488575 24042 raft_consensus.cc:493] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.488829 24042 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.492585 24042 raft_consensus.cc:515] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.493933 24042 leader_election.cc:290] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 3 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:40.494935 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:40.494956 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:40.495438 24190 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.495550 24116 raft_consensus.cc:3055] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:40.495913 24116 raft_consensus.cc:740] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:40.496560 24116 consensus_queue.cc:260] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.497581 24116 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.500414 24190 raft_consensus.cc:2468] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 3.
I20260709 13:07:40.501318 24008 leader_election.cc:304] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:40.502208 24331 raft_consensus.cc:2804] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:40.502681 24331 raft_consensus.cc:697] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:40.503592 24116 raft_consensus.cc:2468] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 3.
I20260709 13:07:40.503408 24331 consensus_queue.cc:237] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.509451 23941 catalog_manager.cc:5697] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 2 to 3, leader changed from 107d690694944a0db9d7541fc7d672db (127.22.225.130) to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 3 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.526769 24346 raft_consensus.cc:993] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3: : Instructing follower ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.527343 24238 raft_consensus.cc:1081] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Signalling peer ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.529428 24042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:47544
I20260709 13:07:40.529979 24042 raft_consensus.cc:493] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.530330 24042 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.535254 24042 raft_consensus.cc:515] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.536610 24042 leader_election.cc:290] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 3 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:40.537467 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:40.537933 24116 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.538254 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:40.538764 24190 raft_consensus.cc:3055] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:40.539059 24190 raft_consensus.cc:740] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:40.539742 24190 consensus_queue.cc:260] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.540795 24190 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:40.542891 24116 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 3.
I20260709 13:07:40.543844 24006 leader_election.cc:304] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:40.544556 24331 raft_consensus.cc:2804] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:40.544968 24331 raft_consensus.cc:697] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:40.545027 24190 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 3.
I20260709 13:07:40.545904 24331 consensus_queue.cc:237] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.551401 23941 catalog_manager.cc:5697] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 2 to 3, leader changed from b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131) to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 3 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.698802 24328 raft_consensus.cc:993] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db: : Instructing follower ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.699229 24351 raft_consensus.cc:1081] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Signalling peer ed62d27738a6442f9c06b53fc2e60129 to start an election
I20260709 13:07:40.700464 24042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc19280eec3a4864b53c5cbd4a7d0b55"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
 from {username='slave'} at 127.0.0.1:47556
I20260709 13:07:40.700820 24042 raft_consensus.cc:493] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:40.701030 24042 raft_consensus.cc:3060] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:40.704756 24042 raft_consensus.cc:515] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.706127 24042 leader_election.cc:290] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 2 election: Requested vote from peers 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:40.706867 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc19280eec3a4864b53c5cbd4a7d0b55" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:40.707190 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc19280eec3a4864b53c5cbd4a7d0b55" candidate_uuid: "ed62d27738a6442f9c06b53fc2e60129" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:40.707449 24116 raft_consensus.cc:3055] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:40.707672 24190 raft_consensus.cc:3060] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:40.707793 24116 raft_consensus.cc:740] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:40.708590 24116 consensus_queue.cc:260] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.709745 24116 raft_consensus.cc:3060] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:40.713717 24190 raft_consensus.cc:2468] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 2.
I20260709 13:07:40.714707 24008 leader_election.cc:304] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9fcec07431c47adb184dc91ad9069a3, ed62d27738a6442f9c06b53fc2e60129; no voters: 
I20260709 13:07:40.715363 24331 raft_consensus.cc:2804] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:40.715798 24116 raft_consensus.cc:2468] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed62d27738a6442f9c06b53fc2e60129 in term 2.
I20260709 13:07:40.715878 24331 raft_consensus.cc:697] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Becoming Leader. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:40.716807 24331 consensus_queue.cc:237] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:40.722868 23941 catalog_manager.cc:5697] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 reported cstate change: term changed from 1 to 2, leader changed from 107d690694944a0db9d7541fc7d672db (127.22.225.130) to ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129). New cstate: current_term: 2 leader_uuid: "ed62d27738a6442f9c06b53fc2e60129" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.774183 24116 raft_consensus.cc:1275] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:40.775378 24331 consensus_queue.cc:1048] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:40.784515 24190 raft_consensus.cc:1275] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:40.785956 24331 consensus_queue.cc:1048] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:40.834594 24190 raft_consensus.cc:1275] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:40.835911 24331 consensus_queue.cc:1048] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:40.845203 24116 raft_consensus.cc:1275] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:40.846827 24327 consensus_queue.cc:1048] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:41.022905 24116 raft_consensus.cc:1275] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:41.024247 24327 consensus_queue.cc:1048] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:41.033861 24190 raft_consensus.cc:1275] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:41.036267 24363 consensus_queue.cc:1048] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:41.059027 24190 raft_consensus.cc:1275] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:41.060209 24363 consensus_queue.cc:1048] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:41.068452 24116 raft_consensus.cc:1275] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:41.069865 24363 consensus_queue.cc:1048] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:41.173913 24116 raft_consensus.cc:1275] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:41.175043 24363 consensus_queue.cc:1048] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:41.183087 24191 raft_consensus.cc:1275] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Refusing update from remote peer ed62d27738a6442f9c06b53fc2e60129: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:41.184653 24331 consensus_queue.cc:1048] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.255537 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:43.263298 24042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b7875b090eb42268d9ea12bff690af6"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
mode: GRACEFUL
new_leader_uuid: "107d690694944a0db9d7541fc7d672db"
 from {username='slave'} at 127.0.0.1:47564
I20260709 13:07:43.263954 24042 raft_consensus.cc:606] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Received request to transfer leadership to TS 107d690694944a0db9d7541fc7d672db
I20260709 13:07:43.266520 24042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41aea863779546f5955735458a1178d3"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
mode: GRACEFUL
new_leader_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:47564
I20260709 13:07:43.266937 24042 raft_consensus.cc:606] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Received request to transfer leadership to TS b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:43.269066 24042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "719558de58d441c59275f27353019719"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
mode: GRACEFUL
new_leader_uuid: "107d690694944a0db9d7541fc7d672db"
 from {username='slave'} at 127.0.0.1:47564
I20260709 13:07:43.269511 24042 raft_consensus.cc:606] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Received request to transfer leadership to TS 107d690694944a0db9d7541fc7d672db
I20260709 13:07:43.271488 24042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6"
dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
mode: GRACEFUL
new_leader_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:47564
I20260709 13:07:43.271881 24042 raft_consensus.cc:606] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Received request to transfer leadership to TS b9fcec07431c47adb184dc91ad9069a3
I20260709 13:07:43.272812 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:43.273288 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:43.504065 24361 raft_consensus.cc:993] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129: : Instructing follower b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:43.505163 24369 raft_consensus.cc:1081] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Signalling peer b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:43.507066 24190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:37484
I20260709 13:07:43.507697 24190 raft_consensus.cc:493] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.508038 24190 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.513935 24190 raft_consensus.cc:515] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.516165 24190 leader_election.cc:290] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 4 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:43.516779 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:43.517558 24042 raft_consensus.cc:3055] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:43.517693 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b0326ba8c4edeb148bb8618f8d7f6" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:43.517880 24042 raft_consensus.cc:740] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:43.518229 24116 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.518756 24042 consensus_queue.cc:260] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.520062 24042 raft_consensus.cc:3060] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.525035 24116 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 4.
I20260709 13:07:43.526407 24155 leader_election.cc:304] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:43.526805 24042 raft_consensus.cc:2468] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 4.
I20260709 13:07:43.527438 24238 raft_consensus.cc:2804] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:43.528347 24238 raft_consensus.cc:697] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 4 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:43.529234 24238 consensus_queue.cc:237] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.536301 23941 catalog_manager.cc:5697] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 3 to 4, leader changed from ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129) to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 4 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.538743 24361 raft_consensus.cc:993] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129: : Instructing follower b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:43.539345 24369 raft_consensus.cc:1081] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Signalling peer b9fcec07431c47adb184dc91ad9069a3 to start an election
I20260709 13:07:43.541270 24190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41aea863779546f5955735458a1178d3"
dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
 from {username='slave'} at 127.0.0.1:37484
I20260709 13:07:43.541720 24190 raft_consensus.cc:493] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.542006 24190 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.548269 24190 raft_consensus.cc:515] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.551122 24190 leader_election.cc:290] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 3 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309)
I20260709 13:07:43.551245 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41aea863779546f5955735458a1178d3" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:43.551488 24116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41aea863779546f5955735458a1178d3" candidate_uuid: "b9fcec07431c47adb184dc91ad9069a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "107d690694944a0db9d7541fc7d672db"
I20260709 13:07:43.551859 24042 raft_consensus.cc:3055] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:43.551963 24116 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.552188 24042 raft_consensus.cc:740] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:43.553020 24042 consensus_queue.cc:260] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.554164 24042 raft_consensus.cc:3060] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:43.558138 24116 raft_consensus.cc:2468] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 3.
I20260709 13:07:43.559089 24155 leader_election.cc:304] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:43.559762 24238 raft_consensus.cc:2804] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:43.559877 24042 raft_consensus.cc:2468] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9fcec07431c47adb184dc91ad9069a3 in term 3.
I20260709 13:07:43.560201 24238 raft_consensus.cc:697] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 3 LEADER]: Becoming Leader. State: Replica: b9fcec07431c47adb184dc91ad9069a3, State: Running, Role: LEADER
I20260709 13:07:43.560992 24238 consensus_queue.cc:237] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.567684 23941 catalog_manager.cc:5697] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 reported cstate change: term changed from 2 to 3, leader changed from ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129) to b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "b9fcec07431c47adb184dc91ad9069a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.580068 24361 raft_consensus.cc:993] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129: : Instructing follower 107d690694944a0db9d7541fc7d672db to start an election
I20260709 13:07:43.580480 24369 raft_consensus.cc:1081] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Signalling peer 107d690694944a0db9d7541fc7d672db to start an election
I20260709 13:07:43.581950 24116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b7875b090eb42268d9ea12bff690af6"
dest_uuid: "107d690694944a0db9d7541fc7d672db"
 from {username='slave'} at 127.0.0.1:41286
I20260709 13:07:43.582397 24116 raft_consensus.cc:493] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.582670 24116 raft_consensus.cc:3060] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.586843 24116 raft_consensus.cc:515] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.588357 24116 leader_election.cc:290] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 2 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:43.589133 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7875b090eb42268d9ea12bff690af6" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:43.589481 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b7875b090eb42268d9ea12bff690af6" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:43.589670 24042 raft_consensus.cc:3055] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.589979 24190 raft_consensus.cc:3060] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.589979 24042 raft_consensus.cc:740] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:43.590986 24042 consensus_queue.cc:260] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.592095 24042 raft_consensus.cc:3060] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.596400 24190 raft_consensus.cc:2468] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 2.
I20260709 13:07:43.597739 24083 leader_election.cc:304] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:43.597975 24042 raft_consensus.cc:2468] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 2.
I20260709 13:07:43.598594 24351 raft_consensus.cc:2804] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.599637 24351 raft_consensus.cc:697] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Becoming Leader. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:43.600498 24351 consensus_queue.cc:237] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.606967 23941 catalog_manager.cc:5697] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db reported cstate change: term changed from 1 to 2, leader changed from ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129) to 107d690694944a0db9d7541fc7d672db (127.22.225.130). New cstate: current_term: 2 leader_uuid: "107d690694944a0db9d7541fc7d672db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.725394 24361 raft_consensus.cc:993] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129: : Instructing follower 107d690694944a0db9d7541fc7d672db to start an election
I20260709 13:07:43.725808 24361 raft_consensus.cc:1081] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Signalling peer 107d690694944a0db9d7541fc7d672db to start an election
I20260709 13:07:43.727094 24116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "719558de58d441c59275f27353019719"
dest_uuid: "107d690694944a0db9d7541fc7d672db"
 from {username='slave'} at 127.0.0.1:41286
I20260709 13:07:43.727517 24116 raft_consensus.cc:493] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.727780 24116 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.731817 24116 raft_consensus.cc:515] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.733098 24116 leader_election.cc:290] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 4 election: Requested vote from peers ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375), b9fcec07431c47adb184dc91ad9069a3 (127.22.225.131:44147)
I20260709 13:07:43.733920 24042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ed62d27738a6442f9c06b53fc2e60129"
I20260709 13:07:43.734248 24190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719558de58d441c59275f27353019719" candidate_uuid: "107d690694944a0db9d7541fc7d672db" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9fcec07431c47adb184dc91ad9069a3"
I20260709 13:07:43.734458 24042 raft_consensus.cc:3055] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:43.734726 24190 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.734743 24042 raft_consensus.cc:740] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed62d27738a6442f9c06b53fc2e60129, State: Running, Role: LEADER
I20260709 13:07:43.735622 24042 consensus_queue.cc:260] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.736771 24042 raft_consensus.cc:3060] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:43.741122 24190 raft_consensus.cc:2468] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 4.
I20260709 13:07:43.742229 24083 leader_election.cc:304] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 107d690694944a0db9d7541fc7d672db, b9fcec07431c47adb184dc91ad9069a3; no voters: 
I20260709 13:07:43.743017 24042 raft_consensus.cc:2468] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 107d690694944a0db9d7541fc7d672db in term 4.
I20260709 13:07:43.743156 24351 raft_consensus.cc:2804] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:43.743692 24351 raft_consensus.cc:697] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 4 LEADER]: Becoming Leader. State: Replica: 107d690694944a0db9d7541fc7d672db, State: Running, Role: LEADER
I20260709 13:07:43.744556 24351 consensus_queue.cc:237] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } }
I20260709 13:07:43.750828 23941 catalog_manager.cc:5697] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db reported cstate change: term changed from 3 to 4, leader changed from ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129) to 107d690694944a0db9d7541fc7d672db (127.22.225.130). New cstate: current_term: 4 leader_uuid: "107d690694944a0db9d7541fc7d672db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.979259 24042 raft_consensus.cc:1275] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Refusing update from remote peer 107d690694944a0db9d7541fc7d672db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.980383 24351 consensus_queue.cc:1048] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.993233 24190 raft_consensus.cc:1275] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Refusing update from remote peer 107d690694944a0db9d7541fc7d672db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.994575 24378 consensus_queue.cc:1048] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:43.999431 24042 raft_consensus.cc:1275] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 4 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:44.001571 24371 consensus_queue.cc:1048] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:44.013852 24116 raft_consensus.cc:1275] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 4 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:44.015434 24238 consensus_queue.cc:1048] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.073982 24043 raft_consensus.cc:1275] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:44.075198 24238 consensus_queue.cc:1048] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:44.084092 24116 raft_consensus.cc:1275] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Refusing update from remote peer b9fcec07431c47adb184dc91ad9069a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:44.085537 24371 consensus_queue.cc:1048] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "107d690694944a0db9d7541fc7d672db" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 34309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:44.248589 24043 raft_consensus.cc:1275] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 4 FOLLOWER]: Refusing update from remote peer 107d690694944a0db9d7541fc7d672db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:44.249915 24378 consensus_queue.cc:1048] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed62d27738a6442f9c06b53fc2e60129" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 35375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.258687 24190 raft_consensus.cc:1275] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 4 FOLLOWER]: Refusing update from remote peer 107d690694944a0db9d7541fc7d672db: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:44.260083 24351 consensus_queue.cc:1048] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9fcec07431c47adb184dc91ad9069a3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.274024 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:44.279587 23430 tablet_server.cc:179] TabletServer@127.22.225.129:0 shutting down...
W20260709 13:07:44.284279 24083 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:07:44.288357 24083 consensus_peers.cc:597] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db -> Peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Couldn't send request to peer ed62d27738a6442f9c06b53fc2e60129. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.306725 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:44.307451 23430 tablet_replica.cc:333] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.308018 23430 raft_consensus.cc:2243] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.308496 23430 raft_consensus.cc:2272] T 05aa17ebe1f24f18ac072293c54b485e P ed62d27738a6442f9c06b53fc2e60129 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.310402 23430 tablet_replica.cc:333] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.310923 23430 raft_consensus.cc:2243] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.311667 23430 raft_consensus.cc:2272] T 17f158725451402bb9cc7a8ef31bd326 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.313402 23430 tablet_replica.cc:333] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.313925 23430 raft_consensus.cc:2243] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.314296 23430 raft_consensus.cc:2272] T 719558de58d441c59275f27353019719 P ed62d27738a6442f9c06b53fc2e60129 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.316581 23430 tablet_replica.cc:333] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.317130 23430 raft_consensus.cc:2243] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.317840 23430 raft_consensus.cc:2272] T d6f8d25f2334413fb0fa7bfc06b5670a P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.319434 23430 tablet_replica.cc:333] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.319902 23430 raft_consensus.cc:2243] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.320616 23430 raft_consensus.cc:2272] T fc19280eec3a4864b53c5cbd4a7d0b55 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.322821 23430 tablet_replica.cc:333] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.323468 23430 raft_consensus.cc:2243] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.323925 23430 raft_consensus.cc:2272] T c98b0326ba8c4edeb148bb8618f8d7f6 P ed62d27738a6442f9c06b53fc2e60129 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.326118 23430 tablet_replica.cc:333] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.326547 23430 raft_consensus.cc:2243] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.327195 23430 raft_consensus.cc:2272] T 28e0e796d2d647d3a27da79e0c852568 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.328806 23430 tablet_replica.cc:333] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.329276 23430 raft_consensus.cc:2243] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.329591 23430 raft_consensus.cc:2272] T 09fec738c86b43ec9c0696fdb3161451 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.331342 23430 tablet_replica.cc:333] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.331753 23430 raft_consensus.cc:2243] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.332072 23430 raft_consensus.cc:2272] T 2b7875b090eb42268d9ea12bff690af6 P ed62d27738a6442f9c06b53fc2e60129 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.333992 23430 tablet_replica.cc:333] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129: stopping tablet replica
I20260709 13:07:44.334378 23430 raft_consensus.cc:2243] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.334693 23430 raft_consensus.cc:2272] T 41aea863779546f5955735458a1178d3 P ed62d27738a6442f9c06b53fc2e60129 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.363219 23430 tablet_server.cc:196] TabletServer@127.22.225.129:0 shutdown complete.
W20260709 13:07:44.369969 24157 consensus_peers.cc:597] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 -> Peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Couldn't send request to peer ed62d27738a6442f9c06b53fc2e60129. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:35375: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.388381 23430 tablet_server.cc:179] TabletServer@127.22.225.130:0 shutting down...
I20260709 13:07:44.410946 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:44.411583 23430 tablet_replica.cc:333] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.412245 23430 raft_consensus.cc:2243] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.413147 23430 raft_consensus.cc:2272] T 05aa17ebe1f24f18ac072293c54b485e P 107d690694944a0db9d7541fc7d672db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.414913 23430 tablet_replica.cc:333] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.415463 23430 raft_consensus.cc:2243] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.415992 23430 raft_consensus.cc:2272] T fc19280eec3a4864b53c5cbd4a7d0b55 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.417887 23430 tablet_replica.cc:333] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.418448 23430 raft_consensus.cc:2243] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.418901 23430 raft_consensus.cc:2272] T 09fec738c86b43ec9c0696fdb3161451 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.420714 23430 tablet_replica.cc:333] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.421344 23430 raft_consensus.cc:2243] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:44.421429 24083 consensus_peers.cc:597] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db -> Peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Couldn't send request to peer ed62d27738a6442f9c06b53fc2e60129. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:35375: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.421800 23430 raft_consensus.cc:2272] T 41aea863779546f5955735458a1178d3 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.423892 23430 tablet_replica.cc:333] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.424368 23430 raft_consensus.cc:2243] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.425021 23430 raft_consensus.cc:2272] T 719558de58d441c59275f27353019719 P 107d690694944a0db9d7541fc7d672db [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.427064 23430 tablet_replica.cc:333] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.427542 23430 raft_consensus.cc:2243] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.427932 23430 raft_consensus.cc:2272] T d6f8d25f2334413fb0fa7bfc06b5670a P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.429965 23430 tablet_replica.cc:333] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.430581 23430 raft_consensus.cc:2243] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.431245 23430 raft_consensus.cc:2272] T 2b7875b090eb42268d9ea12bff690af6 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:44.432161 24155 consensus_peers.cc:597] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 -> Peer 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309): Couldn't send request to peer 107d690694944a0db9d7541fc7d672db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.433255 23430 tablet_replica.cc:333] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.433733 23430 raft_consensus.cc:2243] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.434092 23430 raft_consensus.cc:2272] T c98b0326ba8c4edeb148bb8618f8d7f6 P 107d690694944a0db9d7541fc7d672db [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.435881 23430 tablet_replica.cc:333] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.436331 23430 raft_consensus.cc:2243] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.436721 23430 raft_consensus.cc:2272] T 28e0e796d2d647d3a27da79e0c852568 P 107d690694944a0db9d7541fc7d672db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.438215 23430 tablet_replica.cc:333] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db: stopping tablet replica
I20260709 13:07:44.438633 23430 raft_consensus.cc:2243] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.439023 23430 raft_consensus.cc:2272] T 17f158725451402bb9cc7a8ef31bd326 P 107d690694944a0db9d7541fc7d672db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:44.450362 24157 consensus_peers.cc:597] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 -> Peer ed62d27738a6442f9c06b53fc2e60129 (127.22.225.129:35375): Couldn't send request to peer ed62d27738a6442f9c06b53fc2e60129. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:35375: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.492376 23430 tablet_server.cc:196] TabletServer@127.22.225.130:0 shutdown complete.
I20260709 13:07:44.509845 23430 tablet_server.cc:179] TabletServer@127.22.225.131:0 shutting down...
W20260709 13:07:44.524884 24155 consensus_peers.cc:597] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 -> Peer 107d690694944a0db9d7541fc7d672db (127.22.225.130:34309): Couldn't send request to peer 107d690694944a0db9d7541fc7d672db. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:34309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.537226 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:44.537791 23430 tablet_replica.cc:333] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.538406 23430 raft_consensus.cc:2243] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.538897 23430 raft_consensus.cc:2272] T 17f158725451402bb9cc7a8ef31bd326 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.540678 23430 tablet_replica.cc:333] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.541235 23430 raft_consensus.cc:2243] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.541957 23430 raft_consensus.cc:2272] T 09fec738c86b43ec9c0696fdb3161451 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.543569 23430 tablet_replica.cc:333] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.544102 23430 raft_consensus.cc:2243] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.544526 23430 raft_consensus.cc:2272] T fc19280eec3a4864b53c5cbd4a7d0b55 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.546104 23430 tablet_replica.cc:333] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.546571 23430 raft_consensus.cc:2243] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.546947 23430 raft_consensus.cc:2272] T 2b7875b090eb42268d9ea12bff690af6 P b9fcec07431c47adb184dc91ad9069a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.548759 23430 tablet_replica.cc:333] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.549309 23430 raft_consensus.cc:2243] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.550031 23430 raft_consensus.cc:2272] T c98b0326ba8c4edeb148bb8618f8d7f6 P b9fcec07431c47adb184dc91ad9069a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.551828 23430 tablet_replica.cc:333] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.552289 23430 raft_consensus.cc:2243] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.552665 23430 raft_consensus.cc:2272] T 28e0e796d2d647d3a27da79e0c852568 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.554196 23430 tablet_replica.cc:333] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.554648 23430 raft_consensus.cc:2243] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.555065 23430 raft_consensus.cc:2272] T d6f8d25f2334413fb0fa7bfc06b5670a P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.556537 23430 tablet_replica.cc:333] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.556977 23430 raft_consensus.cc:2243] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.557431 23430 raft_consensus.cc:2272] T 719558de58d441c59275f27353019719 P b9fcec07431c47adb184dc91ad9069a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.559136 23430 tablet_replica.cc:333] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.559569 23430 raft_consensus.cc:2243] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.559965 23430 raft_consensus.cc:2272] T 05aa17ebe1f24f18ac072293c54b485e P b9fcec07431c47adb184dc91ad9069a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.561619 23430 tablet_replica.cc:333] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3: stopping tablet replica
I20260709 13:07:44.562038 23430 raft_consensus.cc:2243] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.562705 23430 raft_consensus.cc:2272] T 41aea863779546f5955735458a1178d3 P b9fcec07431c47adb184dc91ad9069a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.589244 23430 tablet_server.cc:196] TabletServer@127.22.225.131:0 shutdown complete.
I20260709 13:07:44.606596 23430 master.cc:562] Master@127.22.225.190:40245 shutting down...
I20260709 13:07:44.627633 23430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:44.628103 23430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.628373 23430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 678c697893c445128983655fb98218e5: stopping tablet replica
I20260709 13:07:44.647928 23430 master.cc:584] Master@127.22.225.190:40245 shutdown complete.
107d690694944a0db9d7541fc7d672db  4
b9fcec07431c47adb184dc91ad9069a3  1
ed62d27738a6442f9c06b53fc2e60129  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10696 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:07:44.685556 23430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.225.190:40709
I20260709 13:07:44.686673 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:44.692230 24398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:44.692919 24399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:44.694070 24401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:44.695015 23430 server_base.cc:1061] running on GCE node
I20260709 13:07:44.696147 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:44.696373 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:44.696544 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602464696518 us; error 0 us; skew 500 ppm
I20260709 13:07:44.697513 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:44.700941 23430 webserver.cc:533] Webserver started at http://127.22.225.190:42131/ using document root <none> and password file <none>
I20260709 13:07:44.702230 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:44.702459 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:44.703037 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:44.704789 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/master-0-root/instance:
uuid: "7c40b21f34414599bc4c7e2b5c7f524d"
format_stamp: "Formatted at 2026-07-09 13:07:44 on dist-test-slave-fx0m"
I20260709 13:07:44.711654 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:44.716547 24406 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:44.717530 23430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:44.717917 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/master-0-root
uuid: "7c40b21f34414599bc4c7e2b5c7f524d"
format_stamp: "Formatted at 2026-07-09 13:07:44 on dist-test-slave-fx0m"
I20260709 13:07:44.718273 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:44.745393 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:44.746598 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:44.784237 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.190:40709
I20260709 13:07:44.784336 24457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.190:40709 every 8 connection(s)
I20260709 13:07:44.788856 24458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:44.798171 24458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Bootstrap starting.
I20260709 13:07:44.802506 24458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:44.806475 24458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: No bootstrap required, opened a new log
I20260709 13:07:44.808566 24458 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c40b21f34414599bc4c7e2b5c7f524d" member_type: VOTER }
I20260709 13:07:44.808964 24458 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:44.809209 24458 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c40b21f34414599bc4c7e2b5c7f524d, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.809837 24458 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c40b21f34414599bc4c7e2b5c7f524d" member_type: VOTER }
I20260709 13:07:44.810276 24458 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:44.810496 24458 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:44.810751 24458 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:44.814865 24458 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c40b21f34414599bc4c7e2b5c7f524d" member_type: VOTER }
I20260709 13:07:44.815364 24458 leader_election.cc:304] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c40b21f34414599bc4c7e2b5c7f524d; no voters: 
I20260709 13:07:44.816468 24458 leader_election.cc:290] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:44.816859 24461 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:44.818209 24461 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 1 LEADER]: Becoming Leader. State: Replica: 7c40b21f34414599bc4c7e2b5c7f524d, State: Running, Role: LEADER
I20260709 13:07:44.818799 24461 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c40b21f34414599bc4c7e2b5c7f524d" member_type: VOTER }
I20260709 13:07:44.819339 24458 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:44.823233 24462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c40b21f34414599bc4c7e2b5c7f524d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c40b21f34414599bc4c7e2b5c7f524d" member_type: VOTER } }
I20260709 13:07:44.823841 24462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:44.824405 24463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c40b21f34414599bc4c7e2b5c7f524d. Latest consensus state: current_term: 1 leader_uuid: "7c40b21f34414599bc4c7e2b5c7f524d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c40b21f34414599bc4c7e2b5c7f524d" member_type: VOTER } }
I20260709 13:07:44.825112 24463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:44.828095 24468 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:44.832754 24468 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:44.836424 23430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:44.840907 24468 catalog_manager.cc:1383] Generated new cluster ID: a85cbe3c3dda40bab63ccabd5a39ad1a
I20260709 13:07:44.841187 24468 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:44.865448 24468 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:44.866691 24468 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:44.881595 24468 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Generated new TSK 0
I20260709 13:07:44.882263 24468 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:44.902554 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:44.908298 24479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:44.909426 24480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:44.911378 23430 server_base.cc:1061] running on GCE node
W20260709 13:07:44.911339 24482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:44.912478 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:44.912700 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:44.912855 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602464912836 us; error 0 us; skew 500 ppm
I20260709 13:07:44.913425 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:44.915565 23430 webserver.cc:533] Webserver started at http://127.22.225.129:39103/ using document root <none> and password file <none>
I20260709 13:07:44.916030 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:44.916227 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:44.916493 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:44.917587 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/instance:
uuid: "0131806e3b9647128f32db1ab8d314fc"
format_stamp: "Formatted at 2026-07-09 13:07:44 on dist-test-slave-fx0m"
I20260709 13:07:44.922040 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:07:44.925019 24487 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:44.925976 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:44.926247 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "0131806e3b9647128f32db1ab8d314fc"
format_stamp: "Formatted at 2026-07-09 13:07:44 on dist-test-slave-fx0m"
I20260709 13:07:44.926535 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:44.949304 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:44.950536 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:44.951987 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:44.954236 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:44.954445 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:44.954687 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:44.954871 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:44.993323 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:45343
I20260709 13:07:44.993424 24549 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:45343 every 8 connection(s)
I20260709 13:07:44.998136 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:45.004928 24554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:45.005326 24555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:45.010181 23430 server_base.cc:1061] running on GCE node
W20260709 13:07:45.011233 24557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:45.011569 24550 heartbeater.cc:344] Connected to a master server at 127.22.225.190:40709
I20260709 13:07:45.012019 24550 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:45.012396 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:45.012641 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:45.012842 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602465012824 us; error 0 us; skew 500 ppm
I20260709 13:07:45.012892 24550 heartbeater.cc:507] Master 127.22.225.190:40709 requested a full tablet report, sending...
I20260709 13:07:45.013633 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:45.015285 24423 ts_manager.cc:194] Registered new tserver with Master: 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:07:45.016340 23430 webserver.cc:533] Webserver started at http://127.22.225.130:37607/ using document root <none> and password file <none>
I20260709 13:07:45.016976 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:45.017226 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:45.017508 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:45.017742 24423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41412
I20260709 13:07:45.018960 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/instance:
uuid: "96002c98f2d142e4b67dc5105a06079c"
format_stamp: "Formatted at 2026-07-09 13:07:45 on dist-test-slave-fx0m"
I20260709 13:07:45.023798 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:45.026995 24562 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:45.027767 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:07:45.028085 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root
uuid: "96002c98f2d142e4b67dc5105a06079c"
format_stamp: "Formatted at 2026-07-09 13:07:45 on dist-test-slave-fx0m"
I20260709 13:07:45.028445 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:45.042934 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:45.044202 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:45.046495 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:45.049631 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:45.049880 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:45.050146 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:45.050341 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:45.090545 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.130:39455
I20260709 13:07:45.090628 24624 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.130:39455 every 8 connection(s)
I20260709 13:07:45.095566 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:45.103539 24628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:45.104569 24629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:45.108002 24625 heartbeater.cc:344] Connected to a master server at 127.22.225.190:40709
I20260709 13:07:45.108462 24625 heartbeater.cc:461] Registering TS with master...
W20260709 13:07:45.109552 24631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:45.109598 24625 heartbeater.cc:507] Master 127.22.225.190:40709 requested a full tablet report, sending...
I20260709 13:07:45.110260 23430 server_base.cc:1061] running on GCE node
I20260709 13:07:45.111056 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:45.111285 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:45.111461 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602465111445 us; error 0 us; skew 500 ppm
I20260709 13:07:45.112147 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:45.112147 24423 ts_manager.cc:194] Registered new tserver with Master: 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:45.114080 24423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41426
I20260709 13:07:45.115008 23430 webserver.cc:533] Webserver started at http://127.22.225.131:36981/ using document root <none> and password file <none>
I20260709 13:07:45.115600 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:45.115840 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:45.116151 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:45.117400 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/instance:
uuid: "148dc963cec64232ad3b248abad6f36d"
format_stamp: "Formatted at 2026-07-09 13:07:45 on dist-test-slave-fx0m"
I20260709 13:07:45.121744 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:45.124893 24636 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:45.125653 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:45.125900 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root
uuid: "148dc963cec64232ad3b248abad6f36d"
format_stamp: "Formatted at 2026-07-09 13:07:45 on dist-test-slave-fx0m"
I20260709 13:07:45.126125 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:45.136528 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:45.137701 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:45.139017 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:45.141165 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:45.141336 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:45.141599 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:45.141738 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:45.179672 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.131:37451
I20260709 13:07:45.179859 24698 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.131:37451 every 8 connection(s)
I20260709 13:07:45.192705 24699 heartbeater.cc:344] Connected to a master server at 127.22.225.190:40709
I20260709 13:07:45.193181 24699 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:45.193940 24699 heartbeater.cc:507] Master 127.22.225.190:40709 requested a full tablet report, sending...
I20260709 13:07:45.195668 24423 ts_manager.cc:194] Registered new tserver with Master: 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:45.195812 23430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013200503s
I20260709 13:07:45.197024 24423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41442
I20260709 13:07:45.220821 24423 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41446:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:45.226833 24423 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:45.415957 24515 tablet_service.cc:1511] Processing CreateTablet for tablet 30a58475c1d54873be44217fc84b05ec (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:45.417519 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a58475c1d54873be44217fc84b05ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.418363 24589 tablet_service.cc:1511] Processing CreateTablet for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:45.419827 24589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.420481 24514 tablet_service.cc:1511] Processing CreateTablet for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:45.421862 24514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.425884 24590 tablet_service.cc:1511] Processing CreateTablet for tablet 30a58475c1d54873be44217fc84b05ec (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:45.427202 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a58475c1d54873be44217fc84b05ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.428174 24588 tablet_service.cc:1511] Processing CreateTablet for tablet cfe7903b435c45a4b85c164ecf24c14f (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:45.429672 24588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7903b435c45a4b85c164ecf24c14f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.430154 24513 tablet_service.cc:1511] Processing CreateTablet for tablet cfe7903b435c45a4b85c164ecf24c14f (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:45.431553 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7903b435c45a4b85c164ecf24c14f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.444952 24512 tablet_service.cc:1511] Processing CreateTablet for tablet e2fa80994624487d980c9d3ef7a166ce (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:45.446041 24664 tablet_service.cc:1511] Processing CreateTablet for tablet 30a58475c1d54873be44217fc84b05ec (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:45.446519 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2fa80994624487d980c9d3ef7a166ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.447415 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a58475c1d54873be44217fc84b05ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.448040 24587 tablet_service.cc:1511] Processing CreateTablet for tablet e2fa80994624487d980c9d3ef7a166ce (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:45.449839 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2fa80994624487d980c9d3ef7a166ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.450342 24663 tablet_service.cc:1511] Processing CreateTablet for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:45.451766 24663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.454340 24662 tablet_service.cc:1511] Processing CreateTablet for tablet cfe7903b435c45a4b85c164ecf24c14f (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:45.455727 24662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7903b435c45a4b85c164ecf24c14f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.461612 24661 tablet_service.cc:1511] Processing CreateTablet for tablet e2fa80994624487d980c9d3ef7a166ce (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:45.463428 24661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2fa80994624487d980c9d3ef7a166ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.485157 24511 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7e4efd4057430f8479100c05796bcf (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:45.486862 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7e4efd4057430f8479100c05796bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.486893 24586 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7e4efd4057430f8479100c05796bcf (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:45.489830 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7e4efd4057430f8479100c05796bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.491873 24660 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7e4efd4057430f8479100c05796bcf (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:45.493621 24660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7e4efd4057430f8479100c05796bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.507678 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 655be3d0d44f42a1aa683fd7271af488 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:45.509621 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655be3d0d44f42a1aa683fd7271af488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.518795 24714 tablet_bootstrap.cc:492] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:45.508946 24514 tablet_service.cc:1511] Processing CreateTablet for tablet 655be3d0d44f42a1aa683fd7271af488 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:45.521358 24514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655be3d0d44f42a1aa683fd7271af488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.524847 24714 tablet_bootstrap.cc:654] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.529028 24662 tablet_service.cc:1511] Processing CreateTablet for tablet 655be3d0d44f42a1aa683fd7271af488 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:45.530593 24662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655be3d0d44f42a1aa683fd7271af488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.549717 24515 tablet_service.cc:1511] Processing CreateTablet for tablet cee5aeb35a614558ad30ac67ec366dcf (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:45.551048 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee5aeb35a614558ad30ac67ec366dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.555416 24715 tablet_bootstrap.cc:492] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:45.567721 24586 tablet_service.cc:1511] Processing CreateTablet for tablet cee5aeb35a614558ad30ac67ec366dcf (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:45.568871 24664 tablet_service.cc:1511] Processing CreateTablet for tablet cee5aeb35a614558ad30ac67ec366dcf (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:45.570264 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee5aeb35a614558ad30ac67ec366dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.579142 24662 tablet_service.cc:1511] Processing CreateTablet for tablet bf2646e18c7042728614c4bbf5b867aa (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:45.580438 24662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2646e18c7042728614c4bbf5b867aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.570634 24714 tablet_bootstrap.cc:492] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:45.572878 24716 tablet_bootstrap.cc:492] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:45.584638 24714 ts_tablet_manager.cc:1403] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.004s
I20260709 13:07:45.587853 24714 raft_consensus.cc:359] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.588693 24714 raft_consensus.cc:385] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.589102 24714 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.590061 24714 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.590381 24514 tablet_service.cc:1511] Processing CreateTablet for tablet e6a2e9eb050b40f8b828d36d037224d8 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:45.572352 24715 tablet_bootstrap.cc:654] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.575378 24515 tablet_service.cc:1511] Processing CreateTablet for tablet bf2646e18c7042728614c4bbf5b867aa (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:45.591781 24514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a2e9eb050b40f8b828d36d037224d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.592408 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2646e18c7042728614c4bbf5b867aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.569051 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee5aeb35a614558ad30ac67ec366dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.576046 24587 tablet_service.cc:1511] Processing CreateTablet for tablet bf2646e18c7042728614c4bbf5b867aa (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:45.595342 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2646e18c7042728614c4bbf5b867aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.590698 24716 tablet_bootstrap.cc:654] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.609555 24715 tablet_bootstrap.cc:492] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:45.610102 24715 ts_tablet_manager.cc:1403] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.010s
I20260709 13:07:45.614365 24664 tablet_service.cc:1511] Processing CreateTablet for tablet e6a2e9eb050b40f8b828d36d037224d8 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:45.609117 24585 tablet_service.cc:1511] Processing CreateTablet for tablet e6a2e9eb050b40f8b828d36d037224d8 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:45.615770 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a2e9eb050b40f8b828d36d037224d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.616503 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a2e9eb050b40f8b828d36d037224d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.622217 24511 tablet_service.cc:1511] Processing CreateTablet for tablet 90e49b6f6ffd4dde98abdfd00821bc27 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:45.624055 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e49b6f6ffd4dde98abdfd00821bc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.622257 24715 raft_consensus.cc:359] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.626547 24587 tablet_service.cc:1511] Processing CreateTablet for tablet 90e49b6f6ffd4dde98abdfd00821bc27 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:45.626960 24660 tablet_service.cc:1511] Processing CreateTablet for tablet 90e49b6f6ffd4dde98abdfd00821bc27 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:45.625700 24715 raft_consensus.cc:385] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.629246 24715 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.629752 24660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e49b6f6ffd4dde98abdfd00821bc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.632156 24512 tablet_service.cc:1511] Processing CreateTablet for tablet 524d0087b4074f61ad31e7ba78ee8b99 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:45.633625 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524d0087b4074f61ad31e7ba78ee8b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.637379 24715 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.640156 24589 tablet_service.cc:1511] Processing CreateTablet for tablet 524d0087b4074f61ad31e7ba78ee8b99 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:45.642689 24661 tablet_service.cc:1511] Processing CreateTablet for tablet 524d0087b4074f61ad31e7ba78ee8b99 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:45.644074 24661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524d0087b4074f61ad31e7ba78ee8b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.647519 24513 tablet_service.cc:1511] Processing CreateTablet for tablet 45fddcc6d2bc4726a21bdfe31a4cae08 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:45.649029 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fddcc6d2bc4726a21bdfe31a4cae08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.644057 24714 ts_tablet_manager.cc:1434] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.005s
I20260709 13:07:45.658496 24716 tablet_bootstrap.cc:492] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:45.658994 24716 ts_tablet_manager.cc:1403] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.008s
I20260709 13:07:45.659489 24590 tablet_service.cc:1511] Processing CreateTablet for tablet 45fddcc6d2bc4726a21bdfe31a4cae08 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:45.662268 24716 raft_consensus.cc:359] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.663223 24716 raft_consensus.cc:385] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.663630 24716 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.668753 24714 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:45.668713 24550 heartbeater.cc:499] Master 127.22.225.190:40709 was elected leader, sending a full tablet report...
I20260709 13:07:45.673254 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e49b6f6ffd4dde98abdfd00821bc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.673935 24589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 524d0087b4074f61ad31e7ba78ee8b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.678793 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fddcc6d2bc4726a21bdfe31a4cae08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.678933 24625 heartbeater.cc:499] Master 127.22.225.190:40709 was elected leader, sending a full tablet report...
I20260709 13:07:45.680596 24714 tablet_bootstrap.cc:654] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.685194 24664 tablet_service.cc:1511] Processing CreateTablet for tablet 45fddcc6d2bc4726a21bdfe31a4cae08 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:45.689306 24715 ts_tablet_manager.cc:1434] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.079s	user 0.019s	sys 0.005s
I20260709 13:07:45.664546 24716 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.690271 24715 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:45.692004 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fddcc6d2bc4726a21bdfe31a4cae08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.701025 24716 ts_tablet_manager.cc:1434] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:07:45.701221 24715 tablet_bootstrap.cc:654] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.701843 24699 heartbeater.cc:499] Master 127.22.225.190:40709 was elected leader, sending a full tablet report...
I20260709 13:07:45.702184 24716 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:45.702953 24721 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.703435 24721 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.690177 24515 tablet_service.cc:1511] Processing CreateTablet for tablet 24de2d510450446080d67047a1f1eebe (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:45.721897 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 24de2d510450446080d67047a1f1eebe (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:45.722800 24661 tablet_service.cc:1511] Processing CreateTablet for tablet 24de2d510450446080d67047a1f1eebe (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:45.723407 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24de2d510450446080d67047a1f1eebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.725880 24586 tablet_service.cc:1511] Processing CreateTablet for tablet 182cc63718a84173a76583588f193929 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:45.727228 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182cc63718a84173a76583588f193929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.729244 24721 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:45.732754 24512 tablet_service.cc:1511] Processing CreateTablet for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:45.733547 24660 tablet_service.cc:1511] Processing CreateTablet for tablet 182cc63718a84173a76583588f193929 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:45.730242 24513 tablet_service.cc:1511] Processing CreateTablet for tablet 182cc63718a84173a76583588f193929 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:45.735756 24714 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:45.736310 24714 ts_tablet_manager.cc:1403] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.068s	user 0.004s	sys 0.007s
I20260709 13:07:45.724155 24661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24de2d510450446080d67047a1f1eebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.738217 24660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182cc63718a84173a76583588f193929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.742838 24714 raft_consensus.cc:359] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.743640 24714 raft_consensus.cc:385] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.743965 24714 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.748168 24662 tablet_service.cc:1511] Processing CreateTablet for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:45.758211 24662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.751693 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24de2d510450446080d67047a1f1eebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.765854 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.774483 24720 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.775039 24720 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.777448 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182cc63718a84173a76583588f193929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.775120 24511 tablet_service.cc:1511] Processing CreateTablet for tablet 5a74983bd9b34474a7cd38346edf8a64 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:45.782879 24716 tablet_bootstrap.cc:654] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.786029 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a74983bd9b34474a7cd38346edf8a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.787492 24590 tablet_service.cc:1511] Processing CreateTablet for tablet 5a74983bd9b34474a7cd38346edf8a64 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:45.788913 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a74983bd9b34474a7cd38346edf8a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.744773 24714 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.807301 24663 tablet_service.cc:1511] Processing CreateTablet for tablet 5a74983bd9b34474a7cd38346edf8a64 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:45.809406 24720 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:45.808972 24663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a74983bd9b34474a7cd38346edf8a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.815107 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 14e96ae54f3a4631bcabb789d2c4146c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:45.815927 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 14e96ae54f3a4631bcabb789d2c4146c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:45.816673 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e96ae54f3a4631bcabb789d2c4146c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.817454 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e96ae54f3a4631bcabb789d2c4146c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.837987 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:45.838858 24525 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:45.840566 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:45.841602 24721 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.841996 24721 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.842362 24721 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.853993 24715 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:45.854508 24715 ts_tablet_manager.cc:1403] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.164s	user 0.030s	sys 0.035s
W20260709 13:07:45.858388 24471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:45.861848 24715 raft_consensus.cc:359] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.862558 24715 raft_consensus.cc:385] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.862996 24715 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.862926 24589 tablet_service.cc:1511] Processing CreateTablet for tablet 5f10dd13cd784e8cb8b1dba5b1d1892a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:45.863934 24715 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.864558 24589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f10dd13cd784e8cb8b1dba5b1d1892a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.870390 24714 ts_tablet_manager.cc:1434] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.134s	user 0.015s	sys 0.023s
I20260709 13:07:45.871394 24714 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:45.882061 24588 tablet_service.cc:1511] Processing CreateTablet for tablet b1932202ddbe46b29ed12a1b38042652 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:45.883039 24588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1932202ddbe46b29ed12a1b38042652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.885219 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:45.885910 24674 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:45.887108 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:45.873306 24587 tablet_service.cc:1511] Processing CreateTablet for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:45.890034 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.862540 24661 tablet_service.cc:1511] Processing CreateTablet for tablet 5f10dd13cd784e8cb8b1dba5b1d1892a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:45.902889 24664 tablet_service.cc:1511] Processing CreateTablet for tablet b1932202ddbe46b29ed12a1b38042652 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:45.904670 24514 tablet_service.cc:1511] Processing CreateTablet for tablet 14e96ae54f3a4631bcabb789d2c4146c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:45.905948 24514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e96ae54f3a4631bcabb789d2c4146c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.909251 24721 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.910430 24600 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:45.911358 24721 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:45.914865 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:45.915416 24525 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.918716 24513 tablet_service.cc:1511] Processing CreateTablet for tablet b1932202ddbe46b29ed12a1b38042652 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:45.920300 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1932202ddbe46b29ed12a1b38042652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.921700 24661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f10dd13cd784e8cb8b1dba5b1d1892a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.925834 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:45.926482 24674 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.927275 24525 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:45.932725 24714 tablet_bootstrap.cc:654] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.937981 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:45.939162 24721 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:45.939838 24721 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:45.941015 24721 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.933710 24511 tablet_service.cc:1511] Processing CreateTablet for tablet 5f10dd13cd784e8cb8b1dba5b1d1892a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:45.954234 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f10dd13cd784e8cb8b1dba5b1d1892a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.953887 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 7db7a15c9a7549a4a147a987f1362c09 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:45.955981 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db7a15c9a7549a4a147a987f1362c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.958546 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1932202ddbe46b29ed12a1b38042652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.971189 24716 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:45.971678 24716 ts_tablet_manager.cc:1403] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.270s	user 0.013s	sys 0.007s
I20260709 13:07:45.972460 24512 tablet_service.cc:1511] Processing CreateTablet for tablet 7db7a15c9a7549a4a147a987f1362c09 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:45.973747 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db7a15c9a7549a4a147a987f1362c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.976802 24716 raft_consensus.cc:359] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.977573 24716 raft_consensus.cc:385] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.978158 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:45.977882 24420 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.981060 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:45.983896 24728 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:45.977855 24716 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.989403 24715 ts_tablet_manager.cc:1434] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.135s	user 0.020s	sys 0.023s
I20260709 13:07:45.989707 24716 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:45.991384 24715 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:45.992211 24714 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:45.992688 24714 ts_tablet_manager.cc:1403] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.019s
I20260709 13:07:45.999130 24716 ts_tablet_manager.cc:1434] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:07:46.000260 24715 tablet_bootstrap.cc:654] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.000523 24714 raft_consensus.cc:359] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.001293 24714 raft_consensus.cc:385] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.001609 24714 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.002271 24714 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.004400 24714 ts_tablet_manager.cc:1434] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:07:45.965425 24674 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:46.007205 24511 tablet_service.cc:1511] Processing CreateTablet for tablet b8b86e620fd64cf5b4c4a826cb95278a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:46.008984 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b86e620fd64cf5b4c4a826cb95278a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.009315 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 7db7a15c9a7549a4a147a987f1362c09 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:46.010802 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db7a15c9a7549a4a147a987f1362c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.013502 24587 tablet_service.cc:1511] Processing CreateTablet for tablet b8b86e620fd64cf5b4c4a826cb95278a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:46.014717 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b86e620fd64cf5b4c4a826cb95278a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.020869 24714 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:46.033205 24715 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:46.033720 24715 ts_tablet_manager.cc:1403] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.007s
I20260709 13:07:46.036523 24715 raft_consensus.cc:359] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.037254 24715 raft_consensus.cc:385] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.037562 24715 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.031049 24716 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:46.038302 24715 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.040850 24715 ts_tablet_manager.cc:1434] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:46.041905 24715 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:46.044226 24716 tablet_bootstrap.cc:654] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.045451 24714 tablet_bootstrap.cc:654] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.048131 24715 tablet_bootstrap.cc:654] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.047940 24663 tablet_service.cc:1511] Processing CreateTablet for tablet b8b86e620fd64cf5b4c4a826cb95278a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:46.049347 24663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b86e620fd64cf5b4c4a826cb95278a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.058655 24714 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:46.059202 24714 ts_tablet_manager.cc:1403] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.010s
I20260709 13:07:46.062058 24714 raft_consensus.cc:359] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.062862 24714 raft_consensus.cc:385] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.063207 24714 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.063928 24714 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.072302 24714 ts_tablet_manager.cc:1434] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 13:07:46.073838 24714 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:46.081748 24714 tablet_bootstrap.cc:654] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.085026 24511 tablet_service.cc:1511] Processing CreateTablet for tablet 8d807668edef41d5b0b7e311228f18c2 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:46.085945 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 8d807668edef41d5b0b7e311228f18c2 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:46.086426 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d807668edef41d5b0b7e311228f18c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.087159 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d807668edef41d5b0b7e311228f18c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.096627 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 8d807668edef41d5b0b7e311228f18c2 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:46.098318 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d807668edef41d5b0b7e311228f18c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.112125 24714 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:46.112686 24714 ts_tablet_manager.cc:1403] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.009s
I20260709 13:07:46.115631 24714 raft_consensus.cc:359] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.117815 24714 raft_consensus.cc:385] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.118119 24714 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.118878 24714 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.121031 24714 ts_tablet_manager.cc:1434] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:07:46.122328 24714 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:46.127940 24714 tablet_bootstrap.cc:654] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.134660 24511 tablet_service.cc:1511] Processing CreateTablet for tablet b6ade31527164676867a5686444d0240 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:46.135964 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ade31527164676867a5686444d0240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.138528 24714 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:46.139093 24714 ts_tablet_manager.cc:1403] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.013s
I20260709 13:07:46.139367 24589 tablet_service.cc:1511] Processing CreateTablet for tablet b6ade31527164676867a5686444d0240 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:46.140617 24589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ade31527164676867a5686444d0240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.142267 24714 raft_consensus.cc:359] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.143055 24714 raft_consensus.cc:385] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.143392 24714 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.144464 24728 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.144263 24714 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.144891 24728 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.146709 24714 ts_tablet_manager.cc:1434] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:07:46.147014 24728 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.149657 24714 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:46.149529 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:46.150439 24600 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:46.157431 24714 tablet_bootstrap.cc:654] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.165045 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:46.166260 24720 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.166700 24720 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.167109 24720 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.152174 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:46.169782 24674 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:46.176894 24720 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.187935 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:46.188225 24720 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.188831 24600 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.197319 24663 tablet_service.cc:1511] Processing CreateTablet for tablet b6ade31527164676867a5686444d0240 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:46.198644 24663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ade31527164676867a5686444d0240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.200011 24661 tablet_service.cc:1511] Processing CreateTablet for tablet 57bac7b2b9c5456588833d44d3dff943 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:46.201320 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 57bac7b2b9c5456588833d44d3dff943 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:46.202543 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bac7b2b9c5456588833d44d3dff943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.206482 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:46.207083 24674 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.207264 24512 tablet_service.cc:1511] Processing CreateTablet for tablet 2732386ac0bf488eb0fcc0893f0c9b0e (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:46.207491 24511 tablet_service.cc:1511] Processing CreateTablet for tablet 57bac7b2b9c5456588833d44d3dff943 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:46.208519 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2732386ac0bf488eb0fcc0893f0c9b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.211683 24588 tablet_service.cc:1511] Processing CreateTablet for tablet 2732386ac0bf488eb0fcc0893f0c9b0e (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:46.212932 24588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2732386ac0bf488eb0fcc0893f0c9b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.213368 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bac7b2b9c5456588833d44d3dff943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.216833 24674 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:46.224002 24491 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:46.224901 24720 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.224869 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 2732386ac0bf488eb0fcc0893f0c9b0e (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:46.225536 24720 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:46.227078 24716 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:46.226436 24720 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.227535 24716 ts_tablet_manager.cc:1403] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.197s	user 0.012s	sys 0.007s
I20260709 13:07:46.230406 24715 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:46.230655 24728 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.230959 24715 ts_tablet_manager.cc:1403] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.189s	user 0.055s	sys 0.054s
I20260709 13:07:46.233174 24728 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.201303 24661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bac7b2b9c5456588833d44d3dff943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.236938 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2732386ac0bf488eb0fcc0893f0c9b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.238987 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:46.239836 24599 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:46.241027 24728 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.241799 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:46.236709 24716 raft_consensus.cc:359] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.245546 24716 raft_consensus.cc:385] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.246593 24716 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.246124 24728 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.247737 24728 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.248296 24728 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.244871 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:46.252215 24600 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:46.264887 24664 tablet_service.cc:1511] Processing CreateTablet for tablet 5644c0da536c49768827dfd20a9662e1 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:46.265400 24589 tablet_service.cc:1511] Processing CreateTablet for tablet 5644c0da536c49768827dfd20a9662e1 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:46.266386 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5644c0da536c49768827dfd20a9662e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.249023 24716 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.268397 24589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5644c0da536c49768827dfd20a9662e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.268841 24716 ts_tablet_manager.cc:1434] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:07:46.270126 24716 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:46.278203 24587 tablet_service.cc:1511] Processing CreateTablet for tablet f8aa20313ae2498e918eac40defe927c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:46.279667 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8aa20313ae2498e918eac40defe927c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.280264 24714 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:46.280891 24714 ts_tablet_manager.cc:1403] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.131s	user 0.043s	sys 0.056s
I20260709 13:07:46.290014 24662 tablet_service.cc:1511] Processing CreateTablet for tablet f8aa20313ae2498e918eac40defe927c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:46.291388 24662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8aa20313ae2498e918eac40defe927c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.284621 24714 raft_consensus.cc:359] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.291905 24714 raft_consensus.cc:385] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.292661 24714 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.294112 24588 tablet_service.cc:1511] Processing CreateTablet for tablet e9c35412a4ad4729862392b77295639d (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:46.295915 24588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c35412a4ad4729862392b77295639d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.290149 24728 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:46.301801 24491 leader_election.cc:343] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.305974 24511 tablet_service.cc:1511] Processing CreateTablet for tablet 5644c0da536c49768827dfd20a9662e1 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:46.307085 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5644c0da536c49768827dfd20a9662e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.307219 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:46.307771 24600 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.305932 24660 tablet_service.cc:1511] Processing CreateTablet for tablet e9c35412a4ad4729862392b77295639d (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:46.310297 24660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c35412a4ad4729862392b77295639d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.300410 24720 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.313248 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 243f0803aa8e4b9e938126e02e960e97 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:46.313534 24720 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.315104 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243f0803aa8e4b9e938126e02e960e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.315153 24728 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.315618 24600 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:46.315567 24589 tablet_service.cc:1511] Processing CreateTablet for tablet 243f0803aa8e4b9e938126e02e960e97 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:46.305918 24716 tablet_bootstrap.cc:654] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.316871 24589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243f0803aa8e4b9e938126e02e960e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.316923 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:46.317955 24728 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.318661 24728 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:46.323732 24590 tablet_service.cc:1511] Processing CreateTablet for tablet 73880209aa174d609bf830ad4c666c8c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:46.324963 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73880209aa174d609bf830ad4c666c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.333602 24663 tablet_service.cc:1511] Processing CreateTablet for tablet 73880209aa174d609bf830ad4c666c8c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:46.335228 24586 tablet_service.cc:1511] Processing CreateTablet for tablet c6328dd8c55f4742b015ea60e33773bc (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:46.336217 24715 raft_consensus.cc:359] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.338384 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6328dd8c55f4742b015ea60e33773bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.342116 24515 tablet_service.cc:1511] Processing CreateTablet for tablet 73880209aa174d609bf830ad4c666c8c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:46.340498 24732 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:46.343683 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73880209aa174d609bf830ad4c666c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.301615 24714 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.346349 24514 tablet_service.cc:1511] Processing CreateTablet for tablet c6328dd8c55f4742b015ea60e33773bc (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:46.347677 24514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6328dd8c55f4742b015ea60e33773bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.340610 24513 tablet_service.cc:1511] Processing CreateTablet for tablet 243f0803aa8e4b9e938126e02e960e97 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:46.350090 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243f0803aa8e4b9e938126e02e960e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.352355 24663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73880209aa174d609bf830ad4c666c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.353931 24715 raft_consensus.cc:385] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.354261 24715 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.355086 24715 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.368153 24732 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:46.372624 24728 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.341670 24512 tablet_service.cc:1511] Processing CreateTablet for tablet e9c35412a4ad4729862392b77295639d (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:46.378585 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9c35412a4ad4729862392b77295639d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.393895 24715 ts_tablet_manager.cc:1434] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.161s	user 0.006s	sys 0.001s
I20260709 13:07:46.394635 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:46.396034 24490 leader_election.cc:343] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.395913 24511 tablet_service.cc:1511] Processing CreateTablet for tablet f8aa20313ae2498e918eac40defe927c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:46.397125 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8aa20313ae2498e918eac40defe927c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.400789 24720 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:07:46.401362 24409 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 48637.3us
I20260709 13:07:46.407437 24714 ts_tablet_manager.cc:1434] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.126s	user 0.009s	sys 0.004s
I20260709 13:07:46.407763 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:46.407891 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 46d76b8a93c540a2936fa04c6712e968 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:46.408475 24714 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:46.409268 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d76b8a93c540a2936fa04c6712e968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.409070 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:46.411758 24672 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:46.413223 24720 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.413681 24720 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.415549 24746 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.416034 24746 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.416448 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:46.417095 24600 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
W20260709 13:07:46.418795 24491 leader_election.cc:343] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.429140 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:46.435505 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:46.436380 24716 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:46.437017 24716 ts_tablet_manager.cc:1403] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.167s	user 0.010s	sys 0.006s
I20260709 13:07:46.439802 24716 raft_consensus.cc:359] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.440725 24716 raft_consensus.cc:385] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.446676 24659 tablet_service.cc:1511] Processing CreateTablet for tablet c6328dd8c55f4742b015ea60e33773bc (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:46.434520 24715 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:46.463025 24751 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.463932 24751 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.469209 24754 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.469636 24751 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.469928 24754 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.472698 24754 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.468951 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:46.454366 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6328dd8c55f4742b015ea60e33773bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.445665 24716 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.477896 24720 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.485345 24728 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.498080 24728 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:46.491180 24490 leader_election.cc:343] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.498484 24728 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.495195 24420 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.507285 24715 tablet_bootstrap.cc:654] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.510537 24714 tablet_bootstrap.cc:654] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.515475 24746 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.515506 24664 tablet_service.cc:1511] Processing CreateTablet for tablet 46d76b8a93c540a2936fa04c6712e968 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:46.517295 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:46.517815 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d76b8a93c540a2936fa04c6712e968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.518556 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.518404 24657 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:46.520524 24656 tablet_service.cc:1511] Processing CreateTablet for tablet ba23ab1f03ef40238962f541c00081d1 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:46.517289 24588 tablet_service.cc:1511] Processing CreateTablet for tablet 46d76b8a93c540a2936fa04c6712e968 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:46.522461 24588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d76b8a93c540a2936fa04c6712e968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.522708 24655 tablet_service.cc:1511] Processing CreateTablet for tablet c5d1c8994b3f41b286ae8a8f4a93b76a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:07:46.485901 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56903.6us
I20260709 13:07:46.528627 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.534423 24587 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:46.537258 24751 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.501029 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:46.549573 24509 tablet_service.cc:1511] Processing CreateTablet for tablet c5d1c8994b3f41b286ae8a8f4a93b76a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:07:46.550655 24490 leader_election.cc:343] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.551034 24509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d1c8994b3f41b286ae8a8f4a93b76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.550666 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:46.501406 24716 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.553248 24673 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:46.554040 24716 ts_tablet_manager.cc:1434] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.000s
I20260709 13:07:46.552933 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:46.554945 24716 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:46.544976 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.554809 24508 tablet_service.cc:1511] Processing CreateTablet for tablet de2b0253cbb445a4bb49f874e70ea972 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:46.556419 24508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2b0253cbb445a4bb49f874e70ea972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.557515 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:46.548861 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:46.561846 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.549072 24511 tablet_service.cc:1511] Processing CreateTablet for tablet ba23ab1f03ef40238962f541c00081d1 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:46.563894 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba23ab1f03ef40238962f541c00081d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.569321 24585 tablet_service.cc:1511] Processing CreateTablet for tablet ba23ab1f03ef40238962f541c00081d1 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:46.569535 24584 tablet_service.cc:1511] Processing CreateTablet for tablet c5d1c8994b3f41b286ae8a8f4a93b76a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:46.570556 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba23ab1f03ef40238962f541c00081d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.571215 24584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d1c8994b3f41b286ae8a8f4a93b76a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:46.571699 24490 leader_election.cc:343] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.574041 24514 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:46.577256 24590 tablet_service.cc:1511] Processing CreateTablet for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:46.585474 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:46.586747 24491 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:46.562661 24656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba23ab1f03ef40238962f541c00081d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.614868 24746 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.617120 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.617166 24746 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.617739 24746 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:46.620455 24491 leader_election.cc:343] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.620908 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:46.621102 24659 tablet_service.cc:1511] Processing CreateTablet for tablet de2b0253cbb445a4bb49f874e70ea972 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:46.622083 24720 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:46.622452 24491 leader_election.cc:343] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.622608 24655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d1c8994b3f41b286ae8a8f4a93b76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.627192 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:46.627817 24674 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.622807 24589 tablet_service.cc:1511] Processing CreateTablet for tablet de2b0253cbb445a4bb49f874e70ea972 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:46.630681 24728 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.633814 24514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.633762 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:46.634452 24600 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.635025 24746 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.636504 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:46.638833 24589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2b0253cbb445a4bb49f874e70ea972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.638978 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2b0253cbb445a4bb49f874e70ea972. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:46.645351 24491 leader_election.cc:343] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.646761 24716 tablet_bootstrap.cc:654] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.648622 24674 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:46.651319 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:46.652562 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:46.653204 24672 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.657691 24600 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
W20260709 13:07:46.657799 24490 leader_election.cc:343] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.657779 24420 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.659143 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:46.660061 24720 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.660532 24720 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:46.661427 24715 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:46.662067 24715 ts_tablet_manager.cc:1403] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.240s	user 0.021s	sys 0.004s
I20260709 13:07:46.661427 24720 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.666244 24715 raft_consensus.cc:359] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.666997 24715 raft_consensus.cc:385] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.615062 24751 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.667961 24746 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.677029 24587 tablet_service.cc:1511] Processing CreateTablet for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:46.683573 24714 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:46.684233 24714 ts_tablet_manager.cc:1403] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.276s	user 0.018s	sys 0.010s
I20260709 13:07:46.684525 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.686971 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:46.638388 24728 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.667659 24715 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.692233 24746 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.711768 24508 tablet_service.cc:1511] Processing CreateTablet for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:46.711952 24586 tablet_service.cc:1511] Processing CreateTablet for tablet 27022900b12b4397b1677f3fb2326347 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:46.713218 24508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.713335 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27022900b12b4397b1677f3fb2326347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.721241 24746 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:46.731675 24746 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.739032 24714 raft_consensus.cc:359] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.740600 24714 raft_consensus.cc:385] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.740933 24714 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.741757 24714 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.743068 24511 tablet_service.cc:1511] Processing CreateTablet for tablet b7ee2372084b4767aa79fc57a0c53278 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:46.737572 24715 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.744228 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ee2372084b4767aa79fc57a0c53278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.744910 24751 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.746707 24663 tablet_service.cc:1511] Processing CreateTablet for tablet 27022900b12b4397b1677f3fb2326347 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:46.747126 24660 tablet_service.cc:1511] Processing CreateTablet for tablet b7ee2372084b4767aa79fc57a0c53278 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:46.747978 24663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27022900b12b4397b1677f3fb2326347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.749516 24715 ts_tablet_manager.cc:1434] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.003s
I20260709 13:07:46.749404 24657 tablet_service.cc:1511] Processing CreateTablet for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:46.749555 24587 tablet_service.cc:1511] Processing CreateTablet for tablet b7ee2372084b4767aa79fc57a0c53278 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:46.750752 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.750882 24715 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:46.750775 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ee2372084b4767aa79fc57a0c53278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.724603 24672 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:46.753407 24660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ee2372084b4767aa79fc57a0c53278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.743068 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 27022900b12b4397b1677f3fb2326347 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:46.754792 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27022900b12b4397b1677f3fb2326347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.745942 24714 ts_tablet_manager.cc:1434] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.004s
I20260709 13:07:46.755798 24714 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:46.754513 24491 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:46.756881 24751 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.757393 24751 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:46.760442 24751 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.761109 24728 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.774612 24509 tablet_service.cc:1511] Processing CreateTablet for tablet e7ec39f0d4e04761ae598f1245692799 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:46.781190 24716 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:46.784674 24714 tablet_bootstrap.cc:654] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.782126 24509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ec39f0d4e04761ae598f1245692799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.801051 24720 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:46.801702 24662 tablet_service.cc:1511] Processing CreateTablet for tablet e7ec39f0d4e04761ae598f1245692799 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:46.803057 24662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ec39f0d4e04761ae598f1245692799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.804644 24585 tablet_service.cc:1511] Processing CreateTablet for tablet e7ec39f0d4e04761ae598f1245692799 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:46.805832 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ec39f0d4e04761ae598f1245692799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.793874 24716 ts_tablet_manager.cc:1403] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.239s	user 0.023s	sys 0.022s
I20260709 13:07:46.837664 24511 tablet_service.cc:1511] Processing CreateTablet for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:46.839273 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.846446 24656 tablet_service.cc:1511] Processing CreateTablet for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:46.849484 24514 tablet_service.cc:1511] Processing CreateTablet for tablet b2451462dc894ec98db5932996a9e329 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:46.851222 24514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2451462dc894ec98db5932996a9e329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.854583 24585 tablet_service.cc:1511] Processing CreateTablet for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:46.855715 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:46.878419 24471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:46.884109 24585 tablet_service.cc:1511] Processing CreateTablet for tablet b2451462dc894ec98db5932996a9e329 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:46.885345 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2451462dc894ec98db5932996a9e329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.887410 24512 tablet_service.cc:1511] Processing CreateTablet for tablet f6e02d1934244d5f93de764a08655a2c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:46.887045 24422 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.888619 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e02d1934244d5f93de764a08655a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.891584 24590 tablet_service.cc:1511] Processing CreateTablet for tablet f6e02d1934244d5f93de764a08655a2c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:46.892977 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e02d1934244d5f93de764a08655a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.894743 24658 tablet_service.cc:1511] Processing CreateTablet for tablet b2451462dc894ec98db5932996a9e329 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:46.897229 24422 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.898424 24715 tablet_bootstrap.cc:654] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.915272 24655 tablet_service.cc:1511] Processing CreateTablet for tablet f6e02d1934244d5f93de764a08655a2c (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:46.917446 24587 tablet_service.cc:1511] Processing CreateTablet for tablet 4430292826c34b99a8f9413e570e0ff3 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:46.918614 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4430292826c34b99a8f9413e570e0ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.920614 24515 tablet_service.cc:1511] Processing CreateTablet for tablet 90f5d915fb71474ab2b58063813a93a9 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:46.921060 24656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.924453 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 4430292826c34b99a8f9413e570e0ff3 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:46.926062 24512 tablet_service.cc:1511] Processing CreateTablet for tablet 4430292826c34b99a8f9413e570e0ff3 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:46.928411 24512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4430292826c34b99a8f9413e570e0ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.934653 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f5d915fb71474ab2b58063813a93a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.933854 24420 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.935967 24716 raft_consensus.cc:359] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.936847 24716 raft_consensus.cc:385] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.937291 24716 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.937948 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2451462dc894ec98db5932996a9e329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.938270 24716 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.940820 24716 ts_tablet_manager.cc:1434] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.000s
I20260709 13:07:46.950071 24655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e02d1934244d5f93de764a08655a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.952000 24661 tablet_service.cc:1511] Processing CreateTablet for tablet 90f5d915fb71474ab2b58063813a93a9 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:46.953312 24661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f5d915fb71474ab2b58063813a93a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.953110 24513 tablet_service.cc:1511] Processing CreateTablet for tablet eb1f10582ce7411b8b3187da8ec646c8 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:46.954350 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1f10582ce7411b8b3187da8ec646c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:46.965824 24765 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:46.973567 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4430292826c34b99a8f9413e570e0ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.976117 24716 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:46.977962 24590 tablet_service.cc:1511] Processing CreateTablet for tablet 90f5d915fb71474ab2b58063813a93a9 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:46.979274 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f5d915fb71474ab2b58063813a93a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:46.982478 24491 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.983074 24746 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.983530 24746 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:46.983635 24657 tablet_service.cc:1511] Processing CreateTablet for tablet eb1f10582ce7411b8b3187da8ec646c8 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:46.985443 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1f10582ce7411b8b3187da8ec646c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.985625 24746 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:46.987182 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:46.988618 24490 leader_election.cc:343] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.990736 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:46.995437 24491 leader_election.cc:343] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.995905 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:46.998353 24664 tablet_service.cc:1511] Processing CreateTablet for tablet f689bef5c09a4f4caf91a81702cc7723 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:46.998857 24714 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:46.999321 24714 ts_tablet_manager.cc:1403] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.244s	user 0.025s	sys 0.026s
I20260709 13:07:46.999778 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f689bef5c09a4f4caf91a81702cc7723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.003683 24714 raft_consensus.cc:359] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.004388 24714 raft_consensus.cc:385] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.004652 24714 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.004976 24720 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:47.005429 24714 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.010242 24586 tablet_service.cc:1511] Processing CreateTablet for tablet f689bef5c09a4f4caf91a81702cc7723 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:47.011029 24714 ts_tablet_manager.cc:1434] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:07:47.015529 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f689bef5c09a4f4caf91a81702cc7723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.024219 24587 tablet_service.cc:1511] Processing CreateTablet for tablet eb1f10582ce7411b8b3187da8ec646c8 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:47.025530 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1f10582ce7411b8b3187da8ec646c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.031162 24716 tablet_bootstrap.cc:654] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.033250 24511 tablet_service.cc:1511] Processing CreateTablet for tablet f689bef5c09a4f4caf91a81702cc7723 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:47.035775 24714 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.038515 24715 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:47.039161 24715 ts_tablet_manager.cc:1403] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.288s	user 0.038s	sys 0.016s
I20260709 13:07:47.043418 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 72b8c4b638a5486c82fb2d3bb64ef503 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:47.048626 24722 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.049237 24722 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.054980 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f689bef5c09a4f4caf91a81702cc7723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.075806 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 72b8c4b638a5486c82fb2d3bb64ef503 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:47.077032 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b8c4b638a5486c82fb2d3bb64ef503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.078840 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b8c4b638a5486c82fb2d3bb64ef503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.081666 24714 tablet_bootstrap.cc:654] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.083002 24722 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:47.086282 24664 tablet_service.cc:1511] Processing CreateTablet for tablet 72b8c4b638a5486c82fb2d3bb64ef503 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:47.087990 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b8c4b638a5486c82fb2d3bb64ef503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.107754 24715 raft_consensus.cc:359] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.108701 24715 raft_consensus.cc:385] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.109050 24715 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.109859 24715 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.112504 24715 ts_tablet_manager.cc:1434] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.004s
I20260709 13:07:47.123040 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 4cf920647a7842d49c08b2453da44143 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:47.124687 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf920647a7842d49c08b2453da44143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.115767 24715 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:47.116149 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 4cf920647a7842d49c08b2453da44143 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:47.138008 24587 tablet_service.cc:1511] Processing CreateTablet for tablet f1d76f2e8d504bd29a4d29e4926a9407 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:47.139230 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d76f2e8d504bd29a4d29e4926a9407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.141613 24600 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.144191 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf920647a7842d49c08b2453da44143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.144004 24746 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:47.151834 24657 tablet_service.cc:1511] Processing CreateTablet for tablet f1d76f2e8d504bd29a4d29e4926a9407 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:47.153232 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d76f2e8d504bd29a4d29e4926a9407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.159538 24714 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:47.161173 24714 ts_tablet_manager.cc:1403] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.126s	user 0.024s	sys 0.018s
I20260709 13:07:47.175470 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 4cf920647a7842d49c08b2453da44143 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:47.176836 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf920647a7842d49c08b2453da44143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.180392 24590 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2117a17f2425cae9c436e59c94b96 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:47.181809 24590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2117a17f2425cae9c436e59c94b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.186076 24513 tablet_service.cc:1511] Processing CreateTablet for tablet f1d76f2e8d504bd29a4d29e4926a9407 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:47.187381 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d76f2e8d504bd29a4d29e4926a9407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.190166 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.190951 24511 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2117a17f2425cae9c436e59c94b96 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:47.192617 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2117a17f2425cae9c436e59c94b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.195222 24674 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.196014 24715 tablet_bootstrap.cc:654] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.203590 24714 raft_consensus.cc:359] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.204308 24714 raft_consensus.cc:385] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.204573 24714 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.204751 24746 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:47.205621 24714 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.215323 24714 ts_tablet_manager.cc:1434] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.002s
I20260709 13:07:47.216277 24714 tablet_bootstrap.cc:492] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.219842 24664 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2117a17f2425cae9c436e59c94b96 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:47.221004 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2117a17f2425cae9c436e59c94b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.223528 24714 tablet_bootstrap.cc:654] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.253799 24746 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:47.256026 24716 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.283545 24716 ts_tablet_manager.cc:1403] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.308s	user 0.021s	sys 0.048s
I20260709 13:07:47.286175 24587 tablet_service.cc:1511] Processing CreateTablet for tablet 28c13259bf74484588e0fb08995091cc (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:47.272960 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.287694 24587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c13259bf74484588e0fb08995091cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.289361 24515 tablet_service.cc:1511] Processing CreateTablet for tablet 28c13259bf74484588e0fb08995091cc (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:47.289436 24716 raft_consensus.cc:359] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.290551 24716 raft_consensus.cc:385] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.296655 24714 tablet_bootstrap.cc:492] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:47.296593 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:47.297163 24714 ts_tablet_manager.cc:1403] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.015s
I20260709 13:07:47.298676 24586 tablet_service.cc:1511] Processing CreateTablet for tablet de0783d3a5f74b1c9adce43ebc457546 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:47.296113 24716 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.299970 24586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0783d3a5f74b1c9adce43ebc457546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.303324 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c13259bf74484588e0fb08995091cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.305104 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd63fe151734a9daa9146d5e744d8be (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:47.306128 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd63fe151734a9daa9146d5e744d8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.306548 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd63fe151734a9daa9146d5e744d8be (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:47.307777 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd63fe151734a9daa9146d5e744d8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.311961 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 869c3dc61dc04d64adba5e6ab84e5d83 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:47.313109 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869c3dc61dc04d64adba5e6ab84e5d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.314801 24655 tablet_service.cc:1511] Processing CreateTablet for tablet e4b8c8f0e3de4df592f498349e097d44 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:47.315961 24655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b8c8f0e3de4df592f498349e097d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.317998 24589 tablet_service.cc:1511] Processing CreateTablet for tablet 869c3dc61dc04d64adba5e6ab84e5d83 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:47.319202 24589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869c3dc61dc04d64adba5e6ab84e5d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.319664 24588 tablet_service.cc:1511] Processing CreateTablet for tablet e4b8c8f0e3de4df592f498349e097d44 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:47.320825 24588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b8c8f0e3de4df592f498349e097d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.322535 24584 tablet_service.cc:1511] Processing CreateTablet for tablet cf80704aefe74fbe81e575cc17508b9a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:47.322775 24661 tablet_service.cc:1511] Processing CreateTablet for tablet cf80704aefe74fbe81e575cc17508b9a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:47.323727 24584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf80704aefe74fbe81e575cc17508b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.324337 24661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf80704aefe74fbe81e575cc17508b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.329444 24583 tablet_service.cc:1511] Processing CreateTablet for tablet 8cd2633e79fe4d3498a4412c062bf875 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:47.330717 24583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cd2633e79fe4d3498a4412c062bf875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.329463 24656 tablet_service.cc:1511] Processing CreateTablet for tablet 8cd2633e79fe4d3498a4412c062bf875 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:47.299660 24714 raft_consensus.cc:359] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.334534 24714 raft_consensus.cc:385] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.334923 24656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cd2633e79fe4d3498a4412c062bf875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.342175 24513 tablet_service.cc:1511] Processing CreateTablet for tablet de0783d3a5f74b1c9adce43ebc457546 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:47.343417 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0783d3a5f74b1c9adce43ebc457546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.334846 24714 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.299989 24716 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.353361 24714 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.358429 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd63fe151734a9daa9146d5e744d8be (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:47.359688 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd63fe151734a9daa9146d5e744d8be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.363349 24714 ts_tablet_manager.cc:1434] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.002s
I20260709 13:07:47.364274 24714 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.370574 24511 tablet_service.cc:1511] Processing CreateTablet for tablet e4b8c8f0e3de4df592f498349e097d44 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:47.371688 24511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b8c8f0e3de4df592f498349e097d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.370895 24657 tablet_service.cc:1511] Processing CreateTablet for tablet 28c13259bf74484588e0fb08995091cc (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:47.373499 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c13259bf74484588e0fb08995091cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.373317 24508 tablet_service.cc:1511] Processing CreateTablet for tablet cf80704aefe74fbe81e575cc17508b9a (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:47.374537 24508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf80704aefe74fbe81e575cc17508b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.381821 24515 tablet_service.cc:1511] Processing CreateTablet for tablet 869c3dc61dc04d64adba5e6ab84e5d83 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:47.384166 24779 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.384735 24779 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.387149 24779 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:47.384347 24714 tablet_bootstrap.cc:654] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.388441 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.390748 24515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 869c3dc61dc04d64adba5e6ab84e5d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.396515 24716 ts_tablet_manager.cc:1434] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.110s	user 0.001s	sys 0.008s
I20260709 13:07:47.397681 24716 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.402155 24664 tablet_service.cc:1511] Processing CreateTablet for tablet de0783d3a5f74b1c9adce43ebc457546 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:47.403123 24664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0783d3a5f74b1c9adce43ebc457546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.405754 24728 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.406491 24728 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.410000 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:47.411475 24490 leader_election.cc:343] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.415316 24728 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.428083 24513 tablet_service.cc:1511] Processing CreateTablet for tablet 8cd2633e79fe4d3498a4412c062bf875 (DEFAULT_TABLE table=test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:47.429433 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cd2633e79fe4d3498a4412c062bf875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.431191 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.432786 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:47.432798 24600 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.442106 24728 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.446213 24728 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.446700 24728 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:47.447782 24491 leader_election.cc:343] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.448439 24491 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:47.449538 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.447052 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:47.450542 24746 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:47.451031 24490 leader_election.cc:343] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.452021 24728 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.455447 24780 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:47.455880 24715 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:47.456337 24715 ts_tablet_manager.cc:1403] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.341s	user 0.014s	sys 0.027s
I20260709 13:07:47.466735 24722 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:47.475492 24715 raft_consensus.cc:359] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.476807 24715 raft_consensus.cc:385] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.477247 24715 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.478471 24715 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.482165 24721 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.485875 24721 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.493742 24746 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:47.497188 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:47.503135 24716 tablet_bootstrap.cc:654] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.504280 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.505244 24721 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.512261 24714 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:47.513401 24714 ts_tablet_manager.cc:1403] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.019s
I20260709 13:07:47.514824 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:47.515506 24674 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:47.520375 24566 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:47.521529 24714 raft_consensus.cc:359] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.524096 24714 raft_consensus.cc:385] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.524945 24714 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.526607 24714 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.530625 24674 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.532405 24714 ts_tablet_manager.cc:1434] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:07:47.535207 24714 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.549779 24782 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:47.550034 24728 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:47.551080 24782 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:07:47.551522 24782 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:47.553261 24491 leader_election.cc:343] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.553748 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:47.557579 24728 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:47.559674 24716 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.560313 24716 ts_tablet_manager.cc:1403] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.163s	user 0.006s	sys 0.011s
I20260709 13:07:47.567600 24716 raft_consensus.cc:359] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.574290 24716 raft_consensus.cc:385] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.574719 24716 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.575672 24714 tablet_bootstrap.cc:654] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.575877 24716 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.578168 24782 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.578756 24716 ts_tablet_manager.cc:1434] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:07:47.579681 24600 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:47.580628 24715 ts_tablet_manager.cc:1434] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.124s	user 0.013s	sys 0.016s
I20260709 13:07:47.581440 24782 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.582254 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:47.584631 24716 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.585191 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:47.586763 24566 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:47.588402 24782 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:47.591795 24716 tablet_bootstrap.cc:654] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.593633 24751 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:47.594852 24751 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:47.595294 24751 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:47.596784 24751 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.601886 24715 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:47.602880 24751 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:47.610433 24715 tablet_bootstrap.cc:654] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.612722 24716 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.613641 24714 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:47.614208 24714 ts_tablet_manager.cc:1403] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.007s
I20260709 13:07:47.617688 24714 raft_consensus.cc:359] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.618588 24714 raft_consensus.cc:385] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.618927 24714 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.620142 24716 ts_tablet_manager.cc:1403] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.004s
I20260709 13:07:47.623835 24716 raft_consensus.cc:359] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.624794 24716 raft_consensus.cc:385] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.625334 24716 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.626158 24716 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.627897 24716 ts_tablet_manager.cc:1434] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:07:47.628450 24715 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:47.619776 24714 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.628809 24715 ts_tablet_manager.cc:1403] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 13:07:47.630271 24714 ts_tablet_manager.cc:1434] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:07:47.631479 24714 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.631511 24715 raft_consensus.cc:359] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.632303 24715 raft_consensus.cc:385] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.632611 24715 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.634186 24715 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.638103 24714 tablet_bootstrap.cc:654] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.638906 24715 ts_tablet_manager.cc:1434] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:07:47.639647 24715 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:47.644800 24716 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.646382 24715 tablet_bootstrap.cc:654] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.654665 24716 tablet_bootstrap.cc:654] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.655678 24714 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:47.656760 24714 ts_tablet_manager.cc:1403] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 13:07:47.659479 24714 raft_consensus.cc:359] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.660233 24714 raft_consensus.cc:385] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.660514 24714 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.661284 24714 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.662247 24716 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.662339 24715 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:47.662735 24716 ts_tablet_manager.cc:1403] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.007s
I20260709 13:07:47.663303 24714 ts_tablet_manager.cc:1434] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:47.662735 24715 ts_tablet_manager.cc:1403] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:07:47.664402 24714 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.664911 24716 raft_consensus.cc:359] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.665565 24716 raft_consensus.cc:385] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.665804 24716 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.666385 24715 raft_consensus.cc:359] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.666414 24716 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.667071 24715 raft_consensus.cc:385] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.667335 24715 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.668037 24715 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.668684 24716 ts_tablet_manager.cc:1434] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:47.670025 24716 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.673020 24715 ts_tablet_manager.cc:1434] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:07:47.673990 24715 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:47.679733 24715 tablet_bootstrap.cc:654] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.683019 24714 tablet_bootstrap.cc:654] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.684420 24716 tablet_bootstrap.cc:654] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.691460 24715 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:47.691637 24716 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.691936 24715 ts_tablet_manager.cc:1403] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:07:47.692018 24716 ts_tablet_manager.cc:1403] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:07:47.695080 24714 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:47.695518 24714 ts_tablet_manager.cc:1403] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.006s
I20260709 13:07:47.695248 24716 raft_consensus.cc:359] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.695248 24715 raft_consensus.cc:359] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.696097 24716 raft_consensus.cc:385] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.696168 24715 raft_consensus.cc:385] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.696444 24716 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.696470 24715 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.697279 24716 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.697358 24715 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.697804 24714 raft_consensus.cc:359] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.698484 24714 raft_consensus.cc:385] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.698743 24714 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.699335 24716 ts_tablet_manager.cc:1434] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:07:47.699465 24714 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.700520 24716 tablet_bootstrap.cc:492] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.706482 24716 tablet_bootstrap.cc:654] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.707358 24715 ts_tablet_manager.cc:1434] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:07:47.708000 24714 ts_tablet_manager.cc:1434] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:07:47.708952 24714 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.712934 24715 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:47.713214 24722 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.713733 24722 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.715124 24714 tablet_bootstrap.cc:654] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.715794 24722 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:47.717552 24716 tablet_bootstrap.cc:492] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.717995 24716 ts_tablet_manager.cc:1403] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:07:47.717887 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.718881 24600 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:47.719530 24715 tablet_bootstrap.cc:654] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.720710 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.720968 24716 raft_consensus.cc:359] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.721690 24716 raft_consensus.cc:385] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.721553 24525 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:47.722010 24716 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.723601 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:47.724071 24716 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.725662 24778 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.726163 24778 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.726583 24778 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.736553 24778 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.740386 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:47.741040 24525 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.750834 24716 ts_tablet_manager.cc:1434] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:07:47.753278 24525 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:47.755023 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:47.756170 24722 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.757014 24722 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:47.758141 24722 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.762185 24716 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.770215 24715 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:47.770700 24715 ts_tablet_manager.cc:1403] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.031s
I20260709 13:07:47.770792 24778 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:47.771355 24714 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:47.771806 24714 ts_tablet_manager.cc:1403] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.063s	user 0.034s	sys 0.015s
I20260709 13:07:47.771952 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:47.772526 24600 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.774092 24715 raft_consensus.cc:359] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.774816 24715 raft_consensus.cc:385] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.775123 24715 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.776304 24715 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.776647 24714 raft_consensus.cc:359] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.777343 24714 raft_consensus.cc:385] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.777617 24714 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.778365 24716 tablet_bootstrap.cc:654] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.778323 24714 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.782591 24715 ts_tablet_manager.cc:1434] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:07:47.783912 24715 tablet_bootstrap.cc:492] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:47.784075 24714 ts_tablet_manager.cc:1434] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:47.784973 24714 tablet_bootstrap.cc:492] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.790717 24714 tablet_bootstrap.cc:654] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.792268 24715 tablet_bootstrap.cc:654] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.798584 24716 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.799047 24716 ts_tablet_manager.cc:1403] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.012s
I20260709 13:07:47.802763 24782 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.802378 24716 raft_consensus.cc:359] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.803187 24716 raft_consensus.cc:385] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.803556 24716 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.803218 24782 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.804337 24716 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.805648 24782 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.806916 24716 ts_tablet_manager.cc:1434] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:47.804486 24422 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.807199 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:47.809408 24672 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:47.810364 24600 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:47.810648 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:47.811452 24782 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.811800 24782 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.812147 24782 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.807819 24716 tablet_bootstrap.cc:492] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.814860 24714 tablet_bootstrap.cc:492] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:47.815534 24714 ts_tablet_manager.cc:1403] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.014s
I20260709 13:07:47.802388 24715 tablet_bootstrap.cc:492] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:47.808571 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.832090 24754 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.840030 24525 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:47.826388 24782 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.840610 24754 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.842780 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:47.842981 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:47.818931 24716 tablet_bootstrap.cc:654] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.843411 24524 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.843549 24672 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.850672 24672 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:47.851668 24715 ts_tablet_manager.cc:1403] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.006s
I20260709 13:07:47.851760 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:47.852705 24782 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.852792 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.853263 24782 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.853722 24600 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:47.854404 24782 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:47.854404 24715 raft_consensus.cc:359] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.855175 24715 raft_consensus.cc:385] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.855446 24715 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.855378 24782 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.855662 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:47.856170 24715 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.856608 24751 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.856980 24751 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.857348 24751 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.858230 24715 ts_tablet_manager.cc:1434] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:47.859123 24715 tablet_bootstrap.cc:492] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:47.860177 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:47.861594 24491 leader_election.cc:343] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.862322 24754 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.819370 24714 raft_consensus.cc:359] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.865127 24714 raft_consensus.cc:385] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.865481 24714 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.866321 24714 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.868451 24714 ts_tablet_manager.cc:1434] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.003s
I20260709 13:07:47.864573 24715 tablet_bootstrap.cc:654] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.864428 24524 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:47.825263 24746 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.874431 24746 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.876855 24714 tablet_bootstrap.cc:492] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:47.877291 24746 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.864108 24751 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.882242 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:47.882931 24672 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:47.884114 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:47.885388 24754 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.885922 24754 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.886973 24754 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.891396 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.893836 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:47.893162 24419 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.890350 24751 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:07:47.895440 24491 leader_election.cc:343] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:47.896968 24490 leader_election.cc:343] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.897109 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:47.897871 24599 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.897996 24751 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.898730 24782 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.898505 24751 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.899142 24782 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.901592 24782 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.902889 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:47.903735 24674 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:47.905212 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:47.906929 24566 leader_election.cc:343] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.907792 24491 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:47.907802 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.909420 24716 tablet_bootstrap.cc:492] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.909852 24716 ts_tablet_manager.cc:1403] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.102s	user 0.034s	sys 0.027s
W20260709 13:07:47.909798 24563 leader_election.cc:343] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.909302 24715 tablet_bootstrap.cc:492] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:47.910369 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:47.911448 24782 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:47.912871 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.914141 24746 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.914860 24714 tablet_bootstrap.cc:654] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.914494 24716 raft_consensus.cc:359] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.915197 24716 raft_consensus.cc:385] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.910693 24715 ts_tablet_manager.cc:1403] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.003s
I20260709 13:07:47.915475 24716 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.914506 24746 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.916865 24746 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.917174 24716 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.918552 24778 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.919240 24716 ts_tablet_manager.cc:1434] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:47.919024 24778 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.920240 24716 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.918617 24754 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.922616 24715 raft_consensus.cc:359] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.923353 24754 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.926011 24716 tablet_bootstrap.cc:654] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.926066 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.928156 24715 raft_consensus.cc:385] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.929219 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:47.929343 24598 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:47.929569 24715 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.929912 24672 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.930773 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:47.931900 24722 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.932296 24599 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:47.932335 24722 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.932955 24722 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.933403 24778 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:47.934312 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.935071 24524 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:47.937446 24672 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:47.940052 24722 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.940537 24716 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:47.941069 24716 ts_tablet_manager.cc:1403] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.006s
I20260709 13:07:47.941898 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:47.942934 24754 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.943506 24754 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:47.943867 24716 raft_consensus.cc:359] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.944612 24716 raft_consensus.cc:385] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.945123 24716 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.945047 24715 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.945960 24716 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.944553 24754 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.948042 24716 ts_tablet_manager.cc:1434] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:47.947988 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:47.948652 24598 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.949150 24716 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:47.954104 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:47.954883 24524 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.955680 24778 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.955974 24598 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:47.956314 24778 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.957219 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:47.957983 24780 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.961120 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.962244 24778 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:47.956287 24716 tablet_bootstrap.cc:654] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:47.965489 24490 leader_election.cc:343] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:47.964232 24637 leader_election.cc:343] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:47.963398 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:47.900576 24751 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.967092 24597 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:47.968571 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:07:47.970062 24778 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.970527 24778 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.970965 24778 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:47.891363 24471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:47.977355 24722 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:47.980305 24782 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.980957 24782 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.983667 24782 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:47.984886 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:47.985366 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:47.985703 24597 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.986203 24525 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:47.987843 24563 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:47.989022 24786 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:47.989499 24786 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.989920 24786 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.993664 24751 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.994329 24751 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.999858 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.000618 24672 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:48.001610 24786 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:47.999809 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.004403 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:48.005200 24525 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:48.005731 24490 leader_election.cc:343] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.006557 24751 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.008394 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.014308 24715 ts_tablet_manager.cc:1434] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.097s	user 0.003s	sys 0.002s
I20260709 13:07:48.015537 24715 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
W20260709 13:07:48.020767 24491 leader_election.cc:343] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.021406 24491 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.023272 24754 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.025420 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:48.026940 24754 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.027539 24754 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:48.031018 24597 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:48.032756 24746 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.035488 24746 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.038367 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:48.039167 24672 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.049566 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:07:48.051285 24490 leader_election.cc:343] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.028664 24754 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.061555 24780 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:48.066326 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:48.066934 24674 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.070325 24714 tablet_bootstrap.cc:492] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.070770 24714 ts_tablet_manager.cc:1403] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.194s	user 0.052s	sys 0.075s
I20260709 13:07:48.070843 24524 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:48.075114 24715 tablet_bootstrap.cc:654] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.063978 24786 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.079556 24714 raft_consensus.cc:359] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.080265 24714 raft_consensus.cc:385] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.080566 24714 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.081672 24714 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.083231 24817 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.081832 24780 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.080626 24751 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.085346 24751 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.089069 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.090763 24751 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:07:48.090772 24490 leader_election.cc:343] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.076191 24422 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.094398 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.098358 24671 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:48.104121 24716 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:48.104636 24716 ts_tablet_manager.cc:1403] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.156s	user 0.045s	sys 0.051s
I20260709 13:07:48.107858 24714 ts_tablet_manager.cc:1434] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:07:48.083681 24525 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:48.109043 24714 tablet_bootstrap.cc:492] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.083683 24817 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.109763 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.082710 24778 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.112993 24751 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.113449 24751 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.113833 24751 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.113690 24817 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.114346 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.114950 24716 raft_consensus.cc:359] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.115592 24563 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.115958 24716 raft_consensus.cc:385] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.116490 24716 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.116567 24786 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.117311 24786 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:07:48.117864 24490 leader_election.cc:343] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.118403 24786 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.122329 24674 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:48.124375 24778 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:48.096310 24672 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:48.125846 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:48.127111 24716 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.127018 24598 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.131749 24716 ts_tablet_manager.cc:1434] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.005s
I20260709 13:07:48.133072 24716 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:48.129915 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:48.133911 24525 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.130673 24491 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.137280 24754 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.139770 24754 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:48.141463 24598 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:48.143388 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.144253 24419 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.144276 24778 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.148730 24778 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.144428 24780 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.152252 24778 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:48.150522 24780 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:48.149609 24751 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.153883 24780 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.155045 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.156607 24778 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.156999 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.142400 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.157620 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:48.157941 24751 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.154529 24422 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.145792 24525 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
W20260709 13:07:48.160581 24490 leader_election.cc:343] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.162847 24598 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:07:48.164397 24715 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:48.164774 24715 ts_tablet_manager.cc:1403] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.149s	user 0.011s	sys 0.002s
I20260709 13:07:48.142879 24754 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.168638 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.169227 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:48.169446 24778 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.169867 24674 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:48.170264 24491 leader_election.cc:343] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.170704 24491 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.174103 24751 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.176561 24778 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.180457 24715 raft_consensus.cc:359] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.181425 24715 raft_consensus.cc:385] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.181942 24715 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.179636 24714 tablet_bootstrap.cc:654] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.182134 24674 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:48.184417 24715 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.187623 24715 ts_tablet_manager.cc:1434] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:07:48.188583 24715 tablet_bootstrap.cc:492] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.192314 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.194988 24754 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.195786 24754 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:48.196591 24754 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.198441 24716 tablet_bootstrap.cc:654] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.199419 24419 catalog_manager.cc:5697] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.207057 24715 tablet_bootstrap.cc:654] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.209749 24423 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.211720 24714 tablet_bootstrap.cc:492] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.212213 24714 ts_tablet_manager.cc:1403] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.001s
I20260709 13:07:48.211891 24423 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.214807 24714 raft_consensus.cc:359] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.215472 24714 raft_consensus.cc:385] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.215720 24714 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.216403 24714 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.219157 24714 ts_tablet_manager.cc:1434] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:48.220000 24714 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.226372 24714 tablet_bootstrap.cc:654] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.232174 24715 tablet_bootstrap.cc:492] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:48.232615 24715 ts_tablet_manager.cc:1403] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.015s
I20260709 13:07:48.235239 24714 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.235129 24715 raft_consensus.cc:359] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.235651 24714 ts_tablet_manager.cc:1403] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:07:48.235816 24715 raft_consensus.cc:385] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.236132 24715 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.236780 24715 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.239053 24715 ts_tablet_manager.cc:1434] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:07:48.239045 24419 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.240164 24715 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.237905 24714 raft_consensus.cc:359] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.243932 24714 raft_consensus.cc:385] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.244211 24714 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.244412 24815 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:48.244937 24714 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.247802 24714 ts_tablet_manager.cc:1434] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:48.248886 24714 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.255911 24715 tablet_bootstrap.cc:654] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.258495 24714 tablet_bootstrap.cc:654] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.259388 24754 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.260007 24754 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.264559 24754 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.265758 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.266415 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:48.270392 24491 leader_election.cc:343] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:48.270895 24490 leader_election.cc:343] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.271348 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.272545 24754 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.272611 24716 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:48.273382 24716 ts_tablet_manager.cc:1403] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.141s	user 0.006s	sys 0.021s
I20260709 13:07:48.274780 24714 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.275094 24714 ts_tablet_manager.cc:1403] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 13:07:48.275893 24716 raft_consensus.cc:359] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.276598 24716 raft_consensus.cc:385] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.276862 24716 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.276777 24714 raft_consensus.cc:359] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.277501 24714 raft_consensus.cc:385] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.277751 24714 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.278456 24714 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.279244 24754 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.285181 24754 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.286273 24714 ts_tablet_manager.cc:1434] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 13:07:48.287217 24714 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.287801 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:48.289018 24490 leader_election.cc:343] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.278412 24716 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.291201 24716 ts_tablet_manager.cc:1434] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:07:48.292939 24714 tablet_bootstrap.cc:654] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.296166 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:48.297714 24491 leader_election.cc:343] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.298266 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.299072 24751 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.302342 24754 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.306066 24715 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:48.306734 24715 ts_tablet_manager.cc:1403] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.005s
I20260709 13:07:48.309358 24714 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.309774 24716 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:48.309886 24714 ts_tablet_manager.cc:1403] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:07:48.309428 24715 raft_consensus.cc:359] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.310379 24715 raft_consensus.cc:385] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.310686 24715 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.311298 24715 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.313441 24715 ts_tablet_manager.cc:1434] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:07:48.312850 24714 raft_consensus.cc:359] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.313921 24714 raft_consensus.cc:385] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.314193 24714 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.314612 24715 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.314946 24714 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.315814 24716 tablet_bootstrap.cc:654] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.320310 24786 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.320525 24714 ts_tablet_manager.cc:1434] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:07:48.320835 24786 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.321301 24715 tablet_bootstrap.cc:654] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.321580 24714 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.324535 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.324741 24786 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.325333 24525 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:48.326136 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.326586 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.327482 24786 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:48.327603 24566 leader_election.cc:343] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.327876 24786 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.328487 24786 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.328653 24714 tablet_bootstrap.cc:654] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.345044 24714 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.345679 24714 ts_tablet_manager.cc:1403] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.010s
I20260709 13:07:48.345783 24786 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.348522 24714 raft_consensus.cc:359] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.349200 24714 raft_consensus.cc:385] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.349494 24714 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.349354 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:48.350251 24714 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.350680 24782 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:48.351613 24566 leader_election.cc:343] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.352653 24714 ts_tablet_manager.cc:1434] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:07:48.352216 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:48.353436 24525 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.353753 24714 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.360530 24525 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:48.361766 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:48.362459 24782 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.352200 24786 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.367003 24716 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:48.367024 24714 tablet_bootstrap.cc:654] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.367661 24716 ts_tablet_manager.cc:1403] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.004s
I20260709 13:07:48.383615 24714 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.384229 24714 ts_tablet_manager.cc:1403] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.003s
I20260709 13:07:48.386951 24714 raft_consensus.cc:359] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.387612 24714 raft_consensus.cc:385] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.387946 24714 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.388934 24714 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.391965 24714 ts_tablet_manager.cc:1434] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:48.394606 24714 tablet_bootstrap.cc:492] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.397477 24751 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.402130 24714 tablet_bootstrap.cc:654] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.405826 24843 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:48.406630 24782 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:48.370628 24716 raft_consensus.cc:359] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.407826 24716 raft_consensus.cc:385] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.408167 24716 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.408015 24782 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.431288 24754 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:48.435796 24846 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.436623 24846 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.440822 24846 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.440815 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:48.444983 24566 leader_election.cc:343] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.455260 24714 tablet_bootstrap.cc:492] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.455778 24714 ts_tablet_manager.cc:1403] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.003s
I20260709 13:07:48.459264 24716 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.460179 24815 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.460700 24815 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.461493 24754 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.462097 24754 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.464985 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.465794 24419 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.468415 24715 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:48.468662 24716 ts_tablet_manager.cc:1434] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.000s
I20260709 13:07:48.468868 24715 ts_tablet_manager.cc:1403] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.154s	user 0.037s	sys 0.061s
W20260709 13:07:48.468871 24490 leader_election.cc:343] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.469630 24716 tablet_bootstrap.cc:492] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:48.470502 24817 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.470942 24817 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.471496 24715 raft_consensus.cc:359] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.472105 24715 raft_consensus.cc:385] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.472368 24715 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.472970 24715 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.474939 24715 ts_tablet_manager.cc:1434] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:07:48.475787 24715 tablet_bootstrap.cc:492] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.476389 24716 tablet_bootstrap.cc:654] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.476342 24728 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.478533 24714 raft_consensus.cc:359] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.479219 24714 raft_consensus.cc:385] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.479637 24817 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.479521 24714 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.480510 24754 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.480520 24714 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.482702 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.483286 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.485663 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.486124 24524 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:48.487113 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.487383 24714 ts_tablet_manager.cc:1434] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:07:48.488287 24714 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
W20260709 13:07:48.465797 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 79214.3us
I20260709 13:07:48.494194 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.495067 24524 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
W20260709 13:07:48.496464 24490 leader_election.cc:343] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.496649 24714 tablet_bootstrap.cc:654] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.499101 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.498329 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:48.501817 24639 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.502084 24715 tablet_bootstrap.cc:654] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.502974 24780 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.493010 24815 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:48.504336 24782 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.505389 24782 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.505714 24782 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:48.502696 24491 leader_election.cc:343] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.510699 24491 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.511451 24754 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.512352 24817 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.512239 24754 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:48.513653 24491 leader_election.cc:343] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.514072 24491 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.514317 24754 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.514302 24780 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.515128 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.515823 24817 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:48.516566 24490 leader_election.cc:343] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.519551 24782 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.522636 24716 tablet_bootstrap.cc:492] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:48.523182 24716 ts_tablet_manager.cc:1403] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.014s
I20260709 13:07:48.523962 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:48.524595 24524 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.526850 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.533595 24524 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:48.536155 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:07:48.539184 24566 leader_election.cc:343] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.536660 24782 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.539292 24751 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:48.541581 24491 leader_election.cc:343] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.542140 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.542996 24754 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.553932 24716 raft_consensus.cc:359] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.554876 24716 raft_consensus.cc:385] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.555202 24716 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.558090 24848 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.560685 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:48.561918 24782 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.562657 24782 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:48.563603 24782 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.576351 24845 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.576979 24845 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.577526 24716 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.579694 24716 ts_tablet_manager.cc:1434] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.056s	user 0.002s	sys 0.004s
I20260709 13:07:48.582593 24714 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.582368 24815 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.583014 24714 ts_tablet_manager.cc:1403] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.095s	user 0.030s	sys 0.014s
I20260709 13:07:48.583982 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.584190 24715 tablet_bootstrap.cc:492] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:48.584787 24715 ts_tablet_manager.cc:1403] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.109s	user 0.031s	sys 0.037s
I20260709 13:07:48.584604 24525 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:48.586495 24563 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.587529 24848 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.587538 24715 raft_consensus.cc:359] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.587985 24848 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.588421 24848 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.588821 24845 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.589598 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.590672 24674 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:48.594870 24848 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.596670 24716 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:48.599951 24715 raft_consensus.cc:385] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.600243 24715 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.600948 24715 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.602785 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:48.601795 24848 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.603343 24674 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.604315 24715 ts_tablet_manager.cc:1434] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:07:48.604817 24714 raft_consensus.cc:359] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.605491 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:48.610788 24714 raft_consensus.cc:385] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.611114 24714 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.610930 24525 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.611807 24715 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.611793 24714 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.614326 24714 ts_tablet_manager.cc:1434] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:07:48.615211 24714 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.615621 24422 catalog_manager.cc:5697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.621070 24525 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:48.622210 24563 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.623500 24782 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.623854 24782 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:48.624500 24782 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:48.631039 24490 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.631588 24843 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.632139 24843 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.636137 24780 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.641490 24843 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.643441 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.644398 24674 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:48.645290 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.646130 24673 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 1: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:07:48.646361 24846 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.648397 24566 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:48.650352 24847 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.650929 24714 tablet_bootstrap.cc:654] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.660445 24847 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.660989 24780 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:48.679199 24419 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.689402 24716 tablet_bootstrap.cc:654] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.694622 24715 tablet_bootstrap.cc:654] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.705411 24778 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.713649 24778 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.714206 24778 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.716472 24754 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.717427 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.717839 24778 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:48.718235 24524 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:48.727414 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.728856 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.729856 24754 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:48.730708 24815 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.735755 24754 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.741971 24815 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.747614 24754 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.747869 24716 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:48.748198 24754 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.749439 24716 ts_tablet_manager.cc:1403] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.153s	user 0.015s	sys 0.004s
I20260709 13:07:48.750626 24754 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.751392 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.752089 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:48.753909 24490 leader_election.cc:343] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.754897 24715 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
W20260709 13:07:48.755474 24491 leader_election.cc:343] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.755474 24715 ts_tablet_manager.cc:1403] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.003s
I20260709 13:07:48.756155 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.760360 24817 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.760589 24716 raft_consensus.cc:359] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.761037 24754 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.761282 24716 raft_consensus.cc:385] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.761583 24716 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.761493 24754 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.762272 24716 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.764138 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.764096 24715 raft_consensus.cc:359] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.764832 24715 raft_consensus.cc:385] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.765129 24715 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
W20260709 13:07:48.765475 24490 leader_election.cc:343] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.765774 24715 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.766515 24754 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.768697 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.769130 24714 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.769253 24716 ts_tablet_manager.cc:1434] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:07:48.769582 24714 ts_tablet_manager.cc:1403] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.155s	user 0.032s	sys 0.034s
I20260709 13:07:48.770081 24716 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
W20260709 13:07:48.773130 24491 leader_election.cc:343] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.774063 24714 raft_consensus.cc:359] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.773765 24491 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.774736 24714 raft_consensus.cc:385] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.775036 24714 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.775127 24715 ts_tablet_manager.cc:1434] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:07:48.775182 24751 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.775668 24714 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.778249 24714 ts_tablet_manager.cc:1434] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:48.778898 24716 tablet_bootstrap.cc:654] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.779091 24714 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.787571 24715 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.789575 24714 tablet_bootstrap.cc:654] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.795261 24715 tablet_bootstrap.cc:654] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.807188 24714 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.807592 24715 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:48.807626 24714 ts_tablet_manager.cc:1403] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 13:07:48.808138 24715 ts_tablet_manager.cc:1403] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.002s
I20260709 13:07:48.811750 24714 raft_consensus.cc:359] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.812427 24714 raft_consensus.cc:385] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.812688 24714 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.813313 24714 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.813580 24715 raft_consensus.cc:359] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.814178 24715 raft_consensus.cc:385] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.814448 24715 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.815521 24714 ts_tablet_manager.cc:1434] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:48.816720 24714 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.818280 24715 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.821977 24715 ts_tablet_manager.cc:1434] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:07:48.823494 24714 tablet_bootstrap.cc:654] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.825758 24715 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.833879 24716 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:48.834481 24716 ts_tablet_manager.cc:1403] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.013s
I20260709 13:07:48.835386 24782 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.835850 24782 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.837821 24782 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.837829 24848 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.839013 24754 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.838932 24848 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.840293 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.840488 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.841413 24848 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.839637 24754 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.843834 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.844456 24714 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.844542 24523 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:48.844719 24566 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:48.845131 24714 ts_tablet_manager.cc:1403] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 13:07:48.846601 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.847070 24715 tablet_bootstrap.cc:654] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.847348 24674 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:48.847579 24714 raft_consensus.cc:359] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.848784 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:48.843557 24716 raft_consensus.cc:359] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.849323 24716 raft_consensus.cc:385] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.849903 24754 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.849617 24716 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
W20260709 13:07:48.850191 24490 leader_election.cc:343] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.848309 24714 raft_consensus.cc:385] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.852283 24714 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.852901 24714 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.853410 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.854984 24714 ts_tablet_manager.cc:1434] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:07:48.855118 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.855808 24716 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:48.856724 24491 leader_election.cc:343] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.857287 24491 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.857604 24716 ts_tablet_manager.cc:1434] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:07:48.858572 24716 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:48.859910 24715 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:48.859992 24782 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.860466 24715 ts_tablet_manager.cc:1403] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 13:07:48.860908 24714 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.860867 24782 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.861469 24782 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.861874 24782 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.863086 24715 raft_consensus.cc:359] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.863796 24715 raft_consensus.cc:385] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.864097 24715 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.865921 24715 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.866711 24714 tablet_bootstrap.cc:654] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.866665 24847 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.867143 24847 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.867659 24728 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.869299 24848 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:48.869722 24847 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.871469 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:48.872149 24524 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:48.873534 24563 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.874461 24847 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.874826 24847 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.875151 24847 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.879263 24716 tablet_bootstrap.cc:654] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.881457 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.882194 24674 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:48.871645 24715 ts_tablet_manager.cc:1434] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:07:48.887970 24782 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.888787 24715 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.894767 24714 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:48.895222 24714 ts_tablet_manager.cc:1403] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 13:07:48.895545 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:48.896123 24524 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.897678 24714 raft_consensus.cc:359] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.898355 24714 raft_consensus.cc:385] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.898610 24714 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.899667 24714 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.899524 24847 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.905498 24714 ts_tablet_manager.cc:1434] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:07:48.906422 24714 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:48.904925 24524 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:48.906842 24847 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.908120 24843 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:48.911764 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:48.912009 24714 tablet_bootstrap.cc:654] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.912444 24673 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.913226 24715 tablet_bootstrap.cc:654] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.914279 24716 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:48.909889 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:48.914912 24716 ts_tablet_manager.cc:1403] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.000s
I20260709 13:07:48.915105 24523 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.918237 24563 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.924444 24751 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.925429 24715 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:48.925848 24715 ts_tablet_manager.cc:1403] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260709 13:07:48.927138 24848 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.927824 24716 raft_consensus.cc:359] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.928454 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:48.925005 24751 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.928733 24716 raft_consensus.cc:385] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.929144 24671 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.929886 24716 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.931872 24716 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.928834 24848 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:48.910187 24782 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.948246 24716 ts_tablet_manager.cc:1434] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:07:48.948988 24716 tablet_bootstrap.cc:492] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:48.950874 24751 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:48.952498 24848 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.958071 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:48.958926 24673 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:48.959910 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:48.961319 24491 leader_election.cc:343] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.962051 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:48.962829 24782 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.963250 24782 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:48.963987 24782 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.966969 24715 raft_consensus.cc:359] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.967902 24715 raft_consensus.cc:385] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.968251 24715 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.969692 24715 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:48.974859 24715 ts_tablet_manager.cc:1434] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
W20260709 13:07:48.975967 24490 leader_election.cc:343] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.976465 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:48.977224 24817 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:48.975977 24715 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:48.991170 24671 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:49.005559 24523 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:49.007682 24714 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:49.008270 24714 ts_tablet_manager.cc:1403] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.102s	user 0.037s	sys 0.038s
I20260709 13:07:49.008882 24848 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.010607 24848 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.013209 24716 tablet_bootstrap.cc:654] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.013559 24848 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.015318 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:49.019035 24566 leader_election.cc:343] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.017339 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.019186 24422 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.021201 24422 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.021766 24848 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.022312 24714 raft_consensus.cc:359] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.022938 24714 raft_consensus.cc:385] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.023200 24714 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.023818 24714 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.020342 24523 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:49.025502 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:49.025872 24714 ts_tablet_manager.cc:1434] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:07:49.026633 24847 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.027051 24847 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.027390 24847 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.034368 24715 tablet_bootstrap.cc:654] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.036120 24598 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.036466 24847 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.040103 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.040819 24523 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.043843 24817 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.044653 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:49.044468 24817 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.046391 24843 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.026748 24714 tablet_bootstrap.cc:492] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:49.047894 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:49.049216 24490 leader_election.cc:343] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.051182 24817 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.057626 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.059669 24714 tablet_bootstrap.cc:654] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:49.059547 24491 leader_election.cc:343] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.060165 24491 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.060364 24523 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:49.043931 24847 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.061048 24817 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.064177 24778 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:07:49.064671 24778 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:49.065299 24566 leader_election.cc:343] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.066576 24778 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:49.068207 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.069339 24597 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:49.077342 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.078002 24524 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:07:49.079682 24843 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.083225 24637 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.084748 24778 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:49.085170 24778 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:07:49.085528 24778 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:49.080072 24716 tablet_bootstrap.cc:492] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:49.088151 24716 ts_tablet_manager.cc:1403] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.139s	user 0.022s	sys 0.004s
I20260709 13:07:49.094200 24716 raft_consensus.cc:359] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.094868 24716 raft_consensus.cc:385] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.095124 24716 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
W20260709 13:07:49.096580 24471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:49.100796 24715 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:49.101440 24715 ts_tablet_manager.cc:1403] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.000s
I20260709 13:07:49.106870 24716 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.107491 24782 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.118078 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:49.119256 24847 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.119081 24778 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.119560 24716 ts_tablet_manager.cc:1434] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.005s
I20260709 13:07:49.120069 24847 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:49.121069 24847 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.125049 24716 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:49.126921 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.128922 24778 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:49.130028 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:49.130800 24598 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:49.104671 24715 raft_consensus.cc:359] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.146035 24715 raft_consensus.cc:385] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.146353 24715 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.147156 24714 tablet_bootstrap.cc:492] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:49.157441 24714 ts_tablet_manager.cc:1403] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.014s
I20260709 13:07:49.159970 24714 raft_consensus.cc:359] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.160622 24714 raft_consensus.cc:385] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.160889 24714 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.161530 24714 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.163304 24523 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:07:49.166332 24637 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.167158 24778 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:49.163643 24714 ts_tablet_manager.cc:1434] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:49.167621 24778 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:49.168294 24714 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:49.146996 24715 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.168429 24778 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.170686 24715 ts_tablet_manager.cc:1434] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:07:49.171573 24715 tablet_bootstrap.cc:492] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:49.152040 24716 tablet_bootstrap.cc:654] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.154672 24817 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.173375 24817 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.174846 24714 tablet_bootstrap.cc:654] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.176199 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:49.177584 24490 leader_election.cc:343] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.180377 24423 catalog_manager.cc:5697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.181753 24817 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.182806 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.183893 24714 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
W20260709 13:07:49.184120 24491 leader_election.cc:343] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.184327 24714 ts_tablet_manager.cc:1403] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:07:49.184572 24491 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.184228 24422 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.185554 24817 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.187314 24714 raft_consensus.cc:359] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.188212 24714 raft_consensus.cc:385] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.188503 24714 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.189559 24714 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.191406 24714 ts_tablet_manager.cc:1434] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:49.195279 24715 tablet_bootstrap.cc:654] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.197891 24714 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:49.206583 24714 tablet_bootstrap.cc:654] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.228309 24715 tablet_bootstrap.cc:492] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:49.228780 24715 ts_tablet_manager.cc:1403] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.010s
I20260709 13:07:49.228780 24714 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:49.230669 24714 ts_tablet_manager.cc:1403] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.008s
I20260709 13:07:49.232216 24715 raft_consensus.cc:359] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.232895 24715 raft_consensus.cc:385] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.233208 24715 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.233016 24714 raft_consensus.cc:359] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.233702 24714 raft_consensus.cc:385] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.234367 24716 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:49.233982 24714 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.234932 24716 ts_tablet_manager.cc:1403] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.111s	user 0.028s	sys 0.023s
I20260709 13:07:49.233966 24715 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.235288 24714 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.236617 24715 ts_tablet_manager.cc:1434] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:49.237483 24714 ts_tablet_manager.cc:1434] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:49.237887 24716 raft_consensus.cc:359] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.237499 24715 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:49.238608 24716 raft_consensus.cc:385] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.239005 24716 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.239744 24716 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.241854 24716 ts_tablet_manager.cc:1434] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:49.238330 24714 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:49.244179 24715 tablet_bootstrap.cc:654] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.245622 24716 tablet_bootstrap.cc:492] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:49.247643 24714 tablet_bootstrap.cc:654] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.252123 24716 tablet_bootstrap.cc:654] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.255878 24715 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:49.256312 24715 ts_tablet_manager.cc:1403] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 13:07:49.258432 24817 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.258873 24817 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.260775 24817 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.262231 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.268146 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:49.268467 24490 leader_election.cc:343] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:49.269326 24491 leader_election.cc:343] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.269716 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.271360 24817 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.272368 24715 raft_consensus.cc:359] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.273025 24715 raft_consensus.cc:385] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.273437 24715 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.274148 24715 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.276350 24715 ts_tablet_manager.cc:1434] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:07:49.277280 24715 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:49.283252 24754 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.283931 24715 tablet_bootstrap.cc:654] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.283771 24754 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.285849 24754 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.287730 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:49.289181 24490 leader_election.cc:343] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.289973 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.290205 24716 tablet_bootstrap.cc:492] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:49.290654 24716 ts_tablet_manager.cc:1403] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.007s
W20260709 13:07:49.291168 24491 leader_election.cc:343] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.291697 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.293043 24817 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.293274 24716 raft_consensus.cc:359] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.293895 24716 raft_consensus.cc:385] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.294166 24716 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.294730 24716 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.295104 24714 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:49.295545 24714 ts_tablet_manager.cc:1403] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.017s
I20260709 13:07:49.296281 24817 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.296506 24716 ts_tablet_manager.cc:1434] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:07:49.296761 24817 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.298026 24715 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:49.298449 24715 ts_tablet_manager.cc:1403] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:07:49.298979 24714 raft_consensus.cc:359] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.299681 24716 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:49.299578 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:49.301054 24490 leader_election.cc:343] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.301608 24817 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.301789 24715 raft_consensus.cc:359] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.302526 24715 raft_consensus.cc:385] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.302829 24715 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.303194 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.303586 24715 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:49.304489 24491 leader_election.cc:343] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.304872 24491 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.305565 24716 tablet_bootstrap.cc:654] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.305776 24817 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.299582 24714 raft_consensus.cc:385] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.306756 24714 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.307449 24714 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.309294 24715 ts_tablet_manager.cc:1434] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:49.310175 24715 tablet_bootstrap.cc:492] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:49.310882 24714 ts_tablet_manager.cc:1434] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:07:49.314134 24780 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.314747 24780 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.315794 24715 tablet_bootstrap.cc:654] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.317906 24780 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:49.318805 24714 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:49.318765 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.318885 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.319581 24597 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:49.320907 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:49.322184 24815 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.322530 24815 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.322835 24815 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.319545 24523 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:49.326982 24714 tablet_bootstrap.cc:654] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.330683 24815 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.333423 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.333987 24523 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.341187 24523 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:49.343665 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:49.343922 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:49.344473 24597 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.344776 24778 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.345283 24778 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:49.346019 24778 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.352361 24780 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.342890 24815 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:49.353559 24597 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:49.359531 24714 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:49.360160 24714 ts_tablet_manager.cc:1403] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.003s
I20260709 13:07:49.361982 24715 tablet_bootstrap.cc:492] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:49.362473 24715 ts_tablet_manager.cc:1403] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 13:07:49.363384 24847 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.364007 24847 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.352959 24780 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.366772 24847 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.367844 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.368466 24673 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:49.368788 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.369609 24523 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:49.380793 24780 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:49.382153 24715 raft_consensus.cc:359] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.383102 24715 raft_consensus.cc:385] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.383468 24715 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.384274 24715 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.372051 24714 raft_consensus.cc:359] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.369653 24566 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:49.385543 24714 raft_consensus.cc:385] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.378597 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.386686 24714 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.386955 24598 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:49.379691 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.390437 24817 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.387625 24714 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.392525 24817 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.394107 24716 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:49.394613 24716 ts_tablet_manager.cc:1403] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.095s	user 0.045s	sys 0.049s
I20260709 13:07:49.388411 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:49.396401 24908 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.396785 24908 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.397053 24908 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.397317 24847 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.397694 24847 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.398052 24847 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.398332 24817 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.399793 24843 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.400278 24843 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.401309 24525 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:49.402284 24843 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.402762 24843 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.402861 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.403198 24843 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:49.404589 24491 leader_election.cc:343] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.404822 24908 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.405892 24715 ts_tablet_manager.cc:1434] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:07:49.406841 24715 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:49.406896 24908 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:49.407522 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.411499 24524 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.411365 24422 catalog_manager.cc:5697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.404587 24847 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.409559 24716 raft_consensus.cc:359] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.413515 24716 raft_consensus.cc:385] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.413857 24716 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.409731 24714 ts_tablet_manager.cc:1434] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.002s
I20260709 13:07:49.414911 24714 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:49.427466 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.407971 24843 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.444034 24525 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:49.470350 24751 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.616665 24716 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.617339 24751 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.495674 24908 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.523598 24817 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.618304 24908 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.618763 24817 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.620733 24908 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:49.621111 24846 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.621572 24846 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.622727 24716 ts_tablet_manager.cc:1434] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.228s	user 0.063s	sys 0.077s
I20260709 13:07:49.623541 24846 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.626003 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.626639 24525 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:49.627192 24847 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.471560 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:49.628918 24597 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:49.507565 24782 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.630795 24782 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.616622 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.664162 24715 tablet_bootstrap.cc:654] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.578271 24780 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.555832 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.636391 24846 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.714835 24780 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.635342 24751 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.636253 24817 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.526057 24843 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.189s
I20260709 13:07:49.710961 24524 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:49.727061 24782 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.721666 24637 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:49.731827 24815 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.719643 24523 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:49.732210 24815 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.722467 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.732573 24815 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.724742 24714 tablet_bootstrap.cc:654] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.511606 24563 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:49.721055 24846 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.746366 24782 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.751747 24780 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:07:49.745733 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 234237us
I20260709 13:07:49.753911 24782 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.760423 24782 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.820034 24846 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.831722 24815 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.834455 24815 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:07:49.839514 24490 leader_election.cc:343] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.839867 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.840076 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.840752 24523 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 1: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:07:49.841157 24917 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.842155 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.843012 24523 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:49.843161 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.842181 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.847357 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:49.848377 24490 leader_election.cc:343] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.848402 24673 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:49.850015 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.850194 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.850670 24597 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:49.850888 24523 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:49.851943 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.852569 24782 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.854672 24782 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.854815 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:49.855438 24673 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.856740 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:49.855463 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.857532 24674 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 1: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:07:49.855373 24598 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.859388 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.860159 24667 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 1: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:07:49.865806 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.869016 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.869221 24598 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:49.871841 24598 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:49.872888 24563 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:49.873374 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:07:49.850034 24490 leader_election.cc:343] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.873939 24674 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.874086 24714 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:49.874574 24714 ts_tablet_manager.cc:1403] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.460s	user 0.015s	sys 0.000s
I20260709 13:07:49.875458 24716 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:49.877051 24714 raft_consensus.cc:359] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.877609 24714 raft_consensus.cc:385] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.877844 24714 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.878391 24714 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.880811 24913 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.881140 24714 ts_tablet_manager.cc:1434] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:07:49.881336 24913 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:49.881150 24566 leader_election.cc:343] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.881803 24913 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.883872 24847 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:49.884004 24566 leader_election.cc:343] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.887475 24782 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:49.889294 24846 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.893435 24714 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:49.894539 24910 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.897735 24715 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:49.898197 24715 ts_tablet_manager.cc:1403] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.492s	user 0.014s	sys 0.009s
I20260709 13:07:49.899798 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:49.899986 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.900820 24524 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.895141 24910 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:49.903441 24491 leader_election.cc:343] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.903760 24491 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.892644 24674 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:49.905126 24917 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.891251 24563 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:49.908640 24522 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:49.910223 24910 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.912595 24716 tablet_bootstrap.cc:654] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.913193 24910 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.913757 24910 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.916006 24910 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.916740 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.917538 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:49.920495 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:49.921948 24524 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
W20260709 13:07:49.922045 24490 leader_election.cc:343] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.918072 24913 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:49.922988 24490 leader_election.cc:343] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.924296 24714 tablet_bootstrap.cc:654] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.924445 24913 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.906096 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.920025 24846 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.925791 24848 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.925971 24523 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:49.926277 24848 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.926748 24848 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.935792 24848 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.938645 24848 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:49.939157 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:49.939591 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:07:49.940356 24491 leader_election.cc:343] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.940546 24778 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.940838 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.941635 24910 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.941871 24778 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:49.942420 24563 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:49.942824 24778 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.943552 24911 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:49.944083 24914 raft_consensus.cc:2764] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:07:49.945959 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:49.948257 24847 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.948928 24847 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:49.949873 24847 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.952739 24715 raft_consensus.cc:359] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.953686 24715 raft_consensus.cc:385] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.954010 24715 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.958369 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:49.959262 24716 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:49.959152 24523 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:07:49.959731 24716 ts_tablet_manager.cc:1403] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.003s
I20260709 13:07:49.962404 24716 raft_consensus.cc:359] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.954805 24715 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.963075 24716 raft_consensus.cc:385] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.964682 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.965217 24716 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.965456 24524 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.966022 24716 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.967463 24715 ts_tablet_manager.cc:1434] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:07:49.968755 24715 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:49.969803 24637 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:49.969734 24908 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:49.970882 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:49.971379 24908 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.974881 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.975812 24523 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.978969 24422 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.980086 24524 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:49.981038 24714 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:49.981528 24714 ts_tablet_manager.cc:1403] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.004s
I20260709 13:07:49.984535 24714 raft_consensus.cc:359] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.986758 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:49.987494 24522 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.989877 24523 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:49.990939 24919 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.992316 24780 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.994284 24908 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:49.994961 24716 ts_tablet_manager.cc:1434] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:07:49.995155 24908 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.995853 24716 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:49.996600 24778 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.997110 24778 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:49.999419 24919 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.000064 24778 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:49.985025 24714 raft_consensus.cc:385] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.003943 24714 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.005556 24714 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.013406 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.022383 24714 ts_tablet_manager.cc:1434] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 13:07:50.023741 24714 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:50.027683 24422 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.044649 24715 tablet_bootstrap.cc:654] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.042810 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.047228 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:50.046090 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:50.059882 24491 leader_election.cc:343] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.060976 24491 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:50.053841 24778 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:07:50.070266 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.070616 24847 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:50.071157 24525 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:50.072065 24847 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:07:50.072259 24817 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.072530 24847 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.075937 24522 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
W20260709 13:07:50.058979 24566 leader_election.cc:343] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.080981 24716 tablet_bootstrap.cc:654] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.084182 24913 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:50.087343 24563 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:50.088169 24913 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.088579 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:50.088829 24913 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:50.089725 24913 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.072510 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:50.098069 24911 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.098589 24911 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:07:50.100842 24639 leader_election.cc:343] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.099385 24911 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.127822 24716 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
W20260709 13:07:50.128298 24491 leader_election.cc:343] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.128736 24491 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:50.129698 24423 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.132332 24917 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.160372 24716 ts_tablet_manager.cc:1403] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.165s	user 0.015s	sys 0.000s
I20260709 13:07:50.131951 24847 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.171212 24716 raft_consensus.cc:359] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.173449 24716 raft_consensus.cc:385] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:50.171904 24566 leader_election.cc:343] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.173728 24716 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.192160 24716 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.196797 24716 ts_tablet_manager.cc:1434] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:07:50.198833 24716 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
W20260709 13:07:50.214039 24930 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:07:50.220108 24597 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:50.222766 24847 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.223629 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:50.223872 24919 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.224357 24714 tablet_bootstrap.cc:654] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.225018 24715 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.228482 24715 ts_tablet_manager.cc:1403] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.260s	user 0.017s	sys 0.005s
I20260709 13:07:50.225804 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:50.232762 24908 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.233176 24908 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.233814 24908 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.235980 24843 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.236485 24843 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.238528 24843 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.241266 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:50.242424 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.243058 24670 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:50.245575 24716 tablet_bootstrap.cc:654] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.246191 24715 raft_consensus.cc:359] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.246898 24715 raft_consensus.cc:385] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.247110 24715 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.258839 24908 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.258635 24715 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.260996 24908 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:07:50.262115 24471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:50.262364 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:50.262741 24778 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:50.262982 24521 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.263209 24778 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:50.267230 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.277724 24715 ts_tablet_manager.cc:1434] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.005s
I20260709 13:07:50.277884 24522 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:50.268566 24566 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:50.270290 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:50.278614 24715 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.280238 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:50.280745 24913 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:50.276197 24521 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:50.288504 24913 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.291162 24913 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.291548 24913 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.293571 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:50.295033 24919 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.295511 24919 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:50.296294 24919 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.289597 24778 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.302875 24778 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.304589 24715 tablet_bootstrap.cc:654] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:50.312685 24639 leader_election.cc:343] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.315834 24913 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.321543 24716 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:50.322023 24716 ts_tablet_manager.cc:1403] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.123s	user 0.032s	sys 0.035s
I20260709 13:07:50.326004 24913 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.326658 24716 raft_consensus.cc:359] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.327356 24716 raft_consensus.cc:385] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.327639 24716 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.328774 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:50.329430 24520 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.331377 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:50.331996 24669 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.333318 24716 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.338732 24716 ts_tablet_manager.cc:1434] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:07:50.339641 24716 tablet_bootstrap.cc:492] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:50.340210 24520 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:50.341378 24563 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:50.342219 24913 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.342727 24913 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:50.343585 24913 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.345498 24716 tablet_bootstrap.cc:654] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.345587 24843 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.346068 24843 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.350284 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.351100 24521 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:50.367515 24715 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.367751 24843 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.368040 24715 ts_tablet_manager.cc:1403] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.027s
I20260709 13:07:50.370395 24917 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.370822 24715 raft_consensus.cc:359] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.371526 24715 raft_consensus.cc:385] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.371042 24917 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.371798 24715 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.372424 24715 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.375671 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:50.376643 24847 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.377003 24847 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.377385 24847 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.377110 24423 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.381335 24423 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.383893 24715 ts_tablet_manager.cc:1434] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:07:50.384795 24715 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.384995 24917 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.387012 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:50.389333 24490 leader_election.cc:343] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.391520 24715 tablet_bootstrap.cc:654] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.391834 24847 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.392810 24716 tablet_bootstrap.cc:492] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:50.393312 24716 ts_tablet_manager.cc:1403] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.054s	user 0.030s	sys 0.012s
I20260709 13:07:50.396238 24715 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.396687 24715 ts_tablet_manager.cc:1403] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.004s
I20260709 13:07:50.398100 24847 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.398299 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:50.398854 24524 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.399252 24715 raft_consensus.cc:359] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.399920 24715 raft_consensus.cc:385] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.400167 24715 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.400467 24714 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:50.400894 24714 ts_tablet_manager.cc:1403] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.377s	user 0.009s	sys 0.009s
I20260709 13:07:50.400724 24715 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.403200 24715 ts_tablet_manager.cc:1434] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:07:50.404007 24715 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.395879 24716 raft_consensus.cc:359] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.405216 24716 raft_consensus.cc:385] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.405489 24716 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.406170 24524 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:50.406070 24716 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.407410 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:50.416564 24715 tablet_bootstrap.cc:654] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.408195 24669 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:50.408838 24847 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.408684 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.422374 24847 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:50.423333 24847 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.423564 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.408243 24716 ts_tablet_manager.cc:1434] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.001s
I20260709 13:07:50.425235 24716 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:50.426934 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:50.429790 24419 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.431052 24716 tablet_bootstrap.cc:654] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:50.432469 24491 leader_election.cc:343] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.433058 24491 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:50.433943 24917 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:50.434939 24566 leader_election.cc:343] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.403386 24714 raft_consensus.cc:359] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.436159 24714 raft_consensus.cc:385] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:50.436448 24566 leader_election.cc:343] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.436605 24908 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.436444 24714 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.438165 24714 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.440197 24714 ts_tablet_manager.cc:1434] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.039s	user 0.001s	sys 0.003s
I20260709 13:07:50.441052 24714 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:50.450767 24715 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.451236 24715 ts_tablet_manager.cc:1403] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.007s
I20260709 13:07:50.453820 24715 raft_consensus.cc:359] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.454452 24715 raft_consensus.cc:385] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.454690 24715 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.454644 24843 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.455569 24715 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.463377 24714 tablet_bootstrap.cc:654] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.467749 24715 ts_tablet_manager.cc:1434] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:07:50.468712 24715 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.477794 24715 tablet_bootstrap.cc:654] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.478446 24778 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.483513 24919 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.486970 24716 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:50.487577 24716 ts_tablet_manager.cc:1403] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.020s
I20260709 13:07:50.502120 24843 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.485924 24422 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.505616 24422 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.510706 24715 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.511183 24715 ts_tablet_manager.cc:1403] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260709 13:07:50.517969 24715 raft_consensus.cc:359] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.518615 24715 raft_consensus.cc:385] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.518870 24715 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.519557 24843 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.519500 24715 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.522544 24715 ts_tablet_manager.cc:1434] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:07:50.523351 24715 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.529856 24715 tablet_bootstrap.cc:654] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.540503 24778 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.544363 24670 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.546128 24715 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.545938 24716 raft_consensus.cc:359] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.546638 24716 raft_consensus.cc:385] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.546708 24715 ts_tablet_manager.cc:1403] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:07:50.546967 24716 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.547652 24716 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.549573 24715 raft_consensus.cc:359] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.551578 24715 raft_consensus.cc:385] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.552228 24715 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.553326 24715 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.558821 24715 ts_tablet_manager.cc:1434] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:50.560850 24715 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.567430 24715 tablet_bootstrap.cc:654] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.572540 24912 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.577896 24716 ts_tablet_manager.cc:1434] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:07:50.579147 24716 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:50.600497 24911 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.604086 24911 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.604933 24843 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.606361 24669 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.607182 24911 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.608160 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.608975 24520 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 1: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:07:50.614034 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.616371 24566 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:50.617239 24911 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.618435 24843 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.619205 24778 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.619673 24778 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.622234 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.622677 24778 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:50.622862 24520 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:50.624432 24637 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:50.625814 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:50.627053 24597 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:50.627280 24714 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:50.627766 24714 ts_tablet_manager.cc:1403] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.187s	user 0.038s	sys 0.069s
I20260709 13:07:50.627892 24778 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.628378 24778 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.628798 24778 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.630388 24714 raft_consensus.cc:359] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.631089 24714 raft_consensus.cc:385] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.631349 24714 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.631958 24714 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.633728 24716 tablet_bootstrap.cc:654] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.634582 24715 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.635042 24715 ts_tablet_manager.cc:1403] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.010s
I20260709 13:07:50.637249 24714 ts_tablet_manager.cc:1434] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:07:50.637648 24715 raft_consensus.cc:359] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.638447 24715 raft_consensus.cc:385] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.638861 24715 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.639787 24715 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.642629 24715 ts_tablet_manager.cc:1434] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:07:50.643810 24715 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.656154 24778 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.662942 24911 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.638160 24714 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:50.676712 24714 tablet_bootstrap.cc:654] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.682992 24715 tablet_bootstrap.cc:654] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.683127 24716 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:50.683513 24716 ts_tablet_manager.cc:1403] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.105s	user 0.029s	sys 0.021s
I20260709 13:07:50.685286 24778 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:50.685765 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:50.686398 24597 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.686255 24716 raft_consensus.cc:359] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.686687 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:50.686975 24716 raft_consensus.cc:385] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.687253 24521 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.687268 24716 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.688155 24716 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.692008 24716 ts_tablet_manager.cc:1434] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:07:50.692924 24716 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:50.695385 24597 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:50.696725 24521 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:50.696929 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:50.697830 24778 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.698311 24778 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:50.699126 24778 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.703275 24716 tablet_bootstrap.cc:654] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.706494 24780 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.707896 24780 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.710043 24780 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:50.711119 24715 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.712015 24715 ts_tablet_manager.cc:1403] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.005s
I20260709 13:07:50.712893 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:50.714526 24715 raft_consensus.cc:359] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.715281 24715 raft_consensus.cc:385] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.715559 24715 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.716280 24715 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.718722 24715 ts_tablet_manager.cc:1434] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:07:50.718865 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.719595 24715 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.719883 24521 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:50.722285 24714 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:50.722775 24714 ts_tablet_manager.cc:1403] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.004s
I20260709 13:07:50.725728 24715 tablet_bootstrap.cc:654] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.725399 24714 raft_consensus.cc:359] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.726189 24714 raft_consensus.cc:385] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.726234 24637 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:50.726544 24714 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.727342 24714 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.727687 24780 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.730165 24714 ts_tablet_manager.cc:1434] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:50.731951 24714 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:50.732170 24419 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.734463 24917 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.734931 24917 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.736819 24917 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.737844 24714 tablet_bootstrap.cc:654] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.738350 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:50.739722 24490 leader_election.cc:343] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.741230 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.744381 24780 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:50.746114 24491 leader_election.cc:343] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.748814 24491 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:50.747732 24715 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.749496 24917 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.750129 24715 ts_tablet_manager.cc:1403] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.004s
I20260709 13:07:50.750402 24716 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:50.750854 24716 ts_tablet_manager.cc:1403] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.007s
I20260709 13:07:50.751540 24714 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:50.751959 24714 ts_tablet_manager.cc:1403] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:07:50.752946 24715 raft_consensus.cc:359] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.753157 24716 raft_consensus.cc:359] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.753814 24715 raft_consensus.cc:385] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.753834 24716 raft_consensus.cc:385] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.754230 24715 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.754320 24716 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.754808 24714 raft_consensus.cc:359] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.755493 24714 raft_consensus.cc:385] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.755090 24715 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.755149 24716 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.755766 24714 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.757604 24715 ts_tablet_manager.cc:1434] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:50.757746 24843 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.758270 24843 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.759831 24716 ts_tablet_manager.cc:1434] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:50.760157 24843 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.760783 24716 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:50.761667 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.761878 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.762290 24520 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:50.764389 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:50.765204 24843 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.766417 24715 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.765549 24843 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.767458 24716 tablet_bootstrap.cc:654] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:50.767699 24566 leader_election.cc:343] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.767061 24843 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.775532 24714 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.777135 24911 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.777666 24911 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.778133 24714 ts_tablet_manager.cc:1434] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 13:07:50.779042 24714 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:50.779698 24911 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.786950 24714 tablet_bootstrap.cc:654] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.787609 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.788322 24520 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:50.789691 24715 tablet_bootstrap.cc:654] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.795475 24563 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:50.796687 24780 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.798481 24847 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.798856 24847 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.799173 24847 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.803377 24913 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.803902 24913 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.805898 24913 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.810774 24714 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:50.811322 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:50.814170 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:50.815469 24566 leader_election.cc:343] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:50.817477 24566 leader_election.cc:343] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.811303 24714 ts_tablet_manager.cc:1403] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.006s
I20260709 13:07:50.821879 24714 raft_consensus.cc:359] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.822570 24714 raft_consensus.cc:385] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.822845 24714 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.823527 24714 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.825579 24714 ts_tablet_manager.cc:1434] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:07:50.826350 24817 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.826800 24817 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.830528 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:50.831907 24491 leader_election.cc:343] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.832432 24817 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.834261 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:50.835628 24490 leader_election.cc:343] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.836066 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:50.837466 24917 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.837725 24715 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.838351 24715 ts_tablet_manager.cc:1403] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.029s
I20260709 13:07:50.840303 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.840976 24520 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:50.842062 24715 raft_consensus.cc:359] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.842984 24715 raft_consensus.cc:385] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.843318 24715 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.846784 24714 tablet_bootstrap.cc:492] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:50.848675 24912 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.849166 24912 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.851428 24912 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.852459 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:50.853857 24566 leader_election.cc:343] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.855072 24911 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.856640 24714 tablet_bootstrap.cc:654] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.844166 24715 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.871778 24715 ts_tablet_manager.cc:1434] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:07:50.875794 24715 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.878393 24780 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.880416 24913 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.891281 24563 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:50.895159 24715 tablet_bootstrap.cc:654] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.895803 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:50.896592 24521 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:50.910435 24817 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.911154 24715 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:50.911008 24817 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.912046 24715 ts_tablet_manager.cc:1403] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.005s
I20260709 13:07:50.915520 24715 raft_consensus.cc:359] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.916399 24715 raft_consensus.cc:385] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.916733 24715 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.917850 24715 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.919094 24714 tablet_bootstrap.cc:492] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:50.919543 24714 ts_tablet_manager.cc:1403] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.005s
I20260709 13:07:50.920547 24715 ts_tablet_manager.cc:1434] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:07:50.921010 24911 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.934530 24911 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.934984 24911 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.921872 24715 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:50.922255 24714 raft_consensus.cc:359] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.937275 24714 raft_consensus.cc:385] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.937541 24714 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.938124 24714 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.940286 24714 ts_tablet_manager.cc:1434] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:07:50.941186 24714 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:50.948076 24843 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.949321 24817 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.950814 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:50.952744 24491 leader_election.cc:343] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.970808 24714 tablet_bootstrap.cc:654] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.977551 24847 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:50.979642 24847 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:50.981025 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:07:50.982822 24566 leader_election.cc:343] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.001256 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.003742 24912 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.004460 24912 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.005781 24843 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.006878 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:51.008329 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:51.008656 24566 leader_election.cc:343] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:51.009821 24566 leader_election.cc:343] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.011242 24912 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.013603 24715 tablet_bootstrap.cc:654] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:51.013823 24490 leader_election.cc:343] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.014295 24490 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:51.019644 24817 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.020123 24817 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.021339 24716 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:51.021835 24716 ts_tablet_manager.cc:1403] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.261s	user 0.074s	sys 0.128s
I20260709 13:07:51.022274 24817 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.021198 24917 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.025842 24911 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.026451 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:51.027783 24491 leader_election.cc:343] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.024531 24716 raft_consensus.cc:359] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.028505 24716 raft_consensus.cc:385] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.028776 24716 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.030484 24716 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.032655 24716 ts_tablet_manager.cc:1434] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:07:51.033599 24716 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:51.056219 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.056900 24600 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:51.058439 24911 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.058495 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.059444 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:51.060099 24981 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.060482 24981 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.060806 24981 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:51.061504 24566 leader_election.cc:343] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.065006 24715 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:51.065338 24716 tablet_bootstrap.cc:654] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.065960 24715 ts_tablet_manager.cc:1403] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.144s	user 0.031s	sys 0.007s
I20260709 13:07:51.066430 24714 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:51.066908 24714 ts_tablet_manager.cc:1403] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.126s	user 0.023s	sys 0.013s
I20260709 13:07:51.070039 24817 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.070487 24817 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.070801 24715 raft_consensus.cc:359] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.071732 24715 raft_consensus.cc:385] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.072077 24715 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.072479 24817 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.073930 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:51.074370 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:51.075578 24491 leader_election.cc:343] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:51.076138 24490 leader_election.cc:343] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.076599 24490 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:51.069321 24714 raft_consensus.cc:359] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.077970 24917 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.078394 24714 raft_consensus.cc:385] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.078747 24714 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.079447 24981 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.080680 24714 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.082967 24714 ts_tablet_manager.cc:1434] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:07:51.089883 24714 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:51.087419 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:51.091363 24597 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.072906 24715 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.090134 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:07:51.090692 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 112475us
I20260709 13:07:51.094863 24563 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.095913 24913 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.096277 24913 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.096606 24913 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.096802 24987 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:51.098173 24491 leader_election.cc:343] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.097044 24597 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:51.099391 24987 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.100308 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.101092 24917 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.101552 24917 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:51.102352 24917 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.103883 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:51.104441 24520 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.105824 24715 ts_tablet_manager.cc:1434] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:07:51.106842 24715 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:51.088666 24981 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.111291 24520 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:51.112610 24714 tablet_bootstrap.cc:654] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.118031 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:51.118718 24519 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.119364 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:51.120205 24524 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.125561 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.126061 24780 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.126525 24780 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.128533 24780 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.132417 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.135295 24519 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:51.136221 24525 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:51.138396 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:51.117645 24716 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:51.139650 24716 ts_tablet_manager.cc:1403] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.026s
I20260709 13:07:51.139951 24778 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.140332 24778 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.140664 24778 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.112560 24913 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.155287 24716 raft_consensus.cc:359] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.156034 24716 raft_consensus.cc:385] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.156301 24716 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.156975 24716 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.162865 24716 ts_tablet_manager.cc:1434] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:07:51.163743 24716 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:51.173126 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:07:51.175014 24566 leader_election.cc:343] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.175107 24981 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.175796 24981 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.176530 24913 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.177280 24524 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:51.178694 24716 tablet_bootstrap.cc:654] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.179196 24981 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.179219 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.183121 24597 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:51.181473 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:51.184414 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:51.185257 24981 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.185632 24981 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.185999 24981 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.192523 24716 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:51.193004 24716 ts_tablet_manager.cc:1403] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
W20260709 13:07:51.193043 24491 leader_election.cc:343] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.195679 24716 raft_consensus.cc:359] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.196362 24716 raft_consensus.cc:385] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.196633 24716 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.197306 24716 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.199744 24987 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.200276 24987 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.200639 24716 ts_tablet_manager.cc:1434] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:51.201638 24716 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:51.203125 24987 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.206003 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:51.209781 24566 leader_election.cc:343] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.210016 24716 tablet_bootstrap.cc:654] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.214380 24778 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.218026 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:51.218936 24518 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.224720 24716 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:51.225440 24716 ts_tablet_manager.cc:1403] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:07:51.227986 24847 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.228493 24847 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.230515 24847 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.235883 24715 tablet_bootstrap.cc:700] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Time spent opening tablet: real 0.123s	user 0.004s	sys 0.000s
I20260709 13:07:51.236433 24715 tablet_bootstrap.cc:654] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.224838 24981 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.240363 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:51.243911 24716 raft_consensus.cc:359] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.244486 24716 raft_consensus.cc:385] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.244702 24716 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.245497 24716 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.247788 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.248513 24716 ts_tablet_manager.cc:1434] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:07:51.246901 24778 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.251358 24598 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
W20260709 13:07:51.253120 24566 leader_election.cc:343] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.264478 24716 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:51.271543 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:51.272167 24599 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.276710 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:51.280088 24520 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.284085 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.284732 24525 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:51.285881 24778 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.279675 24422 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.287971 24520 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:51.289361 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.289969 24599 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:51.290949 24563 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.291314 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:51.292200 24917 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.292624 24917 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:51.290169 24524 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:51.293124 24911 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.293032 24518 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:51.295032 24911 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:51.293483 24917 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.295864 24911 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.293371 24981 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.301918 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:07:51.311952 24780 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.312495 24780 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:51.313719 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:51.313607 24780 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.315855 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.316605 24847 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:51.320989 24491 leader_election.cc:343] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.321486 24714 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:51.321933 24714 ts_tablet_manager.cc:1403] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.232s	user 0.042s	sys 0.105s
I20260709 13:07:51.321969 24563 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.327258 24714 raft_consensus.cc:359] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.331563 24714 raft_consensus.cc:385] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.331979 24714 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.332851 24714 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.342979 24714 ts_tablet_manager.cc:1434] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:07:51.344983 24714 tablet_bootstrap.cc:492] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:51.343981 24911 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.354125 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.354416 24981 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.354936 24994 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:07:51.355762 24715 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:51.379431 24715 ts_tablet_manager.cc:1403] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.008s
I20260709 13:07:51.371430 24423 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.367543 24420 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.386116 24847 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.386798 24847 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:51.355607 24981 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.387903 24715 raft_consensus.cc:359] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.387621 24847 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.388619 24715 raft_consensus.cc:385] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.387642 24716 tablet_bootstrap.cc:654] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.355958 24911 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:51.391696 24911 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.388936 24715 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.395068 24715 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.399155 24715 ts_tablet_manager.cc:1434] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:07:51.400035 24715 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:51.404423 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:51.406042 24490 leader_election.cc:343] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.409603 24981 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.401194 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.409797 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:51.414423 24847 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.414827 24847 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.414790 24563 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.415566 24847 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:51.416548 24491 leader_election.cc:343] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.416927 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:51.421401 24714 tablet_bootstrap.cc:654] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.419674 24987 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.426220 24987 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:51.427028 24987 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.431275 24563 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.432771 24913 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.433221 24913 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.433609 24913 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.432191 24715 tablet_bootstrap.cc:654] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.438721 24780 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.423383 24981 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.441116 24716 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:51.441586 24716 ts_tablet_manager.cc:1403] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.178s	user 0.012s	sys 0.002s
I20260709 13:07:51.439330 24780 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.445387 24780 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.445565 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.446988 24524 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:51.449461 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:51.450191 24599 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.458341 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.459197 24780 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.476016 24714 tablet_bootstrap.cc:492] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:51.476678 24714 ts_tablet_manager.cc:1403] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.020s
I20260709 13:07:51.469156 24599 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:51.477901 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:51.479046 24780 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.480779 24780 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.481236 25001 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.483887 24716 raft_consensus.cc:359] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.484825 24716 raft_consensus.cc:385] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.485145 24716 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.485714 24716 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.488013 24716 ts_tablet_manager.cc:1434] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:07:51.491704 25001 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.469761 24847 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.503074 24780 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.504863 24714 raft_consensus.cc:359] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.506389 24714 raft_consensus.cc:385] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.506747 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.506803 24714 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.507568 24519 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:51.508025 24714 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.509876 24714 ts_tablet_manager.cc:1434] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:07:51.511399 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.514576 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:51.532663 24716 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:51.522533 24780 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.546774 24714 tablet_bootstrap.cc:492] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:51.555248 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:51.555995 24520 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.556725 24981 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.539857 24913 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.563764 24913 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.578696 24778 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.579651 24715 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:51.580204 24715 ts_tablet_manager.cc:1403] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.010s
I20260709 13:07:51.584626 24778 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.586751 24778 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.590178 24778 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.592255 24778 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.597702 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:07:51.607548 24491 consensus_peers.cc:597] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:51.614209 24714 tablet_bootstrap.cc:654] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:51.622890 24471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:51.621235 24422 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.614598 24847 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.630462 24520 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:51.627617 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:51.617900 24780 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:51.633055 24566 leader_election.cc:343] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.635462 24715 raft_consensus.cc:359] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.636137 24715 raft_consensus.cc:385] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.636417 24715 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.637014 24715 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.638170 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:51.638484 24715 ts_tablet_manager.cc:1434] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
I20260709 13:07:51.638767 24669 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.618726 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.626289 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:51.641511 24522 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.648339 24669 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:51.640933 24600 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:51.651726 24917 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.653476 24917 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.653899 24778 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.655566 24917 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.651698 24639 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:51.656625 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:51.658528 25001 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.658977 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.659825 24598 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:07:51.659140 25001 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.661329 24847 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.661280 25001 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.662091 24847 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:51.662397 24715 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:51.662949 24847 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.663389 25001 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.666877 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.666970 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.668530 24639 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:07:51.669806 24490 leader_election.cc:343] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.670298 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.671038 24518 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:51.672037 25001 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:51.673187 24637 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:51.673588 24716 tablet_bootstrap.cc:654] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.668601 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:51.673070 24422 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.674932 24778 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.677377 24422 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.672461 25001 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:51.678819 24491 leader_election.cc:343] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.678941 24422 catalog_manager.cc:5697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.679364 24491 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:51.681699 24917 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.687827 24522 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:51.689265 24563 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.679176 25001 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:51.679077 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.691553 24911 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.696954 24911 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:51.697707 24911 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.705892 24778 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.707751 24715 tablet_bootstrap.cc:654] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.727926 24714 tablet_bootstrap.cc:492] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:51.729595 24714 ts_tablet_manager.cc:1403] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.009s
I20260709 13:07:51.717181 24911 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:07:51.732602 24714 raft_consensus.cc:359] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.735141 24714 raft_consensus.cc:385] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.735417 24714 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.736064 24714 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.732191 24420 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.736898 25001 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.737694 24420 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.738806 24715 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:51.739487 24715 ts_tablet_manager.cc:1403] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.005s
I20260709 13:07:51.739476 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:51.742213 24714 ts_tablet_manager.cc:1434] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:07:51.743106 24714 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:51.743675 24715 raft_consensus.cc:359] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.744316 24715 raft_consensus.cc:385] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.744561 24715 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.745200 24715 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.747746 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:51.748060 24716 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:51.748347 25001 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.748451 24596 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:51.748584 24716 ts_tablet_manager.cc:1403] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.216s	user 0.014s	sys 0.000s
I20260709 13:07:51.750600 24715 ts_tablet_manager.cc:1434] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:07:51.754462 24716 raft_consensus.cc:359] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.755229 24714 tablet_bootstrap.cc:654] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.755417 24716 raft_consensus.cc:385] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.755429 24596 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:07:51.755781 24716 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.756652 24716 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.757035 24639 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:07:51.758509 24778 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:51.759024 24778 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:51.759091 24716 ts_tablet_manager.cc:1434] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:07:51.759871 24715 tablet_bootstrap.cc:492] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:51.761849 24714 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:51.762275 24714 ts_tablet_manager.cc:1403] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:07:51.764780 24714 raft_consensus.cc:359] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.760161 24716 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:51.759791 24778 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.765434 24714 raft_consensus.cc:385] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.765776 24714 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.766561 24714 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.766496 24912 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:51.770609 24714 ts_tablet_manager.cc:1434] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:51.770744 24912 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.771517 24714 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:51.780402 24715 tablet_bootstrap.cc:654] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.785014 24716 tablet_bootstrap.cc:654] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.826853 24817 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:07:51.831439 24912 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.832540 24912 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.828675 24817 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.844592 24817 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.847781 24714 tablet_bootstrap.cc:654] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.851116 24981 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.853003 24912 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.858677 25001 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.862097 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:51.866840 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.868201 24596 raft_consensus.cc:2368] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:07:51.872655 25013 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:51.876551 24566 leader_election.cc:343] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.853138 24981 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.878971 25014 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.880998 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.885411 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.891268 24524 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:51.897454 24911 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.898458 24911 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.919145 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.919463 24911 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.919950 24524 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:51.926684 24917 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.926671 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:51.932416 24917 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:51.933233 24566 leader_election.cc:343] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.930402 25001 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.935855 25001 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:51.945951 24715 tablet_bootstrap.cc:492] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:51.947125 24715 ts_tablet_manager.cc:1403] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.196s	user 0.009s	sys 0.006s
I20260709 13:07:51.947315 24917 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.948091 24563 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.942193 24981 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:51.955749 24912 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:51.955874 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45855.4us
I20260709 13:07:51.956246 24912 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.956755 24912 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:51.957881 24490 leader_election.cc:343] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.958848 24490 leader_election.cc:400] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:07:51.959141 24490 leader_election.cc:403] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:51.965443 25001 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:51.967607 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:51.972225 25014 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.972658 25014 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.973026 25014 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.973901 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:51.970131 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:51.975629 24525 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:51.977759 25013 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.981382 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.980712 24917 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:07:51.994884 24639 leader_election.cc:343] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.997749 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:51.997869 24981 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:52.006737 24490 leader_election.cc:343] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.007339 25030 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.003116 25014 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.011408 25014 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.008179 25030 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.019039 24912 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.022437 24716 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:52.023108 24716 ts_tablet_manager.cc:1403] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.263s	user 0.016s	sys 0.001s
I20260709 13:07:52.020066 24715 raft_consensus.cc:359] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.026059 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:52.025216 24715 raft_consensus.cc:385] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.029480 24715 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.034404 24716 raft_consensus.cc:359] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.035226 24716 raft_consensus.cc:385] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.035451 24716 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.036360 24716 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.038055 24715 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:52.045253 24566 leader_election.cc:343] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.046068 24716 ts_tablet_manager.cc:1434] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:07:52.047050 25030 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.048529 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:52.049247 24522 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.052968 24714 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:52.053285 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:52.054780 24490 leader_election.cc:343] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.053547 24714 ts_tablet_manager.cc:1403] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.282s	user 0.014s	sys 0.014s
I20260709 13:07:52.057708 24715 ts_tablet_manager.cc:1434] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.003s
I20260709 13:07:52.058348 24912 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.068461 24522 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
W20260709 13:07:52.070402 24491 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.077849 24716 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
W20260709 13:07:52.079509 25037 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:52.080222 24419 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.081866 24715 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:52.085177 24714 raft_consensus.cc:359] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.085964 24714 raft_consensus.cc:385] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.086223 24714 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.086800 24714 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.087205 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.089042 24780 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.089442 24780 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.089802 24780 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.096951 24780 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.098640 24780 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:52.099727 24917 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:07:52.102864 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:52.103368 24524 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.105741 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.105857 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.107254 25014 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.107247 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.107899 25014 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.110769 25014 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.115741 24714 ts_tablet_manager.cc:1434] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
W20260709 13:07:52.116323 24566 consensus_peers.cc:597] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.115386 24780 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:07:52.118220 24491 leader_election.cc:343] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.118667 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.119635 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:52.120229 24525 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.122038 24524 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:52.120106 24714 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:52.125900 24817 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.129590 24716 tablet_bootstrap.cc:654] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.131480 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:52.136544 24525 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:52.138753 24715 tablet_bootstrap.cc:654] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.139195 24847 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.143415 24847 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.144534 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:52.145320 24847 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.139155 24912 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.146997 24714 tablet_bootstrap.cc:654] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.149608 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.139478 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:07:52.139657 24491 leader_election.cc:343] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.150532 24491 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.150964 25014 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.151625 25014 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:52.152434 24817 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:52.154079 24491 leader_election.cc:343] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.156064 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.157320 24917 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.159400 24563 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:52.152544 25014 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.160321 24847 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.160734 24847 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:52.161769 24847 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.165443 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.168314 24716 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:52.168800 24716 ts_tablet_manager.cc:1403] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.001s
I20260709 13:07:52.171368 24716 raft_consensus.cc:359] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:52.171514 24566 leader_election.cc:343] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.171555 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:52.172909 24524 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:52.174893 24716 raft_consensus.cc:385] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.175181 24716 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
W20260709 13:07:52.175905 24566 leader_election.cc:343] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.175833 24716 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.178139 24716 ts_tablet_manager.cc:1434] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
W20260709 13:07:52.179522 24639 leader_election.cc:343] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:52.180526 24566 leader_election.cc:343] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.179941 24714 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:52.181960 24714 ts_tablet_manager.cc:1403] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.005s
I20260709 13:07:52.181665 25013 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.182334 24716 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:52.184382 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:52.184530 24714 raft_consensus.cc:359] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.184995 24524 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:52.185283 24714 raft_consensus.cc:385] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.185643 24714 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.189908 24716 tablet_bootstrap.cc:654] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.190796 24714 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.197350 25013 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.199035 24714 ts_tablet_manager.cc:1434] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:07:52.203660 24714 tablet_bootstrap.cc:492] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:52.211637 24715 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:52.212189 24715 ts_tablet_manager.cc:1403] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.018s
I20260709 13:07:52.213887 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.215478 24780 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.216187 24780 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:52.217176 24716 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:52.218021 24714 tablet_bootstrap.cc:654] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.217061 24780 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.218029 24716 ts_tablet_manager.cc:1403] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.012s
I20260709 13:07:52.220476 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:52.221463 25013 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.221927 25013 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.222410 25013 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.221939 24715 raft_consensus.cc:359] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.222812 24715 raft_consensus.cc:385] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.223088 24715 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.223750 24715 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.232820 24715 ts_tablet_manager.cc:1434] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:07:52.233258 24997 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.234148 24715 tablet_bootstrap.cc:492] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:52.233796 24997 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.230751 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:52.237275 24997 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:52.237361 24714 tablet_bootstrap.cc:492] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:52.237964 25014 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.238435 25014 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.238811 25014 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.236414 24422 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.242705 24422 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.240898 24715 tablet_bootstrap.cc:654] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.304793 24714 ts_tablet_manager.cc:1403] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.101s	user 0.028s	sys 0.047s
I20260709 13:07:52.246269 24716 raft_consensus.cc:359] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.298866 25013 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.295818 25014 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.309185 24714 raft_consensus.cc:359] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.313570 24714 raft_consensus.cc:385] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.313935 24714 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.256058 24780 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.311537 24715 tablet_bootstrap.cc:492] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:52.314627 25013 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.314994 24715 ts_tablet_manager.cc:1403] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.020s
I20260709 13:07:52.314690 24714 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.314884 24780 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.255816 24420 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.316375 24714 ts_tablet_manager.cc:1434] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:07:52.325958 24714 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:52.335258 24715 raft_consensus.cc:359] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.336038 24715 raft_consensus.cc:385] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.336356 24715 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.337042 24715 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.317803 24716 raft_consensus.cc:385] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.337260 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:52.338347 24518 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.339618 24715 ts_tablet_manager.cc:1434] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:07:52.342653 24917 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.343225 24917 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.344826 24714 tablet_bootstrap.cc:654] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.316431 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:52.337900 24716 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.350495 24673 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.350680 24716 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.351199 25013 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.354053 24917 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.355389 24716 ts_tablet_manager.cc:1434] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.136s	user 0.004s	sys 0.002s
I20260709 13:07:52.351781 24715 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:52.345937 24780 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:52.356383 24716 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:52.349700 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:52.352461 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:52.361064 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:07:52.366438 24490 leader_election.cc:343] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.361768 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:52.369131 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:52.369685 24524 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.373291 24518 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:52.374590 25014 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.380769 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:52.385578 24637 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:07:52.386356 24566 leader_election.cc:343] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.386767 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:52.387411 24780 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.387941 24987 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.390340 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:52.391324 24522 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:52.392320 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.398625 24637 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.402823 24780 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.402647 24997 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:52.404484 24491 leader_election.cc:343] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.405213 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:07:52.415077 24566 leader_election.cc:343] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.417830 24524 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:52.418783 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:52.411628 24917 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.425203 25013 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.427492 24715 tablet_bootstrap.cc:654] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.428089 24667 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.415632 24987 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:52.423506 24911 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.422513 24598 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:52.442809 24997 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.449939 24716 tablet_bootstrap.cc:654] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.446193 24911 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:52.457422 24911 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.467810 25055 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.468447 25055 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.488917 24981 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.494131 24997 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.494717 24997 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.513260 24981 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.515033 25055 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.504400 24987 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.516340 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:52.516690 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.517424 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:52.518121 24524 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 1: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:07:52.518369 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.518739 24981 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:07:52.518493 24490 leader_election.cc:343] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.524644 24563 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:07:52.524667 24491 leader_election.cc:343] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.523988 24669 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.532109 24714 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:52.532712 24714 ts_tablet_manager.cc:1403] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.207s	user 0.020s	sys 0.035s
I20260709 13:07:52.542774 25056 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.542994 24714 raft_consensus.cc:359] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.543361 24491 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.543745 24714 raft_consensus.cc:385] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.546558 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:52.547616 24524 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:52.544180 24714 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.550626 24997 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:52.550230 24981 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.560128 24715 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:52.560621 24715 ts_tablet_manager.cc:1403] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.209s	user 0.020s	sys 0.011s
I20260709 13:07:52.560953 24714 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.563563 24714 ts_tablet_manager.cc:1434] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:07:52.570801 24715 raft_consensus.cc:359] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.571854 24715 raft_consensus.cc:385] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.572119 24715 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.572614 24715 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.575806 24714 tablet_bootstrap.cc:492] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:52.576798 24716 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:52.577276 24716 ts_tablet_manager.cc:1403] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.221s	user 0.007s	sys 0.015s
I20260709 13:07:52.571543 24917 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.577772 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:52.583060 24917 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.585116 24917 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.585513 24639 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.588024 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.589143 25001 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.590867 24715 ts_tablet_manager.cc:1434] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
W20260709 13:07:52.591328 24491 leader_election.cc:343] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.591987 24715 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:52.593436 24420 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.616616 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:52.621675 24490 leader_election.cc:343] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.622116 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.637135 24716 raft_consensus.cc:359] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.638159 24716 raft_consensus.cc:385] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.638522 24716 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.639406 24716 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.668684 24716 ts_tablet_manager.cc:1434] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.004s
W20260709 13:07:52.674181 25061 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:07:52.633677 24981 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.692410 24716 tablet_bootstrap.cc:492] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:52.696919 24714 tablet_bootstrap.cc:654] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.697342 25001 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.701529 25056 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.720747 24778 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:07:52.721298 24778 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.755630 24778 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:52.805338 24987 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.805959 24987 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:52.821779 25067 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.102s	user 0.010s	sys 0.033s
I20260709 13:07:52.822582 24987 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.823203 25070 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.823732 25070 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.824925 24715 tablet_bootstrap.cc:654] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.828047 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:07:52.839601 24471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:52.841852 24716 tablet_bootstrap.cc:654] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:52.855450 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 144724us
I20260709 13:07:52.860167 24716 tablet_bootstrap.cc:492] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:52.860298 25056 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.860673 24716 ts_tablet_manager.cc:1403] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.181s	user 0.018s	sys 0.004s
I20260709 13:07:52.863430 24716 raft_consensus.cc:359] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.864080 24716 raft_consensus.cc:385] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.864326 24716 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.864952 24716 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.868112 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:52.868772 24519 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:52.872011 24780 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.872520 24780 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.882609 24716 ts_tablet_manager.cc:1434] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:07:52.886412 25070 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:52.888352 24668 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.890646 24780 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:52.884454 24987 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:07:52.894708 24715 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:52.895345 24715 ts_tablet_manager.cc:1403] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.304s	user 0.051s	sys 0.011s
I20260709 13:07:52.894186 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:52.902323 24716 tablet_bootstrap.cc:492] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:52.902438 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:52.903558 24843 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:07:52.900568 24423 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.909319 24715 raft_consensus.cc:359] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:52.909950 24715 raft_consensus.cc:385] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.909817 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:52.910233 24715 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.901398 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:52.911325 25013 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.924556 25071 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:52.925119 25013 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.925493 25013 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:52.924630 24639 leader_election.cc:343] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.935331 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:52.965703 24639 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:52.966884 25071 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:53.012722 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.012986 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.013744 24519 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 0.
I20260709 13:07:53.014386 24780 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:53.016819 24491 leader_election.cc:343] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.011189 24715 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.020349 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.021071 25071 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.021456 25071 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.021801 25071 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.028630 25071 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.030871 25071 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:53.032939 24715 ts_tablet_manager.cc:1434] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.137s	user 0.017s	sys 0.050s
I20260709 13:07:53.033984 24715 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.036365 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:07:53.037909 24639 leader_election.cc:343] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.040910 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.041517 24524 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.048300 24714 tablet_bootstrap.cc:492] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:53.048764 24714 ts_tablet_manager.cc:1403] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.478s	user 0.029s	sys 0.017s
I20260709 13:07:53.051862 24714 raft_consensus.cc:359] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.052492 24714 raft_consensus.cc:385] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.052752 24714 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.053349 24524 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:07:53.053606 24714 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.056188 24714 ts_tablet_manager.cc:1434] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:53.058531 24715 tablet_bootstrap.cc:654] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.061684 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.063443 24780 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.063937 24780 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:07:53.064687 24780 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.067673 25055 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.068200 25055 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.070312 25055 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:07:53.072793 24566 consensus_peers.cc:597] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.075706 24715 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.076046 24715 ts_tablet_manager.cc:1403] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:07:53.078280 24714 tablet_bootstrap.cc:492] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:53.079144 24715 raft_consensus.cc:359] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.079859 24715 raft_consensus.cc:385] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.080088 24715 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.080614 24715 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.082623 24715 ts_tablet_manager.cc:1434] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:53.083429 24715 tablet_bootstrap.cc:492] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.088310 24715 tablet_bootstrap.cc:654] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.086961 24714 tablet_bootstrap.cc:654] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.086714 25013 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:53.093314 24490 leader_election.cc:343] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.093743 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.094733 25072 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.105680 25055 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.114933 25055 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.115360 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.115643 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.116003 24519 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:53.116168 24524 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.116752 25055 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.108160 24714 tablet_bootstrap.cc:492] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:53.118533 24714 ts_tablet_manager.cc:1403] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.041s	user 0.005s	sys 0.009s
I20260709 13:07:53.121189 24714 raft_consensus.cc:359] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.121848 24714 raft_consensus.cc:385] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.122148 24714 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.122694 24524 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:53.122913 24714 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.124989 24714 ts_tablet_manager.cc:1434] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:07:53.125872 24714 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:53.126690 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:07:53.105954 24566 leader_election.cc:343] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.127352 24524 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:53.110672 24715 tablet_bootstrap.cc:492] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.128697 24715 ts_tablet_manager.cc:1403] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.045s	user 0.000s	sys 0.016s
I20260709 13:07:53.130033 24843 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.094820 25013 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.131971 24715 raft_consensus.cc:359] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.132601 24715 raft_consensus.cc:385] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.132802 24911 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.134681 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.135393 24911 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.135778 24911 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.135737 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.136315 24911 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.137234 24843 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.137689 24843 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:53.138530 24843 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.143097 24911 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.144659 24716 tablet_bootstrap.cc:654] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.145145 24911 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.132844 24715 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.147343 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.149950 25087 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.150310 25087 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.150627 25087 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.147833 24715 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.152215 25070 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.152642 25070 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.153990 24715 ts_tablet_manager.cc:1434] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:07:53.154634 25070 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.154917 24715 tablet_bootstrap.cc:492] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.156010 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:53.157359 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:53.157378 24490 leader_election.cc:343] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:53.160689 24491 leader_election.cc:343] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.161113 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.161185 25087 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.161934 25072 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.166427 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.166590 25087 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.167042 24522 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.167136 24714 tablet_bootstrap.cc:654] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.173419 24522 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:53.175091 24716 tablet_bootstrap.cc:492] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:53.175537 24716 ts_tablet_manager.cc:1403] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.279s	user 0.009s	sys 0.002s
I20260709 13:07:53.177791 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.178126 24716 raft_consensus.cc:359] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.178767 24716 raft_consensus.cc:385] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.179028 24716 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.179682 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.180308 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.180977 24520 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.181957 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.182785 25087 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.183311 25087 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:53.183995 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.184280 25087 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.190574 24714 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:53.191069 24714 ts_tablet_manager.cc:1403] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.002s
I20260709 13:07:53.192471 24520 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:53.179658 24716 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.195480 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.196895 24716 ts_tablet_manager.cc:1434] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.005s
I20260709 13:07:53.197342 24843 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.197943 24716 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:53.197897 24843 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:53.198913 24843 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.201402 24714 raft_consensus.cc:359] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.202123 24714 raft_consensus.cc:385] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.202395 24714 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.204079 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.205785 24715 tablet_bootstrap.cc:654] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.206480 24714 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:53.208694 24566 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.210129 24714 ts_tablet_manager.cc:1434] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:07:53.209972 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.211162 24714 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
W20260709 13:07:53.218430 24566 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.221791 24716 tablet_bootstrap.cc:654] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.224198 24997 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.224705 24997 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.226881 24997 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:53.228515 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:07:53.229116 24566 leader_election.cc:343] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.228308 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:53.230898 24566 leader_election.cc:343] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.219456 24423 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 0 to 1, leader changed from <none> to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:53.231923 24566 leader_election.cc:343] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:53.233219 24566 leader_election.cc:343] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:53.234256 24566 leader_election.cc:343] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.238265 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.239076 24997 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.241849 24714 tablet_bootstrap.cc:654] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.247479 24715 tablet_bootstrap.cc:492] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.247905 24715 ts_tablet_manager.cc:1403] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.003s
I20260709 13:07:53.248749 24714 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:53.249195 24714 ts_tablet_manager.cc:1403] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.000s
I20260709 13:07:53.251760 24714 raft_consensus.cc:359] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.252462 24714 raft_consensus.cc:385] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.252728 24714 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.253324 24714 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.254622 24715 raft_consensus.cc:359] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.255348 24715 raft_consensus.cc:385] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.255796 24715 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.256464 24715 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.255348 24714 ts_tablet_manager.cc:1434] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:53.259227 24715 ts_tablet_manager.cc:1434] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:07:53.260113 24715 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.260125 24714 tablet_bootstrap.cc:492] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:53.270323 24716 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:53.270835 24716 ts_tablet_manager.cc:1403] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.004s
I20260709 13:07:53.272315 24714 tablet_bootstrap.cc:654] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.270355 24715 tablet_bootstrap.cc:654] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.275476 24420 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.278064 24420 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.280201 24716 raft_consensus.cc:359] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.280845 24716 raft_consensus.cc:385] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.282052 25087 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.283278 25087 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.282896 24716 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.284924 24716 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.287302 25087 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.288094 24716 ts_tablet_manager.cc:1434] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:07:53.288026 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.288692 24520 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:53.289140 24716 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:53.289801 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.290482 24843 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.290804 24843 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.291138 24843 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.293341 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.298470 24843 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:53.299443 24566 leader_election.cc:343] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.306489 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.307607 24520 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.312769 24716 tablet_bootstrap.cc:654] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.314227 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.302404 24843 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:07:53.316346 24566 leader_election.cc:343] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.317564 24715 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.320420 24715 ts_tablet_manager.cc:1403] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.004s
I20260709 13:07:53.323381 24715 raft_consensus.cc:359] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.324015 24715 raft_consensus.cc:385] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.324266 24715 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.324901 24715 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.327430 24817 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.328002 25070 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.328081 24817 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.328868 25070 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.332019 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:53.332617 25070 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.333967 24817 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.335419 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:53.335601 24490 leader_election.cc:343] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.337885 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:53.340438 24490 leader_election.cc:343] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.341514 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:53.343086 24491 leader_election.cc:343] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.343613 24491 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.345137 24817 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:53.346832 24491 leader_election.cc:343] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.347501 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.348596 24817 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.349838 24520 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:53.351753 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:53.353236 25087 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.353716 25087 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:53.353873 24715 ts_tablet_manager.cc:1434] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:07:53.354199 24714 tablet_bootstrap.cc:492] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:53.354621 24714 ts_tablet_manager.cc:1403] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.095s	user 0.036s	sys 0.047s
I20260709 13:07:53.354564 25087 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.355227 24715 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.357329 24714 raft_consensus.cc:359] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.358704 24714 raft_consensus.cc:385] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.358999 24714 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.360448 24714 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.362771 24714 ts_tablet_manager.cc:1434] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:53.364634 24714 tablet_bootstrap.cc:492] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Bootstrap starting.
I20260709 13:07:53.376495 24714 tablet_bootstrap.cc:654] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.383070 24715 tablet_bootstrap.cc:654] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.385265 24420 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.386794 24420 catalog_manager.cc:5697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.392251 24714 tablet_bootstrap.cc:492] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: No bootstrap required, opened a new log
I20260709 13:07:53.392782 24714 ts_tablet_manager.cc:1403] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.006s
I20260709 13:07:53.393657 24716 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:53.394102 24716 ts_tablet_manager.cc:1403] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.105s	user 0.023s	sys 0.027s
I20260709 13:07:53.395907 24714 raft_consensus.cc:359] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.396577 24714 raft_consensus.cc:385] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.396467 24716 raft_consensus.cc:359] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.397311 24716 raft_consensus.cc:385] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.397586 24716 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.398361 24716 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.401156 24716 ts_tablet_manager.cc:1434] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:07:53.396970 24714 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.401872 24714 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.403913 24714 ts_tablet_manager.cc:1434] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:07:53.405131 24716 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:53.409029 25088 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.409581 25088 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.411377 24716 tablet_bootstrap.cc:654] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.411713 25088 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.412145 24715 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.412572 24715 ts_tablet_manager.cc:1403] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.004s
I20260709 13:07:53.413630 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.415055 24715 raft_consensus.cc:359] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.415683 24715 raft_consensus.cc:385] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.415931 24715 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
W20260709 13:07:53.416039 24566 leader_election.cc:343] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.416605 24715 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.417557 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.418402 24520 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:53.417584 25087 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.419935 24715 ts_tablet_manager.cc:1434] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:07:53.419803 25087 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.420958 24715 tablet_bootstrap.cc:492] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.423007 25087 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.426756 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.427579 24524 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:53.430177 24715 tablet_bootstrap.cc:654] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.441793 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:53.444835 25014 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.445372 25014 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.445786 25014 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.449635 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.453919 24563 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.455277 24817 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.457207 24566 leader_election.cc:343] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.457800 24716 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:53.458263 24716 ts_tablet_manager.cc:1403] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.027s
I20260709 13:07:53.455787 24817 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.463485 24715 tablet_bootstrap.cc:492] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.465034 24715 ts_tablet_manager.cc:1403] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.020s
I20260709 13:07:53.466543 24817 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.462473 24843 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.467144 24716 raft_consensus.cc:359] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.467758 24715 raft_consensus.cc:359] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.467851 24716 raft_consensus.cc:385] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.468712 24716 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.468400 24715 raft_consensus.cc:385] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.469599 24715 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.470103 24715 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.470665 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.471446 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:53.471810 24715 ts_tablet_manager.cc:1434] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:07:53.467777 24843 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.472258 24843 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.473209 24716 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:53.475785 24491 leader_election.cc:343] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.476341 24716 ts_tablet_manager.cc:1434] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:07:53.477280 24716 tablet_bootstrap.cc:492] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:53.472043 24599 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:53.482642 24716 tablet_bootstrap.cc:654] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.482915 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:53.483520 24715 tablet_bootstrap.cc:492] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.484711 25070 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.485138 25070 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.484838 25014 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.485492 25070 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.487434 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.488018 24522 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.489506 24715 tablet_bootstrap.cc:654] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.492295 25071 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.498147 24669 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.502916 24674 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.503744 25070 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.505465 24843 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.507716 24843 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.510076 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.511516 24715 tablet_bootstrap.cc:492] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.512184 24715 ts_tablet_manager.cc:1403] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.005s
I20260709 13:07:53.512470 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:53.512986 24598 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.515691 24715 raft_consensus.cc:359] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.516674 24715 raft_consensus.cc:385] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.517110 24715 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.518110 24715 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.521438 24715 ts_tablet_manager.cc:1434] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:07:53.522047 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.522586 24524 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.522809 24715 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.525683 24817 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.526151 24817 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.528702 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:53.529300 24599 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 0.
I20260709 13:07:53.531291 24490 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.531901 24715 tablet_bootstrap.cc:654] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.532092 25072 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.532519 25072 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.532857 25072 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:53.544828 24566 leader_election.cc:343] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.546499 24715 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.548182 24715 ts_tablet_manager.cc:1403] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.013s
I20260709 13:07:53.552148 24715 raft_consensus.cc:359] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.554442 24522 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:53.555464 24598 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:53.536363 24524 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:53.556664 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.555473 24715 raft_consensus.cc:385] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.557395 24981 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.557514 24715 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.558226 24817 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.558977 24715 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.561919 24715 ts_tablet_manager.cc:1434] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:07:53.565716 25014 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.565862 25072 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.574461 24598 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.577127 24563 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:53.578176 24843 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.581043 24843 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:53.591796 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.593444 24715 tablet_bootstrap.cc:492] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.589769 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.595608 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.596922 25056 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.602082 25056 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:53.603276 25056 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.591310 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:07:53.606390 24599 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.592437 24843 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.598748 25072 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.590500 25087 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:07:53.613634 24981 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:53.618599 24981 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.627313 24715 tablet_bootstrap.cc:654] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.629223 24843 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.629679 24843 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.607628 25070 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.639074 24843 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:07:53.650658 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 56920.5us
I20260709 13:07:53.653309 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.656734 24599 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:07:53.658517 24780 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:53.653419 24491 leader_election.cc:343] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.661401 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.665769 24843 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.666337 24843 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:53.665504 24566 leader_election.cc:343] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:53.693115 24491 leader_election.cc:343] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.697350 24843 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.713565 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:07:53.718222 24491 leader_election.cc:343] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.719859 24490 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:53.724244 24716 tablet_bootstrap.cc:492] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:53.724853 24716 ts_tablet_manager.cc:1403] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.248s	user 0.023s	sys 0.089s
I20260709 13:07:53.710628 25070 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.725643 24981 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.740078 24981 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:07:53.741146 24981 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.745280 25066 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.735536 25070 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.745836 25066 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.748163 25070 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.748323 25066 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:53.751051 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.756425 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.757491 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:53.767513 24524 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:07:53.768643 24491 leader_election.cc:343] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.765893 24716 raft_consensus.cc:359] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.770329 24716 raft_consensus.cc:385] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.770654 24716 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.770805 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.771754 24716 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.774226 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:07:53.775359 24490 leader_election.cc:343] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.784992 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.785032 24519 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
W20260709 13:07:53.779421 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 82753.2us
I20260709 13:07:53.786410 25070 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.790252 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.792146 24716 ts_tablet_manager.cc:1434] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.001s
I20260709 13:07:53.793560 24716 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:53.793677 24715 tablet_bootstrap.cc:492] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.794147 24715 ts_tablet_manager.cc:1403] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.213s	user 0.024s	sys 0.019s
I20260709 13:07:53.799425 24674 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.799491 24843 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.801605 24843 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.803366 24843 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.805223 24716 tablet_bootstrap.cc:654] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.805827 24423 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.807471 24423 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.808917 24420 catalog_manager.cc:5697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.810624 25066 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.811168 25066 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:53.812290 24566 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:53.812919 24566 leader_election.cc:343] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.813068 25066 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:53.814353 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:53.817938 24715 raft_consensus.cc:359] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.820881 24715 raft_consensus.cc:385] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.823693 24715 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.819433 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.824550 24715 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.817611 24843 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:53.823714 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:53.822084 25087 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:53.826503 24843 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.826823 24843 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.827126 24843 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.828454 24715 ts_tablet_manager.cc:1434] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:07:53.829909 24715 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:53.831053 24671 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.833567 24843 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.835281 24843 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.837260 24715 tablet_bootstrap.cc:654] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.838356 24716 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:53.838788 24716 ts_tablet_manager.cc:1403] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.005s
I20260709 13:07:53.841396 24668 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.840906 24422 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.862895 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:53.867578 24716 raft_consensus.cc:359] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.868319 24716 raft_consensus.cc:385] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.868165 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:53.868623 24716 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.870885 24716 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.872776 24716 ts_tablet_manager.cc:1434] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:07:53.874440 24716 tablet_bootstrap.cc:492] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:53.883558 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.883559 24639 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.886248 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.889065 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.889667 24524 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.884557 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:53.885071 24522 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:53.896741 24524 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:53.893990 25066 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.903254 24716 tablet_bootstrap.cc:654] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.914796 24716 tablet_bootstrap.cc:492] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:53.915277 24716 ts_tablet_manager.cc:1403] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.003s
I20260709 13:07:53.918772 24843 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.919600 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.920003 25014 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.920413 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.920691 24843 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.920995 24843 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.921294 25014 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.921468 24843 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.921797 25014 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:53.922605 25014 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.927676 24843 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.929489 24843 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:53.930111 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:53.930670 24522 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.932974 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.933156 25071 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.933645 25071 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.934513 24911 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.935508 25071 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:53.938028 24997 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.943289 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:07:53.933161 24566 leader_election.cc:343] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.947150 24716 raft_consensus.cc:359] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.950306 24716 raft_consensus.cc:385] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.951426 24716 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.952517 24522 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:53.953181 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:53.955336 24716 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.958745 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:53.961323 25121 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:53.963186 24566 leader_election.cc:343] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.964075 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:53.964804 25121 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.965365 25121 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:53.966169 25121 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:53.967541 24637 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:53.968391 24997 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.970978 24716 ts_tablet_manager.cc:1434] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.003s
I20260709 13:07:53.974162 24715 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:53.975104 24716 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:53.976171 24715 ts_tablet_manager.cc:1403] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.146s	user 0.020s	sys 0.045s
I20260709 13:07:53.993255 24715 raft_consensus.cc:359] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:53.987850 24566 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.998427 24715 raft_consensus.cc:385] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:54.000771 24566 leader_election.cc:343] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.998751 24715 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.002302 24715 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.003865 24716 tablet_bootstrap.cc:654] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.007243 24715 ts_tablet_manager.cc:1434] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:07:54.008610 24715 tablet_bootstrap.cc:492] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Bootstrap starting.
I20260709 13:07:54.010603 25070 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:54.015307 24471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:54.020207 24715 tablet_bootstrap.cc:654] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.022128 24716 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.022858 24716 ts_tablet_manager.cc:1403] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.002s
I20260709 13:07:54.025557 24716 raft_consensus.cc:359] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.028591 24716 raft_consensus.cc:385] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.028923 24716 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.029714 24716 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.033033 24716 ts_tablet_manager.cc:1434] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:07:54.034129 24716 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:54.037830 24422 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:54.038623 24491 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.040836 24716 tablet_bootstrap.cc:654] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.079643 24716 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.080054 24716 ts_tablet_manager.cc:1403] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.021s
I20260709 13:07:54.082449 24716 raft_consensus.cc:359] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.083115 24716 raft_consensus.cc:385] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.083360 24716 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.083958 24716 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.090232 24997 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.090682 24997 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.092590 24997 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.093102 24716 ts_tablet_manager.cc:1434] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:07:54.094020 24716 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:54.095072 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.096966 24997 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.097741 24997 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.098412 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.099445 24524 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:54.099594 24716 tablet_bootstrap.cc:654] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.100435 24997 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.115346 25014 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.118961 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.124325 24637 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.125373 24997 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.127465 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.135535 24997 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.140805 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.143736 25001 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.158927 25121 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.168850 25072 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:54.257121 24491 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.259351 24715 tablet_bootstrap.cc:492] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: No bootstrap required, opened a new log
I20260709 13:07:54.259976 24715 ts_tablet_manager.cc:1403] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Time spent bootstrapping tablet: real 0.252s	user 0.090s	sys 0.135s
I20260709 13:07:54.263324 24715 raft_consensus.cc:359] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.264262 24715 raft_consensus.cc:385] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.264606 24715 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Initialized, Role: FOLLOWER
W20260709 13:07:54.272374 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 52193.9us
I20260709 13:07:54.278578 24671 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.279618 24715 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.282289 24715 ts_tablet_manager.cc:1434] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:07:54.294389 24843 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.294868 24843 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.295099 24422 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.296401 24843 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:54.297523 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.298118 24519 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:54.299234 25001 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.299893 25001 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.301671 24843 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.302440 25001 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.303536 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:54.306491 25055 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.307668 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.308210 24716 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.308676 24716 ts_tablet_manager.cc:1403] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.215s	user 0.091s	sys 0.100s
I20260709 13:07:54.309438 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.309584 24563 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:54.310420 24843 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.310740 24843 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.311028 24843 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.311172 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.311203 24716 raft_consensus.cc:359] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.312022 24716 raft_consensus.cc:385] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.312263 25001 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.312292 24716 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.313190 24716 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:07:54.315475 24566 leader_election.cc:343] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.329648 24716 ts_tablet_manager.cc:1434] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 13:07:54.330997 24716 tablet_bootstrap.cc:492] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:54.332248 25087 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.332723 25087 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.335400 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.337721 24525 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
I20260709 13:07:54.338387 24716 tablet_bootstrap.cc:654] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.338901 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:54.339579 25056 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.339936 25056 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.340065 25087 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:54.340369 25056 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.343578 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:54.350062 25056 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.350834 24843 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.351658 24716 tablet_bootstrap.cc:492] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.352119 24716 ts_tablet_manager.cc:1403] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:07:54.352742 24843 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:54.353634 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:54.354270 24525 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.354555 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:54.354714 24716 raft_consensus.cc:359] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.355423 24716 raft_consensus.cc:385] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.355705 24716 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.356340 24716 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.355101 24519 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.357427 24843 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.358467 24716 ts_tablet_manager.cc:1434] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:54.359354 24716 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:54.359994 25056 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:54.362139 24525 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:54.365317 24716 tablet_bootstrap.cc:654] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.365688 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:07:54.351698 24566 leader_election.cc:343] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.366714 25056 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.367688 25056 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:54.368731 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:07:54.369693 24671 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.369736 25056 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.370530 24519 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
W20260709 13:07:54.371745 24566 leader_election.cc:343] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.372859 24563 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:07:54.375228 24843 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.375656 24843 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:54.376492 24843 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.385815 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:07:54.394112 24566 leader_election.cc:343] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.397047 24667 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.400995 25056 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.401692 25056 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.405756 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.405923 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:07:54.406597 24519 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 0.
W20260709 13:07:54.408377 24566 leader_election.cc:343] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.412110 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:54.412372 25056 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:54.421598 25121 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.422118 25121 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.422564 25121 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.431952 24716 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.432415 24716 ts_tablet_manager.cc:1403] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.025s
I20260709 13:07:54.434876 24716 raft_consensus.cc:359] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.435510 24716 raft_consensus.cc:385] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.435760 24716 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.436441 24716 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.438534 24716 ts_tablet_manager.cc:1434] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:07:54.439440 24716 tablet_bootstrap.cc:492] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:54.445001 24716 tablet_bootstrap.cc:654] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.449774 25121 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.450476 24674 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.456913 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:07:54.457566 24524 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.458036 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:07:54.459311 24566 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.457826 24422 catalog_manager.cc:5697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:54.464547 24566 leader_election.cc:343] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.465581 25056 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.469480 24524 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:07:54.471122 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:07:54.472328 24843 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.472775 24843 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:07:54.473518 24843 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.460700 25121 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 1 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:54.483834 24716 tablet_bootstrap.cc:492] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.484294 24716 ts_tablet_manager.cc:1403] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.014s
I20260709 13:07:54.486709 24716 raft_consensus.cc:359] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.487344 24716 raft_consensus.cc:385] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.487596 24716 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.488230 24716 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.490471 24716 ts_tablet_manager.cc:1434] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:07:54.491354 24716 tablet_bootstrap.cc:492] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:54.491578 25001 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.492065 25001 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.494015 25001 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.495457 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.496855 24716 tablet_bootstrap.cc:654] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.497799 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.505424 24639 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.506772 25001 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.507921 24716 tablet_bootstrap.cc:492] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.508350 24716 ts_tablet_manager.cc:1403] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:07:54.510926 24716 raft_consensus.cc:359] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.511647 24716 raft_consensus.cc:385] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.511791 25056 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.512013 24716 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.513041 24716 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.515187 24716 ts_tablet_manager.cc:1434] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:54.516072 24716 tablet_bootstrap.cc:492] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:54.518033 24422 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.520382 24422 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 0 to 1, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.521620 24716 tablet_bootstrap.cc:654] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:54.522017 24700 tablet.cc:2406] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:54.531000 24716 tablet_bootstrap.cc:492] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.532029 24716 ts_tablet_manager.cc:1403] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.001s
I20260709 13:07:54.534521 24716 raft_consensus.cc:359] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.535166 24716 raft_consensus.cc:385] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.535413 24716 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.536012 24716 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.537380 24716 ts_tablet_manager.cc:1434] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:07:54.538252 24716 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: Bootstrap starting.
I20260709 13:07:54.541261 25001 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.541742 25001 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.543744 25001 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.543946 24716 tablet_bootstrap.cc:654] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.546445 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.563380 24716 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: No bootstrap required, opened a new log
I20260709 13:07:54.563843 24716 ts_tablet_manager.cc:1403] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.013s
I20260709 13:07:54.566783 24716 raft_consensus.cc:359] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.567627 24716 raft_consensus.cc:385] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.567898 24716 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.568503 24716 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.570317 24716 ts_tablet_manager.cc:1434] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:54.571238 25001 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.571642 25001 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.572482 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.573199 24524 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:54.575089 25001 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.576326 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.576326 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.579178 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.580117 25001 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.580374 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.581161 25066 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.589742 25001 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.617353 24667 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.683245 25001 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.683813 25001 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.686123 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.686535 25001 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.686663 24524 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:54.687705 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.688796 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.689519 25066 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.694182 25066 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.739612 25066 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.740069 25066 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.741888 25066 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.742496 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.742756 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.743332 24524 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 1: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:07:54.744601 24637 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.745304 25066 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.752148 25066 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.787597 25055 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.798779 24843 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.808588 24667 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.868546 24843 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.883798 25087 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.889751 24911 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.906347 24911 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.921597 25066 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.922013 25066 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:07:54.923732 25066 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:54.924464 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:07:54.925413 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:07:54.927136 24637 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:07:54.927795 25066 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.984401 24674 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.539330 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:55.571228 25174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:55.571228 25173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:55.573350 25176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:55.576500 23430 server_base.cc:1061] running on GCE node
I20260709 13:07:55.579224 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:55.579421 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:55.579656 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602475579638 us; error 0 us; skew 500 ppm
I20260709 13:07:55.580200 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:55.583632 23430 webserver.cc:533] Webserver started at http://127.22.225.132:41145/ using document root <none> and password file <none>
I20260709 13:07:55.584220 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:55.584460 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:55.584926 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:55.586808 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-3-root/instance:
uuid: "983693721af6486c97ece1410a90cf30"
format_stamp: "Formatted at 2026-07-09 13:07:55 on dist-test-slave-fx0m"
I20260709 13:07:55.592589 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:55.596577 25181 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:55.597563 23430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:55.597958 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-3-root
uuid: "983693721af6486c97ece1410a90cf30"
format_stamp: "Formatted at 2026-07-09 13:07:55 on dist-test-slave-fx0m"
I20260709 13:07:55.598356 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:55.623739 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:55.625335 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:55.627012 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:55.630965 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:55.631326 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:07:55.631673 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:55.631893 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:55.694550 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.132:34125
I20260709 13:07:55.694746 25243 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.132:34125 every 8 connection(s)
I20260709 13:07:55.701942 23430 auto_leader_rebalancer-test.cc:384] add a tserver: 983693721af6486c97ece1410a90cf30
I20260709 13:07:55.714600 25244 heartbeater.cc:344] Connected to a master server at 127.22.225.190:40709
I20260709 13:07:55.715049 25244 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:55.715920 25244 heartbeater.cc:507] Master 127.22.225.190:40709 requested a full tablet report, sending...
I20260709 13:07:55.717779 24423 ts_manager.cc:194] Registered new tserver with Master: 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:07:55.719000 24423 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49112
I20260709 13:07:56.144616 24667 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.153061 24599 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.153791 24525 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.154453 25172 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.155412 25066 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.167639 25066 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.175278 24522 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:07:56.186532 24639 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 243f0803aa8e4b9e938126e02e960e97. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.195871 24599 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.213016 24423 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.242329 24598 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.250006 24667 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.251048 24522 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.253758 25056 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.256026 25056 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.264219 25087 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:07:56.265941 24565 consensus_peers.cc:597] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14e96ae54f3a4631bcabb789d2c4146c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.266906 24525 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.268518 24667 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.283236 24419 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.304170 24525 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.313130 24674 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.314257 25248 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:56.318518 24599 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.319885 25248 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:56.331254 24490 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b92ce30bcd84b2ca0734f9ebff2a43e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.332871 25248 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.334030 24599 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.349138 24674 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.352487 24423 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.362358 24522 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.374734 24674 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:56.375241 24490 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfe7903b435c45a4b85c164ecf24c14f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.376261 24599 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.376719 25248 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.379573 25272 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.399804 25272 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.402127 24599 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.404604 24671 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.431926 24419 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:56.594842 25279 ts_tablet_manager.cc:933] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:07:56.598666 25279 tablet_copy_client.cc:323] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:07:56.612164 24684 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet 243f0803aa8e4b9e938126e02e960e97 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:07:56.612736 24684 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet 243f0803aa8e4b9e938126e02e960e97 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-243f0803aa8e4b9e938126e02e960e97
I20260709 13:07:56.618918 24684 tablet_copy_source_session.cc:215] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:56.622503 25279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243f0803aa8e4b9e938126e02e960e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.633391 25279 tablet_copy_client.cc:806] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:56.633957 25279 tablet_copy_client.cc:670] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:56.638468 25279 tablet_copy_client.cc:538] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:56.645860 25279 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:07:56.665693 25279 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:56.666754 25279 tablet_bootstrap.cc:492] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:07:56.667384 25279 ts_tablet_manager.cc:1403] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:07:56.670303 25279 raft_consensus.cc:359] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.671142 25279 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:07:56.671782 25279 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.674819 25244 heartbeater.cc:499] Master 127.22.225.190:40709 was elected leader, sending a full tablet report...
I20260709 13:07:56.675315 25279 ts_tablet_manager.cc:1434] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:07:56.677340 24684 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-243f0803aa8e4b9e938126e02e960e97 received from {username='slave'} at 127.0.0.1:52138
I20260709 13:07:56.677805 24684 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-243f0803aa8e4b9e938126e02e960e97 on tablet 243f0803aa8e4b9e938126e02e960e97 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:07:56.745496 25279 ts_tablet_manager.cc:933] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:56.761423 25279 tablet_copy_client.cc:323] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:07:56.782025 25285 ts_tablet_manager.cc:933] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:07:56.791085 25285 tablet_copy_client.cc:323] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:07:56.794682 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 14e96ae54f3a4631bcabb789d2c4146c from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:07:56.795318 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 14e96ae54f3a4631bcabb789d2c4146c from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-14e96ae54f3a4631bcabb789d2c4146c
I20260709 13:07:56.802196 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:07:56.802842 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet 5b92ce30bcd84b2ca0734f9ebff2a43e from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-5b92ce30bcd84b2ca0734f9ebff2a43e
I20260709 13:07:56.804867 24610 tablet_copy_source_session.cc:215] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:56.808092 25279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e96ae54f3a4631bcabb789d2c4146c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.809604 24535 tablet_copy_source_session.cc:215] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:56.812602 25285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.822778 25279 tablet_copy_client.cc:806] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:56.823684 25279 tablet_copy_client.cc:670] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:56.831621 25285 tablet_copy_client.cc:806] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:56.832991 25279 tablet_copy_client.cc:538] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:56.833823 25285 tablet_copy_client.cc:670] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:56.841171 25285 tablet_copy_client.cc:538] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:56.844218 25279 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:07:56.847604 25285 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:07:56.863391 25288 ts_tablet_manager.cc:933] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:07:56.868602 25288 tablet_copy_client.cc:323] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:07:56.870395 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet cfe7903b435c45a4b85c164ecf24c14f from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:07:56.871064 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet cfe7903b435c45a4b85c164ecf24c14f from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-cfe7903b435c45a4b85c164ecf24c14f
I20260709 13:07:56.876238 25285 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:56.877743 25285 tablet_bootstrap.cc:492] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:07:56.878427 25285 ts_tablet_manager.cc:1403] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.031s	user 0.026s	sys 0.000s
I20260709 13:07:56.881517 25285 raft_consensus.cc:359] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.882356 25285 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:07:56.883018 25285 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.886605 25285 ts_tablet_manager.cc:1434] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:56.891233 24534 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-5b92ce30bcd84b2ca0734f9ebff2a43e received from {username='slave'} at 127.0.0.1:53446
I20260709 13:07:56.891674 24534 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-5b92ce30bcd84b2ca0734f9ebff2a43e on tablet 5b92ce30bcd84b2ca0734f9ebff2a43e with peer 983693721af6486c97ece1410a90cf30
I20260709 13:07:56.894904 24535 tablet_copy_source_session.cc:215] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:56.898032 25288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7903b435c45a4b85c164ecf24c14f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.906317 25279 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:56.907033 25279 tablet_bootstrap.cc:492] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:07:56.907580 25279 ts_tablet_manager.cc:1403] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.022s
I20260709 13:07:56.911722 25279 raft_consensus.cc:359] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.912513 25279 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:07:56.913161 25279 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.914780 25288 tablet_copy_client.cc:806] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:56.915308 25288 tablet_copy_client.cc:670] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:56.917155 25279 ts_tablet_manager.cc:1434] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:07:56.919401 25288 tablet_copy_client.cc:538] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:56.919518 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-14e96ae54f3a4631bcabb789d2c4146c received from {username='slave'} at 127.0.0.1:51506
I20260709 13:07:56.920020 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-14e96ae54f3a4631bcabb789d2c4146c on tablet 14e96ae54f3a4631bcabb789d2c4146c with peer 983693721af6486c97ece1410a90cf30
I20260709 13:07:56.929225 25288 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:07:56.946110 25288 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:56.946895 25288 tablet_bootstrap.cc:492] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:07:56.947427 25288 ts_tablet_manager.cc:1403] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.018s	user 0.018s	sys 0.001s
I20260709 13:07:56.949515 25288 raft_consensus.cc:359] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.950273 25288 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:07:56.950809 25288 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:56.952831 25288 ts_tablet_manager.cc:1434] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:07:56.954315 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-cfe7903b435c45a4b85c164ecf24c14f received from {username='slave'} at 127.0.0.1:53446
I20260709 13:07:56.954749 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-cfe7903b435c45a4b85c164ecf24c14f on tablet cfe7903b435c45a4b85c164ecf24c14f with peer 983693721af6486c97ece1410a90cf30
I20260709 13:07:57.164687 25219 raft_consensus.cc:1217] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:57.199450 25219 raft_consensus.cc:1217] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:57.249049 25219 raft_consensus.cc:1217] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:57.309796 25219 raft_consensus.cc:1217] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:57.666533 25272 raft_consensus.cc:1064] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:07:57.668593 25272 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:07:57.675374 25219 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.675928 24671 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.677161 25273 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.678035 24599 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.677912 25248 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.679620 25272 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.690986 25248 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.692445 25218 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.693877 25294 raft_consensus.cc:1064] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:07:57.696235 25294 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:07:57.705614 24671 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.709393 24419 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.720984 25256 raft_consensus.cc:1064] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:07:57.725817 25256 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:07:57.793109 24524 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.795459 25218 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.796739 25256 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.824506 24674 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.827142 25087 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.829473 25218 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.831140 25087 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.834587 25256 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.840471 24598 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.842672 24598 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.854036 24524 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.855430 25294 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.860551 25256 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.859301 24525 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:07:57.867096 25217 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.868676 25304 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:57.880218 24600 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:57.880579 25273 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.889472 25248 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:57.897166 25219 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.903183 24600 raft_consensus.cc:2955] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.930187 25305 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.932443 25248 raft_consensus.cc:1064] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:07:57.931979 25218 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.934937 25248 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:07:57.941984 25277 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:07:57.956342 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 64212.2us
I20260709 13:07:57.959841 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:57.964164 24420 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.965541 24522 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.970173 24423 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:57.980523 25311 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.063s	user 0.003s	sys 0.000s
I20260709 13:07:57.985178 25217 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:57.993191 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b92ce30bcd84b2ca0734f9ebff2a43e with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:07:57.996685 24674 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.004503 24668 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:07:58.029938 25317 tablet_replica.cc:333] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:07:58.031666 25317 raft_consensus.cc:2243] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.032480 24674 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:58.032552 25217 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:58.032223 24519 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.034157 25273 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.035050 25304 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.046836 24599 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:58.059304 25248 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:58.077463 24423 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.082399 24525 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.083941 25256 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:58.093611 25256 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.098055 24599 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:07:58.099445 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 49290us
I20260709 13:07:58.098129 24525 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.104045 25317 raft_consensus.cc:2272] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.104283 25218 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.114573 25293 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:58.119959 25317 ts_tablet_manager.cc:1916] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:58.121646 25219 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.120813 25218 raft_consensus.cc:2955] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.135051 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 243f0803aa8e4b9e938126e02e960e97 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:58.143126 25248 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.145641 24600 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.151187 24674 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.152061 24420 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.156065 25315 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:58.187328 25218 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.191334 25317 ts_tablet_manager.cc:1929] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:58.191843 25317 log.cc:1199] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/5b92ce30bcd84b2ca0734f9ebff2a43e
I20260709 13:07:58.194392 25315 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.198089 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet 5b92ce30bcd84b2ca0734f9ebff2a43e (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:07:58.200465 25294 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:58.203107 24423 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.205664 24674 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.211120 25218 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.213991 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14e96ae54f3a4631bcabb789d2c4146c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:58.214840 24584 tablet_service.cc:1558] Processing DeleteTablet for tablet 243f0803aa8e4b9e938126e02e960e97 with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:07:58.225200 24668 raft_consensus.cc:2955] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.230553 25324 tablet_replica.cc:333] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:07:58.231590 25324 raft_consensus.cc:2243] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.232190 25324 pending_rounds.cc:70] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Trying to abort 1 pending ops.
I20260709 13:07:58.232534 25324 pending_rounds.cc:77] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635748749672448 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "243f0803aa8e4b9e938126e02e960e97" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } } }
I20260709 13:07:58.234980 25324 raft_consensus.cc:2917] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:07:58.235407 25324 raft_consensus.cc:2889] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:07:58.235783 25324 raft_consensus.cc:2272] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.242540 24524 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:07:58.249298 24600 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.250586 25218 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.251662 24419 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.252671 25324 ts_tablet_manager.cc:1916] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:58.255141 25248 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:58.263070 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet 14e96ae54f3a4631bcabb789d2c4146c with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:07:58.256834 25248 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:07:58.270640 25324 ts_tablet_manager.cc:1929] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:58.271123 25324 log.cc:1199] T 243f0803aa8e4b9e938126e02e960e97 P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/243f0803aa8e4b9e938126e02e960e97
I20260709 13:07:58.274260 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 243f0803aa8e4b9e938126e02e960e97 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:07:58.274535 25248 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.277848 25218 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.283058 25325 tablet_replica.cc:333] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:07:58.275104 24596 raft_consensus.cc:2955] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.284070 25325 raft_consensus.cc:2243] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.284555 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfe7903b435c45a4b85c164ecf24c14f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:58.284709 25325 raft_consensus.cc:2272] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.297845 24422 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:07:58.299188 25325 ts_tablet_manager.cc:1916] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:58.311589 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet cfe7903b435c45a4b85c164ecf24c14f with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:07:58.312546 25317 tablet_replica.cc:333] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:07:58.313593 25317 raft_consensus.cc:2243] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.314247 25317 raft_consensus.cc:2272] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.315642 25325 ts_tablet_manager.cc:1929] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:58.316075 25325 log.cc:1199] T 14e96ae54f3a4631bcabb789d2c4146c P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/14e96ae54f3a4631bcabb789d2c4146c
I20260709 13:07:58.317682 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet 14e96ae54f3a4631bcabb789d2c4146c (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:07:58.318316 25317 ts_tablet_manager.cc:1916] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:58.329007 25317 ts_tablet_manager.cc:1929] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:58.329337 25317 log.cc:1199] T cfe7903b435c45a4b85c164ecf24c14f P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/cfe7903b435c45a4b85c164ecf24c14f
I20260709 13:07:58.330641 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet cfe7903b435c45a4b85c164ecf24c14f (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:07:59.371496 24524 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:59.378168 24668 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:59.378484 24490 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cd2633e79fe4d3498a4412c062bf875. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.379400 24600 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.379343 25272 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.381417 25248 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.388788 25328 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.390506 24674 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.392028 24600 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.407353 24600 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:59.412218 24423 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.434724 24519 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:59.434825 24565 consensus_peers.cc:597] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5644c0da536c49768827dfd20a9662e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.437219 24674 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.436813 25277 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.439553 25333 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.458050 25277 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.459143 24524 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.464541 24674 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.485715 24519 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:59.497891 24422 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.505306 24674 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:59.505457 24490 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2fa80994624487d980c9d3ef7a166ce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.507702 25331 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.510530 24600 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.512032 25272 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.539755 25331 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.541594 24600 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.548681 24674 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.558952 24421 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.560676 24596 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:07:59.579973 24565 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73880209aa174d609bf830ad4c666c8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.581713 24524 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.581827 24674 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.583082 25333 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.584038 25294 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.593611 25333 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.594703 24671 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.594743 24524 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:07:59.612183 24422 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.816074 25348 ts_tablet_manager.cc:933] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:07:59.817890 25348 tablet_copy_client.cc:323] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:07:59.819376 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet 8cd2633e79fe4d3498a4412c062bf875 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:07:59.819916 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet 8cd2633e79fe4d3498a4412c062bf875 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-8cd2633e79fe4d3498a4412c062bf875
I20260709 13:07:59.826300 24535 tablet_copy_source_session.cc:215] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.829191 25348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cd2633e79fe4d3498a4412c062bf875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.840557 25348 tablet_copy_client.cc:806] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.841126 25348 tablet_copy_client.cc:670] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.844545 25348 tablet_copy_client.cc:538] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.851373 25348 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:07:59.866586 25348 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:59.867236 25348 tablet_bootstrap.cc:492] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:07:59.867815 25348 ts_tablet_manager.cc:1403] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:07:59.869833 25348 raft_consensus.cc:359] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:59.870402 25348 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:07:59.870963 25348 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:07:59.875159 25348 ts_tablet_manager.cc:1434] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:07:59.877169 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-8cd2633e79fe4d3498a4412c062bf875 received from {username='slave'} at 127.0.0.1:53446
I20260709 13:07:59.877565 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-8cd2633e79fe4d3498a4412c062bf875 on tablet 8cd2633e79fe4d3498a4412c062bf875 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:07:59.958328 25348 ts_tablet_manager.cc:933] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:07:59.959884 25348 tablet_copy_client.cc:323] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:07:59.961269 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 73880209aa174d609bf830ad4c666c8c from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:07:59.961706 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 73880209aa174d609bf830ad4c666c8c from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-73880209aa174d609bf830ad4c666c8c
I20260709 13:07:59.967614 24610 tablet_copy_source_session.cc:215] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.970383 25348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73880209aa174d609bf830ad4c666c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.987797 25348 tablet_copy_client.cc:806] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.988304 25348 tablet_copy_client.cc:670] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.992264 25348 tablet_copy_client.cc:538] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:00.001183 25348 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:00.022253 25353 ts_tablet_manager.cc:933] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:00.023813 25348 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:00.032456 25348 tablet_bootstrap.cc:492] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:00.024636 25353 tablet_copy_client.cc:323] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:00.034125 25348 ts_tablet_manager.cc:1403] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.002s
I20260709 13:08:00.034829 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 5644c0da536c49768827dfd20a9662e1 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:00.035419 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 5644c0da536c49768827dfd20a9662e1 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-5644c0da536c49768827dfd20a9662e1
I20260709 13:08:00.038055 25348 raft_consensus.cc:359] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:00.038949 25348 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:00.039577 25348 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:00.042039 25348 ts_tablet_manager.cc:1434] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:08:00.042979 24610 tablet_copy_source_session.cc:215] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:00.044785 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-73880209aa174d609bf830ad4c666c8c received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:00.045253 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-73880209aa174d609bf830ad4c666c8c on tablet 73880209aa174d609bf830ad4c666c8c with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:00.046782 25353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5644c0da536c49768827dfd20a9662e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:00.063244 25353 tablet_copy_client.cc:806] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:00.063827 25353 tablet_copy_client.cc:670] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:00.067431 25353 tablet_copy_client.cc:538] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:00.077312 25353 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:00.092974 25348 ts_tablet_manager.cc:933] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:08:00.097186 25348 tablet_copy_client.cc:323] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:08:00.099370 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet e2fa80994624487d980c9d3ef7a166ce from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:08:00.099913 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet e2fa80994624487d980c9d3ef7a166ce from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-e2fa80994624487d980c9d3ef7a166ce
I20260709 13:08:00.102258 25353 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:00.103206 25353 tablet_bootstrap.cc:492] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:00.103879 25353 ts_tablet_manager.cc:1403] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.005s
I20260709 13:08:00.107350 25353 raft_consensus.cc:359] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:00.108213 25353 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:00.108893 25353 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:00.111066 25353 ts_tablet_manager.cc:1434] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:08:00.115964 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-5644c0da536c49768827dfd20a9662e1 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:00.116477 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-5644c0da536c49768827dfd20a9662e1 on tablet 5644c0da536c49768827dfd20a9662e1 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:00.122165 24535 tablet_copy_source_session.cc:215] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:00.125926 25348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2fa80994624487d980c9d3ef7a166ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:00.142597 25348 tablet_copy_client.cc:806] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:00.143152 25348 tablet_copy_client.cc:670] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:00.146679 25348 tablet_copy_client.cc:538] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:00.154132 25348 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:00.169262 25348 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:00.170064 25348 tablet_bootstrap.cc:492] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:00.170647 25348 ts_tablet_manager.cc:1403] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:08:00.172863 25348 raft_consensus.cc:359] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:00.173463 25348 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:00.173960 25348 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:00.175396 25348 ts_tablet_manager.cc:1434] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:00.177013 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-e2fa80994624487d980c9d3ef7a166ce received from {username='slave'} at 127.0.0.1:53446
I20260709 13:08:00.177451 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-e2fa80994624487d980c9d3ef7a166ce on tablet e2fa80994624487d980c9d3ef7a166ce with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:00.254309 25218 raft_consensus.cc:1217] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.339866 25218 raft_consensus.cc:1217] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.568579 25218 raft_consensus.cc:1217] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.630805 25218 raft_consensus.cc:1217] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.789907 25331 raft_consensus.cc:1064] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:00.792220 25331 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:00.799587 25218 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.800561 24671 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.801496 25272 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.803094 25272 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.805545 24600 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.819490 25248 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.827531 25331 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:00.829703 24671 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:00.833390 24596 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:00.851841 25218 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:00.857913 25333 raft_consensus.cc:1064] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:00.844029 24421 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.860416 25333 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:00.896720 24519 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.896720 25218 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.901584 25360 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:00.903925 25360 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.909134 24671 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.912137 25333 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.930294 25333 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:00.938791 24524 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:00.938620 25218 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:00.949851 25294 raft_consensus.cc:1064] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:00.954452 25294 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:00.954610 24422 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:00.960467 25218 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:00.963085 24668 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:00.967368 25331 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:00.974622 25331 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:00.983942 24668 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:00.991452 25248 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.006599 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8cd2633e79fe4d3498a4412c062bf875 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:01.007812 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45258.6us
I20260709 13:08:01.008992 24674 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.011945 24524 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.018647 25218 raft_consensus.cc:2955] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.021934 24419 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.026610 24600 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:01.029850 25217 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.031428 25332 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.044646 25219 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.047528 25277 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.053658 24523 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.053831 24668 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.057394 24584 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cd2633e79fe4d3498a4412c062bf875 with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:01.057885 25375 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.058774 25333 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.062708 24523 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.073146 25277 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.076041 25217 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.076458 25374 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.083635 24524 raft_consensus.cc:2955] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.095024 25378 tablet_replica.cc:333] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:01.096040 25378 raft_consensus.cc:2243] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.096762 25378 raft_consensus.cc:2272] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.108379 24422 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.115231 25360 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.125669 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet 73880209aa174d609bf830ad4c666c8c with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:01.126094 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73880209aa174d609bf830ad4c666c8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.138512 24668 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.139978 25378 ts_tablet_manager.cc:1916] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.121403 24523 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.164022 24420 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.177848 25362 raft_consensus.cc:1064] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:01.180756 25362 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:01.184587 25218 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.177489 25378 ts_tablet_manager.cc:1929] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.205262 25378 log.cc:1199] T 8cd2633e79fe4d3498a4412c062bf875 P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/8cd2633e79fe4d3498a4412c062bf875
I20260709 13:08:01.208451 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 8cd2633e79fe4d3498a4412c062bf875 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:01.217841 25381 tablet_replica.cc:333] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:01.219182 25381 raft_consensus.cc:2243] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.219898 25381 raft_consensus.cc:2272] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.221850 24668 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.223754 24600 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.224715 25381 ts_tablet_manager.cc:1916] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.228150 25248 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.229842 25248 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.230208 24600 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:01.240958 25219 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.246598 25375 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.247040 24674 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.221850 25218 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.250202 25248 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:01.250384 25360 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.263460 25381 ts_tablet_manager.cc:1929] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.263958 25381 log.cc:1199] T 73880209aa174d609bf830ad4c666c8c P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/73880209aa174d609bf830ad4c666c8c
I20260709 13:08:01.264256 25272 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.265655 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet 73880209aa174d609bf830ad4c666c8c (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:01.269356 24668 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.270138 25375 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.271299 25219 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.287259 24600 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.288627 24421 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.301762 24420 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.308187 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5644c0da536c49768827dfd20a9662e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.314488 24668 raft_consensus.cc:2955] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.320463 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet 5644c0da536c49768827dfd20a9662e1 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:01.330713 25219 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.355525 25386 tablet_replica.cc:333] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:01.357625 25386 raft_consensus.cc:2243] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.358384 25386 raft_consensus.cc:2272] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.361111 24519 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:01.365123 25386 ts_tablet_manager.cc:1916] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.381279 25219 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.382131 24668 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.382869 25272 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.381302 25386 ts_tablet_manager.cc:1929] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.383859 25386 log.cc:1199] T 5644c0da536c49768827dfd20a9662e1 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/5644c0da536c49768827dfd20a9662e1
I20260709 13:08:01.383891 25248 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:01.385788 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet 5644c0da536c49768827dfd20a9662e1 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:01.392113 25248 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.394213 25219 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.397265 24668 raft_consensus.cc:2955] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.409065 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e2fa80994624487d980c9d3ef7a166ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.418917 24420 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:01.428224 24584 tablet_service.cc:1558] Processing DeleteTablet for tablet e2fa80994624487d980c9d3ef7a166ce with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:01.429200 25378 tablet_replica.cc:333] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:01.430226 25378 raft_consensus.cc:2243] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.430866 25378 raft_consensus.cc:2272] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.434836 25378 ts_tablet_manager.cc:1916] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.450125 25378 ts_tablet_manager.cc:1929] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.450538 25378 log.cc:1199] T e2fa80994624487d980c9d3ef7a166ce P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/e2fa80994624487d980c9d3ef7a166ce
I20260709 13:08:01.451962 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet e2fa80994624487d980c9d3ef7a166ce (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:02.505559 24600 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:08:02.513000 24565 consensus_peers.cc:597] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46d76b8a93c540a2936fa04c6712e968. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.513021 24525 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.513214 24668 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.514729 25388 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.515604 25389 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.526110 25294 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.528154 24525 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.536428 24668 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.541867 24674 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:02.545678 24423 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:02.565421 24639 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6328dd8c55f4742b015ea60e33773bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.565454 24600 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.567345 25396 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:02.568645 24525 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.570768 25323 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.588279 25323 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.590643 24523 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.608973 24600 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.620854 24421 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.622098 24596 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:08:02.630618 24565 consensus_peers.cc:597] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5d1c8994b3f41b286ae8a8f4a93b76a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.632051 24523 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.633702 24668 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.633581 25294 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.635809 25375 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.649225 25294 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.652732 24668 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.654268 24523 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.667389 24596 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:02.670720 24421 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:02.690152 24565 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba23ab1f03ef40238962f541c00081d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.691174 24668 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.692844 24525 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.692950 25388 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:02.697417 25375 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:02.705212 25389 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.706266 24668 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.709064 24523 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:02.724701 24421 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.965883 25408 ts_tablet_manager.cc:933] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:02.967638 25408 tablet_copy_client.cc:323] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:02.969736 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 46d76b8a93c540a2936fa04c6712e968 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:02.970353 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 46d76b8a93c540a2936fa04c6712e968 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-46d76b8a93c540a2936fa04c6712e968
I20260709 13:08:02.977289 24610 tablet_copy_source_session.cc:215] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.980659 25408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d76b8a93c540a2936fa04c6712e968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.997212 25408 tablet_copy_client.cc:806] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.997828 25408 tablet_copy_client.cc:670] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.001610 25408 tablet_copy_client.cc:538] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.008881 25408 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:03.026216 25408 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.026947 25408 tablet_bootstrap.cc:492] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:03.027496 25408 ts_tablet_manager.cc:1403] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 13:08:03.031733 25408 raft_consensus.cc:359] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:03.032421 25408 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:03.032943 25408 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:03.035951 25408 ts_tablet_manager.cc:1434] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:03.037775 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-46d76b8a93c540a2936fa04c6712e968 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:03.038237 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-46d76b8a93c540a2936fa04c6712e968 on tablet 46d76b8a93c540a2936fa04c6712e968 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:03.126068 25408 ts_tablet_manager.cc:933] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:03.128087 25408 tablet_copy_client.cc:323] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:03.130692 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet c5d1c8994b3f41b286ae8a8f4a93b76a from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:03.131210 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet c5d1c8994b3f41b286ae8a8f4a93b76a from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-c5d1c8994b3f41b286ae8a8f4a93b76a
I20260709 13:08:03.144243 24610 tablet_copy_source_session.cc:215] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.147645 25408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d1c8994b3f41b286ae8a8f4a93b76a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.166707 25413 ts_tablet_manager.cc:933] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:03.166875 25408 tablet_copy_client.cc:806] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.167451 25408 tablet_copy_client.cc:670] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.168720 25413 tablet_copy_client.cc:323] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:03.171470 25408 tablet_copy_client.cc:538] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.171666 24684 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet c6328dd8c55f4742b015ea60e33773bc from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:03.172221 24684 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet c6328dd8c55f4742b015ea60e33773bc from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-c6328dd8c55f4742b015ea60e33773bc
I20260709 13:08:03.180245 25408 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:03.180753 24684 tablet_copy_source_session.cc:215] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.183801 25413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6328dd8c55f4742b015ea60e33773bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.199725 25413 tablet_copy_client.cc:806] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.200258 25413 tablet_copy_client.cc:670] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.201182 25408 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.202108 25408 tablet_bootstrap.cc:492] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:03.202731 25408 ts_tablet_manager.cc:1403] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.023s	user 0.023s	sys 0.000s
I20260709 13:08:03.205616 25408 raft_consensus.cc:359] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:03.206446 25408 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:03.207401 25413 tablet_copy_client.cc:538] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.207065 25408 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:03.213686 25408 ts_tablet_manager.cc:1434] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:08:03.215809 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-c5d1c8994b3f41b286ae8a8f4a93b76a received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:03.216229 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-c5d1c8994b3f41b286ae8a8f4a93b76a on tablet c5d1c8994b3f41b286ae8a8f4a93b76a with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:03.228729 25413 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:03.252595 25413 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.253530 25413 tablet_bootstrap.cc:492] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:03.254248 25413 ts_tablet_manager.cc:1403] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 13:08:03.256618 25413 raft_consensus.cc:359] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:03.257371 25413 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:03.257917 25413 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:03.260243 25413 ts_tablet_manager.cc:1434] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:03.262023 24684 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-c6328dd8c55f4742b015ea60e33773bc received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:03.262507 24684 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-c6328dd8c55f4742b015ea60e33773bc on tablet c6328dd8c55f4742b015ea60e33773bc with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:03.299805 25413 ts_tablet_manager.cc:933] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:03.301415 25413 tablet_copy_client.cc:323] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:03.302963 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet ba23ab1f03ef40238962f541c00081d1 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:03.303489 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet ba23ab1f03ef40238962f541c00081d1 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-ba23ab1f03ef40238962f541c00081d1
I20260709 13:08:03.310971 24610 tablet_copy_source_session.cc:215] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.314213 25413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba23ab1f03ef40238962f541c00081d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.327922 25413 tablet_copy_client.cc:806] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.328496 25413 tablet_copy_client.cc:670] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.333359 25413 tablet_copy_client.cc:538] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.340353 25413 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:03.358284 25413 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.359304 25413 tablet_bootstrap.cc:492] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:03.359930 25413 ts_tablet_manager.cc:1403] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.009s
I20260709 13:08:03.362761 25413 raft_consensus.cc:359] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:03.363788 25413 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:03.364394 25413 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:03.369575 25413 ts_tablet_manager.cc:1434] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:03.371688 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-ba23ab1f03ef40238962f541c00081d1 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:03.372078 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-ba23ab1f03ef40238962f541c00081d1 on tablet ba23ab1f03ef40238962f541c00081d1 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:03.488848 25219 raft_consensus.cc:1217] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.517680 25219 raft_consensus.cc:1217] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.630254 25219 raft_consensus.cc:1217] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.741472 25219 raft_consensus.cc:1217] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.875144 25389 raft_consensus.cc:1064] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:03.877696 25389 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:03.884444 25219 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.884490 24668 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.885910 24525 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.885908 25388 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.887089 25375 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.887912 25389 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.902547 25389 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:03.945753 24524 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:03.947660 24674 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:03.952718 25375 raft_consensus.cc:1064] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:03.963548 25375 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:03.978060 24420 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:03.978091 25219 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.018256 25217 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.019204 24671 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.024809 25375 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.026077 24524 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.027494 25431 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.028712 25427 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.069386 25427 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.075527 24671 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.071656 25217 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.082254 24523 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.087316 24596 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:04.092962 25219 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.093322 24674 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.094677 25427 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.096472 25375 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.093864 24422 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.103036 25427 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.104525 24674 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.117851 25217 raft_consensus.cc:2955] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.123566 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46d76b8a93c540a2936fa04c6712e968 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:04.135738 25421 raft_consensus.cc:1064] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:04.138607 24422 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.130898 24596 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:04.138406 25421 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:04.153492 25217 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.153930 24671 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.154904 25429 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.155802 25431 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.157510 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d76b8a93c540a2936fa04c6712e968 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:04.162736 24596 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.164423 25375 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.166471 24523 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.168642 25396 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.170993 25396 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.172891 25217 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.176012 25218 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.181135 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5d1c8994b3f41b286ae8a8f4a93b76a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:04.186261 25431 raft_consensus.cc:1064] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:04.187723 24420 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.187521 25421 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:04.189700 24671 raft_consensus.cc:2955] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.197314 25442 tablet_replica.cc:333] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:04.188846 25431 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:04.202224 25442 raft_consensus.cc:2243] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.205600 25442 raft_consensus.cc:2272] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.224440 24671 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.224597 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet c5d1c8994b3f41b286ae8a8f4a93b76a with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:04.226823 24523 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.227777 25218 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.257694 25431 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.258857 25389 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.260972 25431 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.250914 25217 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.249583 25421 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.280718 24596 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.282312 25442 ts_tablet_manager.cc:1916] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:04.300657 24420 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.312271 25431 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.317572 24523 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.322156 24671 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.323882 25217 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.320451 24524 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.339815 24422 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.360426 24671 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:04.376085 25217 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.377797 25421 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:04.379762 25442 ts_tablet_manager.cc:1929] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:04.380251 25442 log.cc:1199] T 46d76b8a93c540a2936fa04c6712e968 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/46d76b8a93c540a2936fa04c6712e968
I20260709 13:08:04.381973 25442 tablet_replica.cc:333] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:04.383075 25442 raft_consensus.cc:2243] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.383845 25442 raft_consensus.cc:2272] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.385458 25396 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.386976 25217 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.389036 25442 ts_tablet_manager.cc:1916] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:04.392204 24524 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.396054 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6328dd8c55f4742b015ea60e33773bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:04.396093 25441 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:04.399549 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet 46d76b8a93c540a2936fa04c6712e968 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:04.404716 24523 raft_consensus.cc:2955] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.407168 25442 ts_tablet_manager.cc:1929] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:04.407683 25442 log.cc:1199] T c5d1c8994b3f41b286ae8a8f4a93b76a P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/c5d1c8994b3f41b286ae8a8f4a93b76a
I20260709 13:08:04.409340 24423 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.410235 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet c5d1c8994b3f41b286ae8a8f4a93b76a (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:04.410562 24596 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:04.423481 25217 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.424842 25431 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:04.425772 24523 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.427073 25375 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.432013 24584 tablet_service.cc:1558] Processing DeleteTablet for tablet c6328dd8c55f4742b015ea60e33773bc with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:04.437636 25451 tablet_replica.cc:333] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:04.435976 25389 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.438870 25451 raft_consensus.cc:2243] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.438652 25218 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.440083 24523 raft_consensus.cc:2955] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.431864 24420 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet c6328dd8c55f4742b015ea60e33773bc with cas_config_opid_index 3: aborting the task: latest config opid_index 4; task opid_index 3
I20260709 13:08:04.450040 25451 raft_consensus.cc:2272] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.458818 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba23ab1f03ef40238962f541c00081d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:04.461346 25451 ts_tablet_manager.cc:1916] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:04.461360 24423 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:04.478251 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet ba23ab1f03ef40238962f541c00081d1 with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:04.481932 25452 tablet_replica.cc:333] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:04.483842 25452 raft_consensus.cc:2243] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.484572 25452 raft_consensus.cc:2272] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.485412 25451 ts_tablet_manager.cc:1929] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:04.486011 25451 log.cc:1199] T c6328dd8c55f4742b015ea60e33773bc P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/c6328dd8c55f4742b015ea60e33773bc
I20260709 13:08:04.489187 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet c6328dd8c55f4742b015ea60e33773bc (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:04.488582 25452 ts_tablet_manager.cc:1916] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:04.502956 25452 ts_tablet_manager.cc:1929] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:04.503249 25452 log.cc:1199] T ba23ab1f03ef40238962f541c00081d1 P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/ba23ab1f03ef40238962f541c00081d1
I20260709 13:08:04.504698 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet ba23ab1f03ef40238962f541c00081d1 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:05.549952 24523 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:08:05.556864 24490 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f7e4efd4057430f8479100c05796bcf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.558558 24674 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.559217 24599 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.560022 25272 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:05.560935 25453 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.575668 25456 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.578109 24674 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.578780 24596 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.588732 24599 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:05.592669 24420 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:05.611033 24523 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.611729 24674 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.612769 25427 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.614048 25431 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:05.616354 24565 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90f5d915fb71474ab2b58063813a93a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.625337 25429 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.639458 24674 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.652050 24599 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:05.654148 24523 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.662290 24674 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.664729 24519 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:05.665334 24565 consensus_peers.cc:597] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de0783d3a5f74b1c9adce43ebc457546. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.667587 25427 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.668327 25466 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:05.690433 25466 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.698963 24523 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.699221 24674 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.715701 24420 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.717866 24674 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:08:05.726370 24639 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8b86e620fd64cf5b4c4a826cb95278a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:05.727074 24599 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.728547 25396 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.727715 24421 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:05.729595 24523 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:05.731047 25396 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.744464 25441 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.746409 24599 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.763000 24523 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:05.768682 24421 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:06.039750 25476 ts_tablet_manager.cc:933] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:06.041630 25476 tablet_copy_client.cc:323] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:06.043087 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 90f5d915fb71474ab2b58063813a93a9 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:06.043629 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 90f5d915fb71474ab2b58063813a93a9 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-90f5d915fb71474ab2b58063813a93a9
I20260709 13:08:06.051023 24610 tablet_copy_source_session.cc:215] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:06.054946 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f5d915fb71474ab2b58063813a93a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:06.070848 25476 tablet_copy_client.cc:806] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:06.071430 25476 tablet_copy_client.cc:670] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:06.073012 25478 ts_tablet_manager.cc:933] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:08:06.075579 25476 tablet_copy_client.cc:538] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:06.078522 25478 tablet_copy_client.cc:323] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:08:06.080971 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet 3f7e4efd4057430f8479100c05796bcf from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:08:06.081465 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet 3f7e4efd4057430f8479100c05796bcf from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-3f7e4efd4057430f8479100c05796bcf
I20260709 13:08:06.086416 25476 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:06.086521 24535 tablet_copy_source_session.cc:215] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:06.092031 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7e4efd4057430f8479100c05796bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:06.110566 25478 tablet_copy_client.cc:806] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:06.111124 25478 tablet_copy_client.cc:670] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:06.114670 25478 tablet_copy_client.cc:538] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:06.124111 25478 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:06.240646 25478 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.241669 25478 tablet_bootstrap.cc:492] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:06.242396 25478 ts_tablet_manager.cc:1403] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.119s	user 0.034s	sys 0.043s
I20260709 13:08:06.249614 25478 raft_consensus.cc:359] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:06.250551 25478 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:06.251272 25478 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:06.271396 25478 ts_tablet_manager.cc:1434] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:08:06.273144 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-3f7e4efd4057430f8479100c05796bcf received from {username='slave'} at 127.0.0.1:53446
I20260709 13:08:06.273695 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-3f7e4efd4057430f8479100c05796bcf on tablet 3f7e4efd4057430f8479100c05796bcf with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:06.276281 25476 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.279960 25476 tablet_bootstrap.cc:492] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:06.281764 25476 ts_tablet_manager.cc:1403] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.196s	user 0.041s	sys 0.055s
I20260709 13:08:06.282933 25484 ts_tablet_manager.cc:933] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:06.289121 25476 raft_consensus.cc:359] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:06.290766 25476 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:06.291587 25476 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:06.294338 25476 ts_tablet_manager.cc:1434] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:06.327270 25478 ts_tablet_manager.cc:933] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:06.332567 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-90f5d915fb71474ab2b58063813a93a9 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:06.333027 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-90f5d915fb71474ab2b58063813a93a9 on tablet 90f5d915fb71474ab2b58063813a93a9 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:06.334889 25484 tablet_copy_client.cc:323] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:06.337210 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet de0783d3a5f74b1c9adce43ebc457546 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:06.337743 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet de0783d3a5f74b1c9adce43ebc457546 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-de0783d3a5f74b1c9adce43ebc457546
I20260709 13:08:06.344451 24610 tablet_copy_source_session.cc:215] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:06.350353 25484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0783d3a5f74b1c9adce43ebc457546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:06.350409 25478 tablet_copy_client.cc:323] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:06.352762 24684 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet b8b86e620fd64cf5b4c4a826cb95278a from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:06.353276 24684 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet b8b86e620fd64cf5b4c4a826cb95278a from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-b8b86e620fd64cf5b4c4a826cb95278a
I20260709 13:08:06.358560 24684 tablet_copy_source_session.cc:215] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:06.361647 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8b86e620fd64cf5b4c4a826cb95278a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:06.367895 25484 tablet_copy_client.cc:806] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:06.368554 25484 tablet_copy_client.cc:670] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:06.372355 25484 tablet_copy_client.cc:538] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:06.379125 25478 tablet_copy_client.cc:806] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:06.379714 25478 tablet_copy_client.cc:670] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:06.382748 25484 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:06.388827 25478 tablet_copy_client.cc:538] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:06.399816 25478 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:06.413166 25484 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.414276 25484 tablet_bootstrap.cc:492] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:06.415030 25484 ts_tablet_manager.cc:1403] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.010s
I20260709 13:08:06.418128 25484 raft_consensus.cc:359] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:06.418965 25484 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:06.419661 25484 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:06.424762 25484 ts_tablet_manager.cc:1434] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:08:06.427379 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-de0783d3a5f74b1c9adce43ebc457546 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:06.427794 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-de0783d3a5f74b1c9adce43ebc457546 on tablet de0783d3a5f74b1c9adce43ebc457546 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:06.428580 25478 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.429523 25478 tablet_bootstrap.cc:492] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:06.430212 25478 ts_tablet_manager.cc:1403] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.007s
I20260709 13:08:06.436962 25478 raft_consensus.cc:359] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:06.437909 25478 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:06.438529 25478 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:06.440740 25218 raft_consensus.cc:1217] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:06.443251 25478 ts_tablet_manager.cc:1434] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:08:06.457329 24684 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-b8b86e620fd64cf5b4c4a826cb95278a received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:06.457823 24684 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-b8b86e620fd64cf5b4c4a826cb95278a on tablet b8b86e620fd64cf5b4c4a826cb95278a with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:06.531843 25217 raft_consensus.cc:1217] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:06.639947 25217 raft_consensus.cc:1217] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:06.807909 25217 raft_consensus.cc:1217] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:06.843298 25467 raft_consensus.cc:1064] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:06.845783 25467 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:06.858494 24669 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:06.859866 24519 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:06.860591 25467 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:06.859935 25217 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:06.861716 25466 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:06.863121 25482 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:06.877149 25482 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.878593 24669 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.892654 25217 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.896062 24421 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.898895 24519 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.939194 24596 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:06.946094 24519 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:06.947432 25217 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:06.947837 25482 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:06.949096 25467 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:06.956240 25482 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.957336 24524 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.957315 25217 raft_consensus.cc:2955] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.966449 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90f5d915fb71474ab2b58063813a93a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:06.974328 24423 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:06.984743 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet 90f5d915fb71474ab2b58063813a93a9 with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:07.021279 25501 tablet_replica.cc:333] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:07.025677 25501 raft_consensus.cc:2243] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.027647 25501 raft_consensus.cc:2272] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.032902 25501 ts_tablet_manager.cc:1916] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.045578 25501 ts_tablet_manager.cc:1929] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:07.046005 25501 log.cc:1199] T 90f5d915fb71474ab2b58063813a93a9 P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/90f5d915fb71474ab2b58063813a93a9
I20260709 13:08:07.047636 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet 90f5d915fb71474ab2b58063813a93a9 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:07.064177 25466 raft_consensus.cc:1064] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:07.066154 25466 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:07.075863 25217 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.076131 24519 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.077373 25427 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.078168 25482 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.078496 24668 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.083051 25467 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.105139 25427 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.106683 24519 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.116492 25217 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.120209 24669 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.126006 24423 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.160156 24596 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:07.160542 25456 raft_consensus.cc:1064] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:07.163955 25456 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:07.166615 24669 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.167577 25217 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.167865 25427 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.169533 25467 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.179899 25427 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.182219 25218 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.194161 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de0783d3a5f74b1c9adce43ebc457546 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.192258 24669 raft_consensus.cc:2955] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.200172 24671 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.203240 24422 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.207195 25509 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.212667 25217 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.233551 25509 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.234125 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet de0783d3a5f74b1c9adce43ebc457546 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:07.250144 25513 tablet_replica.cc:333] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:07.251353 25513 raft_consensus.cc:2243] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.252090 25513 raft_consensus.cc:2272] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.253499 25506 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.255602 25513 ts_tablet_manager.cc:1916] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.255369 25218 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.266480 24596 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.267736 24671 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.270927 25513 ts_tablet_manager.cc:1929] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:07.271363 25513 log.cc:1199] T de0783d3a5f74b1c9adce43ebc457546 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/de0783d3a5f74b1c9adce43ebc457546
I20260709 13:08:07.272838 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet de0783d3a5f74b1c9adce43ebc457546 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:07.280346 24423 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.281857 25510 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.291002 24596 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.333633 24519 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:07.337884 25218 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.339309 25507 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.343425 24671 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.345346 25396 raft_consensus.cc:1064] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:07.345221 25507 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.346859 25506 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.347575 25396 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:07.354632 25218 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.357585 24671 raft_consensus.cc:2955] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.362681 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f7e4efd4057430f8479100c05796bcf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.374065 24422 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.392858 24584 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f7e4efd4057430f8479100c05796bcf with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:07.397926 24600 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.399739 25488 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.406810 25218 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.408666 24524 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.408851 25488 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.410501 25486 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.435731 25517 tablet_replica.cc:333] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:07.437760 25517 raft_consensus.cc:2243] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.438576 25517 raft_consensus.cc:2272] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.442368 25517 ts_tablet_manager.cc:1916] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.444904 25218 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.440050 25488 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.460216 24524 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.467651 25517 ts_tablet_manager.cc:1929] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:07.468173 25517 log.cc:1199] T 3f7e4efd4057430f8479100c05796bcf P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/3f7e4efd4057430f8479100c05796bcf
I20260709 13:08:07.470714 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 3f7e4efd4057430f8479100c05796bcf (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:07.471381 24421 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.479136 24600 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.490974 24671 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:07.498368 25218 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.500619 25396 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.503314 24524 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.506533 25486 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.507937 25521 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.510933 25218 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.518785 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8b86e620fd64cf5b4c4a826cb95278a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.519567 24519 raft_consensus.cc:2955] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:07.528348 24423 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.542297 24584 tablet_service.cc:1558] Processing DeleteTablet for tablet b8b86e620fd64cf5b4c4a826cb95278a with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:07.547467 25517 tablet_replica.cc:333] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:07.548499 25517 raft_consensus.cc:2243] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.549263 25517 raft_consensus.cc:2272] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.553987 25517 ts_tablet_manager.cc:1916] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.571010 25517 ts_tablet_manager.cc:1929] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:07.571405 25517 log.cc:1199] T b8b86e620fd64cf5b4c4a826cb95278a P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/b8b86e620fd64cf5b4c4a826cb95278a
I20260709 13:08:07.572940 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet b8b86e620fd64cf5b4c4a826cb95278a (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:08.602632 24600 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:08.609334 24524 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:08.609439 24671 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:08.609644 24565 consensus_peers.cc:597] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7db7a15c9a7549a4a147a987f1362c09. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.610710 25467 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.611523 25427 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.621301 25427 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.622835 24524 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.637964 24667 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.650540 24600 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:08.650542 24423 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:08.678800 24565 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6e02d1934244d5f93de764a08655a2c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.679924 24519 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:08.682337 25482 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.686118 24671 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:08.689522 25528 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.708527 25528 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.711676 24524 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.711283 24674 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.723759 24600 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:08.734752 24422 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:08.740233 24674 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:08.741930 24565 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a74983bd9b34474a7cd38346edf8a64. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.742951 24524 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:08.744154 25527 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.745129 25528 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.767112 25467 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.768692 24674 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.769649 24524 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.780838 24600 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:08:08.787909 24565 consensus_peers.cc:597] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2451462dc894ec98db5932996a9e329. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.788525 24423 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.791458 24674 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:08.793908 25427 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.795111 24519 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:08.797115 25482 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.803922 25427 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.812300 24671 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.824824 24523 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:08.836511 24421 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:09.195055 25544 ts_tablet_manager.cc:933] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:09.197165 25544 tablet_copy_client.cc:323] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:09.198626 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet f6e02d1934244d5f93de764a08655a2c from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:09.199074 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet f6e02d1934244d5f93de764a08655a2c from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-f6e02d1934244d5f93de764a08655a2c
I20260709 13:08:09.204429 24610 tablet_copy_source_session.cc:215] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.207017 25544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e02d1934244d5f93de764a08655a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.217515 25546 ts_tablet_manager.cc:933] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:09.221700 25546 tablet_copy_client.cc:323] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:09.223423 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 7db7a15c9a7549a4a147a987f1362c09 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:09.223990 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 7db7a15c9a7549a4a147a987f1362c09 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-7db7a15c9a7549a4a147a987f1362c09
I20260709 13:08:09.226949 25544 tablet_copy_client.cc:806] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.227520 25544 tablet_copy_client.cc:670] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.232046 24610 tablet_copy_source_session.cc:215] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.234925 25548 ts_tablet_manager.cc:933] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:09.235173 25544 tablet_copy_client.cc:538] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.245618 25546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db7a15c9a7549a4a147a987f1362c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.247712 25544 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:09.261853 25548 tablet_copy_client.cc:323] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:09.263635 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 5a74983bd9b34474a7cd38346edf8a64 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:09.264153 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 5a74983bd9b34474a7cd38346edf8a64 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-5a74983bd9b34474a7cd38346edf8a64
I20260709 13:08:09.265578 25546 tablet_copy_client.cc:806] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.266150 25546 tablet_copy_client.cc:670] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.276958 24610 tablet_copy_source_session.cc:215] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.277431 25546 tablet_copy_client.cc:538] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.284395 25548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a74983bd9b34474a7cd38346edf8a64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.288396 25544 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:09.289569 25544 tablet_bootstrap.cc:492] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:09.290241 25544 ts_tablet_manager.cc:1403] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.019s
I20260709 13:08:09.291496 25546 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:09.293399 25544 raft_consensus.cc:359] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:09.294318 25544 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:09.294960 25544 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:09.315533 25544 ts_tablet_manager.cc:1434] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.007s
I20260709 13:08:09.320681 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-f6e02d1934244d5f93de764a08655a2c received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:09.321168 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-f6e02d1934244d5f93de764a08655a2c on tablet f6e02d1934244d5f93de764a08655a2c with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:09.336078 25546 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:09.337124 25546 tablet_bootstrap.cc:492] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:09.337817 25546 ts_tablet_manager.cc:1403] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.008s
I20260709 13:08:09.340204 25548 tablet_copy_client.cc:806] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.340883 25548 tablet_copy_client.cc:670] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.340711 25546 raft_consensus.cc:359] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:09.341650 25546 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:09.342202 25546 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:09.349152 25546 ts_tablet_manager.cc:1434] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:08:09.350742 25548 tablet_copy_client.cc:538] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.350901 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-7db7a15c9a7549a4a147a987f1362c09 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:09.351419 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-7db7a15c9a7549a4a147a987f1362c09 on tablet 7db7a15c9a7549a4a147a987f1362c09 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:09.366715 25548 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:09.391017 25548 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:09.392053 25548 tablet_bootstrap.cc:492] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:09.392742 25548 ts_tablet_manager.cc:1403] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.005s
I20260709 13:08:09.395764 25548 raft_consensus.cc:359] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:09.396924 25548 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:09.397792 25548 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:09.407428 25546 ts_tablet_manager.cc:933] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:09.407429 25548 ts_tablet_manager.cc:1434] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260709 13:08:09.415697 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-5a74983bd9b34474a7cd38346edf8a64 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:09.416181 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-5a74983bd9b34474a7cd38346edf8a64 on tablet 5a74983bd9b34474a7cd38346edf8a64 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:09.424813 25546 tablet_copy_client.cc:323] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:09.426589 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet b2451462dc894ec98db5932996a9e329 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:09.427142 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet b2451462dc894ec98db5932996a9e329 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-b2451462dc894ec98db5932996a9e329
I20260709 13:08:09.435483 24610 tablet_copy_source_session.cc:215] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.438616 25546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2451462dc894ec98db5932996a9e329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.454730 25546 tablet_copy_client.cc:806] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.455353 25546 tablet_copy_client.cc:670] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.459815 25546 tablet_copy_client.cc:538] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.467813 25546 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:09.485284 25546 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:09.486073 25546 tablet_bootstrap.cc:492] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:09.486629 25546 ts_tablet_manager.cc:1403] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.007s
I20260709 13:08:09.488900 25546 raft_consensus.cc:359] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:09.489562 25546 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:09.490199 25546 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:09.492123 25546 ts_tablet_manager.cc:1434] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:09.495642 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-b2451462dc894ec98db5932996a9e329 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:09.496050 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-b2451462dc894ec98db5932996a9e329 on tablet b2451462dc894ec98db5932996a9e329 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:09.620920 25218 raft_consensus.cc:1217] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:09.667343 25218 raft_consensus.cc:1217] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:09.738643 25218 raft_consensus.cc:1217] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:09.940245 25218 raft_consensus.cc:1217] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.070971 25554 raft_consensus.cc:1064] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:10.072976 25554 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:10.085635 25217 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.086385 24523 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.087039 24671 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.088130 25554 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.089052 25557 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.089787 25427 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.109542 25482 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.112149 24523 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.119643 25217 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.119938 24671 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.137410 24422 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.171494 24600 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:10.177157 25217 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.178009 24671 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.179080 25557 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.181679 25557 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.192236 25427 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.197604 24671 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.198069 25217 raft_consensus.cc:2955] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.216461 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7db7a15c9a7549a4a147a987f1362c09 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:10.225755 24421 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.241534 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet 7db7a15c9a7549a4a147a987f1362c09 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:10.246158 25566 tablet_replica.cc:333] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:10.250375 25566 raft_consensus.cc:2243] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.251127 25566 raft_consensus.cc:2272] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.256230 25566 ts_tablet_manager.cc:1916] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:10.267059 25482 raft_consensus.cc:1064] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:10.269443 25482 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:10.270474 25566 ts_tablet_manager.cc:1929] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:10.270895 25566 log.cc:1199] T 7db7a15c9a7549a4a147a987f1362c09 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/7db7a15c9a7549a4a147a987f1362c09
I20260709 13:08:10.272449 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet 7db7a15c9a7549a4a147a987f1362c09 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:10.275969 25217 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.277583 25554 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.279146 24671 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.279367 24523 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.281374 25554 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.282517 25427 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.294226 25557 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.296329 24674 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.320938 24523 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.321978 25217 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.364904 25576 raft_consensus.cc:1064] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:10.368716 25576 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:10.364189 24420 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.385439 25554 raft_consensus.cc:1064] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:10.387549 25554 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:10.396112 24523 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.397614 25575 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.400305 25217 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.401605 24671 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.401944 25557 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:10.406213 25557 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.418715 24596 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:10.426666 25218 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.428467 24523 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.428973 24674 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.428747 25575 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.430693 25575 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:08:10.434427 25217 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.434383 25571 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:10.433523 25573 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.437217 25427 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.437281 24523 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.441773 25578 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.444003 24671 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.449640 25574 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.454924 25219 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.455502 24525 raft_consensus.cc:2955] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.463871 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a74983bd9b34474a7cd38346edf8a64 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:10.468477 25217 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.485493 24422 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.491842 24524 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.494690 25573 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.498435 24523 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.505391 25218 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.505899 24420 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.514968 24671 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.520637 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a74983bd9b34474a7cd38346edf8a64 with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:10.534942 25587 tablet_replica.cc:333] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:10.535943 25587 raft_consensus.cc:2243] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.536661 25587 raft_consensus.cc:2272] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.541323 25587 ts_tablet_manager.cc:1916] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:10.547851 24420 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.560318 25587 ts_tablet_manager.cc:1929] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:10.560825 25587 log.cc:1199] T 5a74983bd9b34474a7cd38346edf8a64 P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/5a74983bd9b34474a7cd38346edf8a64
I20260709 13:08:10.562489 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet 5a74983bd9b34474a7cd38346edf8a64 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:10.575768 24600 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:10.576421 24596 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:10.583310 25217 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.583499 25218 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.584662 25427 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.585644 24524 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.587692 24671 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.586323 25427 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.588975 25554 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.589110 25578 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.596633 25573 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.596812 25572 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.606403 24671 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.608381 25218 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.610324 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b2451462dc894ec98db5932996a9e329 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:10.615043 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6e02d1934244d5f93de764a08655a2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:10.629729 25218 raft_consensus.cc:2955] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.654060 24524 raft_consensus.cc:2955] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:10.659729 24423 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.661585 24423 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.680245 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet b2451462dc894ec98db5932996a9e329 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:10.680994 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet f6e02d1934244d5f93de764a08655a2c with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:10.681218 25566 tablet_replica.cc:333] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:10.681977 25587 tablet_replica.cc:333] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:10.682297 25566 raft_consensus.cc:2243] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.682958 25587 raft_consensus.cc:2243] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.683046 25566 raft_consensus.cc:2272] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.683822 25587 raft_consensus.cc:2272] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.686559 25566 ts_tablet_manager.cc:1916] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:10.688398 25587 ts_tablet_manager.cc:1916] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:10.701376 25566 ts_tablet_manager.cc:1929] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:10.701923 25566 log.cc:1199] T b2451462dc894ec98db5932996a9e329 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/b2451462dc894ec98db5932996a9e329
I20260709 13:08:10.703200 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet b2451462dc894ec98db5932996a9e329 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:10.704800 25587 ts_tablet_manager.cc:1929] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:10.705287 25587 log.cc:1199] T f6e02d1934244d5f93de764a08655a2c P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/f6e02d1934244d5f93de764a08655a2c
I20260709 13:08:10.706552 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet f6e02d1934244d5f93de764a08655a2c (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:11.746551 24525 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:11.752137 24671 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:11.752781 24596 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:11.753373 24490 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 037c6a6c25cb4df5bc9bc7d29ad8347a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.753547 25590 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.754493 25543 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.762521 25577 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.764099 24596 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.765439 24671 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.782248 24423 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.793509 24525 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:08:11.807009 24490 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 182cc63718a84173a76583588f193929. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.808442 24671 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:11.809899 24600 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:11.809859 25593 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:08:11.813865 25577 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.830437 25577 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.838302 24671 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.844300 24596 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.853643 24600 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:11.866148 24423 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:08:11.867367 24565 consensus_peers.cc:597] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8aa20313ae2498e918eac40defe927c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.872622 24674 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:11.875124 24525 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:11.876945 25572 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.878543 25573 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.892913 25572 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.895275 24525 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.897516 24669 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.915333 24669 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:11.917649 24423 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:08:11.925817 24639 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bfcb1d6cfeb49dd83c1d2795dc046bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.927528 24600 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:11.928644 25486 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.930006 24525 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:11.932705 25486 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.945869 25486 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:11.948098 24600 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:12.015817 24422 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.984295 24525 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:12.272571 25610 ts_tablet_manager.cc:933] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:08:12.274973 25610 tablet_copy_client.cc:323] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:08:12.277043 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:08:12.277662 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet 037c6a6c25cb4df5bc9bc7d29ad8347a from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-037c6a6c25cb4df5bc9bc7d29ad8347a
I20260709 13:08:12.286540 24535 tablet_copy_source_session.cc:215] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:12.290279 25610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.305064 25610 tablet_copy_client.cc:806] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:12.305686 25610 tablet_copy_client.cc:670] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:12.309476 25610 tablet_copy_client.cc:538] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:12.317592 25610 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:12.344749 25610 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:12.345849 25610 tablet_bootstrap.cc:492] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:12.346634 25610 ts_tablet_manager.cc:1403] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.013s
I20260709 13:08:12.350015 25610 raft_consensus.cc:359] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:12.351002 25610 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:12.351769 25610 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:12.367530 25610 ts_tablet_manager.cc:1434] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 13:08:12.370518 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-037c6a6c25cb4df5bc9bc7d29ad8347a received from {username='slave'} at 127.0.0.1:53446
I20260709 13:08:12.370888 25613 ts_tablet_manager.cc:933] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:12.371124 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-037c6a6c25cb4df5bc9bc7d29ad8347a on tablet 037c6a6c25cb4df5bc9bc7d29ad8347a with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:12.373468 25615 ts_tablet_manager.cc:933] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:08:12.388852 25615 tablet_copy_client.cc:323] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:08:12.393407 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet 182cc63718a84173a76583588f193929 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:08:12.393678 25613 tablet_copy_client.cc:323] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:12.397132 25618 ts_tablet_manager.cc:933] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:12.394169 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet 182cc63718a84173a76583588f193929 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-182cc63718a84173a76583588f193929
I20260709 13:08:12.402302 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet f8aa20313ae2498e918eac40defe927c from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:12.402916 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet f8aa20313ae2498e918eac40defe927c from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-f8aa20313ae2498e918eac40defe927c
I20260709 13:08:12.408951 24535 tablet_copy_source_session.cc:215] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:12.409744 25618 tablet_copy_client.cc:323] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:12.410900 24610 tablet_copy_source_session.cc:215] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:12.411907 24684 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:12.412459 24684 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-9bfcb1d6cfeb49dd83c1d2795dc046bb
I20260709 13:08:12.414749 25615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182cc63718a84173a76583588f193929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.425701 25613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8aa20313ae2498e918eac40defe927c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.441192 24684 tablet_copy_source_session.cc:215] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:12.445129 25618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.450240 25613 tablet_copy_client.cc:806] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:12.450873 25613 tablet_copy_client.cc:670] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:12.454568 25615 tablet_copy_client.cc:806] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:12.455662 25615 tablet_copy_client.cc:670] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:12.456701 25613 tablet_copy_client.cc:538] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:12.461797 25615 tablet_copy_client.cc:538] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:12.467590 25618 tablet_copy_client.cc:806] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:12.467787 25613 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:12.468268 25618 tablet_copy_client.cc:670] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:12.479879 25618 tablet_copy_client.cc:538] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:12.489804 25615 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:12.495270 25618 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:12.499047 25613 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:12.500149 25613 tablet_bootstrap.cc:492] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:12.500969 25613 ts_tablet_manager.cc:1403] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.013s
I20260709 13:08:12.505177 25613 raft_consensus.cc:359] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:12.506070 25613 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:12.506774 25613 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:12.513219 25613 ts_tablet_manager.cc:1434] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:12.515331 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-f8aa20313ae2498e918eac40defe927c received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:12.515770 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-f8aa20313ae2498e918eac40defe927c on tablet f8aa20313ae2498e918eac40defe927c with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:12.527979 25615 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:12.529166 25615 tablet_bootstrap.cc:492] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:12.530777 25618 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:12.530968 25615 ts_tablet_manager.cc:1403] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.008s
I20260709 13:08:12.531857 25618 tablet_bootstrap.cc:492] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:12.533483 25618 ts_tablet_manager.cc:1403] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.009s
I20260709 13:08:12.534560 25615 raft_consensus.cc:359] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:12.535516 25615 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:12.536197 25615 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:12.536682 25618 raft_consensus.cc:359] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:12.538187 25618 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:12.539006 25618 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:12.541806 25615 ts_tablet_manager.cc:1434] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:12.543206 25618 ts_tablet_manager.cc:1434] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260709 13:08:12.543505 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-182cc63718a84173a76583588f193929 received from {username='slave'} at 127.0.0.1:53446
I20260709 13:08:12.543952 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-182cc63718a84173a76583588f193929 on tablet 182cc63718a84173a76583588f193929 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:12.545243 24684 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-9bfcb1d6cfeb49dd83c1d2795dc046bb received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:12.545794 24684 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-9bfcb1d6cfeb49dd83c1d2795dc046bb on tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:12.664413 25218 raft_consensus.cc:1217] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:12.814599 25218 raft_consensus.cc:1217] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:12.853796 25218 raft_consensus.cc:1217] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:12.981235 25218 raft_consensus.cc:1217] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:13.251204 25623 raft_consensus.cc:1064] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:13.253937 25623 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:13.264179 25218 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.265527 24669 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.266010 25623 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:13.266932 24596 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.268299 25577 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:13.271328 25577 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:13.318030 25577 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.319993 25218 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.324571 25624 raft_consensus.cc:1064] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:13.327230 25624 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:13.338017 24596 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.340030 24423 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.345520 24667 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.368667 25218 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.370448 25608 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:13.376960 24596 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.383566 25529 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:13.387804 24525 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.394698 25634 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:13.400640 25624 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.402606 24596 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.406028 24524 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:13.411543 24525 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.415262 25217 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.419497 24669 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.421164 25577 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:13.422948 25577 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:13.426088 25217 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.431243 24421 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.436345 25623 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.441452 25219 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.446596 24667 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:13.448742 25572 raft_consensus.cc:1064] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:13.449059 25577 raft_consensus.cc:1064] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:13.455232 24667 raft_consensus.cc:2955] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.456044 25577 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:13.466989 25572 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:13.477445 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:13.483004 24523 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.486193 25218 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.488962 24420 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.488962 25624 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:13.489545 25573 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:13.496243 24667 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.499331 25219 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.511080 25529 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:13.510990 25608 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.515728 25219 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.520807 24525 raft_consensus.cc:2955] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.543061 25219 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.561919 24421 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.574719 25543 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:08:13.593466 24667 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.604525 25639 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:08:13.607132 24584 tablet_service.cc:1558] Processing DeleteTablet for tablet 037c6a6c25cb4df5bc9bc7d29ad8347a with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:13.607129 25643 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:13.603526 24525 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.621021 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:13.626953 25643 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:13.631434 24588 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:13.645588 24599 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.646157 25650 tablet_replica.cc:333] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:13.648067 25650 raft_consensus.cc:2243] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:13.649140 25577 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:13.654374 25650 raft_consensus.cc:2272] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:13.665306 25650 ts_tablet_manager.cc:1916] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:13.674721 25572 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.680161 24524 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.682276 25639 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.691887 24599 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.690696 25219 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.699456 24420 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.705739 24669 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.721107 25219 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.732157 24420 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.729571 24667 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.750001 24599 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:13.752698 24524 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:13.756311 25218 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.757788 25572 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:13.763921 25588 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.772369 24596 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.774240 25639 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:13.775645 25218 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.778286 24667 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.776800 25650 ts_tablet_manager.cc:1929] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:13.779304 25650 log.cc:1199] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/037c6a6c25cb4df5bc9bc7d29ad8347a
I20260709 13:08:13.781191 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 037c6a6c25cb4df5bc9bc7d29ad8347a (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:13.782295 25650 tablet_replica.cc:333] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:13.782454 25644 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:13.783330 25650 raft_consensus.cc:2243] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:13.784124 25650 raft_consensus.cc:2272] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:13.787161 24669 raft_consensus.cc:2955] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.787484 25577 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.784605 25219 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.795042 25650 ts_tablet_manager.cc:1916] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:13.795778 25646 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:13.796577 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8aa20313ae2498e918eac40defe927c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:13.809671 24422 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.804368 24596 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.816695 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 182cc63718a84173a76583588f193929 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:13.826298 25219 raft_consensus.cc:2955] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:13.828882 24421 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.837390 25650 ts_tablet_manager.cc:1929] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:13.837944 25650 log.cc:1199] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/9bfcb1d6cfeb49dd83c1d2795dc046bb
I20260709 13:08:13.839272 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 9bfcb1d6cfeb49dd83c1d2795dc046bb (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:13.842350 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet f8aa20313ae2498e918eac40defe927c with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:13.843997 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet 182cc63718a84173a76583588f193929 with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:13.859952 25656 tablet_replica.cc:333] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:13.860798 25655 tablet_replica.cc:333] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:13.861346 25656 raft_consensus.cc:2243] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:13.862030 25655 raft_consensus.cc:2243] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:13.862138 25656 raft_consensus.cc:2272] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:13.862833 25655 raft_consensus.cc:2272] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:13.867164 25656 ts_tablet_manager.cc:1916] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:13.867479 25655 ts_tablet_manager.cc:1916] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:13.883463 25656 ts_tablet_manager.cc:1929] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:13.883807 25655 ts_tablet_manager.cc:1929] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:13.884052 25656 log.cc:1199] T 182cc63718a84173a76583588f193929 P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/182cc63718a84173a76583588f193929
I20260709 13:08:13.884245 25655 log.cc:1199] T f8aa20313ae2498e918eac40defe927c P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/f8aa20313ae2498e918eac40defe927c
I20260709 13:08:13.885800 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet 182cc63718a84173a76583588f193929 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:13.885931 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet f8aa20313ae2498e918eac40defe927c (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:14.929068 24599 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:08:14.936817 24565 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28c13259bf74484588e0fb08995091cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.938158 24525 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:14.938272 24669 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:14.940828 25657 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.941686 25644 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.950031 25657 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:14.952729 24669 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:14.953631 24523 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.001403 24599 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.009487 24420 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:08:15.032493 24565 consensus_peers.cc:597] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7ee2372084b4767aa79fc57a0c53278. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.033296 24525 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.033321 24667 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.035225 25644 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.036399 25657 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.046460 25644 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.051565 24525 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.067394 24667 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.070022 24669 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.073590 24422 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:08:15.086335 24621 debug-util.cc:398] Leaking SignalData structure 0x7b080005ad40 after lost signal to thread 23433
W20260709 13:08:15.087714 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7fe0 after lost signal to thread 24457
W20260709 13:08:15.088913 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08000ebb20 after lost signal to thread 24549
W20260709 13:08:15.089905 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003254a0 after lost signal to thread 24624
W20260709 13:08:15.091051 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800234140 after lost signal to thread 24698
W20260709 13:08:15.092027 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800265820 after lost signal to thread 25243
W20260709 13:08:15.101037 24639 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27022900b12b4397b1677f3fb2326347. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.104588 24599 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.105759 24525 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.106244 25529 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.107290 25661 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:15.125924 25661 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.128130 24599 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.144539 24525 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.147168 24420 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.175207 24669 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:08:15.181922 24639 consensus_peers.cc:597] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90e49b6f6ffd4dde98abdfd00821bc27. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.183846 24599 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.184605 24525 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.185290 25681 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.188133 25681 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.198664 25661 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.200387 24523 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.218588 24599 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:15.225811 24422 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.515523 25686 ts_tablet_manager.cc:933] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:15.521173 25686 tablet_copy_client.cc:323] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:15.522835 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 28c13259bf74484588e0fb08995091cc from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:15.523361 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 28c13259bf74484588e0fb08995091cc from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-28c13259bf74484588e0fb08995091cc
I20260709 13:08:15.535665 24610 tablet_copy_source_session.cc:215] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:15.541296 25686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c13259bf74484588e0fb08995091cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.574971 25686 tablet_copy_client.cc:806] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:15.575657 25686 tablet_copy_client.cc:670] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:15.580474 25686 tablet_copy_client.cc:538] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:15.578222 25688 ts_tablet_manager.cc:933] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:15.595145 25686 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:15.627287 25688 tablet_copy_client.cc:323] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:15.629017 24684 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet 27022900b12b4397b1677f3fb2326347 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:15.629598 24684 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet 27022900b12b4397b1677f3fb2326347 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-27022900b12b4397b1677f3fb2326347
I20260709 13:08:15.650286 25690 ts_tablet_manager.cc:933] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:15.652472 24684 tablet_copy_source_session.cc:215] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:15.656235 25688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27022900b12b4397b1677f3fb2326347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.662282 25690 tablet_copy_client.cc:323] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:15.663949 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet b7ee2372084b4767aa79fc57a0c53278 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:15.664489 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet b7ee2372084b4767aa79fc57a0c53278 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-b7ee2372084b4767aa79fc57a0c53278
I20260709 13:08:15.673290 24610 tablet_copy_source_session.cc:215] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:15.679101 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ee2372084b4767aa79fc57a0c53278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.698122 25686 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:15.699149 25686 tablet_bootstrap.cc:492] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:15.702217 25686 ts_tablet_manager.cc:1403] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.107s	user 0.022s	sys 0.004s
I20260709 13:08:15.712601 25688 tablet_copy_client.cc:806] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:15.713201 25688 tablet_copy_client.cc:670] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:15.716745 25690 tablet_copy_client.cc:806] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:15.718557 25686 raft_consensus.cc:359] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.719661 25688 tablet_copy_client.cc:538] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:15.721603 25686 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:15.723017 25686 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.717268 25690 tablet_copy_client.cc:670] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:15.738550 25686 ts_tablet_manager.cc:1434] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.004s
I20260709 13:08:15.740685 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-28c13259bf74484588e0fb08995091cc received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:15.741108 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-28c13259bf74484588e0fb08995091cc on tablet 28c13259bf74484588e0fb08995091cc with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:15.746018 25690 tablet_copy_client.cc:538] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:15.748061 25686 ts_tablet_manager.cc:933] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:15.765152 25690 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:15.773344 25686 tablet_copy_client.cc:323] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:15.774605 25688 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:15.776016 24684 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet 90e49b6f6ffd4dde98abdfd00821bc27 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:15.776574 24684 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet 90e49b6f6ffd4dde98abdfd00821bc27 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-90e49b6f6ffd4dde98abdfd00821bc27
I20260709 13:08:15.794507 24684 tablet_copy_source_session.cc:215] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:15.797799 25686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e49b6f6ffd4dde98abdfd00821bc27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.802583 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:15.825116 25688 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:15.826152 25688 tablet_bootstrap.cc:492] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:15.826814 25688 ts_tablet_manager.cc:1403] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.003s
I20260709 13:08:15.830252 25688 raft_consensus.cc:359] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.831187 25688 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:15.831816 25688 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.837903 25690 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:15.838039 25686 tablet_copy_client.cc:806] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:15.838791 25686 tablet_copy_client.cc:670] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:15.842813 25686 tablet_copy_client.cc:538] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:15.843179 25690 tablet_bootstrap.cc:492] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:15.843922 25690 ts_tablet_manager.cc:1403] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.007s
I20260709 13:08:15.846575 25688 ts_tablet_manager.cc:1434] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:08:15.848316 24684 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-27022900b12b4397b1677f3fb2326347 received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:15.848743 24684 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-27022900b12b4397b1677f3fb2326347 on tablet 27022900b12b4397b1677f3fb2326347 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:15.850035 25690 raft_consensus.cc:359] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.850886 25690 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:15.851524 25690 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.858086 25686 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:15.874075 25690 ts_tablet_manager.cc:1434] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:08:15.875630 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-b7ee2372084b4767aa79fc57a0c53278 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:15.876029 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-b7ee2372084b4767aa79fc57a0c53278 on tablet b7ee2372084b4767aa79fc57a0c53278 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:15.927697 25686 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:15.928985 25686 tablet_bootstrap.cc:492] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:15.932093 25686 ts_tablet_manager.cc:1403] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.021s
I20260709 13:08:15.947892 25686 raft_consensus.cc:359] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.949235 25686 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:15.950188 25686 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:15.951514 25218 raft_consensus.cc:1217] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:15.954622 25686 ts_tablet_manager.cc:1434] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.006s
I20260709 13:08:15.957298 24684 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-90e49b6f6ffd4dde98abdfd00821bc27 received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:15.957741 24684 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-90e49b6f6ffd4dde98abdfd00821bc27 on tablet 90e49b6f6ffd4dde98abdfd00821bc27 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:15.979892 25218 raft_consensus.cc:1217] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:15.987766 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:15.988474 24599 raft_consensus.cc:606] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:16.000696 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:16.001286 24599 raft_consensus.cc:606] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:16.011152 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:16.011698 24599 raft_consensus.cc:606] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:16.014231 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:16.014819 24599 raft_consensus.cc:606] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:16.017728 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:16.018411 24599 raft_consensus.cc:606] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:16.019575 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:16.021350 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:16.045282 25644 raft_consensus.cc:993] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:16.045872 25677 raft_consensus.cc:1081] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:16.047698 24667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:08:16.048282 24667 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.048561 24667 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.058672 24667 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.060575 24667 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:16.060847 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:16.061600 24525 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.067375 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:16.067951 24599 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.068121 25675 raft_consensus.cc:993] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:16.068231 24599 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:16.068635 25675 raft_consensus.cc:1081] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:16.069061 24599 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.070309 24599 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.071575 24523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50164
I20260709 13:08:16.072019 24523 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.072301 24523 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.094656 24523 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:16.102571 25218 raft_consensus.cc:1217] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:16.103444 24525 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:16.111769 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:16.112361 24596 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.112679 24596 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:16.112958 24599 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:16.113516 24596 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:16.113785 24523 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:16.114825 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:16.116434 25661 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.116496 24596 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.117224 25661 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:16.118942 25661 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.128527 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:16.129187 24669 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.133574 24669 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:16.137887 24491 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:16.137465 24422 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.139276 25668 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.140723 25668 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:16.141739 25668 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:16.139232 24596 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:16.186519 25572 raft_consensus.cc:993] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:16.187052 25572 raft_consensus.cc:1081] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:16.189258 25218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:08:16.189927 25218 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.190320 25218 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.231031 25218 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:16.247839 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:16.248521 24596 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.248907 24596 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:16.249804 24596 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:16.252480 24596 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.259655 25218 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:16.263649 24596 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:16.265173 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:16.265720 24667 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.279058 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:16.279919 25694 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.286365 25675 raft_consensus.cc:993] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:16.289261 25572 raft_consensus.cc:993] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:16.289618 25572 raft_consensus.cc:1081] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:16.290295 25572 raft_consensus.cc:1081] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:16.291783 24523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50164
I20260709 13:08:16.292260 24523 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.292590 24523 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.307016 24669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:08:16.307745 24669 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.308167 24669 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.313163 24667 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:16.321589 24669 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.336993 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:16.337668 24596 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.338243 24596 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:16.320363 24523 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.339105 24596 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.341743 24669 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:16.340834 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:16.342869 24599 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.343173 24599 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:16.344007 24599 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.345201 24599 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.351948 24599 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:16.342234 24596 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.340212 24523 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:16.354239 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:16.355186 24525 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.362047 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:16.362587 24667 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.353765 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:16.369628 24420 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.353859 25694 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:16.383384 25704 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.391110 25704 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:16.392093 25704 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.382148 24596 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:16.400401 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:16.401346 25710 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.403904 25710 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:16.405010 25710 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:16.389513 25694 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:16.407835 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:16.408392 24519 raft_consensus.cc:606] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Received request to transfer leadership
I20260709 13:08:16.387929 24667 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:16.390306 24525 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:16.416152 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:16.416656 24519 raft_consensus.cc:606] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Received request to transfer leadership
I20260709 13:08:16.418457 24420 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:16.420392 24407 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b7ee2372084b4767aa79fc57a0c53278 already in progress [suppressed 5 similar messages]
I20260709 13:08:16.423765 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:16.424284 24519 raft_consensus.cc:606] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Received request to transfer leadership
I20260709 13:08:16.437687 24422 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:16.442960 24471 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:08:16.443470 24471 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b7ee2372084b4767aa79fc57a0c53278 already in progress
I20260709 13:08:16.440147 24420 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:16.443804 24471 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b7ee2372084b4767aa79fc57a0c53278 already in progress
I20260709 13:08:16.497812 25709 raft_consensus.cc:1064] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:16.501760 25709 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:16.509016 25218 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.511286 24669 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.512638 25572 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:16.516150 25572 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:16.522267 24525 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.525880 25572 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:16.569221 24667 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:16.585222 25681 raft_consensus.cc:1064] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:16.591207 25681 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:16.598605 25645 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:16.608871 24596 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:16.612974 24596 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.614711 25219 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.623665 25645 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:16.623805 25529 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:16.637313 25661 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:08:16.664976 25529 raft_consensus.cc:1064] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:16.671787 24524 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:16.675046 25681 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.677861 25572 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:16.679800 24667 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:16.668098 25529 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:16.695119 25668 raft_consensus.cc:993] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:16.695647 25668 raft_consensus.cc:1081] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:16.701771 24674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44436
I20260709 13:08:16.706032 24599 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:16.706557 24523 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.729135 24420 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.751116 25218 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Advancing to term 2
I20260709 13:08:16.761364 25218 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:16.781219 25730 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:16.796939 25717 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:08:16.797714 25716 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:16.721069 25681 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:08:16.807832 24596 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:16.807796 24523 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:16.809724 25694 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:16.798470 25723 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:08:16.849315 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 150172us
I20260709 13:08:16.854319 25219 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:16.859283 24674 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:16.859750 24674 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:16.873198 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 165263us
I20260709 13:08:16.877035 24600 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:16.881052 25731 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:16.894728 25218 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:16.904649 24674 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:16.909459 25729 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:16.921046 25219 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.926915 25729 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:16.933058 24600 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.933830 24597 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:16.935832 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 227897us
I20260709 13:08:16.992367 24525 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:16.999905 24674 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:17.018442 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:17.028659 24674 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:16.997514 25731 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:08:17.051553 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:17.090989 24595 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.107401 24668 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:17.113691 25744 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:08:17.132205 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 112559us
I20260709 13:08:17.183162 24422 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:17.203020 25747 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:08:17.146603 25731 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
W20260709 13:08:17.228093 25746 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:08:17.265362 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 127372us
I20260709 13:08:17.267879 25668 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:08:17.353045 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 46791.9us
I20260709 13:08:17.356470 25681 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.361943 25213 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:17.426156 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56236.6us
I20260709 13:08:17.436689 24598 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:17.441450 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 160531us
I20260709 13:08:17.453312 25762 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:17.455395 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 175708us
I20260709 13:08:17.457165 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:17.457700 24524 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:17.457988 24524 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:17.458775 24524 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:17.459676 24525 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.459936 24524 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.466321 24524 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:17.513886 24420 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.541951 25729 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.542245 24637 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:17.543717 25729 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:17.544209 25729 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:17.576704 24598 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:17.588210 24524 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.549829 25729 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:17.592904 24523 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.646132 25218 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:08:17.658005 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.657843 24671 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:17.667663 25709 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:17.674903 25218 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:17.675884 24595 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:17.682125 25710 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:17.687726 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:17.693369 24522 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:17.706926 25661 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:17.710561 25572 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:17.713020 24668 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:17.754455 25763 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:08:17.778678 25219 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.787014 24421 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 2 to 3, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 3 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.803602 25214 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.776232 25709 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.833019 24525 raft_consensus.cc:2955] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.843374 24423 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.791018 25710 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:17.867942 24597 raft_consensus.cc:2955] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:17.923066 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47907.2us
I20260709 13:08:17.930074 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28c13259bf74484588e0fb08995091cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:17.931047 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90e49b6f6ffd4dde98abdfd00821bc27 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:17.939026 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c13259bf74484588e0fb08995091cc with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:17.957154 24423 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.016701 25770 tablet_replica.cc:333] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:18.017762 25770 raft_consensus.cc:2243] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.018538 25770 raft_consensus.cc:2272] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.024041 24667 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:18.025166 25770 ts_tablet_manager.cc:1916] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:18.037220 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 64386.7us
I20260709 13:08:18.039780 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet 90e49b6f6ffd4dde98abdfd00821bc27 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:18.058025 24525 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.059458 25214 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.061012 25710 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.067879 25710 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.075778 25770 ts_tablet_manager.cc:1929] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:18.076258 25770 log.cc:1199] T 28c13259bf74484588e0fb08995091cc P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/28c13259bf74484588e0fb08995091cc
I20260709 13:08:18.077908 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet 28c13259bf74484588e0fb08995091cc (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:18.093956 25710 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.080214 25774 tablet_replica.cc:333] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:18.095518 24525 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.107760 24520 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:18.101580 25774 raft_consensus.cc:2243] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.115990 25774 raft_consensus.cc:2272] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.116833 25681 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:18.132318 25774 ts_tablet_manager.cc:1916] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.138844 25214 raft_consensus.cc:2955] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.153860 25774 ts_tablet_manager.cc:1929] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:18.162578 25213 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Advancing to term 3
I20260709 13:08:18.163677 24596 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.176231 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 27022900b12b4397b1677f3fb2326347 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.194182 24597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:18.194792 24597 raft_consensus.cc:606] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:18.181344 24423 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.209416 24588 tablet_service.cc:1558] Processing DeleteTablet for tablet 27022900b12b4397b1677f3fb2326347 with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:18.212023 24596 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:18.214123 25710 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.231595 25774 log.cc:1199] T 90e49b6f6ffd4dde98abdfd00821bc27 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/90e49b6f6ffd4dde98abdfd00821bc27
I20260709 13:08:18.209419 25213 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:18.233804 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet 90e49b6f6ffd4dde98abdfd00821bc27 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:18.236218 24597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:18.236775 24597 raft_consensus.cc:606] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:18.235862 25710 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:18.242877 24597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:18.243412 24597 raft_consensus.cc:606] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:18.247221 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c35412a4ad4729862392b77295639d"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:18.247737 24598 raft_consensus.cc:606] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:18.253151 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:18.253683 24598 raft_consensus.cc:606] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:18.256420 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:18.258596 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:18.264647 25777 tablet_replica.cc:333] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:18.270295 25777 raft_consensus.cc:2243] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.272351 25777 raft_consensus.cc:2272] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.280753 25730 raft_consensus.cc:1064] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:18.277410 25777 ts_tablet_manager.cc:1916] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.290131 25730 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:18.298466 24519 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:18.299079 24597 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:18.300397 25661 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:18.297873 25214 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:18.303660 25661 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:18.305166 25661 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:18.319242 25681 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.330834 25777 ts_tablet_manager.cc:1929] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:18.331323 25777 log.cc:1199] T 27022900b12b4397b1677f3fb2326347 P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/27022900b12b4397b1677f3fb2326347
I20260709 13:08:18.330158 24519 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.333133 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 27022900b12b4397b1677f3fb2326347 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:18.329787 25213 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.341390 24597 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.348893 24422 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.363863 24667 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:18.370961 24596 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:18.373235 25730 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:18.377796 25213 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:18.383381 25710 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:18.386021 25736 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.395509 24596 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.398823 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7ee2372084b4767aa79fc57a0c53278 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.402590 25214 raft_consensus.cc:2955] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:18.418697 24422 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 5 to 6, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 3 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.435067 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet b7ee2372084b4767aa79fc57a0c53278 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:18.436203 25774 tablet_replica.cc:333] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:18.437798 25774 raft_consensus.cc:2243] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.438791 25774 raft_consensus.cc:2272] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.443349 25774 ts_tablet_manager.cc:1916] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.463052 25774 ts_tablet_manager.cc:1929] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:08:18.463510 25774 log.cc:1199] T b7ee2372084b4767aa79fc57a0c53278 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/b7ee2372084b4767aa79fc57a0c53278
I20260709 13:08:18.465114 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet b7ee2372084b4767aa79fc57a0c53278 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:18.474656 25675 raft_consensus.cc:993] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:18.475351 25737 raft_consensus.cc:1081] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:18.478919 24519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50164
I20260709 13:08:18.479481 24519 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.479803 24519 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.489030 24519 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.490787 25737 raft_consensus.cc:993] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:18.491303 25737 raft_consensus.cc:1081] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:18.493889 24525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50164
I20260709 13:08:18.494395 24525 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.494719 24525 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.495121 24519 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:18.498013 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:18.498587 24667 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.504832 24525 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.511296 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:18.541244 24597 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.541585 24597 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:18.543542 24597 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.544756 24597 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.544988 24667 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:18.547923 25572 raft_consensus.cc:993] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:18.548336 25572 raft_consensus.cc:1081] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:18.552217 24597 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:18.555034 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:18.562732 24525 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:18.563071 25772 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.563567 25772 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:18.564476 25772 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.569397 24519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9c35412a4ad4729862392b77295639d"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50164
I20260709 13:08:18.569939 24519 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.570307 24519 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.589816 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:18.590417 24596 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.590704 24596 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:18.591387 24596 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.592505 24596 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.595062 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:18.595582 24667 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.598155 24519 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.599097 24596 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:18.600216 24519 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:18.602080 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:18.602632 24674 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.604944 24420 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.611809 24674 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:18.613488 24667 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:18.614388 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:18.615226 25780 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.616252 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:18.618167 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:18.618574 25782 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.619057 25782 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:18.619410 25780 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:18.651616 25780 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.621155 25782 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.618700 24596 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.650501 25572 raft_consensus.cc:993] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:18.655004 24596 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:18.655823 25572 raft_consensus.cc:1081] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:18.657706 25214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:08:18.658223 25214 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.658598 25214 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.655853 24596 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.671080 24596 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.677354 25214 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:18.680085 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:18.680567 24597 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.680881 24597 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:18.681699 24597 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:18.682801 24597 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.690191 25214 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:18.690543 24597 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:18.690687 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:18.691290 24667 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.691819 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:18.692627 25743 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.701325 24667 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:18.704209 24596 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:18.707046 25737 raft_consensus.cc:993] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:18.707494 25737 raft_consensus.cc:1081] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:18.708886 25743 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:18.709954 25743 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:18.711207 24667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:08:18.711730 24667 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.712059 24667 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.713199 24420 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.714695 24420 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.719590 24667 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.726181 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:18.726346 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:18.726773 24519 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.726843 24597 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.730770 24597 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:18.731614 24597 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.732297 24597 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.734884 24519 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:18.736276 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:18.738485 24597 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:18.726178 24667 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:18.743968 25736 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.744556 25736 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:18.746043 25736 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:18.747721 24420 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.763458 24420 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.097918 24597 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.099140 25743 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.145484 24598 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.146837 25782 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.157334 24597 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.158810 25780 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.166817 24674 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.172386 25785 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.184408 24668 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.184564 24671 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.187089 25782 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.191148 24671 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.197422 25780 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.202814 25780 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.243726 24596 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.249776 25782 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.259632 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:19.279763 24519 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.281037 25736 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.300453 24596 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.302647 25736 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.411564 24519 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:19.426959 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:19.444060 24674 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:19.444340 24490 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6458c5ddfa4b4a4188e06ad9fc7d983d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.447387 24596 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.448796 25782 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.450594 25782 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.478945 25772 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.482107 24597 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.488638 24674 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.499306 24597 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:19.500151 24422 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.535832 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:19.536510 24596 raft_consensus.cc:606] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:19.540258 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:19.540844 24596 raft_consensus.cc:606] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
W20260709 13:08:19.555742 24565 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72b8c4b638a5486c82fb2d3bb64ef503. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.558753 24674 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.559289 24519 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.561435 25675 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.567231 25572 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.567734 25675 raft_consensus.cc:993] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:19.568137 25675 raft_consensus.cc:1081] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:19.569644 24674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:08:19.570318 24674 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.570765 24674 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.577369 24674 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:19.579320 24674 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:19.581377 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:19.581975 24596 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.582259 24596 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:19.582942 24596 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:19.583952 24596 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.587826 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:19.588440 24520 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.601504 24520 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:19.603248 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:19.604491 25736 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.605237 25736 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:19.606462 25736 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:19.618808 25737 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.624126 24671 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.678401 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:19.679128 24520 raft_consensus.cc:606] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:19.690891 24597 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:19.696112 24420 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.731876 24671 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:19.733028 24565 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9f2117a17f2425cae9c436e59c94b96. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.734629 25815 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:19.736557 24596 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:19.795626 24520 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.840715 24420 catalog_manager.cc:5697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.850662 25675 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.856688 24674 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.870522 25820 ts_tablet_manager.cc:933] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:08:19.888149 25820 tablet_copy_client.cc:323] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:08:19.890170 25572 raft_consensus.cc:993] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:19.890666 25572 raft_consensus.cc:1081] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:19.891903 24597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:19.891752 25737 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.892472 24597 raft_consensus.cc:606] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:19.894747 24596 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:19.897159 25214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:08:19.897305 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:08:19.897821 25214 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.897854 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet 6458c5ddfa4b4a4188e06ad9fc7d983d from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-6458c5ddfa4b4a4188e06ad9fc7d983d
I20260709 13:08:19.898429 25214 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.899711 24520 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.905462 24420 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.907027 24535 tablet_copy_source_session.cc:215] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:19.908207 25214 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:19.911998 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:19.912513 24519 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.912870 25214 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:19.921502 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.928978 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:19.929641 24597 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.929946 24597 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:19.930759 24597 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:19.931937 24597 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.933856 24519 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:19.934900 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:19.935909 25743 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.936375 25743 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:19.937340 25743 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:19.949642 24565 consensus_peers.cc:597] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d807668edef41d5b0b7e311228f18c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.952991 24671 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.954418 24520 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.955191 25819 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.955618 24519 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:19.957208 25821 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:19.965337 24674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:19.965881 24674 raft_consensus.cc:606] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:19.967098 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:19.968740 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:19.970978 24597 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:19.972256 24420 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.986538 25820 tablet_copy_client.cc:806] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:19.987284 25820 tablet_copy_client.cc:670] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:19.991086 25572 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:19.992190 25820 tablet_copy_client.cc:538] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:19.993108 24525 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:20.012887 25820 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:20.013195 24671 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:20.015976 24422 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:20.050702 25820 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:20.051688 25820 tablet_bootstrap.cc:492] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:20.052351 25820 ts_tablet_manager.cc:1403] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.007s
I20260709 13:08:20.055450 25820 raft_consensus.cc:359] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:20.056291 25820 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:20.056915 25820 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:20.058670 25820 ts_tablet_manager.cc:1434] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:20.060858 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-6458c5ddfa4b4a4188e06ad9fc7d983d received from {username='slave'} at 127.0.0.1:53446
I20260709 13:08:20.061303 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-6458c5ddfa4b4a4188e06ad9fc7d983d on tablet 6458c5ddfa4b4a4188e06ad9fc7d983d with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:20.079473 25820 ts_tablet_manager.cc:933] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:20.081362 25820 tablet_copy_client.cc:323] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:20.083053 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 72b8c4b638a5486c82fb2d3bb64ef503 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:20.083621 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 72b8c4b638a5486c82fb2d3bb64ef503 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-72b8c4b638a5486c82fb2d3bb64ef503
I20260709 13:08:20.091224 24610 tablet_copy_source_session.cc:215] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:20.094810 25772 raft_consensus.cc:993] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:20.095323 25772 raft_consensus.cc:1081] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:20.098726 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b8c4b638a5486c82fb2d3bb64ef503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.109316 24671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44436
I20260709 13:08:20.109896 24671 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.110245 24671 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.119473 24671 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:20.124599 24525 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:20.127138 25736 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.130455 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:20.131047 24525 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:20.131397 24525 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:20.134840 24525 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:20.137439 24525 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.176695 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:20.177436 24596 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.204540 25816 raft_consensus.cc:993] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:20.205534 25816 raft_consensus.cc:1081] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:20.207479 24520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50178
I20260709 13:08:20.208011 24520 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.208336 24520 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.211437 24599 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:20.217805 25816 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:20.218415 24520 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:20.221047 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:20.221905 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:20.222497 24674 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:20.222779 24674 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:20.223845 24674 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:20.221908 24597 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.228262 24674 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.231005 24520 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:20.320381 24671 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:20.348546 25840 ts_tablet_manager.cc:933] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:20.399070 25840 tablet_copy_client.cc:323] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
W20260709 13:08:20.465801 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45253us
I20260709 13:08:20.479746 24520 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:20.484030 25743 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:20.485441 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.498821 24525 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:20.503696 24674 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:20.505410 24597 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:20.509197 24596 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:20.514822 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:20.515578 25782 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:20.516290 25782 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:20.518904 25782 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:20.531622 25572 raft_consensus.cc:993] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:20.532033 25572 raft_consensus.cc:1081] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:20.539445 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:20.540423 25837 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:20.540913 25837 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:20.541826 25837 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:20.544948 25843 ts_tablet_manager.cc:933] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:20.547950 25213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:08:20.548240 25820 tablet_copy_client.cc:806] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:20.548636 25213 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.548883 25820 tablet_copy_client.cc:670] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:20.549119 25213 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.556041 25843 tablet_copy_client.cc:323] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:20.572542 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet c9f2117a17f2425cae9c436e59c94b96 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:20.573112 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet c9f2117a17f2425cae9c436e59c94b96 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-c9f2117a17f2425cae9c436e59c94b96
I20260709 13:08:20.574028 24599 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:20.576500 24609 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 8d807668edef41d5b0b7e311228f18c2 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:20.577034 24609 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 8d807668edef41d5b0b7e311228f18c2 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-8d807668edef41d5b0b7e311228f18c2
I20260709 13:08:20.586231 24610 tablet_copy_source_session.cc:215] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:20.568454 25213 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:20.594023 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:20.594681 24520 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.599632 24609 tablet_copy_source_session.cc:215] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:20.606937 24520 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:20.593582 25213 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:20.618834 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:20.619654 24599 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:20.620054 24599 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:20.633265 24599 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:20.640069 24599 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.634994 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:20.647732 25850 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:20.652419 25743 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:20.653033 25743 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:20.660461 24599 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:20.677165 24421 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.685312 25743 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:20.688352 25840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2117a17f2425cae9c436e59c94b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.693306 25843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d807668edef41d5b0b7e311228f18c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.699802 24422 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.706168 25820 tablet_copy_client.cc:538] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:20.749770 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 93873.3us
I20260709 13:08:20.752892 25820 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
W20260709 13:08:20.797233 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 183711us
I20260709 13:08:20.835253 25843 tablet_copy_client.cc:806] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:20.835877 25843 tablet_copy_client.cc:670] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:20.842927 25843 tablet_copy_client.cc:538] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:20.849817 25840 tablet_copy_client.cc:806] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:20.850486 25840 tablet_copy_client.cc:670] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:20.868067 24420 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.857060 25843 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:20.894085 25840 tablet_copy_client.cc:538] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:20.895598 25820 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:20.897781 25820 tablet_bootstrap.cc:492] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:20.898496 25820 ts_tablet_manager.cc:1403] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.146s	user 0.022s	sys 0.004s
I20260709 13:08:20.903324 25820 raft_consensus.cc:359] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:20.904248 25820 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:20.904901 25820 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:20.914700 25820 ts_tablet_manager.cc:1434] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:08:20.916579 24609 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-72b8c4b638a5486c82fb2d3bb64ef503 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:20.917006 24609 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-72b8c4b638a5486c82fb2d3bb64ef503 on tablet 72b8c4b638a5486c82fb2d3bb64ef503 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:20.919713 25840 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:20.969623 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:20.981740 25213 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Advancing to term 2
I20260709 13:08:20.990873 25843 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:20.991954 25843 tablet_bootstrap.cc:492] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:20.992610 25843 ts_tablet_manager.cc:1403] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.136s	user 0.029s	sys 0.030s
I20260709 13:08:20.993506 24672 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:20.995208 25782 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:20.995843 25840 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:20.995507 25843 raft_consensus.cc:359] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:20.996348 25843 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:20.996719 25840 tablet_bootstrap.cc:492] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:20.997429 25840 ts_tablet_manager.cc:1403] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.078s	user 0.023s	sys 0.000s
I20260709 13:08:20.997068 25843 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:21.000895 25843 ts_tablet_manager.cc:1434] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:08:21.001178 25840 raft_consensus.cc:359] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:21.002437 25840 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:21.003038 25840 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:21.006318 25840 ts_tablet_manager.cc:1434] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:08:21.020011 24599 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:21.022676 24609 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-8d807668edef41d5b0b7e311228f18c2 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:21.023149 24609 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-8d807668edef41d5b0b7e311228f18c2 on tablet 8d807668edef41d5b0b7e311228f18c2 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:21.023259 25837 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:21.023977 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-c9f2117a17f2425cae9c436e59c94b96 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:21.024356 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-c9f2117a17f2425cae9c436e59c94b96 on tablet c9f2117a17f2425cae9c436e59c94b96 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:21.041313 24596 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:21.042562 25853 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.055968 25214 raft_consensus.cc:1217] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:21.092844 24523 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:20.990907 25213 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:21.098809 25837 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.104151 25816 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.128321 24525 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.130584 25743 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:21.202719 24599 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.204881 25852 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:21.234475 25816 raft_consensus.cc:1064] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:21.236994 25816 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.260567 24599 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:21.260689 25213 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:21.262362 25681 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:21.282835 25816 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:21.305466 24520 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:21.308931 25816 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:21.349211 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:21.417603 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 64003.7us
I20260709 13:08:21.462498 25849 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.465925 25213 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.469753 25214 raft_consensus.cc:1217] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:21.491711 24599 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.500623 24421 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.506843 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cf920647a7842d49c08b2453da44143"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:21.507577 24596 raft_consensus.cc:606] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:21.514575 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:21.515179 24667 raft_consensus.cc:606] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:21.516480 25839 raft_consensus.cc:1064] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:21.519682 25219 raft_consensus.cc:1217] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:21.519078 25839 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.532600 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:21.533332 24667 raft_consensus.cc:606] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:21.577406 25219 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.578954 25572 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.624675 24523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:21.625402 24523 raft_consensus.cc:606] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:21.628235 25782 raft_consensus.cc:993] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:21.628657 25782 raft_consensus.cc:1081] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:21.630350 25219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:08:21.630878 25219 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.631203 25219 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.638459 25219 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.640345 24525 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.649914 25219 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:21.650141 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:21.657037 24674 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.659507 24669 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:21.651481 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:21.663023 24523 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.663393 24523 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:21.664155 24523 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.665244 24523 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.675403 24525 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.677824 25821 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.683094 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:21.683740 24599 raft_consensus.cc:606] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:21.697846 25839 raft_consensus.cc:993] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:21.698331 25839 raft_consensus.cc:1081] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:21.700091 24671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cf920647a7842d49c08b2453da44143"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:08:21.700702 24671 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.694340 25873 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.701052 24671 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.707283 24671 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:21.716529 24671 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:21.721143 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:21.722906 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:21.723107 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:21.723758 24520 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.726653 24674 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:21.729537 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:21.733986 24597 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.734277 24597 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:21.734995 24597 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:21.735091 24668 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.736123 24597 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.741621 25219 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.747042 25849 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:21.751504 24520 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:21.754129 25681 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.755895 24597 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:21.758667 24525 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.771397 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:21.774855 25213 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.787104 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:21.785985 24422 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.788266 25816 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.788888 25816 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:21.789775 25816 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:21.796348 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:21.797405 25850 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.797901 25850 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:21.798760 25850 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.798902 25572 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.801045 25849 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:21.825714 24588 tablet_service.cc:1558] Processing DeleteTablet for tablet 6458c5ddfa4b4a4188e06ad9fc7d983d with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:21.854301 25878 raft_consensus.cc:993] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:21.854830 25878 raft_consensus.cc:1081] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:21.856689 24525 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.858670 24421 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.862214 25213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48918
I20260709 13:08:21.862813 25213 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.863482 25213 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.873840 24523 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:21.872174 24422 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.882876 25219 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.892565 25213 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.898916 25213 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:21.906076 25884 tablet_replica.cc:333] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:21.907378 25884 raft_consensus.cc:2243] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:21.908154 25884 raft_consensus.cc:2272] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:21.937728 24520 raft_consensus.cc:2955] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:21.949011 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:21.954033 25821 raft_consensus.cc:1064] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:21.957094 24674 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:21.959259 25821 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.957738 24674 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:21.962237 24674 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.956071 24597 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:21.996299 25838 raft_consensus.cc:993] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:22.006094 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:22.012179 25873 raft_consensus.cc:993] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:22.070086 25838 raft_consensus.cc:1081] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:22.071760 25873 raft_consensus.cc:1081] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:22.070137 24599 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.073997 25213 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:22.075726 24674 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.084362 25219 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:22.020092 25839 raft_consensus.cc:1064] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:22.087775 25839 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:22.017153 25884 ts_tablet_manager.cc:1916] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:22.089929 24667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:08:22.090592 24667 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:22.090950 24667 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.091341 24674 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:22.077490 25819 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:22.081312 24599 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:22.095610 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:22.096381 25850 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:22.096869 25850 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:22.097776 25850 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:22.105002 25819 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:22.111210 24667 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:22.157658 24524 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:22.159572 24519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50178
I20260709 13:08:22.167284 24674 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:22.175688 24520 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:22.160858 24519 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:22.200547 24519 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:22.207158 25886 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:22.184273 25873 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.230655 24667 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:22.230159 24420 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.250051 25213 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.265112 25821 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:22.278821 25737 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:22.279052 24519 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:22.281343 24519 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:22.286512 25215 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:22.296583 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:22.297463 24596 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:22.297811 24596 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:22.298892 24596 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:22.318629 24520 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:22.320063 24596 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.323431 24674 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:22.323799 24519 raft_consensus.cc:2955] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.332473 24596 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:22.333609 25847 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:08:22.338205 25888 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:22.351537 25819 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:22.350485 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 102854us
I20260709 13:08:22.358461 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:22.359059 25884 ts_tablet_manager.cc:1929] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:08:22.359627 25878 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:22.359764 25884 log.cc:1199] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/6458c5ddfa4b4a4188e06ad9fc7d983d
I20260709 13:08:22.360203 25878 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:22.373407 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:22.374199 24596 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:22.361452 25878 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:22.386396 24596 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:22.392444 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:22.393232 24524 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:22.401191 25890 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.127s	user 0.000s	sys 0.002s
I20260709 13:08:22.403100 24422 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 3 to 4, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.415262 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72b8c4b638a5486c82fb2d3bb64ef503 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:22.418121 24524 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:22.419773 24525 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.447701 24599 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.450953 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:22.451702 24674 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:22.451994 24674 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:22.452915 24674 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:22.454438 24674 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:22.465919 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 6458c5ddfa4b4a4188e06ad9fc7d983d (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:22.480334 25838 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:22.484638 24420 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.491802 25681 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:22.496716 24524 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:22.498188 24673 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:22.507961 24674 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:22.513477 25819 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:22.515053 24423 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.516419 25873 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.521132 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet 72b8c4b638a5486c82fb2d3bb64ef503 with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:22.541021 25904 tablet_replica.cc:333] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:22.558830 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:22.559983 25782 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:22.560636 25782 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:22.543720 25216 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.580715 25782 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:22.569818 25886 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 13:08:22.605302 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44625.7us
I20260709 13:08:22.621590 25904 raft_consensus.cc:2243] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:22.622143 25897 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:08:22.622380 25904 pending_rounds.cc:70] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: Trying to abort 1 pending ops.
I20260709 13:08:22.635162 25852 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:08:22.622681 25904 pending_rounds.cc:77] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635846216085504 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } } }
I20260709 13:08:22.636041 25904 raft_consensus.cc:2917] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:08:22.636574 25904 raft_consensus.cc:2889] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:22.636979 25904 raft_consensus.cc:2272] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.689533 24668 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:22.700809 25904 ts_tablet_manager.cc:1916] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:22.708901 25896 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:08:22.746409 25219 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:22.765432 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 110138us
I20260709 13:08:22.729928 25911 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.783876 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:22.789636 24598 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:22.798457 24669 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.802917 25896 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:22.823930 24524 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:22.830078 25915 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:08:22.849514 24523 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.851199 24420 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.889335 24420 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:22.895862 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 140908us
I20260709 13:08:22.936153 24596 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.939054 25904 ts_tablet_manager.cc:1929] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:22.939625 25904 log.cc:1199] T 72b8c4b638a5486c82fb2d3bb64ef503 P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/72b8c4b638a5486c82fb2d3bb64ef503
I20260709 13:08:22.941977 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet 72b8c4b638a5486c82fb2d3bb64ef503 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:22.944046 24596 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:22.945489 24421 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 5, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.949023 24667 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.951728 25838 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.953608 25216 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:22.955107 25821 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:22.964161 24597 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:22.975279 25215 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:22.977098 25886 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:22.984225 25916 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.988734 25219 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:22.990423 24519 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:22.987318 24667 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.002591 25913 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:23.007848 24519 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:23.010845 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c9f2117a17f2425cae9c436e59c94b96 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.020838 25849 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:23.034387 25911 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:23.044456 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d807668edef41d5b0b7e311228f18c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.051198 24672 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:23.062228 25821 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.043699 25216 raft_consensus.cc:2955] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:23.073740 24419 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.076072 24419 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.088001 24523 raft_consensus.cc:2955] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:23.109153 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d807668edef41d5b0b7e311228f18c2 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:23.128454 25926 tablet_replica.cc:333] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:23.129593 25926 raft_consensus.cc:2243] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:23.130599 25926 raft_consensus.cc:2272] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:23.136428 25926 ts_tablet_manager.cc:1916] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:23.137283 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet c9f2117a17f2425cae9c436e59c94b96 with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:23.138255 25904 tablet_replica.cc:333] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:23.139312 25904 raft_consensus.cc:2243] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:23.140100 25904 raft_consensus.cc:2272] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:23.143718 25904 ts_tablet_manager.cc:1916] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:23.155184 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:23.167310 24597 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:23.170302 25921 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.184650 25904 ts_tablet_manager.cc:1929] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:23.191524 24672 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:23.222784 25904 log.cc:1199] T c9f2117a17f2425cae9c436e59c94b96 P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/c9f2117a17f2425cae9c436e59c94b96
I20260709 13:08:23.285562 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet c9f2117a17f2425cae9c436e59c94b96 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:23.312412 25926 ts_tablet_manager.cc:1929] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:23.314414 25926 log.cc:1199] T 8d807668edef41d5b0b7e311228f18c2 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/8d807668edef41d5b0b7e311228f18c2
I20260709 13:08:23.326402 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:23.326484 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet 8d807668edef41d5b0b7e311228f18c2 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:23.329933 25921 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.328619 24596 raft_consensus.cc:606] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:23.339879 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:23.340431 24596 raft_consensus.cc:606] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:23.346721 24523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:23.347299 24523 raft_consensus.cc:606] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:23.352241 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:23.352818 24667 raft_consensus.cc:606] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:23.360507 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:23.361058 24667 raft_consensus.cc:606] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:23.366119 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:23.367892 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:23.524998 25838 raft_consensus.cc:993] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:23.525534 25838 raft_consensus.cc:1081] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:23.527125 24519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50178
I20260709 13:08:23.527648 24519 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.527987 24519 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.533176 24519 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:23.535518 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:23.536073 24596 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.536437 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:23.537043 24669 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:23.535518 24519 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:23.537407 24669 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:23.538654 24669 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:23.539808 24669 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.542462 24596 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:23.543682 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:23.544555 25772 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:23.545204 25772 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:23.545964 25772 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:23.546582 24669 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:23.565207 24419 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.646286 25892 raft_consensus.cc:993] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:23.646749 25772 raft_consensus.cc:1081] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:23.648104 25216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:08:23.648592 25216 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.649003 25216 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.654740 25216 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.656929 25216 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:23.658025 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:23.658599 24522 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.658677 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:23.658926 24522 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:23.659262 24669 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.659653 24522 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.660849 24522 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.665416 24669 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:23.667039 24522 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:23.668241 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:23.669121 25852 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:23.674181 25852 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:23.675592 25852 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.683320 25821 raft_consensus.cc:993] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:23.683807 25821 raft_consensus.cc:1081] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:23.686493 25216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:08:23.687157 25216 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.687512 25216 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.687798 25837 raft_consensus.cc:993] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:23.688302 25837 raft_consensus.cc:1081] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:23.688289 24418 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.690042 25219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48918
I20260709 13:08:23.690543 25219 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.690868 25219 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.694579 25216 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.697670 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:23.696806 25219 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.698213 24522 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.700127 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:23.700769 24519 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.701449 25821 raft_consensus.cc:993] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:23.701951 25821 raft_consensus.cc:1081] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:23.703729 24669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:08:23.704209 24669 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.704532 24669 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.705961 24522 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:23.706694 24519 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:23.707505 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:23.708107 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:23.708451 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:23.709005 25216 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:23.708617 24596 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.709645 25852 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:23.710016 24596 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:23.712540 25852 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:23.713166 25219 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:23.712932 24596 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.714177 24596 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.711886 24669 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:23.709998 25932 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:23.715328 25852 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.716763 24669 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:23.714053 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:23.717327 24667 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.717366 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:23.718250 24667 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:23.718482 24519 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.718997 24667 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.720517 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:23.721098 24598 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.721378 24598 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:23.722092 24598 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:23.722886 24596 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:23.723296 24598 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.720134 24667 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.731592 24519 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:23.733187 24667 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:23.733743 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:23.735816 25837 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:23.736465 25837 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:23.737351 25932 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:23.738659 24598 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:23.738173 25837 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:23.739264 25932 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:23.746048 24418 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.750885 24419 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.761451 24419 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.966015 24667 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:23.967150 25892 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:23.979681 24598 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:23.995281 25919 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:24.123703 24667 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.125111 25932 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:24.136780 24522 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.138094 25852 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:24.150799 24523 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.152272 25932 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:24.154273 24667 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.157045 25852 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:24.192428 24522 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:24.194748 25928 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.212323 24597 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:24.213883 25837 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.243328 24667 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:24.247604 24597 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.249650 25950 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:24.256116 24639 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cee5aeb35a614558ad30ac67ec366dcf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:24.256852 24523 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.258730 24523 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:24.258997 24597 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:24.258229 25950 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:24.260444 25928 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.267431 25837 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.301905 25849 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.305624 24519 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.306502 24598 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.325055 24667 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:24.326889 24419 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.333614 24597 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:24.334277 24519 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:24.335136 25849 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:24.336066 24639 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4cf920647a7842d49c08b2453da44143. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:24.336670 25957 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:24.346302 25957 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.348256 24598 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.350404 24519 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.392426 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:24.405915 24597 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:24.418321 24419 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 3, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.436692 24519 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:24.438270 25916 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:24.441843 24565 consensus_peers.cc:597] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ff0c5b0ac6e4cc5b9d864a010ffdfe4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:24.442585 24667 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:24.444068 25821 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.464674 25916 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.466228 24667 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.481395 24598 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:24.482709 24519 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.483244 24419 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.495055 24669 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:24.496387 24522 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:24.496659 25821 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:24.499150 24565 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5ca582b84fd4b4fa8344fc31bcb9c2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:24.499351 25913 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:08:24.509131 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:24.508960 25821 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.516294 24667 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.527881 24522 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:24.540613 24419 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.579449 24522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:24.580008 24522 raft_consensus.cc:606] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:24.582765 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:24.583215 24598 raft_consensus.cc:606] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:24.586026 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:24.586488 24598 raft_consensus.cc:606] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:24.588655 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:24.589128 24667 raft_consensus.cc:606] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:24.591324 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:24.591737 24598 raft_consensus.cc:606] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:24.592759 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:24.593865 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:24.687964 25837 raft_consensus.cc:993] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:24.688458 25957 raft_consensus.cc:1081] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:24.689941 24522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50178
I20260709 13:08:24.690384 24522 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.690775 24522 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.695843 24522 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:24.697853 24522 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:24.698024 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:24.698638 24598 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.701195 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:24.701750 24667 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:24.702009 24667 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:24.702721 24667 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:24.703975 24667 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.705490 24598 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:24.706849 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:24.707717 25919 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:24.708156 25919 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:24.709002 25919 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:24.710199 24667 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:24.715883 25973 ts_tablet_manager.cc:933] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:24.739029 24418 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.746845 25973 tablet_copy_client.cc:323] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:24.751819 24684 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet 4cf920647a7842d49c08b2453da44143 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:24.752168 25977 ts_tablet_manager.cc:933] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:24.752405 24684 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet 4cf920647a7842d49c08b2453da44143 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-4cf920647a7842d49c08b2453da44143
I20260709 13:08:24.758188 25977 tablet_copy_client.cc:323] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:24.759896 24683 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet cee5aeb35a614558ad30ac67ec366dcf from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:24.760422 24683 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet cee5aeb35a614558ad30ac67ec366dcf from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-cee5aeb35a614558ad30ac67ec366dcf
I20260709 13:08:24.760701 24684 tablet_copy_source_session.cc:215] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:24.763634 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf920647a7842d49c08b2453da44143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.767827 24683 tablet_copy_source_session.cc:215] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:24.771100 25977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee5aeb35a614558ad30ac67ec366dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:24.778650 25973 tablet_copy_client.cc:806] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:24.779327 25973 tablet_copy_client.cc:670] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:24.783887 25973 tablet_copy_client.cc:538] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:24.791061 25977 tablet_copy_client.cc:806] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:24.791767 25977 tablet_copy_client.cc:670] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:24.793205 25973 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:24.800084 25977 tablet_copy_client.cc:538] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:24.812167 25977 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:24.830511 25973 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:24.831825 25973 tablet_bootstrap.cc:492] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:24.832800 25973 ts_tablet_manager.cc:1403] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.016s
I20260709 13:08:24.836797 25973 raft_consensus.cc:359] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:24.837749 25973 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:24.838446 25973 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:24.841681 25973 ts_tablet_manager.cc:1434] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:08:24.843981 25977 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:24.844893 25977 tablet_bootstrap.cc:492] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:24.845633 25977 ts_tablet_manager.cc:1403] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.034s	user 0.029s	sys 0.003s
I20260709 13:08:24.848438 25977 raft_consensus.cc:359] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:24.849346 25977 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:24.849905 24683 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-4cf920647a7842d49c08b2453da44143 received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:24.850426 24683 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-4cf920647a7842d49c08b2453da44143 on tablet 4cf920647a7842d49c08b2453da44143 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:24.850001 25977 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:24.852777 25977 ts_tablet_manager.cc:1434] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:24.854321 24683 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-cee5aeb35a614558ad30ac67ec366dcf received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:24.854698 24683 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-cee5aeb35a614558ad30ac67ec366dcf on tablet cee5aeb35a614558ad30ac67ec366dcf with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:24.891770 25972 raft_consensus.cc:993] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:24.892367 25972 raft_consensus.cc:1081] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:24.894228 25216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:08:24.894747 25216 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.895116 25216 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.901782 25216 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:24.903486 25216 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:24.904661 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:24.905753 24597 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:24.906003 24597 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:24.906648 24597 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:24.907562 24597 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.904387 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:24.909386 24522 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.913731 24597 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:24.914943 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:24.915784 25932 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:24.916486 25932 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:24.917747 25932 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:24.919866 24522 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:24.937606 24418 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.005401 25913 raft_consensus.cc:993] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:25.005962 25913 raft_consensus.cc:1081] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:25.006402 25977 ts_tablet_manager.cc:933] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:25.007738 24522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50164
I20260709 13:08:25.008342 24522 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.008746 24522 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.019404 24522 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:25.021436 25977 tablet_copy_client.cc:323] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:25.023357 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:25.023849 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-6ff0c5b0ac6e4cc5b9d864a010ffdfe4
I20260709 13:08:25.024108 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:25.024682 24671 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.028753 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:25.029590 24671 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:25.029706 24598 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.030138 24598 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:25.030848 24598 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:25.031810 24598 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.031987 24522 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:25.035666 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:25.036867 25982 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.037400 25982 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:25.037824 25972 raft_consensus.cc:993] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:25.039631 25972 raft_consensus.cc:1081] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:25.039115 25892 raft_consensus.cc:993] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:25.040609 25919 raft_consensus.cc:1081] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:25.040932 25982 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:25.042157 24667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44436
I20260709 13:08:25.042660 24667 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.042996 24667 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.043673 24610 tablet_copy_source_session.cc:215] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:25.043890 24598 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:25.042173 25216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:08:25.045684 25216 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.046041 25216 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.052896 25977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.059428 24418 catalog_manager.cc:5697] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.071563 25977 tablet_copy_client.cc:806] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:25.072248 25977 tablet_copy_client.cc:670] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:25.072829 25216 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:25.075721 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:25.075934 25977 tablet_copy_client.cc:538] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:25.076282 24522 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.076536 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:25.077134 24598 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.077407 24598 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:25.078109 24598 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:25.079063 24598 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.083009 24522 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:25.085445 25973 ts_tablet_manager.cc:933] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:25.085330 24667 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:25.086695 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:25.087356 24598 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:25.087599 25932 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.088068 25932 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:25.088277 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:25.090905 24522 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.089180 25932 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:25.091279 24522 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:25.090066 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:25.090466 24667 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:25.084658 25977 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:25.084954 25216 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:25.092182 24522 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:25.099593 24598 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.103327 24522 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.099354 25973 tablet_copy_client.cc:323] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:25.108155 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:25.108657 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet b5ca582b84fd4b4fa8344fc31bcb9c2a from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-b5ca582b84fd4b4fa8344fc31bcb9c2a
I20260709 13:08:25.117439 24418 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.123277 24610 tablet_copy_source_session.cc:215] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:25.113871 24522 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:25.128445 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:25.130363 25957 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.130997 25957 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:25.130935 24598 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:25.132108 25957 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:25.140873 25973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:25.143110 25977 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:25.144079 25977 tablet_bootstrap.cc:492] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:25.144824 25977 ts_tablet_manager.cc:1403] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.012s
I20260709 13:08:25.147903 25977 raft_consensus.cc:359] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:25.148787 25977 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:25.149502 25977 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:25.165419 25977 ts_tablet_manager.cc:1434] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 13:08:25.172032 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-6ff0c5b0ac6e4cc5b9d864a010ffdfe4 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:25.172447 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-6ff0c5b0ac6e4cc5b9d864a010ffdfe4 on tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:25.181572 25973 tablet_copy_client.cc:806] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:25.183559 25973 tablet_copy_client.cc:670] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:25.191329 24418 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.198848 25973 tablet_copy_client.cc:538] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:25.199107 25216 raft_consensus.cc:1217] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:08:25.207841 25973 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:25.224541 25216 raft_consensus.cc:1217] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:25.240669 25973 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:25.241719 25973 tablet_bootstrap.cc:492] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:25.242746 25973 ts_tablet_manager.cc:1403] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.009s
I20260709 13:08:25.245630 25973 raft_consensus.cc:359] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:25.246477 25973 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:25.247172 25973 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:25.251706 25973 ts_tablet_manager.cc:1434] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:25.253319 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-b5ca582b84fd4b4fa8344fc31bcb9c2a received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:25.253690 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-b5ca582b84fd4b4fa8344fc31bcb9c2a on tablet b5ca582b84fd4b4fa8344fc31bcb9c2a with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:25.285630 24597 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.287242 25892 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.325716 24667 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.328579 25919 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.462774 25219 raft_consensus.cc:1217] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:25.498306 24597 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.499624 25950 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.517903 24522 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.519188 25932 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.564028 25219 raft_consensus.cc:1217] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:25.594745 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.602592 24671 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.604490 25892 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:25.619694 24597 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.621237 25982 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.647274 25849 raft_consensus.cc:1064] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:25.651502 24519 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.651216 25849 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:25.652913 25932 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.681083 25219 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:25.693490 26003 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:25.702704 24598 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.703524 24523 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:25.705056 26004 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.713647 24596 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.715349 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.716058 24597 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:25.722755 25849 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:25.715391 25932 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:25.737269 26003 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:25.748829 24524 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.767282 26004 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.783735 25976 raft_consensus.cc:1064] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:25.786358 25976 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:25.789384 26004 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.795667 24600 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.814684 25216 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.816630 24519 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.841977 24419 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.871018 25216 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:25.873620 24595 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:25.873366 25976 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:25.875381 26002 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:25.915292 24667 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:25.918529 24525 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:25.922223 25976 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.926478 25849 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:25.935051 25972 raft_consensus.cc:1064] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:25.935837 25219 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.937700 25849 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.937600 24595 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.934216 25216 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.946169 25849 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.949599 25972 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:25.952740 24519 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.956461 25219 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.963100 24418 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:25.972651 26014 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:25.973543 25913 raft_consensus.cc:1064] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:25.976092 25913 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:25.980494 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4cf920647a7842d49c08b2453da44143 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:25.987142 25216 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:25.987959 24519 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:25.989194 25913 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:25.990204 24418 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.993450 25913 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:25.998116 24525 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.008152 24523 raft_consensus.cc:2955] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.020998 24588 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cf920647a7842d49c08b2453da44143 with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:26.036633 25219 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:26.038750 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27022900b12b4397b1677f3fb2326347"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:26.039299 24667 raft_consensus.cc:606] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:26.039350 24668 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:26.041744 25916 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:26.046880 24519 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:26.047005 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:26.048135 24520 raft_consensus.cc:606] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:26.049201 25972 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:26.049664 24672 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:26.048632 25913 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.052776 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:26.053380 24519 raft_consensus.cc:606] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:26.054651 26024 tablet_replica.cc:333] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:26.056419 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:26.058077 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:26.056681 25219 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.075973 24520 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.079571 25972 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.088569 25216 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.093623 24419 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.101833 26024 raft_consensus.cc:2243] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:26.118527 24418 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.119643 26024 raft_consensus.cc:2272] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:26.126456 25916 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.127741 26024 ts_tablet_manager.cc:1916] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:26.130322 25916 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:26.138047 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45827.4us
I20260709 13:08:26.145957 24525 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.156296 24672 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.171214 24669 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.183857 26024 ts_tablet_manager.cc:1929] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:08:26.184353 26024 log.cc:1199] T 4cf920647a7842d49c08b2453da44143 P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/4cf920647a7842d49c08b2453da44143
I20260709 13:08:26.184998 24600 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.188679 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 4cf920647a7842d49c08b2453da44143 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:26.191567 25216 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:26.191704 24525 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:26.193480 26028 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:26.194782 26030 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:26.204958 26028 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.209327 24525 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.214825 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:26.218029 25216 raft_consensus.cc:2955] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.227463 24418 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.241526 26002 raft_consensus.cc:993] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:26.242035 26002 raft_consensus.cc:1081] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:26.243716 24525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27022900b12b4397b1677f3fb2326347"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50178
I20260709 13:08:26.244205 24525 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.244516 24525 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.249588 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ca582b84fd4b4fa8344fc31bcb9c2a with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:26.251217 26034 tablet_replica.cc:333] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:26.252385 26034 raft_consensus.cc:2243] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:26.253528 26034 raft_consensus.cc:2272] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:26.256407 24525 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.259287 24525 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:26.259469 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:26.259779 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:26.260061 25216 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.260335 24672 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.260655 24672 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:26.261608 24672 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.262692 24672 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.266434 26034 ts_tablet_manager.cc:1916] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:26.267666 25216 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:26.268858 24490 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:26.269654 25942 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.270151 25942 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:26.270364 24672 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:26.270925 25942 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.281250 26034 ts_tablet_manager.cc:1929] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:26.281778 26034 log.cc:1199] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/b5ca582b84fd4b4fa8344fc31bcb9c2a
I20260709 13:08:26.284386 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet b5ca582b84fd4b4fa8344fc31bcb9c2a (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:26.295650 24418 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.393219 25982 raft_consensus.cc:993] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 96002c98f2d142e4b67dc5105a06079c to start an election
I20260709 13:08:26.393926 25982 raft_consensus.cc:1081] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Signalling peer 96002c98f2d142e4b67dc5105a06079c to start an election
I20260709 13:08:26.396363 25942 raft_consensus.cc:993] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 96002c98f2d142e4b67dc5105a06079c to start an election
I20260709 13:08:26.396813 25942 raft_consensus.cc:1081] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Signalling peer 96002c98f2d142e4b67dc5105a06079c to start an election
I20260709 13:08:26.396865 24600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:56006
I20260709 13:08:26.397468 24600 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.397812 24600 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.400270 24598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:56006
I20260709 13:08:26.400847 24598 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.402277 24598 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.407253 24600 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.409169 24600 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:26.409875 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:26.409646 24598 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:26.410365 24525 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.410580 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:26.410763 24525 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:26.411190 25216 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.411583 24525 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.412395 24525 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.415293 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:26.415803 24520 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:26.416090 24520 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:26.416782 24520 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:26.417748 24520 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.417872 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:26.418509 24672 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.420220 24525 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:26.421399 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:26.422397 25913 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.422886 25913 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:26.415807 24598 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:26.423804 25913 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.420763 25216 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:26.428859 24520 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:26.429914 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:26.430869 26031 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:26.431300 26031 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:26.432041 26031 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:26.433365 24672 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:26.445310 24418 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 2 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.473368 24418 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 3, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.508641 24672 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.514317 25216 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:26.514745 24519 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:26.517712 26002 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:26.522363 24598 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:26.525166 25976 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:26.527722 25976 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.532977 25216 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.534718 24519 raft_consensus.cc:2955] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.541389 24672 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:26.541635 25217 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:26.542725 26030 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:26.544850 26030 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:26.548229 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cee5aeb35a614558ad30ac67ec366dcf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:26.551393 25913 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.559716 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:26.561791 25217 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.568732 24672 raft_consensus.cc:2955] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:26.572502 24418 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 3 to 4, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.579675 24423 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.587040 24588 tablet_service.cc:1558] Processing DeleteTablet for tablet cee5aeb35a614558ad30ac67ec366dcf with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:26.588066 26024 tablet_replica.cc:333] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:26.589147 26024 raft_consensus.cc:2243] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:26.589792 26024 raft_consensus.cc:2272] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:26.593362 26024 ts_tablet_manager.cc:1916] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:26.601588 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:26.609747 26024 ts_tablet_manager.cc:1929] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:26.610188 26024 log.cc:1199] T cee5aeb35a614558ad30ac67ec366dcf P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/cee5aeb35a614558ad30ac67ec366dcf
I20260709 13:08:26.611822 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet cee5aeb35a614558ad30ac67ec366dcf (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:26.617376 26039 tablet_replica.cc:333] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:26.619108 26039 raft_consensus.cc:2243] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:26.619897 26039 raft_consensus.cc:2272] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:26.624989 26039 ts_tablet_manager.cc:1916] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:26.638612 26039 ts_tablet_manager.cc:1929] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:26.638972 26039 log.cc:1199] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/6ff0c5b0ac6e4cc5b9d864a010ffdfe4
I20260709 13:08:26.640805 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:26.758759 24672 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:26.759989 25942 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:26.770335 25216 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:26.771809 25919 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:26.882017 24667 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.883275 26030 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.895046 24519 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.897194 26030 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:27.022549 24525 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:27.023931 26031 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:27.024427 25216 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:27.029699 26030 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:27.058858 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:27.166121 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:27.198753 24525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:27.199179 24525 raft_consensus.cc:606] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:27.201465 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:27.201983 24598 raft_consensus.cc:606] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:27.204942 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:27.205474 24598 raft_consensus.cc:606] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:27.206353 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:27.207405 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:27.527509 26028 raft_consensus.cc:993] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:27.527940 25913 raft_consensus.cc:1081] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:27.529214 24525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50164
I20260709 13:08:27.529639 24525 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.529903 24525 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.535990 24525 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.538362 24525 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:27.539295 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:27.539393 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:27.539995 24600 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:27.540076 25217 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.540318 24600 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:27.541314 24600 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.542336 24600 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.545713 25217 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:27.546561 24600 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:27.546703 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:27.547713 25919 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:27.548218 25919 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:27.549050 25919 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.557897 24419 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.671476 24525 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:27.674896 25982 raft_consensus.cc:993] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:27.675383 25982 raft_consensus.cc:1081] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:27.678308 25216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:08:27.678818 25216 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.679117 25216 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:27.682037 24490 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 655be3d0d44f42a1aa683fd7271af488. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.683540 24667 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:27.684015 24600 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:27.684801 25919 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:27.684801 25216 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.685900 25982 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:27.688532 25216 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:27.689915 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:27.690577 24525 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:27.690933 24525 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:27.691715 24525 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.692163 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:27.693243 24525 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.695009 24672 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.701308 24672 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:27.702407 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:27.703222 25950 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:27.704316 25950 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:27.705279 25950 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.706385 25982 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.707423 24598 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.716284 24525 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:27.720314 24525 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:27.724263 25913 raft_consensus.cc:993] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:27.724767 25913 raft_consensus.cc:1081] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:27.726698 24672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:08:27.729175 24418 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.730710 24672 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.731446 24672 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.724643 24419 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.733210 24667 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:08:27.740427 24490 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf2646e18c7042728614c4bbf5b867aa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.743595 24669 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:27.745335 24600 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:27.745235 25919 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:27.745730 24672 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.747318 25942 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:27.747859 24672 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:27.748726 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:27.749487 25216 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.765015 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:27.767309 24600 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:27.767644 24600 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:27.771023 24600 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.771723 25982 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.774963 24600 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.774399 24595 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.774061 25216 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:27.780391 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:27.781333 26014 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:27.782754 26014 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:27.784893 24600 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:27.786998 24672 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:27.783918 26014 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:27.810963 24418 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 4, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.819466 24595 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:27.819406 24419 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.823354 24525 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:27.823444 24639 consensus_peers.cc:597] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6ade31527164676867a5686444d0240. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.824864 26014 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:27.829401 26002 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:27.833715 24672 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.843567 26014 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.845497 24525 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.862075 24672 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:27.864341 24598 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.887015 24418 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:08:27.932449 24639 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57bac7b2b9c5456588833d44d3dff943. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.933825 24598 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:27.935317 26002 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:27.936273 24525 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:27.937736 26002 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:27.943194 26071 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.944832 24600 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.947306 24525 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:27.959298 24419 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index -1 to 3, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.038579 24600 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:28.039853 25982 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:28.055442 25216 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:28.057121 25942 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:28.110950 24525 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:28.112274 25950 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:28.126873 24672 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:28.132174 26057 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:28.202939 25216 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:28.204195 26071 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:28.208220 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.223212 24598 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:28.224632 26071 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:28.277463 26085 ts_tablet_manager.cc:933] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:08:28.280534 26085 tablet_copy_client.cc:323] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:08:28.283582 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet 655be3d0d44f42a1aa683fd7271af488 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:08:28.284113 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet 655be3d0d44f42a1aa683fd7271af488 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-655be3d0d44f42a1aa683fd7271af488
I20260709 13:08:28.291355 24535 tablet_copy_source_session.cc:215] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:28.295100 26085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655be3d0d44f42a1aa683fd7271af488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.311924 26085 tablet_copy_client.cc:806] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:28.312487 26085 tablet_copy_client.cc:670] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:28.315866 26085 tablet_copy_client.cc:538] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:28.323012 26085 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:28.372663 26089 ts_tablet_manager.cc:933] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:28.386337 26088 ts_tablet_manager.cc:933] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:08:28.387915 26089 tablet_copy_client.cc:323] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:28.389640 24683 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet b6ade31527164676867a5686444d0240 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:28.390164 24683 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet b6ade31527164676867a5686444d0240 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-b6ade31527164676867a5686444d0240
I20260709 13:08:28.393610 26088 tablet_copy_client.cc:323] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:08:28.395174 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet bf2646e18c7042728614c4bbf5b867aa from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:08:28.395686 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet bf2646e18c7042728614c4bbf5b867aa from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-bf2646e18c7042728614c4bbf5b867aa
I20260709 13:08:28.398423 24683 tablet_copy_source_session.cc:215] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:28.401686 26089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ade31527164676867a5686444d0240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.403100 24535 tablet_copy_source_session.cc:215] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:28.406138 26088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf2646e18c7042728614c4bbf5b867aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.406625 26085 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:28.407148 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.407594 26085 tablet_bootstrap.cc:492] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:28.408309 26085 ts_tablet_manager.cc:1403] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.086s	user 0.036s	sys 0.030s
I20260709 13:08:28.411880 26085 raft_consensus.cc:359] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:28.412703 26085 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:28.413627 26085 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:28.422698 26085 ts_tablet_manager.cc:1434] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 13:08:28.423825 26092 ts_tablet_manager.cc:933] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:28.424290 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-655be3d0d44f42a1aa683fd7271af488 received from {username='slave'} at 127.0.0.1:53446
I20260709 13:08:28.425155 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-655be3d0d44f42a1aa683fd7271af488 on tablet 655be3d0d44f42a1aa683fd7271af488 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:28.431988 26088 tablet_copy_client.cc:806] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:28.432576 26088 tablet_copy_client.cc:670] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:28.442044 26088 tablet_copy_client.cc:538] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:28.450093 26092 tablet_copy_client.cc:323] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.131:37451
I20260709 13:08:28.453027 24683 tablet_copy_service.cc:140] P 148dc963cec64232ad3b248abad6f36d: Received BeginTabletCopySession request for tablet 57bac7b2b9c5456588833d44d3dff943 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:52138)
I20260709 13:08:28.453578 24683 tablet_copy_service.cc:161] P 148dc963cec64232ad3b248abad6f36d: Beginning new tablet copy session on tablet 57bac7b2b9c5456588833d44d3dff943 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:52138: session id = 983693721af6486c97ece1410a90cf30-57bac7b2b9c5456588833d44d3dff943
I20260709 13:08:28.460832 26089 tablet_copy_client.cc:806] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:28.461469 26089 tablet_copy_client.cc:670] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:28.465355 26089 tablet_copy_client.cc:538] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:28.465943 24683 tablet_copy_source_session.cc:215] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:28.469027 26092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bac7b2b9c5456588833d44d3dff943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.474552 26089 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:28.492684 26088 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:28.511312 26092 tablet_copy_client.cc:806] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:28.511930 26092 tablet_copy_client.cc:670] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:28.521817 26089 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:28.522866 26089 tablet_bootstrap.cc:492] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:28.523169 26092 tablet_copy_client.cc:538] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:28.523684 26089 ts_tablet_manager.cc:1403] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.049s	user 0.030s	sys 0.012s
I20260709 13:08:28.527416 26089 raft_consensus.cc:359] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:28.528303 26089 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:28.528990 26089 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:28.531847 26089 ts_tablet_manager.cc:1434] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:08:28.539052 24683 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-b6ade31527164676867a5686444d0240 received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:28.539480 24683 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-b6ade31527164676867a5686444d0240 on tablet b6ade31527164676867a5686444d0240 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:28.547360 26092 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:28.549430 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:28.550057 24667 raft_consensus.cc:606] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:28.552996 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:28.553507 24520 raft_consensus.cc:606] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:28.554734 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:28.556421 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:28.564500 26088 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:28.565366 26088 tablet_bootstrap.cc:492] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:28.566031 26088 ts_tablet_manager.cc:1403] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.011s
I20260709 13:08:28.568310 26088 raft_consensus.cc:359] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:28.568929 26088 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:28.569754 26088 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:28.572031 26088 ts_tablet_manager.cc:1434] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:08:28.575290 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-bf2646e18c7042728614c4bbf5b867aa received from {username='slave'} at 127.0.0.1:53446
I20260709 13:08:28.575692 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-bf2646e18c7042728614c4bbf5b867aa on tablet bf2646e18c7042728614c4bbf5b867aa with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:28.577803 26092 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:28.578709 26092 tablet_bootstrap.cc:492] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:28.579352 26092 ts_tablet_manager.cc:1403] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.016s
I20260709 13:08:28.582190 26092 raft_consensus.cc:359] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:28.583033 26092 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:28.583665 26092 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:28.586352 26092 ts_tablet_manager.cc:1434] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:28.586645 25942 raft_consensus.cc:993] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 96002c98f2d142e4b67dc5105a06079c to start an election
I20260709 13:08:28.587110 25942 raft_consensus.cc:1081] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Signalling peer 96002c98f2d142e4b67dc5105a06079c to start an election
I20260709 13:08:28.587903 24683 tablet_copy_service.cc:342] P 148dc963cec64232ad3b248abad6f36d: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-57bac7b2b9c5456588833d44d3dff943 received from {username='slave'} at 127.0.0.1:52138
I20260709 13:08:28.588346 24683 tablet_copy_service.cc:434] P 148dc963cec64232ad3b248abad6f36d: ending tablet copy session 983693721af6486c97ece1410a90cf30-57bac7b2b9c5456588833d44d3dff943 on tablet 57bac7b2b9c5456588833d44d3dff943 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:08:28.589156 24600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:56006
I20260709 13:08:28.589692 24600 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.590021 24600 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.601280 24600 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:28.604082 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:28.604622 24520 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:28.604902 24520 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:28.605607 24520 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:28.606547 24520 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.606648 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:28.607276 24667 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:28.612530 24667 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:28.613102 24520 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:28.614190 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:28.615664 26031 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:28.627729 24600 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:28.629451 26031 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:28.630414 26031 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:28.649433 24418 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 2 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.826455 26071 raft_consensus.cc:993] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:28.826936 26102 raft_consensus.cc:1081] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:08:28.828214 24520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50178
I20260709 13:08:28.828742 24520 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.829025 24520 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.836076 24520 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:28.837765 24520 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:28.838660 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:28.839162 24600 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.840420 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:28.840953 24667 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:28.841285 24667 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:28.841985 24667 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:28.843030 24667 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.853567 25216 raft_consensus.cc:1217] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:08:28.865026 24667 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:28.869122 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:28.864871 24600 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:28.869858 25942 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.870354 25942 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:28.871023 25942 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:28.881832 25216 raft_consensus.cc:1217] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:28.895399 24418 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.896142 25216 raft_consensus.cc:1217] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:08:28.998834 25216 raft_consensus.cc:1217] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:08:29.123848 24667 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:29.124962 25913 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:29.140954 24525 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:29.142367 26097 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:29.541392 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 93787.6us
I20260709 13:08:29.560120 24667 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:29.566625 25942 raft_consensus.cc:1064] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:29.569169 25942 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:29.580801 24598 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:29.601869 26111 raft_consensus.cc:1064] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:29.608592 25919 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:29.604416 26111 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:29.641959 26114 raft_consensus.cc:1064] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:29.644299 26114 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:29.647284 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 87212.6us
I20260709 13:08:29.652221 26118 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:29.657738 26071 raft_consensus.cc:1064] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:08:29.672514 24667 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:29.676905 25919 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:29.681907 24594 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:29.660292 26071 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:29.683712 25919 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:29.688608 25216 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:29.690613 25919 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:29.706893 24520 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:29.713303 26109 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:29.726485 26118 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:29.733997 24594 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:29.740115 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 189424us
I20260709 13:08:29.749317 25212 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:29.753157 26114 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:29.752308 25212 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:29.764777 25216 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:29.767422 26118 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:29.796903 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55850.3us
I20260709 13:08:29.827241 24598 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:29.822256 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:29.822278 24667 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:29.869570 24597 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:29.917716 25213 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:29.974941 24418 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 4 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:29.922250 26126 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:30.132329 26071 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:30.133600 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 242469us
W20260709 13:08:30.167038 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 336013us
I20260709 13:08:30.180589 25942 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:30.265683 24520 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:08:30.288138 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 169481us
I20260709 13:08:30.286473 24665 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.304768 26123 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:30.329414 26149 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:08:30.344375 26069 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:30.396800 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 108777us
W20260709 13:08:30.397464 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55532.1us
W20260709 13:08:30.402005 24695 debug-util.cc:398] Leaking SignalData structure 0x7b0800107420 after lost signal to thread 23433
W20260709 13:08:30.403012 24695 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6e40 after lost signal to thread 24457
W20260709 13:08:30.404157 24695 debug-util.cc:398] Leaking SignalData structure 0x7b0800331e00 after lost signal to thread 24549
W20260709 13:08:30.406054 24695 debug-util.cc:398] Leaking SignalData structure 0x7b0800332dc0 after lost signal to thread 24624
W20260709 13:08:30.407209 24695 debug-util.cc:398] Leaking SignalData structure 0x7b08002ab000 after lost signal to thread 24698
W20260709 13:08:30.408268 24695 debug-util.cc:398] Leaking SignalData structure 0x7b0800307dc0 after lost signal to thread 25243
W20260709 13:08:30.415939 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 101183us
I20260709 13:08:30.421216 24594 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:30.439500 25215 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.448748 26157 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:30.459688 24419 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:30.462618 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 62240.4us
I20260709 13:08:30.464238 24598 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.473476 26157 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:30.484841 26111 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.486703 24595 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.496744 26143 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.501520 24525 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.497905 24594 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.518083 24674 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.523985 24522 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:30.531154 25215 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.533506 25212 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:30.536185 25942 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:30.539498 24420 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.550251 25215 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.557235 26111 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.561450 25212 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.578241 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:30.610797 24674 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:30.612972 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf2646e18c7042728614c4bbf5b867aa with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:30.626897 25942 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:30.638233 24420 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 5 to 6, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.656239 24674 raft_consensus.cc:2955] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.690471 24421 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 5 to 6, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.704809 24674 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:30.710083 25215 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:30.711427 24595 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:30.713781 26157 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:30.715641 26157 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:30.734758 26158 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.736506 24594 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.733516 24522 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } attrs { replace: true } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.751641 25215 raft_consensus.cc:2955] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.759841 24519 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:30.766180 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b6ade31527164676867a5686444d0240 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:30.770207 24588 tablet_service.cc:1558] Processing DeleteTablet for tablet bf2646e18c7042728614c4bbf5b867aa with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:30.771600 24595 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:30.773406 26111 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:30.775882 24418 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 3 to 4, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 1 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.779270 24674 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:30.785491 26122 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.771596 25216 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:30.789803 25214 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:30.789639 25942 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:30.792493 26109 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:30.799141 25213 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.811573 26165 tablet_replica.cc:333] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:30.813123 26165 raft_consensus.cc:2243] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.816269 26165 raft_consensus.cc:2272] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.816645 26157 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.822125 25216 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.836699 24407 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 655be3d0d44f42a1aa683fd7271af488 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:30.858481 24595 raft_consensus.cc:2955] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.862542 24410 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57bac7b2b9c5456588833d44d3dff943 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:30.877954 24515 tablet_service.cc:1558] Processing DeleteTablet for tablet b6ade31527164676867a5686444d0240 with delete_type TABLET_DATA_TOMBSTONED (TS 0131806e3b9647128f32db1ab8d314fc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50160
I20260709 13:08:30.825546 24519 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:30.823163 24421 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 6 to 7, VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131) evicted. New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.915431 24418 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.823966 26165 ts_tablet_manager.cc:1916] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:30.926405 24594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:49946
I20260709 13:08:30.927098 24594 raft_consensus.cc:606] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:30.933115 26112 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:30.937979 24657 tablet_service.cc:1558] Processing DeleteTablet for tablet 655be3d0d44f42a1aa683fd7271af488 with delete_type TABLET_DATA_TOMBSTONED (TS 148dc963cec64232ad3b248abad6f36d not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:44420
I20260709 13:08:30.947113 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:08:30.947764 24519 raft_consensus.cc:606] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:30.951501 24519 raft_consensus.cc:2955] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:30.957932 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:30.959980 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:30.973722 26166 tablet_replica.cc:333] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:08:30.986907 26166 raft_consensus.cc:2243] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:30.987737 26166 raft_consensus.cc:2272] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:30.991315 26165 ts_tablet_manager.cc:1929] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:08:30.992111 26165 log.cc:1199] T bf2646e18c7042728614c4bbf5b867aa P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/bf2646e18c7042728614c4bbf5b867aa
I20260709 13:08:30.995736 24588 tablet_service.cc:1558] Processing DeleteTablet for tablet 57bac7b2b9c5456588833d44d3dff943 with delete_type TABLET_DATA_TOMBSTONED (TS 96002c98f2d142e4b67dc5105a06079c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55992
I20260709 13:08:30.997756 26166 ts_tablet_manager.cc:1916] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:31.000801 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet bf2646e18c7042728614c4bbf5b867aa (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:31.001451 26165 tablet_replica.cc:333] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:08:31.002935 26165 raft_consensus.cc:2243] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:31.003573 26165 raft_consensus.cc:2272] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:31.012732 26168 tablet_replica.cc:333] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:08:31.014686 26168 raft_consensus.cc:2243] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:31.015573 26168 raft_consensus.cc:2272] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:31.021533 26165 ts_tablet_manager.cc:1916] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:31.030162 26166 ts_tablet_manager.cc:1929] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:31.030680 26166 log.cc:1199] T b6ade31527164676867a5686444d0240 P 0131806e3b9647128f32db1ab8d314fc: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/wals/b6ade31527164676867a5686444d0240
I20260709 13:08:31.032423 24407 catalog_manager.cc:5028] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): tablet b6ade31527164676867a5686444d0240 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:31.034274 26168 ts_tablet_manager.cc:1916] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:31.046860 26111 raft_consensus.cc:993] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:31.047379 26111 raft_consensus.cc:1081] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:08:31.048920 24674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44436
I20260709 13:08:31.049440 24674 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.049785 24674 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:31.053349 26165 ts_tablet_manager.cc:1929] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:08:31.053882 26165 log.cc:1199] T 57bac7b2b9c5456588833d44d3dff943 P 96002c98f2d142e4b67dc5105a06079c: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/wals/57bac7b2b9c5456588833d44d3dff943
I20260709 13:08:31.055469 24409 catalog_manager.cc:5028] TS 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): tablet 57bac7b2b9c5456588833d44d3dff943 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:31.055948 24674 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:31.060065 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:31.060595 24519 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:31.060926 24519 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:31.061636 24519 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:31.062634 24519 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:31.066903 26168 ts_tablet_manager.cc:1929] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:08:31.067462 26168 log.cc:1199] T 655be3d0d44f42a1aa683fd7271af488 P 148dc963cec64232ad3b248abad6f36d: Deleting WAL directory at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/wals/655be3d0d44f42a1aa683fd7271af488
I20260709 13:08:31.068325 24519 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:31.069386 24410 catalog_manager.cc:5028] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): tablet 655be3d0d44f42a1aa683fd7271af488 (table test-workload [id=99ad4e2f10c8490e9962c736bc8024ed]) successfully deleted
I20260709 13:08:31.069399 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:31.070263 26158 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:31.070688 26158 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:31.071460 26158 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:31.079906 24674 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:31.080837 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:31.081671 24595 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:31.099172 24595 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:31.098839 24420 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 3 to 4, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 4 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.379981 26117 raft_consensus.cc:993] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:31.380482 26117 raft_consensus.cc:1081] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:31.382385 25212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:08:31.382897 25212 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.383200 25212 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.389708 25212 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:31.392740 25212 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:31.393405 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:31.393968 24520 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.393810 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:31.395460 24595 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.395828 24595 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:31.396755 24595 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:31.398241 24595 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.400389 24520 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:31.402860 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:31.403671 26057 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.404795 26057 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:31.405706 26057 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:31.407523 24595 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:31.420302 24420 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.492611 24595 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:31.493834 26158 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:31.521728 24519 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:31.523208 26158 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:31.740325 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 56529.2us
I20260709 13:08:32.869891 26185 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:32.871624 26185 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:32.878417 26185 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:32.879215 26185 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:32.880159 26185 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.112268 26188 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.113441 26188 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.116524 26188 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.147539 26189 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:33.189311 26190 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.190330 26190 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:33.148512 26189 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:33.216038 26188 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.217178 26188 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.220013 26188 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.220659 26188 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:33.243068 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.001s	sys 0.003s
I20260709 13:08:33.538983 26179 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:33.540017 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.001s	sys 0.003s
I20260709 13:08:33.403874 26180 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:33.404357 26181 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:33.403965 26176 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:33.537828 26190 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:33.540334 26179 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.544704 26176 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.550542 26180 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.552821 26176 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.553743 26181 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.556489 26181 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.570873 26179 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.571511 26180 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.542781 26189 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:33.574074 26176 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:33.573683 26190 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.574642 26181 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.574998 26176 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.576948 26181 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.600708 26185 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.601596 26181 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.602097 26189 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:33.574877 26188 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.603235 26189 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.604192 26188 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.575793 26190 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:33.605139 26189 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.605736 26189 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.606498 26190 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:33.607121 26190 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:33.606570 26189 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.607795 26190 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.608917 26192 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:33.609421 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.017s
W20260709 13:08:33.609827 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.004s	sys 0.017s
I20260709 13:08:33.609882 26189 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:33.609872 26192 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.645149 26192 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:33.645885 26192 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.645979 26189 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.646826 26192 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.646958 26189 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:33.649899 26189 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:33.652444 26189 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:33.653451 26189 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:33.672864 26193 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:33.673708 26193 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.674836 26189 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:33.677109 26194 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:33.678049 26194 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:33.685274 26194 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:33.844790 26193 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:33.868461 26192 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:34.001250 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:34.004401 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:34.005409 24525 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:34.081502 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:34.082801 26192 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:34.083328 26192 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.083777 26192 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.097230 26193 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.098173 26193 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.100831 26193 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.108513 26192 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.390321 26192 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.464622 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:34.465639 24525 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:34.515712 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:34.516594 24524 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.518981 26195 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:34.520128 26195 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.523960 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:34.525034 26192 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:34.525467 26192 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.525859 26192 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.526360 26195 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.534564 26190 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.535323 26196 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.536262 26196 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.537513 26195 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:34.545215 26195 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.551093 24524 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:34.552228 26196 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.554626 26195 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.556228 26198 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:34.541123 26192 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.567329 26192 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.569533 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:34.570318 24522 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.578583 26198 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.583220 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:34.584501 26192 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:34.588518 24522 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:34.590042 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:34.593307 26198 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.594411 26193 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:34.594995 26193 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:34.591355 26196 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.588490 26192 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:34.596328 26193 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.600018 26197 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:34.605957 26192 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.607199 26197 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.609714 26197 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.610289 26197 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:34.610495 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7060 after lost signal to thread 23433
I20260709 13:08:34.612782 26197 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.605513 26196 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.618800 26196 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.627355 24519 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:34.624974 26196 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.634794 26196 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.664337 26200 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:34.669554 26205 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.670496 26205 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.681778 26200 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.684659 26200 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.651192 26202 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:08:34.648360 26203 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.700516 26195 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.701385 26195 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.703670 26195 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.668256 26196 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.704155 26192 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:34.705878 26192 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.709762 26192 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:34.710304 26197 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.710940 26205 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:08:34.695052 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 64900.5us
I20260709 13:08:34.721336 26207 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:34.726001 26207 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.727017 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 197) took 1041 ms. Trace:
I20260709 13:08:34.719193 26203 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.727464 24520 rpcz_store.cc:276] 0709 13:08:33.674648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.711538 (+1036890us) service_pool.cc:224] Handling call
0709 13:08:34.715037 (+  3499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.715304 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:34.715328 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:34.715374 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:34.715406 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.715464 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:34.716291 (+   827us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:34.728657 26207 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:34.712811 26195 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.738658 26197 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:34.739015 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:34.716925 26196 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.749060 24519 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:34.751906 26190 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:34.750741 26207 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.752646 26190 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.754441 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:34.753204 26207 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.737126 26192 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.717881 26193 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.763484 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:34.765566 26176 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.764293 26202 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:34.745741 26195 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.776647 26197 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.767639 26196 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.777856 26195 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.779317 26197 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.779467 26196 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.779783 26192 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.781613 26213 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:34.782537 26192 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.774669 26202 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:34.849687 26202 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.782254 26213 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.853130 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:34.856710 26207 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:34.857548 26214 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:34.848368 26211 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.865442 26210 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:34.865432 26196 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.866883 26196 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.866119 26190 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.858366 26214 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.880887 26196 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.866119 26210 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.883458 26210 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:34.886188 26198 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:34.886584 26219 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.893123 26213 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:34.854081 26193 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.896807 26203 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:34.886893 26198 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.905857 26200 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.886894 26218 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.935873 26199 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:34.944703 26216 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:34.948247 26227 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:34.962535 26214 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.911955 26198 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:34.888304 26219 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.945574 26216 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.936337 26209 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.939797 26200 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.940198 26218 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:34.936635 26204 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:34.945469 26199 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.889133 26211 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:34.938985 26215 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:35.648396 26198 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:35.713599 26209 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:35.722786 26216 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:35.724624 26219 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:35.725195 26215 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:35.720489 26204 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:35.727973 26200 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:35.729817 26211 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:35.731489 26199 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:35.719625 26198 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:35.736270 26209 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:35.737138 26202 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.887s	user 0.006s	sys 0.006s
I20260709 13:08:35.737542 26218 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:35.749632 26202 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:35.741040 26215 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:35.751385 26198 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:34.949380 26227 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:35.758225 26202 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:35.760047 26227 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:35.742799 26204 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:08:36.396034 24491 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.032s (SENT)
W20260709 13:08:36.719985 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800038b80 after lost signal to thread 23433
W20260709 13:08:36.928925 24491 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.001s
W20260709 13:08:36.929445 24491 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.006s	sys 0.001s
W20260709 13:08:36.929764 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 533744us
W20260709 13:08:36.930253 24491 connection.cc:256] RPC call timeout handler was delayed by -1.3741554649999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:08:36.931214 24491 connection.cc:256] RPC call timeout handler was delayed by -1.3543554649999123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:08:36.931612 24491 connection.cc:256] RPC call timeout handler was delayed by -1.3543554649999123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:08:36.931921 24491 connection.cc:256] RPC call timeout handler was delayed by -1.2346554649999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:08:36.932426 24491 connection.cc:256] RPC call timeout handler was delayed by -1.0816554649999262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 13:08:36.932752 24491 connection.cc:256] RPC call timeout handler was delayed by -1.0456554649999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:08:36.947719 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7740 after lost signal to thread 24457
W20260709 13:08:36.949424 25240 debug-util.cc:398] Leaking SignalData structure 0x7b080031dc80 after lost signal to thread 24549
W20260709 13:08:37.622107 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08000f61c0 after lost signal to thread 24624
W20260709 13:08:37.638445 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.741s	user 0.001s	sys 0.033s
W20260709 13:08:37.640987 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.744s	user 0.002s	sys 0.033s
I20260709 13:08:37.649662 26230 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:37.653664 26230 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.657466 26231 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:37.661444 26231 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.663933 26231 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:37.665244 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 209) took 2760 ms. Trace:
I20260709 13:08:37.665573 24520 rpcz_store.cc:276] 0709 13:08:34.904645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.904833 (+   188us) service_pool.cc:224] Handling call
0709 13:08:37.664786 (+2759953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.664923 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.664938 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:37.664986 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:37.665004 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.665036 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.665171 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:37.669258 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.669972 26230 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:37.670632 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:37.677779 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08003370c0 after lost signal to thread 24698
W20260709 13:08:37.679046 25240 debug-util.cc:398] Leaking SignalData structure 0x7b080035c740 after lost signal to thread 25243
W20260709 13:08:37.679351 25240 debug-util.cc:398] Leaking SignalData structure 0x7b0800357a00 after lost signal to thread 25244
I20260709 13:08:37.700791 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:37.703482 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:37.704834 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:37.712186 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:37.715545 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:37.727638 26193 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:37.729128 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:37.729784 24525 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:37.731120 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:37.731905 26230 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:37.732332 26230 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:37.732703 26230 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.731817 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.733610 24599 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:37.749372 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.750152 24595 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:37.753005 26230 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.755941 26230 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:37.758028 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:37.758744 24525 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.768709 24525 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:37.770222 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:37.771261 26230 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.782440 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:37.781894 26230 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:37.784559 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:37.785210 24523 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:37.785734 26230 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:37.795063 24564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.941s	user 0.012s	sys 0.027s
W20260709 13:08:37.795903 24564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.944s	user 0.012s	sys 0.027s
I20260709 13:08:37.797151 26207 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:37.798033 26207 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.798717 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:37.800428 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:37.794946 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:37.802560 24670 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:37.803272 26208 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:37.804350 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:37.804149 26208 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.806864 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:37.807250 26208 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:37.808178 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:37.808868 24670 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:37.809966 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:37.813954 26201 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:37.814524 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.814811 26201 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.819410 26207 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:37.834894 24523 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:37.837136 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:37.838987 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:37.840504 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:37.840842 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:37.844039 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:37.843331 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800035220 after lost signal to thread 24457
I20260709 13:08:37.848795 26205 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:37.844976 26192 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:37.893915 26241 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:37.858060 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:37.858183 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:37.896926 25216 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:37.897018 24674 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:37.859120 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:37.860073 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:37.863224 24639 connection.cc:256] RPC call timeout handler was delayed by -1.8283761270000696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:08:37.868268 25211 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:37.909473 26241 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:37.867784 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:37.910885 25219 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:08:37.880405 26201 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:37.882267 26239 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.912705 26241 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:37.913000 26239 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.893595 25215 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:08:37.894234 26192 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.852561 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:37.919185 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 101699us
I20260709 13:08:37.894750 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:37.895243 26205 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:37.898702 24639 connection.cc:256] RPC call timeout handler was delayed by -1.5592761270000892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:08:37.898239 25210 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:08:37.922096 26193 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:37.918744 26201 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:37.922731 26193 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.923221 26201 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:37.921522 24639 connection.cc:256] RPC call timeout handler was delayed by -1.446776127000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:08:37.923969 24639 connection.cc:256] RPC call timeout handler was delayed by -1.4400737720000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 13:08:37.924260 24639 connection.cc:256] RPC call timeout handler was delayed by -1.4400737720000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 13:08:37.924556 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.074s	user 0.028s	sys 0.047s
W20260709 13:08:37.924530 24639 connection.cc:256] RPC call timeout handler was delayed by -1.4157737719999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 13:08:37.925006 24639 connection.cc:256] RPC call timeout handler was delayed by -1.4049737719999484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 13:08:37.923498 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.925309 26201 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:37.925344 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3662737719999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:08:37.926222 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3180761270000403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:08:37.926491 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3180761270000403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 13:08:37.926532 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.926821 26205 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:37.927110 24595 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:37.927845 25212 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:08:37.928596 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.928790 26239 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:37.929232 24599 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:37.930644 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.930919 26192 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:37.926846 24639 connection.cc:256] RPC call timeout handler was delayed by -1.2550761270000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:08:37.932363 24639 connection.cc:256] RPC call timeout handler was delayed by -1.2303737720000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 13:08:37.932643 24639 connection.cc:256] RPC call timeout handler was delayed by -1.0899737720000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:08:37.932947 24639 connection.cc:256] RPC call timeout handler was delayed by -1.04587377200005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 13:08:37.933284 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.083s	user 0.028s	sys 0.050s
W20260709 13:08:37.933307 24639 connection.cc:256] RPC call timeout handler was delayed by -1.04587377200005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 13:08:37.932065 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:37.920599 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65001.9us
I20260709 13:08:37.920056 26235 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:37.941277 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.943737 26240 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:37.943882 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.944434 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.945065 24595 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:37.979035 26243 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:37.979234 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:37.979795 26243 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:37.979904 26192 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:37.980762 26192 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.942519 26208 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:37.982951 26192 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:37.983175 26208 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:37.974237 26193 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:37.968256 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:37.987196 24593 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:37.979991 24524 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:37.995890 24599 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:38.003279 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:38.005355 26243 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.002226 26239 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:38.006058 26193 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.006494 26239 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:38.006688 26193 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.008675 26193 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:37.988075 26235 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.008750 26239 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.009881 26240 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:38.020081 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.156s	user 0.022s	sys 0.054s
I20260709 13:08:38.015116 26208 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.016427 26235 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.017500 26243 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.019449 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:38.021386 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.158s	user 0.023s	sys 0.054s
W20260709 13:08:38.026868 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90928.3us
I20260709 13:08:38.028251 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.028802 26208 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:38.035894 24454 debug-util.cc:398] Leaking SignalData structure 0x7b08003090a0 after lost signal to thread 24549
I20260709 13:08:38.035863 26242 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:38.036460 24524 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:38.036662 26242 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.026005 26243 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:38.040978 26243 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.041752 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.042322 24519 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:38.040977 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.044636 24523 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:38.044795 26248 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:08:38.045059 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800284f80 after lost signal to thread 24624
I20260709 13:08:38.047998 26236 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.048233 24519 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:38.049628 24523 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:38.045504 26248 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:38.031450 26240 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.053536 26242 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.037963 26239 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:38.057811 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.048645 26236 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:38.063406 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.066395 26217 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:38.066654 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800330dc0 after lost signal to thread 24698
I20260709 13:08:38.067096 26217 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:38.067888 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800363c80 after lost signal to thread 25243
W20260709 13:08:38.068238 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800370260 after lost signal to thread 25244
W20260709 13:08:38.068508 24454 debug-util.cc:398] Leaking SignalData structure 0x7b080035ac60 after lost signal to thread 26176
I20260709 13:08:38.066672 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.072865 26235 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:38.066442 26238 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:08:38.073549 26235 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.058120 26208 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.076370 26217 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:38.078907 24591 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:38.066406 26242 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:38.080099 26242 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.062074 26239 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.083860 26208 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.075060 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.087371 26236 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.094642 26235 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.099941 26239 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.100505 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.101423 24670 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:38.102370 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.105559 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.106407 24673 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:38.107589 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.108340 26245 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.108471 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.107635 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.109156 26245 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.110127 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.110368 26208 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.110790 26208 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:38.111203 26208 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.111848 26245 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.112479 26245 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.111900 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.125280 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.121460 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.119065 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.120107 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.119834 24522 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:38.121223 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 179529us
W20260709 13:08:38.161666 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49851.2us
I20260709 13:08:38.160564 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.162817 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:38.165627 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:38.119843 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.122397 26211 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.168066 26211 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:38.113579 26248 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.123018 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:38.119454 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.171013 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.170523 24667 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:38.172976 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.171643 24599 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:38.115584 26242 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.122195 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:38.120051 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.176152 26225 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.176216 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.122210 26216 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.176738 26225 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.176913 24671 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:08:38.177211 26225 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.113266 26240 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.177821 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.179176 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.176970 26216 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.122298 26195 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.122092 26200 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.160658 26238 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.108382 24665 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:38.121867 26204 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.169624 26192 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.113776 26247 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.197646 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.117031 26243 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:38.113056 26245 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.200215 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.181293 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.164402 26237 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:38.197824 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.122004 26231 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:08:38.185143 26238 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:38.200461 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.206810 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.181368 26240 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.186630 26205 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.186645 26192 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.214674 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.211069 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.201664 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.218557 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.219797 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.211056 26238 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.200047 26200 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.222100 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.221944 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.213006 26192 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.214071 26240 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.223279 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.205487 26204 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.225051 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.207713 26195 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:38.225244 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.226612 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.225821 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.229122 24668 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:38.234639 24594 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:38.235087 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.236264 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.228343 26237 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.240208 26237 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.240581 26237 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.243232 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.243847 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:38.246629 25210 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:38.247637 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.247969 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.248106 25219 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:38.248551 25216 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:08:38.242344 24667 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:38.217469 26205 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.254810 24669 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:38.260135 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.260756 26200 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.264178 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.264422 26243 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.233093 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.242025 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.231664 26231 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.271375 24525 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:38.230075 26234 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:08:38.278173 24674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:38.278980 26234 consensus_queue.cc:1243] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:38.279117 24674 raft_consensus.cc:606] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:38.280085 26245 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.272500 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.280797 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.209028 26247 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:38.281864 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.274405 26204 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.273917 24594 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:38.283439 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.284186 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.284837 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:38.297097 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.297787 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.298287 24671 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:08:38.295962 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:38.304430 24523 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:38.305450 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.306485 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.307006 24674 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:38.307224 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:38.307700 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.308212 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.308759 25213 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:38.270248 26211 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:38.314405 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.315615 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.316294 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.316644 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.317512 26216 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.326810 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.318454 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.319944 26195 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:38.319648 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.280623 26231 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.339437 26231 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.340477 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.325225 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.325623 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.344696 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.295001 26201 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:08:38.336980 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.351356 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.343827 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.332227 26207 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:38.351126 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.346118 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.344692 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.345302 26247 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.347323 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.408723 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.368213 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.349161 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.410646 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.412101 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:38.416677 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 207077us
I20260709 13:08:38.417935 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.352416 26207 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:38.428503 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.430697 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.354840 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.467563 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.431865 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:08:38.488185 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60170.4us
I20260709 13:08:38.489087 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:38.489957 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:38.490182 26195 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.490579 26195 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.490904 26195 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.497900 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.492130 26247 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.535337 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:38.431995 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.419638 26256 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:38.540292 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.541772 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:38.544070 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.539386 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.547297 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.558377 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.559139 26217 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.559631 26217 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.559988 26217 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.559984 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:38.562626 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.560890 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:38.551079 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.549306 26204 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:38.596359 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 121596us
I20260709 13:08:38.598568 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.603797 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.614952 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.538482 26240 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.616734 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.615110 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.598687 26216 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.600942 26204 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:38.601326 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.620098 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:38.614619 26200 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.624236 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.625707 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.628775 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.628775 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:38.630901 26255 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.619580 26216 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.622022 26204 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.624801 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:38.622352 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.598332 26207 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.639730 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.642115 26200 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.628774 26244 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:38.649425 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.649325 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.635576 25215 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:38.636126 26216 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.634487 26238 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.637315 26255 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:38.633471 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.653617 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.600472 26256 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.649534 26200 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.647558 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:38.651932 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 91109us
I20260709 13:08:38.662302 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.664179 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:38.653899 26244 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:38.667115 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.657066 26202 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.658039 26255 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.660497 26264 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.663408 26207 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.680223 26264 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.680697 26264 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.680552 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.686479 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.672484 26202 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.731340 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.681624 26192 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.739317 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.741907 24519 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:38.738770 26260 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
W20260709 13:08:38.753533 26263 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:38.754424 26244 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:38.752426 24423 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 3, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:38.835549 25217 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:38.781936 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 115627us
I20260709 13:08:38.842185 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.856720 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.897388 24599 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
W20260709 13:08:38.856289 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.793690 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.791292 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.725054 26258 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.765645 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.907775 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.900308 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.915345 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.820092 26240 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:38.861833 26208 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.000s
W20260709 13:08:38.766070 26259 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:08:38.899145 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.861392 26265 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:38.737540 26202 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.894279 26244 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.837205 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:38.836623 26256 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:38.852939 26192 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:38.912637 26225 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.001s
I20260709 13:08:38.930083 26208 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:38.937863 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 93115us
I20260709 13:08:38.939075 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.940008 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.943271 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.917591 26258 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:38.938936 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.966825 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.944083 26238 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:38.938014 26265 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:38.979647 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.958173 26258 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.983151 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:38.986862 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:38.988953 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 359242us
I20260709 13:08:38.994244 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:38.944352 26225 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:39.000770 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 286406us
I20260709 13:08:39.004739 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:38.983127 26265 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.012241 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:39.013430 26238 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.014005 26238 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:39.014482 26238 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.018460 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:39.020208 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.022054 26208 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.029738 25216 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:39.007733 26275 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:39.030599 26275 consensus_queue.cc:1243] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:39.031131 26247 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:39.031482 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.031567 26247 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:39.032763 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.032933 26247 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.033784 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.034384 26247 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:39.035709 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 75250.4us
I20260709 13:08:39.034801 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:39.009964 26237 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.769s	user 0.008s	sys 0.003s
I20260709 13:08:39.040072 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.040131 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.047164 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.008934 26256 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.051980 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.052841 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.052357 26256 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:39.057245 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 63068.7us
I20260709 13:08:39.059223 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:39.057991 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.063951 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.065814 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.054095 26256 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.057471 26211 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.047044 26237 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.074236 26280 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.075572 26225 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:39.078910 26217 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.000s
I20260709 13:08:39.079038 26200 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.079319 26217 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.080855 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:39.062664 26257 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.087761 25211 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.067639 26204 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.097877 24597 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:39.098803 26202 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.100720 26202 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.103598 26258 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.105425 25213 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.105333 26258 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.117517 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:39.117995 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:39.081581 26200 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:08:39.128338 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 92488.3us
I20260709 13:08:39.072997 26269 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:39.184584 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 67172.6us
W20260709 13:08:39.187318 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 217821us
I20260709 13:08:39.192180 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:39.115341 26255 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.215026 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.188387 26192 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:39.230782 26195 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.001s
I20260709 13:08:39.231232 26195 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:39.238654 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 170400us
I20260709 13:08:39.244371 24668 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:39.245442 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85816.2us
I20260709 13:08:39.185402 26238 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.234303 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.248661 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.222834 26247 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:39.250387 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:39.253247 26280 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:39.253531 26204 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:39.253618 26280 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:39.254108 26280 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:39.226727 26192 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:39.255836 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.260703 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.261220 25217 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:08:39.254738 26216 consensus_meta.cc:287] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
I20260709 13:08:39.247247 26231 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:39.265547 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 156481us
I20260709 13:08:39.259018 26192 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.268486 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.253666 26237 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.269665 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:39.269719 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.276779 24596 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:39.277240 26244 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:39.270203 26278 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.263285 26260 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:08:39.262189 26195 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:39.270530 26217 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:08:39.270705 26264 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.003s
I20260709 13:08:39.274339 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.276407 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:39.270848 26211 raft_consensus.cc:993] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:39.285128 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1129) took 1083 ms. Trace:
I20260709 13:08:39.287089 25219 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.263607 26247 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.305866 24600 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:39.291010 26290 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:39.291581 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:39.292462 24565 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de2b0253cbb445a4bb49f874e70ea972. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:39.292654 26270 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:39.280773 26200 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.270704 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:39.293730 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 798) took 1047 ms. Trace:
I20260709 13:08:39.266196 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.295760 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:39.306531 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 240782us
I20260709 13:08:39.266893 26216 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.271031 26231 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.316594 26204 raft_consensus.cc:1081] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:39.349363 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.333966 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.324761 26289 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:39.343408 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.315915 26284 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:08:39.339845 26270 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:39.332724 26200 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:39.373549 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 77901.5us
I20260709 13:08:39.350625 26238 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.344650 26205 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:39.366698 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.449692 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.391638 26255 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:39.298350 26278 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:39.385776 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.308125 26264 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:39.457234 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 113901us
I20260709 13:08:39.461627 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:39.460750 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 214693us
I20260709 13:08:39.337282 25211 rpcz_store.cc:276] 0709 13:08:38.246452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.249037 (+  2585us) service_pool.cc:224] Handling call
0709 13:08:38.253597 (+  4560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.088214 (+834617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.293523 (+205309us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54004fa454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:39.293677 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914427648}
I20260709 13:08:39.448755 26243 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:39.449512 26275 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:39.326195 24673 rpcz_store.cc:276] 0709 13:08:38.201857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.238250 (+ 36393us) service_pool.cc:224] Handling call
0709 13:08:39.115729 (+877479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.115937 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.118922 (+  2985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.185816 (+ 66894us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:39.187009 (+  1193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.189230 (+  2221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.284845 (+ 95615us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b540017eb50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:39.285002 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017265408}
W20260709 13:08:39.462559 26207 consensus_meta.cc:287] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.777s	user 0.002s	sys 0.010s
I20260709 13:08:39.474525 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:39.475754 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 102477us
I20260709 13:08:39.463038 26200 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.469549 26278 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.479800 25218 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:39.478049 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:39.487722 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.500137 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:39.501878 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.477541 26238 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.473667 26275 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:39.510666 24524 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:39.511102 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.471943 26193 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:39.519851 24523 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:39.481436 26287 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.516323 26265 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.496032 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.517264 26256 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.518610 26280 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.475652 26243 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.503979 26207 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.499927 26237 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:39.509069 26225 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.466436 26289 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:39.538615 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 69199.4us
I20260709 13:08:39.519681 26240 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.529258 26231 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.514765 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:39.542470 26225 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:39.543022 26225 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.506978 26277 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.529978 26275 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.544039 26275 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.530086 26216 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:39.516278 26273 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.540572 24491 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:39.547488 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.548751 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.552799 25212 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.554736 26273 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:39.555263 26273 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.558058 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.535954 26237 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:39.546141 26247 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.570298 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.547366 26284 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:39.545660 26248 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:39.572734 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 102128us
I20260709 13:08:39.545292 26201 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:39.562018 26287 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:39.588665 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:39.544687 26192 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.575212 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.590276 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.591257 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.575608 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.566951 26237 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:39.582916 26231 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:39.584522 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.586340 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.587078 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.591441 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:39.593763 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.596256 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.597846 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.571496 26284 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:39.605726 26292 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.606670 26292 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.608494 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.573333 26240 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:39.612336 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.629786 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:39.631341 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.527038 26270 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.633687 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.589462 26287 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:39.600049 26202 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:39.603539 25212 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.634245 26240 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.642894 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.611692 26238 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.576869 26248 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.632097 26264 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.663849 26289 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.644799 26287 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.638422 26273 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.642149 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.607985 26231 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.669574 26295 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.673707 26303 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.651077 26249 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.677639 26299 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:39.650418 26192 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.681191 26294 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.681278 26293 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.683596 26292 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.670190 26208 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:08:39.668576 26247 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.691924 26294 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.606595 26284 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.695295 26243 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.689522 26256 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:39.691116 26265 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:39.701519 26231 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.650997 26301 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.648797 26202 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.648746 26298 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.682597 26289 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.696020 26299 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.702942 26278 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.707983 26248 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.709666 26278 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:39.718212 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 122959us
I20260709 13:08:39.740849 26300 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.741539 26300 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:39.742008 26300 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.705786 26200 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.748698 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:39.749574 24522 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:39.718887 26284 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.755723 26225 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.747645 26202 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.746425 26297 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.751286 26289 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:39.803926 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 174218us
I20260709 13:08:39.790300 26273 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:39.805778 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.809723 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:39.811717 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 220495us
I20260709 13:08:39.812561 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:39.813575 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.814332 26297 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.814869 26297 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:39.815248 26293 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.815373 26297 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.815569 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.816363 26301 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.817447 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.819017 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.819761 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:39.820381 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.821192 25213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48918
I20260709 13:08:39.822003 25213 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:39.822438 25213 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.821187 25217 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:39.833314 26301 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.835117 26306 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.836787 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:39.778692 26289 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:39.834679 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.849064 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.851950 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:39.853281 26200 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:39.855485 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:39.856601 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 216068us
I20260709 13:08:39.858573 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:39.858615 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.839516 26298 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.860252 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 810) took 1446 ms. Trace:
I20260709 13:08:39.863814 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.857450 25213 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:39.862808 25219 rpcz_store.cc:276] 0709 13:08:38.408709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.409955 (+  1246us) service_pool.cc:224] Handling call
0709 13:08:39.039207 (+629252us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:39.286922 (+247715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.331876 (+ 44954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.854514 (+522638us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5400478950. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:39.854653 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576704512}
I20260709 13:08:39.876513 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.876806 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:39.877964 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.865283 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.884135 26309 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.884217 26307 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.885623 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.886034 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.887667 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.858028 26243 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.891893 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:39.889731 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:39.890563 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:39.894343 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.882715 26295 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.899029 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.902006 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.893390 24523 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:39.901036 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.907814 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.874887 26256 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.910804 24599 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:39.909515 25213 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.884923 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.880782 26202 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.875440 26225 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:39.880823 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:39.919567 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.922297 25219 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:39.919632 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.925315 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.925439 26266 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.926508 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.885635 26278 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:39.928891 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 286025us
I20260709 13:08:39.897964 26257 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.930121 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.932058 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.933323 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.917162 26273 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.937958 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.908445 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:39.940027 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.941716 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:39.942714 26225 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.942425 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:39.923915 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.945600 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.948019 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:39.948263 24668 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:39.952287 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.953897 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.932554 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:39.958958 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:39.946710 26245 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:08:39.909740 26302 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.936685 26249 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.954885 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:39.959620 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.956368 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:39.957870 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.936879 26289 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:39.967558 25219 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 3. Ops: []
I20260709 13:08:39.970028 25216 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:39.970990 25210 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:39.972209 24667 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:39.950459 26278 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.952523 26217 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:39.974438 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.946478 26312 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.975888 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:39.983608 24669 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:39.946408 26283 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.978901 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:39.983879 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:39.979243 25213 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.980273 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.958950 26243 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.955860 26303 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:08:39.988394 25219 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:39.989727 26310 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:39.990191 26310 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:39.990558 26310 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.992341 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:39.993178 25216 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:39.996122 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:39.996541 26256 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:39.999148 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:39.974051 26231 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:40.003894 24674 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:40.004145 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.005776 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:39.983322 26294 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.007364 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.007655 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.008409 24522 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.985798 26302 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.994199 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:40.004072 26303 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.019590 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:40.010854 26298 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.024991 26247 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.018507 26303 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:40.021895 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:40.022401 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.012306 26231 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.026949 26298 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:40.029862 26306 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:40.039356 26276 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.036473 26314 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:40.038472 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.042097 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.043502 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.044893 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.045903 26300 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.047024 26287 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.047549 24595 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.048012 24525 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.048622 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.049234 24595 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.050781 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.051908 24525 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:40.033497 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:40.055531 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.056013 24522 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:40.056332 26297 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.056932 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.058635 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.060468 24525 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:40.059778 26287 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:40.059566 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.061995 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.066295 24522 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:40.075757 24595 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:40.048004 26300 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:40.083190 26270 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.040562 26306 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:40.034930 26303 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.030791 26317 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.088822 26217 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:40.089535 26231 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:40.092298 26275 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.000s
I20260709 13:08:40.092875 24521 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 3. Ops: []
I20260709 13:08:40.072647 26237 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.095353 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:40.101507 26306 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.104166 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:40.104532 26306 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.105372 26265 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.105501 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.095511 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.038738 26298 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.106312 24524 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:40.108477 26204 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.097414 26240 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:40.099620 26280 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:40.066840 26310 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.100831 26217 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.114121 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:40.103696 24519 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.104225 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:40.107236 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:40.107852 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:40.096385 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:40.112797 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.114240 26217 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:40.097322 26297 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:40.120564 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.120982 25219 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:40.109133 26208 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.123576 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:40.118621 26204 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.109010 24594 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:40.125563 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:40.120018 26280 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.127388 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:40.127919 26231 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.158939 24598 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:40.135460 26310 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:40.136168 26258 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.161592 26258 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:40.162788 24517 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.162513 26258 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.163650 26258 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.137387 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:40.165235 25218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 457) took 1321 ms (client timeout 1668 ms). Trace:
W20260709 13:08:40.165639 25218 rpcz_store.cc:269] 0709 13:08:38.836305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.918448 (+ 82143us) service_pool.cc:224] Handling call
0709 13:08:40.157231 (+1238783us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540009e7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:40.157339 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1222515328}
I20260709 13:08:40.138711 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.139923 26299 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:40.142529 26317 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:40.142678 26237 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:40.125017 26275 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:08:40.178464 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:40.143628 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.178928 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.144510 24519 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:08:40.126307 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.146509 26244 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.148470 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:40.150974 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.154057 26217 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.190325 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:40.157814 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:40.115428 26300 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:08:40.117430 26269 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.159198 26231 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:40.161042 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:40.164841 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.129554 26284 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.168641 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:40.144855 26309 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:40.159140 26305 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.180631 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.192665 26275 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.038457 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:40.191617 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:40.180213 26317 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.159577 25214 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:40.196854 24667 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:40.199132 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:40.199512 24599 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:40.193914 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 67713us
I20260709 13:08:40.188251 26266 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.189000 26244 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:40.206524 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.208889 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.195372 26257 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.175362 26211 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:40.198302 26231 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.209715 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:40.216068 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47479.3us
I20260709 13:08:40.197789 26306 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.203796 24673 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.217916 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.218478 26240 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.219002 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:40.219516 26208 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:40.200403 26284 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:40.221060 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:40.241349 26284 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.242353 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:40.224202 24600 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:40.225256 24671 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.201958 26305 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:40.231415 26202 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.231844 26201 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:40.252534 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 54403.4us
I20260709 13:08:40.215915 26307 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.226485 26248 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:40.226400 26240 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:40.202442 26275 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:40.214883 26217 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.252036 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.249346 26305 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.274317 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.215987 26256 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.259907 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.231846 26314 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:08:40.263863 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.249372 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:40.226688 26277 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.269631 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.222880 26309 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:40.249920 24666 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.277474 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.282292 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.273800 26240 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:40.287529 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 96599.7us
W20260709 13:08:40.268497 26318 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:40.266561 24674 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.275672 26201 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:40.293710 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60839us
I20260709 13:08:40.294292 26271 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.300808 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 816) took 1289 ms. Trace:
I20260709 13:08:40.300968 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:08:40.350811 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 49942.1us
I20260709 13:08:40.291092 26301 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.303776 24597 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:40.304275 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.306753 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.243597 26299 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:40.228571 26311 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:08:40.352838 26299 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.353909 24423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 340) took 2043 ms. Trace:
I20260709 13:08:40.354231 24597 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:40.355136 26299 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:40.259876 26208 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.354357 24423 rpcz_store.cc:276] 0709 13:08:38.310008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.310164 (+   156us) service_pool.cc:224] Handling call
0709 13:08:40.353849 (+2043685us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:38.973839 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:38.974807 (+   968us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:38.974880 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:08:38.974927 (+    47us) tablet.cc:662] Decoding operations
0709 13:08:38.975493 (+   566us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:38.975621 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:38.975668 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:38.976043 (+   375us) tablet.cc:701] Row locks acquired
0709 13:08:38.976103 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:08:38.976304 (+   201us) write_op.cc:270] Start()
0709 13:08:38.976490 (+   186us) write_op.cc:276] Timestamp: P: 1783602518976229 usec, L: 0
0709 13:08:38.976538 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:08:38.978078 (+  1540us) log.cc:844] Serialized 539 byte log entry
0709 13:08:39.044725 (+ 66647us) op_driver.cc:464] REPLICATION: finished
0709 13:08:40.041361 (+996636us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b5400226428. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c23029e1 00007f17c230164c 00007f17bf97d845 00007f17bf981d61 00007f17bf981d19 00007f17bf981ca9 00007f17bf981c71 00007f17bf980e9d 000000000038f354 000000000038f199 00007f17b8e59475
0709 13:08:40.041452 (+    91us) write_op.cc:301] APPLY: starting
0709 13:08:40.041544 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:40.041651 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:40.041682 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:40.041949 (+   267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:40.042235 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:40.042292 (+    57us) write_op.cc:312] APPLY: finished
0709 13:08:40.042552 (+   260us) log.cc:844] Serialized 23 byte log entry
0709 13:08:40.042739 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:40.042816 (+    77us) write_op.cc:454] Released schema lock
0709 13:08:40.042866 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:40.043233 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:40.043261 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144347,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":466390,"apply.run_cpu_time_us":5862,"apply.run_wall_time_us":525950,"num_ops":1,"prepare.queue_time_us":67121,"prepare.run_cpu_time_us":17277,"prepare.run_wall_time_us":40542,"raft.queue_time_us":31089,"raft.run_cpu_time_us":127797,"raft.run_wall_time_us":410057,"replication_time_us":68033,"spinlock_wait_cycles":7444864,"thread_start_us":534766,"threads_started":4,"wal-append.queue_time_us":32736}]]}
I20260709 13:08:40.361311 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:40.360715 24421 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:40.362064 24667 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:40.362651 26310 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.363637 26310 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:40.308801 26323 ts_tablet_manager.cc:933] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:40.259466 26202 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:40.347213 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.350263 25214 rpcz_store.cc:276] 0709 13:08:39.011558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.075693 (+ 64135us) service_pool.cc:224] Handling call
0709 13:08:40.157340 (+1081647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.203358 (+ 46018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.300592 (+ 97234us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540009e7d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:40.300748 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486896000}
I20260709 13:08:40.365664 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.349694 24674 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:08:40.366343 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62152.6us
I20260709 13:08:40.351658 26322 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.367208 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.263350 26243 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:40.371276 26283 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.371448 24670 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.372534 26202 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.377542 24674 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.378731 24674 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.364785 26310 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.382526 26310 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.309247 26286 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.345532 24673 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:40.385588 26202 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.386322 24599 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
W20260709 13:08:40.404331 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 57252.8us
I20260709 13:08:40.404419 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.405254 24597 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.405256 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:40.407334 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 100685us
I20260709 13:08:40.407894 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.408757 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.409896 24639 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.394809 24674 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:40.294186 26296 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:08:40.304309 26245 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:08:40.395573 24420 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 340) took 2096 ms. Trace:
I20260709 13:08:40.412774 24420 rpcz_store.cc:276] 0709 13:08:38.216679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.219449 (+  2770us) service_pool.cc:224] Handling call
0709 13:08:38.689229 (+469780us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:08:40.312549 (+1623320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5489,"reported_tablets":4,"spinlock_wait_cycles":16275200}
I20260709 13:08:40.265308 26244 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.414445 26244 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.431061 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.432258 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.432885 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:40.369529 26289 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.406793 26275 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.439504 26275 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.387310 26312 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.451009 26269 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.448640 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.455708 24594 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:40.411115 26301 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:08:40.463877 26248 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:40.407173 26216 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.406395 26201 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.433760 26211 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.476202 26231 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.478839 26276 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.479100 26231 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:40.479171 26276 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:40.471784 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.452435 26298 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.467417 26278 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:08:40.507279 26231 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.531363 24595 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.510596 26289 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:08:40.534633 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62893.8us
W20260709 13:08:40.541525 26319 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:08:40.515024 26314 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:40.539022 26322 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.536994 26289 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:08:40.562901 26321 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
W20260709 13:08:40.572288 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.475157 26309 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:40.417135 26306 consensus_queue.cc:1175] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "983693721af6486c97ece1410a90cf30" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:40.586681 26289 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.588128 26289 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.567507 26324 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.565794 26276 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:40.610394 26276 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.654682 26247 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.655184 26247 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:08:40.727998 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.795390 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:40.652135 26240 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.818584 26325 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:40.819429 26325 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.682308 26298 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:40.824757 26217 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:08:40.825487 26306 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:40.838174 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.681229 26247 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.838243 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.869439 24517 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: [1.2-1.2]
W20260709 13:08:40.871968 26270 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.774s	user 0.005s	sys 0.006s
I20260709 13:08:40.887538 24665 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:40.851325 24521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.018s	sys 0.026s
W20260709 13:08:40.833263 26273 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:08:40.881057 24599 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
W20260709 13:08:40.891680 24521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.018s	sys 0.027s
I20260709 13:08:40.905498 24674 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.847770 26302 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:08:40.902245 26240 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:40.915196 26324 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:40.916512 26284 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.001s
I20260709 13:08:40.917030 26284 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:40.895901 26303 consensus_meta.cc:287] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.799s	user 0.012s	sys 0.000s
I20260709 13:08:40.905541 26231 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:40.907516 26305 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 13:08:40.922418 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:40.846035 26306 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:40.949705 26284 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:40.943460 26303 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.948047 26305 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.894394 26325 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:40.927135 26317 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.716s	user 0.004s	sys 0.006s
W20260709 13:08:40.929322 26310 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.004s
W20260709 13:08:40.951037 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.071s
W20260709 13:08:40.955897 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.004s	sys 0.071s
W20260709 13:08:40.956379 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 510498us
I20260709 13:08:40.958835 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:40.964884 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.961858 24591 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.972500 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.972779 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:40.968655 26240 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:40.973507 24516 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:40.974758 26306 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:40.975286 26306 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:40.954267 26317 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:40.977525 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:40.976208 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:40.969247 26225 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:40.979702 26323 tablet_copy_client.cc:323] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:08:40.980355 26283 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.990828 26283 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:08:40.991632 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.984295 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:40.988417 26256 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.988605 26295 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.988968 26314 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.989470 26298 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:40.988428 26308 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.996827 24667 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.998008 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:40.999213 26295 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:40.986748 26305 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:41.001677 26333 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.001991 26317 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.002218 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.002528 26225 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:41.019405 26225 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.003254 26298 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:41.005126 26308 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:41.006009 24666 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.011294 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.007023 26295 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.031787 26295 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.031857 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:41.015071 26247 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.016527 24674 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:41.017562 24669 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:41.002688 26314 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.021436 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:41.033680 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:41.034324 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:40.992892 26306 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:41.026782 26298 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.991775 26283 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.051146 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:41.053665 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:41.048553 24518 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.016s	sys 0.048s
W20260709 13:08:41.045456 26245 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.008s	sys 0.028s
I20260709 13:08:41.043823 26284 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:41.059556 25184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.008s	sys 0.032s
W20260709 13:08:41.067123 25184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.009s	sys 0.032s
W20260709 13:08:41.067508 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 824079us
W20260709 13:08:41.065282 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.006s	sys 0.013s
I20260709 13:08:41.065845 24671 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:41.068236 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.006s	sys 0.013s
W20260709 13:08:41.069773 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.026s	sys 0.039s
W20260709 13:08:41.070191 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.026s	sys 0.039s
W20260709 13:08:41.071732 26245 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.008s	sys 0.029s
I20260709 13:08:41.054862 26302 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:41.063218 24518 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.016s	sys 0.049s
I20260709 13:08:41.026965 26271 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:08:41.099843 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:41.110313 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:41.112397 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:41.107892 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:41.126657 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:41.108145 26258 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:41.100737 26310 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:08:41.132656 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.014s	sys 0.023s
W20260709 13:08:41.140399 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.014s	sys 0.023s
I20260709 13:08:41.142819 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:41.144337 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:41.132777 26271 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:41.148729 26310 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:08:41.156397 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:41.157122 24592 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.152509 24599 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:41.132551 26342 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:41.133378 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:41.153949 24598 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.154412 25218 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:41.132642 26300 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.135985 26305 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.195529 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:41.150720 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:41.179962 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.178160 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2258) took 1151 ms. Trace:
I20260709 13:08:41.180981 25212 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.181635 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:41.183195 26345 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.184613 26283 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.186998 25219 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:41.148707 26265 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:41.145401 26237 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.146131 26314 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.158533 26242 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:41.161999 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet de2b0253cbb445a4bb49f874e70ea972 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:08:41.148911 26287 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:41.193413 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:41.194315 24524 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.222414 24593 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:41.188089 26293 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 13:08:41.242738 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 92913.7us
I20260709 13:08:41.190410 26313 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:08:41.236532 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet de2b0253cbb445a4bb49f874e70ea972 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-de2b0253cbb445a4bb49f874e70ea972
I20260709 13:08:41.223685 26269 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:41.234807 26287 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.234486 26305 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:41.265025 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 69049.4us
I20260709 13:08:41.235723 26265 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:41.256389 26242 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.263723 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 251) took 1148 ms. Trace:
I20260709 13:08:41.284092 24518 rpcz_store.cc:276] 0709 13:08:40.109571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.179766 (+ 70195us) service_pool.cc:224] Handling call
0709 13:08:40.192289 (+ 12523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.192478 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:41.098673 (+906195us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.193798 (+ 95125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.228449 (+ 34651us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:41.229758 (+  1309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.232140 (+  2382us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.257854 (+ 25714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4158,"prepare.queue_time_us":911928,"raft.queue_time_us":1587,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":1937,"spinlock_wait_cycles":6356224,"thread_start_us":962613,"threads_started":2,"wal-append.queue_time_us":135720}
I20260709 13:08:41.287160 26265 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.233373 26237 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.291734 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:41.294679 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:41.292994 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:41.297020 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:41.298413 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:41.301401 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:41.308238 26270 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:41.299775 26346 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.308365 26216 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:41.312580 26315 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.313704 26332 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.310115 26309 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:41.318841 26324 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.326478 24593 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:41.223409 24521 rpcz_store.cc:276] 0709 13:08:40.026840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.166115 (+139275us) service_pool.cc:224] Handling call
0709 13:08:40.166462 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.166858 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.166889 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.167340 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.902867 (+735527us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:40.902912 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.902996 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.177899 (+274903us) raft_consensus.cc:1685] finished
0709 13:08:41.177932 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.178098 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3193,"raft.queue_time_us":7179,"raft.run_cpu_time_us":2380,"raft.run_wall_time_us":12591,"thread_start_us":735124,"threads_started":1,"wal-append.queue_time_us":883537}
W20260709 13:08:41.329553 26349 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:41.329761 26305 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.330382 26237 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:41.332031 26298 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.326579 26270 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:41.336026 24592 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:41.313537 25211 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:41.308074 26242 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.321113 26216 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:41.345706 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47206.5us
I20260709 13:08:41.322880 26346 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:41.327553 24516 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:41.320235 26287 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.356267 24595 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:41.353406 26315 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.354903 26353 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.358150 26216 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.361459 26315 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:41.369498 26287 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:41.370954 26308 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.363116 26353 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.377444 26270 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.378428 24421 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 344) took 1437 ms. Trace:
I20260709 13:08:41.379959 26311 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:41.380354 26311 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:08:41.393299 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.393626 24592 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:41.396721 26298 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:41.387514 24610 tablet_copy_source_session.cc:215] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:41.397257 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:41.398494 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:41.405356 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.405915 24669 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:41.387403 26237 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:41.378790 24421 rpcz_store.cc:276] 0709 13:08:39.940918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.941070 (+   152us) service_pool.cc:224] Handling call
0709 13:08:41.378372 (+1437302us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:40.581408 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:40.595920 (+ 14512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:40.595961 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:08:40.595980 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:40.596364 (+   384us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:40.596431 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:40.597071 (+   640us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:40.614868 (+ 17797us) tablet.cc:701] Row locks acquired
0709 13:08:40.620086 (+  5218us) write_op.cc:260] PREPARE: finished
0709 13:08:40.661410 (+ 41324us) write_op.cc:270] Start()
0709 13:08:40.672573 (+ 11163us) write_op.cc:276] Timestamp: P: 1783602520656062 usec, L: 0
0709 13:08:40.674447 (+  1874us) op_driver.cc:348] REPLICATION: starting
0709 13:08:40.690515 (+ 16068us) log.cc:844] Serialized 539 byte log entry
0709 13:08:41.234724 (+544209us) op_driver.cc:464] REPLICATION: finished
0709 13:08:41.360298 (+125574us) write_op.cc:301] APPLY: starting
0709 13:08:41.362591 (+  2293us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:41.364713 (+  2122us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:41.364842 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:41.365061 (+   219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:41.365283 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:41.365331 (+    48us) write_op.cc:312] APPLY: finished
0709 13:08:41.368341 (+  3010us) log.cc:844] Serialized 23 byte log entry
0709 13:08:41.368511 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.368592 (+    81us) write_op.cc:454] Released schema lock
0709 13:08:41.368632 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:41.369030 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.369064 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":353423,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":100356,"apply.run_cpu_time_us":2082,"apply.run_wall_time_us":10423,"num_ops":1,"prepare.queue_time_us":192377,"prepare.run_cpu_time_us":4131,"prepare.run_wall_time_us":128536,"replication_time_us":547320,"thread_start_us":159407,"threads_started":2}]]}
I20260709 13:08:41.368712 26315 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.413870 26315 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.419701 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 287) took 1211 ms. Trace:
I20260709 13:08:41.420147 24591 rpcz_store.cc:276] 0709 13:08:40.208278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.209550 (+  1272us) service_pool.cc:224] Handling call
0709 13:08:40.270546 (+ 60996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.969659 (+699113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.419440 (+449781us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540033e354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:41.419623 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588301056}
I20260709 13:08:41.432153 26303 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.417763 26237 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.435986 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:41.392968 26346 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.436982 26293 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:41.437032 26283 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:41.438030 26293 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:41.438241 26283 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:41.436439 26242 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:41.439240 26283 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:41.439602 26283 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.421485 26311 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.440335 26283 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.441926 24524 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:41.451026 26237 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:41.457952 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.459218 26271 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:41.459632 26271 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.460076 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:41.460805 26237 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:41.461884 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:41.462081 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:41.461889 26237 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.462603 26237 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:41.463495 26237 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:41.464080 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.464802 26237 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.467674 26311 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.469283 26231 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:41.469834 26231 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:41.470731 26231 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.470853 26216 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.474157 26310 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.474538 26310 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.475425 26310 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.476353 26297 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:41.477411 26352 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:41.477736 26352 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.478408 24674 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.478543 26352 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.479804 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:41.480005 26352 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.476639 26310 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.438491 26293 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.442730 26323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2b0253cbb445a4bb49f874e70ea972. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:41.483772 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.484534 26240 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:41.488345 26283 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.490590 24669 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:41.498781 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:41.533838 24672 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:41.535806 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 237459us
I20260709 13:08:41.536303 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:41.548600 25214 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:41.460457 26271 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.499662 26303 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.565424 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:41.497681 26208 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:41.568122 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.564788 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:41.572361 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:41.557330 26270 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:41.569111 26208 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:41.581739 26240 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:41.582103 24595 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.582355 26208 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.574045 26265 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:08:41.565407 26216 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.570029 26303 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.583784 26216 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.584152 26216 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:41.584995 26303 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.584959 26216 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.586434 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:08:41.587270 26359 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:08:41.588760 25217 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:41.585574 26271 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.571542 26231 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:41.566823 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.574371 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.577709 26217 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.577791 26317 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:41.586485 26216 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.596716 26324 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:08:41.608268 26317 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:41.608683 26360 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:41.597668 26270 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.574525 26307 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:08:41.599478 26256 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:41.624001 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59289.2us
I20260709 13:08:41.617192 26334 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.629510 26303 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:41.630457 26256 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.631273 26303 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.633352 26303 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.623214 26247 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:41.635572 26247 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.637578 26247 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.639447 26317 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.642207 24593 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:41.644479 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:41.645601 26346 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:41.628468 26334 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.646195 26346 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:41.603291 26293 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.647197 26346 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.649398 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:41.650035 24593 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:41.651381 26311 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:41.673840 25219 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:41.651860 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:41.653604 25212 raft_consensus.cc:2410] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:08:41.655721 26363 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 13:08:41.632838 26256 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.646827 26334 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.661486 26308 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.599910 26231 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.672202 26217 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.680642 24673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:41.683246 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:41.678315 26356 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:41.686870 26231 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.687667 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:41.645769 26270 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.688517 26334 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.673206 26287 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:41.692935 24673 raft_consensus.cc:606] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:08:41.694765 24524 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:41.694586 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:41.692407 26356 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:41.698872 26369 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.702888 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:41.677903 26311 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.695252 26317 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:41.697414 26287 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.705339 24593 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.706949 26355 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:41.707911 24665 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.708324 24673 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:41.708894 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.709550 25216 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:41.709793 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.710857 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.709633 24671 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:41.710978 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.716602 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:41.730268 25217 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:41.703698 26356 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.776996 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.778344 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.779111 25214 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:41.711014 24673 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:41.768916 25211 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:41.774362 26374 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:08:41.773512 26368 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:08:41.713581 26317 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.786942 26270 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.777652 24667 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:41.774941 26287 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:41.728120 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.798509 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:41.782784 26355 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:08:41.773613 26323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48926 (request call id 826) took 1558 ms. Trace:
I20260709 13:08:41.794544 24592 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:41.817560 26237 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.818132 26237 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.818565 24591 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:41.805416 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.812799 26332 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.813993 26311 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:41.815258 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.815840 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:41.815972 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.816601 26323 rpcz_store.cc:276] 0709 13:08:40.214801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.220945 (+  6144us) service_pool.cc:224] Handling call
0709 13:08:40.364869 (+143924us) ts_tablet_manager.cc:934] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
0709 13:08:41.428602 (+1063733us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:41.639302 (+210700us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:41.639420 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:41.696179 (+ 56759us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:41.742248 (+ 46069us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:41.773479 (+ 31231us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:41.773534 (+    55us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":14891,"tablet-copy.queue_time_us":76181,"thread_start_us":493819,"threads_started":2}
I20260709 13:08:41.742035 26352 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:08:41.822423 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.820137 26237 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:41.830543 26256 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.839834 26332 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.841252 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:41.832252 25215 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:41.846180 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:41.851688 24516 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:41.852066 26258 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:41.852713 26204 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:41.840737 26355 consensus_queue.cc:1243] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:41.854068 24525 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:41.854415 24525 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:41.847385 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:41.848639 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.849023 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:41.831252 26315 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.856082 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:41.829861 26371 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:41.830184 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:41.865830 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:41.868937 24595 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:41.856683 24524 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
W20260709 13:08:41.868026 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.858140 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:41.801586 26270 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.832099 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:41.866130 25211 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:41.855201 24525 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.874840 24525 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.861502 26307 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:41.875180 26248 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.875383 26307 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.875699 26248 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.879184 24421 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:41.847782 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.885445 24423 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 3, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.891199 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:41.829542 26346 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:08:41.930287 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:41.932643 25216 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:41.866703 26311 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:41.862143 26355 raft_consensus.cc:2764] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:41.857542 26323 tablet_copy_client.cc:806] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
W20260709 13:08:41.947252 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 56160.1us
I20260709 13:08:41.867240 26317 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:41.945708 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:41.923363 26364 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.870406 26352 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:41.871912 26204 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:42.004182 26204 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:41.968465 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:42.005053 24517 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.005463 26247 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.005951 26247 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.007987 26247 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:41.983891 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.877509 26269 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:08:42.009372 26323 tablet_copy_client.cc:670] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:42.010182 26352 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:42.011659 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:41.955634 26345 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.012980 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.013676 24667 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:41.948865 26273 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.014398 26273 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:41.877470 26287 consensus_queue.cc:1175] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96002c98f2d142e4b67dc5105a06079c" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:41.869408 26315 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.016353 24524 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:42.016712 26273 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:42.017351 24525 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:42.017654 26315 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:41.867815 26371 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:41.971953 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:41.848935 26256 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:41.943686 26343 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:41.941916 26216 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:08:42.001564 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:41.855456 26332 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:41.969350 26311 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:42.019193 25217 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:41.994865 26298 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:42.022413 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:42.022190 26300 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:08:41.995720 26202 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:42.045238 26202 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.045662 26202 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.002262 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:08:42.049659 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47472.2us
I20260709 13:08:42.051808 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:42.052533 24599 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 2: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:42.052467 26381 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.053911 24592 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:42.055068 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:42.055719 24595 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.056994 24598 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:42.058094 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:42.058763 24600 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.059623 26248 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.060753 26258 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:42.061187 26258 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:42.061563 26258 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:42.062629 26307 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:42.022712 26371 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.065218 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.071643 26256 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.072636 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.073311 24593 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:42.073320 24668 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:42.074615 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:42.075464 26256 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:42.075853 26256 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.076071 26270 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:42.076190 26256 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.011417 26352 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.024508 26343 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.079649 26343 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.084342 24668 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:42.005097 26204 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:41.975392 26364 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:42.039515 26308 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:42.039381 26311 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.087682 24597 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:42.034826 26309 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:42.036459 26305 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:08:42.090670 26381 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.088550 26309 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.090756 26364 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.091424 26309 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.040643 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.093369 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:42.094026 24518 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:42.043211 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.044049 26237 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:42.084262 26356 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.080482 26298 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.042083 24667 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:42.091336 26381 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.093140 26305 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:42.090703 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:42.095764 26371 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:42.035830 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 177750us
I20260709 13:08:42.114359 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:42.118680 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:42.119825 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:42.119993 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:42.117705 24672 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:42.096807 26380 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.101809 26332 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.128206 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:42.136401 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:42.116607 26364 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.142557 24524 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:42.145614 24667 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:42.125442 26240 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.110774 26314 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:08:42.125382 26306 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:42.125794 26325 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.126662 26247 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.158897 26371 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.159412 24673 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.146587 24516 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:42.126073 26248 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:08:42.125918 26315 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:08:42.147949 26303 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.155021 26240 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.156322 26306 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.156128 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:42.141535 26332 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.160341 26325 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.166185 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:42.139132 26380 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.179520 26323 tablet_copy_client.cc:538] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:42.210106 26231 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:42.210917 26395 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.181175 26353 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.213202 26353 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:42.216187 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 96246.9us
I20260709 13:08:42.217620 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:42.184365 26306 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.220664 26332 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.211517 26395 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.205521 26325 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.181044 26216 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.219183 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:42.179667 26240 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.228477 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:42.229067 26314 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.205756 26247 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:42.230921 24596 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.230295 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:42.235009 26356 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:42.235993 26395 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:42.236521 26395 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.237177 26382 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.144s	user 0.004s	sys 0.000s
I20260709 13:08:42.237824 24593 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:08:42.253710 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.224189 26303 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.263502 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:42.212638 26390 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:42.267917 24673 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:42.262342 26202 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.265601 26231 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.266232 26271 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.267416 26389 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.269282 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.274185 26369 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.274708 24597 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:42.271121 26231 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:42.269189 26298 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.236974 26395 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.275157 26217 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.231052 26216 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.279486 26305 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.276607 26314 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.276893 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:42.279233 26315 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.263398 26247 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.284657 26231 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.297310 26305 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.274677 26369 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.424288 26380 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:42.295079 26217 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.465816 26247 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.467576 26216 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:42.268210 26390 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:42.469113 25212 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:08:42.470609 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.274356 26389 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.427416 26202 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.426301 26305 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.483150 26306 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.477079 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:42.439182 26315 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.494298 26315 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.498162 26390 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:42.458949 26381 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:42.498282 26258 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.500263 26369 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.491245 26247 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.507503 26389 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:42.543532 26271 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:42.543908 26247 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.544134 26271 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.555112 26396 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.555730 26271 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:42.556299 26217 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:42.555750 26396 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.423357 26314 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:42.508468 26256 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.562094 26396 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.563570 26314 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:42.563696 26394 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:08:42.563496 24591 raft_consensus.cc:2368] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:42.557374 24592 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:42.558427 26357 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:42.587110 26309 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.587718 26258 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:42.585866 26247 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:42.589247 26357 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.651593 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:42.601790 26303 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.601161 26395 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:42.639776 26314 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.657995 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:42.669687 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.670425 24667 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:42.671604 26303 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.672163 26303 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.674412 26303 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.681785 26300 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:42.685850 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:42.686471 24523 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:42.689224 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:42.689968 24523 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:42.690256 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:42.692868 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.694169 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.695065 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.696992 24668 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.654488 26256 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.715433 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:42.716468 24595 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 2: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:42.722371 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:42.726516 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.730129 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:42.667557 26314 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.730783 24595 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.733599 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:42.707926 26306 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.737602 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:42.738235 25218 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:42.710850 26303 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.739567 24595 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:42.740935 24595 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:42.742326 24595 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:42.744064 26352 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.744544 26352 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:42.745221 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.712738 26309 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:42.744889 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:42.770887 24667 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.771885 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:42.746151 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.773262 24671 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.771963 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:42.729604 26273 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:42.731364 26271 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.774744 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:42.739126 26364 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260709 13:08:42.779242 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:42.780395 25219 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:42.780836 24671 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.772830 25212 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:42.737816 26258 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.746588 26332 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.779203 26238 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.777635 26273 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:42.744834 26216 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:08:42.789911 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.779835 26306 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.798419 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:42.802822 24672 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.783430 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:42.795506 26240 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.004s
I20260709 13:08:42.779630 26303 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.795068 26332 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.823025 24670 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.798556 26238 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.824623 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:42.837930 24600 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:42.817966 26240 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.825821 26231 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.805413 26306 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.798477 26258 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:42.832211 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 136845us
W20260709 13:08:42.834739 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 86665.9us
I20260709 13:08:42.798878 26402 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:42.782651 26271 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:42.852238 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:42.837150 24671 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:42.838088 24667 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:42.850438 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:42.840839 24599 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.816924 26256 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.843654 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:42.846017 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:42.859146 24523 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.859382 24525 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:42.839226 26238 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:42.836766 26343 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.001s
I20260709 13:08:42.851527 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:42.831142 26317 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:42.841756 26353 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.004s
W20260709 13:08:42.861112 26311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.030s	sys 0.018s
W20260709 13:08:42.847009 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 68733.8us
W20260709 13:08:42.883672 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.855414 26273 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:42.851249 26306 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:42.871081 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74359.2us
I20260709 13:08:42.836397 26332 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.858538 26385 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:42.902340 24523 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:42.860814 26256 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:42.880610 26325 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 13:08:43.085317 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:43.012002 24520 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:42.860843 26400 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:42.885401 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.098562 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.098889 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.099402 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.100521 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.100905 24599 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:43.107422 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:43.107684 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:42.904876 26323 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:08:42.903904 26308 raft_consensus.cc:993] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:42.902782 24521 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:42.902685 26353 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:42.924352 26279 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:42.938482 26258 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:42.903402 26399 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:43.087517 26352 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:43.109483 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.919865 26231 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:42.881191 26311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.031s	sys 0.018s
I20260709 13:08:42.879827 26408 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.320s
I20260709 13:08:42.876452 24673 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:42.926445 26225 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:42.912559 26247 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.179409 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:43.292762 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.180224 24667 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:42.984091 26397 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:43.182480 24669 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:08:43.295420 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:43.296811 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:43.297906 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.050621 26381 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:42.919031 26240 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.110970 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:43.299273 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 188402us
I20260709 13:08:43.299455 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.297755 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:43.300349 24669 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:43.300163 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:43.181844 24519 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:43.087517 26385 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.301968 26385 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.301637 26381 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.304001 26381 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.186672 24672 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:42.919610 26271 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:43.194792 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.880129 26343 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.111515 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:42.922119 26303 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.178364 26309 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.859902 26402 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.299050 26247 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.319023 24594 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:43.108599 26256 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.320436 26248 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:43.321110 26248 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.322429 26343 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.291033 26258 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.323501 26258 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.111662 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:43.325443 24666 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.112263 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.286511 24423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 342) took 1510 ms. Trace:
W20260709 13:08:43.200860 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85357.7us
I20260709 13:08:43.279299 26412 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.201610 26407 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:08:43.281999 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2284) took 1170 ms. Trace:
I20260709 13:08:43.194268 26391 raft_consensus.cc:1081] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:08:43.190834 26353 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.243499 26417 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:43.178071 26325 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.277791 26352 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:43.187318 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.397549 26414 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.226547 26311 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.283341 26208 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.260337 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1284) took 1125 ms. Trace:
W20260709 13:08:43.289623 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 182268us
I20260709 13:08:43.426036 26402 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.461182 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.462098 24522 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:43.228482 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:43.463634 24673 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:08:43.259749 26238 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.294361 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.308774 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:43.307020 26397 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.331830 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:08:43.466321 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 134584us
W20260709 13:08:43.333003 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.336839 24668 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:43.416524 24524 rpcz_store.cc:276] 0709 13:08:42.111430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.111608 (+   178us) service_pool.cc:224] Handling call
0709 13:08:43.281791 (+1170183us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b54003ae8d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:43.281908 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11560192}
I20260709 13:08:43.291384 26225 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:43.426467 24490 leader_election.cc:400] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:43.400556 24423 rpcz_store.cc:276] 0709 13:08:41.775699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.783237 (+  7538us) service_pool.cc:224] Handling call
0709 13:08:43.286431 (+1503194us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.085544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.087630 (+  2086us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.087663 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:08:42.087681 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:42.088003 (+   322us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.088057 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.088083 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:42.088257 (+   174us) tablet.cc:701] Row locks acquired
0709 13:08:42.088269 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:08:42.088393 (+   124us) write_op.cc:270] Start()
0709 13:08:42.088491 (+    98us) write_op.cc:276] Timestamp: P: 1783602522088353 usec, L: 0
0709 13:08:42.088511 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.159992 (+ 71481us) log.cc:844] Serialized 544 byte log entry
0709 13:08:42.581588 (+421596us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.714251 (+132663us) write_op.cc:301] APPLY: starting
0709 13:08:42.728642 (+ 14391us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.737974 (+  9332us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.777758 (+ 39784us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:42.798071 (+ 20313us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:42.815844 (+ 17773us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:42.834484 (+ 18640us) write_op.cc:312] APPLY: finished
0709 13:08:42.850462 (+ 15978us) log.cc:844] Serialized 23 byte log entry
0709 13:08:42.860513 (+ 10051us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.865030 (+  4517us) write_op.cc:454] Released schema lock
0709 13:08:42.875897 (+ 10867us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:42.924618 (+ 48721us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.924662 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":125825,"apply.run_cpu_time_us":2481,"apply.run_wall_time_us":214877,"num_ops":1,"prepare.queue_time_us":143363,"prepare.run_cpu_time_us":3148,"prepare.run_wall_time_us":83082,"replication_time_us":492876,"thread_start_us":153389,"threads_started":2}]]}
I20260709 13:08:43.472759 24490 leader_election.cc:403] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.306833 26231 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:42.882846 26317 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.399753 26381 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.397796 26305 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:43.320317 26247 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.330117 26309 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.399976 26298 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:43.326454 26258 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:43.330313 26315 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.328464 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:43.329689 26240 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:43.456529 25217 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:43.180835 26400 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.480094 26381 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.455669 26311 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:43.473323 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56338.1us
I20260709 13:08:43.489058 26248 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.474337 26231 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.483029 26309 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.470804 26415 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.478929 26408 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.448644 26352 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.427505 26417 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:43.427161 26412 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.454445 26414 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.520532 25210 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:43.502115 26403 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.579s	user 0.009s	sys 0.002s
I20260709 13:08:43.502375 26400 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.467497 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:08:43.555928 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 88494.8us
I20260709 13:08:43.327838 26332 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.513969 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:43.558684 24597 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:43.453104 24517 rpcz_store.cc:276] 0709 13:08:42.135331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.138674 (+  3343us) service_pool.cc:224] Handling call
0709 13:08:43.259488 (+1120814us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:43.259730 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.259933 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.259967 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.260019 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:43.260057 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.260123 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.260271 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20056832}
I20260709 13:08:43.559832 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:43.559984 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.560428 24597 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:08:43.506750 26306 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.514640 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:43.490651 26298 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.515049 26325 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.515550 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:43.517916 26353 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.552618 26417 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.520017 26317 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.505439 26381 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.508630 26303 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:43.497933 26258 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:43.524202 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 215517us
I20260709 13:08:43.527024 26416 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:43.527992 24595 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:43.528165 26418 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:43.529980 26355 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:43.580847 26258 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:43.581305 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:43.492940 26315 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.514470 26238 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.501121 26240 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.586995 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:43.587800 24670 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.510962 26415 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.587978 26240 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.602574 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 311) took 1364 ms. Trace:
I20260709 13:08:43.602741 26415 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.514017 26231 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.571432 26402 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.566617 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:43.566625 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.519135 26397 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.608088 26217 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:43.567447 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 62582.3us
I20260709 13:08:43.507781 26256 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.578627 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.579573 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.581125 26355 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.532635 26430 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:43.557755 26247 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:43.584725 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:43.556277 26305 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:43.580905 26418 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.585925 26315 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.519285 26385 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.552802 26407 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:43.569244 26422 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:43.573704 24666 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:43.710142 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:43.623524 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:43.534930 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.711709 24591 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.603117 24596 rpcz_store.cc:276] 0709 13:08:42.238671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.264562 (+ 25891us) service_pool.cc:224] Handling call
0709 13:08:42.264970 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.571999 (+307029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.572028 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:42.579004 (+  6976us) log.cc:844] Serialized 26 byte log entry
0709 13:08:42.794342 (+215338us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:42.794397 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.794458 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.501574 (+707116us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:08:43.588501 (+ 86927us) raft_consensus.cc:1685] finished
0709 13:08:43.588531 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.602485 (+ 13954us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3456,"raft.queue_time_us":21241,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"spinlock_wait_cycles":404537728,"thread_start_us":518001,"threads_started":2,"wal-append.queue_time_us":276440}
I20260709 13:08:43.714118 24674 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:43.536077 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:43.536397 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:43.717598 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.719076 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.719846 24520 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:08:43.533712 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.722558 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.723423 24523 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:43.724432 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.531687 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.726740 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:43.727571 24524 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.571925 24566 leader_election.cc:400] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:08:43.531363 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.705901 24517 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.707940 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1055) took 1572 ms. Trace:
I20260709 13:08:43.712561 24518 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:43.566232 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:43.532361 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.737995 24566 leader_election.cc:403] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:43.621599 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:43.741336 24598 rpcz_store.cc:276] 0709 13:08:42.135011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.135811 (+   800us) service_pool.cc:224] Handling call
0709 13:08:43.184984 (+1049173us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:43.185245 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.445156 (+259911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.445205 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.457444 (+ 12239us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.604790 (+147346us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:43.604834 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.604897 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.707143 (+102246us) raft_consensus.cc:1685] finished
0709 13:08:43.707210 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.707650 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41512,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":7341440,"thread_start_us":340370,"threads_started":2,"wal-append.queue_time_us":136264}
I20260709 13:08:43.575042 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 464) took 1440 ms. Trace:
I20260709 13:08:43.620509 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:43.621702 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:43.616478 25215 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:08:43.770311 25211 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:43.621371 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:43.773263 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:43.621425 25219 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:43.624398 26217 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.774845 26208 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:43.775350 26208 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.775768 26208 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.776378 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:43.546150 26225 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.628319 26247 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.789916 26247 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.665372 26256 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.590606 26258 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.603881 26269 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.584081 26303 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.640046 26298 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.802469 26298 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:43.803310 26298 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.803699 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 467) took 1614 ms. Trace:
I20260709 13:08:43.804098 26303 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.804160 25217 rpcz_store.cc:276] 0709 13:08:42.189132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.189258 (+   126us) service_pool.cc:224] Handling call
0709 13:08:42.189541 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.496134 (+1306593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.803193 (+307059us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400477cd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:43.803510 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2913401600}
I20260709 13:08:43.651901 26306 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.663937 26309 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.650120 26311 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.649420 26332 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.630740 26352 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.667681 26355 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.676141 26381 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:43.823881 26309 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.825059 26381 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.545337 26384 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:43.793255 26269 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.658461 26385 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:43.830885 25218 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:43.831133 24600 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:43.581889 26391 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:43.607493 26401 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:43.609059 26402 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.848768 26402 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.674817 26408 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:43.608764 26412 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.671244 26415 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.583896 26416 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.679257 26417 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.651438 26418 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.630582 26422 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.638962 26428 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.627102 26430 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.643263 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:43.734953 26283 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:43.737282 24639 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.502s (SENT) [suppressed 24 similar messages]
I20260709 13:08:43.721014 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.669446 26400 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.714754 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:43.749421 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:43.275897 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:43.890487 26428 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.893193 24523 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:43.752195 26397 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:43.759075 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 196077us
I20260709 13:08:43.760483 26407 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:43.760356 26343 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:08:43.897220 24520 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:43.761467 25210 rpcz_store.cc:276] 0709 13:08:42.134211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.142867 (+  8656us) service_pool.cc:224] Handling call
0709 13:08:43.520114 (+1377247us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:43.520345 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.558067 (+ 37722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.574182 (+ 16115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5120256}
W20260709 13:08:43.757063 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 135393us
I20260709 13:08:43.897339 26283 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.772107 24421 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 342) took 2208 ms. Trace:
I20260709 13:08:43.772552 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1058) took 1632 ms. Trace:
I20260709 13:08:43.774122 25211 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.774147 25216 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:43.780418 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:43.781917 24594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1062) took 1565 ms (client timeout 1502 ms). Trace:
I20260709 13:08:43.777490 26429 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.805930 26298 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.647886 26305 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:43.904026 24594 rpcz_store.cc:269] 0709 13:08:42.216428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.218502 (+  2074us) service_pool.cc:224] Handling call
0709 13:08:43.781279 (+1562777us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001cb454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:43.781617 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2348436224}
I20260709 13:08:43.809855 26225 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.810173 26204 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.812072 26323 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:08:43.815021 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:43.917668 26397 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:43.819196 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 249258us
I20260709 13:08:43.836596 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:43.919080 24672 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.841343 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:43.837786 26391 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.844198 26269 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:43.896399 26407 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:43.823882 26357 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:43.845254 26401 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:43.826536 26384 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:43.853156 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 70615.3us
I20260709 13:08:43.861920 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:43.862893 26415 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.863317 24670 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:43.880542 26417 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.895913 24596 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:43.887499 26309 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:43.904749 24519 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:43.909409 26429 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:43.828123 26217 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.944531 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:43.958918 24671 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:43.946341 26391 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:43.947829 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56760.3us
I20260709 13:08:43.901836 24592 rpcz_store.cc:276] 0709 13:08:42.139618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.140949 (+  1331us) service_pool.cc:224] Handling call
0709 13:08:42.159992 (+ 19043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.574454 (+414462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.771821 (+1197367us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b540025e4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:43.772317 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782385920}
I20260709 13:08:43.949118 24593 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:43.917701 26323 tablet_bootstrap.cc:492] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:08:43.968325 26416 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.968518 26323 ts_tablet_manager.cc:1403] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 1.064s	user 0.036s	sys 0.030s
I20260709 13:08:43.969463 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:43.944970 26397 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.134289 24672 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:43.952893 26407 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.979839 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:44.036661 24524 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:44.188766 26400 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:44.189064 26428 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:44.174971 24591 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:44.190550 25214 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:44.193243 25211 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:44.192531 26402 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.195928 26402 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:44.197249 26397 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.979424 26391 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.198292 26415 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:44.047910 26238 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:44.198935 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 279089us
I20260709 13:08:44.189924 26430 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.200344 26225 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:43.959030 26309 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:44.201766 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 222088us
I20260709 13:08:43.898574 24421 rpcz_store.cc:276] 0709 13:08:41.563841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.570112 (+  6271us) service_pool.cc:224] Handling call
0709 13:08:43.771808 (+2201696us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.206869 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.290715 (+ 83846us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.293507 (+  2792us) write_op.cc:435] Acquired schema lock
0709 13:08:42.294182 (+   675us) tablet.cc:662] Decoding operations
0709 13:08:42.469213 (+175031us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.469255 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.469279 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:42.469456 (+   177us) tablet.cc:701] Row locks acquired
0709 13:08:42.469472 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:42.469593 (+   121us) write_op.cc:270] Start()
0709 13:08:42.469695 (+   102us) write_op.cc:276] Timestamp: P: 1783602522469553 usec, L: 0
0709 13:08:42.469713 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.470269 (+   556us) log.cc:844] Serialized 539 byte log entry
0709 13:08:42.743864 (+273595us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.857566 (+113702us) write_op.cc:301] APPLY: starting
0709 13:08:42.860100 (+  2534us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.860211 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.863660 (+  3449us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:42.863950 (+   290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:42.864127 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:42.864168 (+    41us) write_op.cc:312] APPLY: finished
0709 13:08:42.936956 (+ 72788us) log.cc:844] Serialized 23 byte log entry
0709 13:08:42.937190 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.937332 (+   142us) write_op.cc:454] Released schema lock
0709 13:08:42.937387 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:43.176926 (+239539us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:43.179060 (+  2134us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":196762,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":105434,"apply.run_cpu_time_us":14981,"apply.run_wall_time_us":253472,"num_ops":1,"prepare.queue_time_us":237690,"prepare.run_cpu_time_us":3078,"prepare.run_wall_time_us":286793,"replication_time_us":262116,"thread_start_us":52304,"threads_started":1}]]}
W20260709 13:08:44.207063 25215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 466) took 2071 ms (client timeout 1958 ms). Trace:
I20260709 13:08:44.207841 24516 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
W20260709 13:08:44.208678 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 316) took 1555 ms (client timeout 1612 ms). Trace:
I20260709 13:08:44.208863 26422 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:43.957221 26315 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:44.217497 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.978418 26384 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.178059 26401 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:08:44.221241 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 251896us
W20260709 13:08:44.219779 24599 rpcz_store.cc:269] 0709 13:08:42.652683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.657671 (+  4988us) service_pool.cc:224] Handling call
0709 13:08:44.208280 (+1550609us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540021be54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:44.208469 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416408960}
I20260709 13:08:44.123487 26208 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:44.224475 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 487431us
I20260709 13:08:44.208220 26323 raft_consensus.cc:359] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.232520 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:44.233919 25217 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.228340 26225 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:44.224584 26415 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:08:44.219097 25215 rpcz_store.cc:269] 0709 13:08:42.135669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.140343 (+  4674us) service_pool.cc:224] Handling call
0709 13:08:44.206650 (+2066307us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54002e59d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:44.206851 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3222747392}
I20260709 13:08:44.239003 26414 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.239812 26208 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:08:44.241029 26231 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.601s	user 0.020s	sys 0.012s
I20260709 13:08:44.241632 26231 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.243269 24595 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:44.240239 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:44.245801 26441 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:44.238027 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:44.231352 26283 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.228987 26391 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.253067 26225 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.254256 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.255419 26225 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.254276 26391 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.256191 26225 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.255380 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.258997 26422 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:44.260030 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.260711 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 313) took 1834 ms. Trace:
I20260709 13:08:44.260502 26422 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:44.250123 26364 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.015s	sys 0.051s
I20260709 13:08:44.261140 24593 rpcz_store.cc:276] 0709 13:08:42.426789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.474107 (+ 47318us) service_pool.cc:224] Handling call
0709 13:08:43.328302 (+854195us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:44.260469 (+932167us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540021bbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:44.260653 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837488640}
I20260709 13:08:44.262255 26397 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.230786 26238 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.258677 26309 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.269870 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.269938 26388 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:44.270315 26298 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:44.270915 24599 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:44.270787 26388 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.271123 26303 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.271080 26298 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.271935 26303 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.272341 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.277391 25215 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.278535 26303 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.263319 26231 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.279767 26369 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:44.280398 26369 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:44.281693 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1192) took 1177 ms. Trace:
I20260709 13:08:44.282140 24668 rpcz_store.cc:276] 0709 13:08:43.103734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.292417 (+188683us) service_pool.cc:224] Handling call
0709 13:08:44.281360 (+988943us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b540017eb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:44.281524 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99367168}
I20260709 13:08:44.283457 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.283842 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 841) took 1546 ms. Trace:
I20260709 13:08:44.284242 24672 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.284340 25218 rpcz_store.cc:276] 0709 13:08:42.742794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.742922 (+   128us) service_pool.cc:224] Handling call
0709 13:08:43.107514 (+364592us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:44.283600 (+1176086us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54004fa454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:44.283773 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555953280}
I20260709 13:08:44.285600 26369 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.290112 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2391) took 1192 ms. Trace:
I20260709 13:08:44.290576 24671 rpcz_store.cc:276] 0709 13:08:43.097391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.105228 (+  7837us) service_pool.cc:224] Handling call
0709 13:08:43.105649 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.029199 (+923550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.289709 (+260510us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400409f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:44.290003 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1940371712}
W20260709 13:08:44.264617 26364 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.401s	user 0.016s	sys 0.052s
I20260709 13:08:44.298431 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.300864 24672 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:44.266636 26323 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:08:44.266810 26391 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.302898 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:44.306015 25215 raft_consensus.cc:2368] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3.
I20260709 13:08:44.272994 26388 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.308867 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.306928 25212 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.306239 26298 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.313836 26300 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:44.309988 26283 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.314945 26283 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.316726 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.318128 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 2399) took 1217 ms. Trace:
I20260709 13:08:44.318419 26343 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:44.318856 26343 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.318653 24674 rpcz_store.cc:276] 0709 13:08:43.100589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.100692 (+   103us) service_pool.cc:224] Handling call
0709 13:08:44.317859 (+1217167us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54001392d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:44.318053 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923419904}
I20260709 13:08:44.319320 26343 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.319916 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.318076 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.321879 26311 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:44.321971 24521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1283) took 2186 ms (client timeout 2911 ms). Trace:
I20260709 13:08:44.321285 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:08:44.322476 24521 rpcz_store.cc:269] 0709 13:08:42.134977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.138606 (+  3629us) service_pool.cc:224] Handling call
0709 13:08:44.321555 (+2182949us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54000bc7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:44.321748 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649486208}
I20260709 13:08:44.323725 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:44.325397 26231 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.326032 26381 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.316567 26417 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.322324 26311 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:44.327283 26311 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.328229 26270 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:44.269032 26441 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.329314 24599 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:44.329653 26346 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:44.330087 26346 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:44.330780 26441 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.313199 26391 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.331049 26346 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.332839 26270 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:44.327621 24420 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.333798 26346 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.335754 26283 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.334352 26401 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:44.336532 26401 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:44.337348 26397 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:44.337564 26401 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.338310 26397 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:44.338763 26397 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:44.308923 26422 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.339910 26397 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.339573 24420 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:44.340421 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.341220 26397 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.312173 26415 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.347594 26401 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.335421 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:44.351034 26357 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:44.351473 26357 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.351919 26357 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.334141 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.313319 26315 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.359424 26428 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:44.363981 26438 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.384922 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.383895 26438 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:44.390662 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55313.8us
I20260709 13:08:44.391953 26441 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.392342 26408 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.393508 26271 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.394230 26417 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:44.395378 26429 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:44.377673 26416 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:44.378989 26270 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.414832 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:44.416040 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.416576 26417 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.369498 26323 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:44.417488 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:44.417743 26271 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.418452 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.420733 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.431919 25217 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:44.414108 26391 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.424386 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.425206 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.425215 26306 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.425712 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.431107 25213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48918
W20260709 13:08:44.421023 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.419286 26343 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.435261 25218 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.397228 26428 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:44.426877 26416 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:44.433465 25213 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.431694 25215 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:44.414042 26438 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.438846 25213 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.431727 26283 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.414057 26441 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.454205 26407 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.456180 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.459038 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.458230 25213 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.441817 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:44.452576 26441 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.462565 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.449425 26417 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:44.467875 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50681.7us
I20260709 13:08:44.464937 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.470204 25213 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.457043 26270 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.476007 26323 ts_tablet_manager.cc:1434] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.439s	user 0.009s	sys 0.009s
I20260709 13:08:44.459830 26408 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.474445 25210 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.476217 26271 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.482861 24490 leader_election.cc:400] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3.
I20260709 13:08:44.484472 24490 leader_election.cc:403] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.478212 26429 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.479180 26323 ts_tablet_manager.cc:1467] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Tablet startup took 505ms
I20260709 13:08:44.493942 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.493489 26283 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.496800 26256 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:44.497224 26448 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:08:44.497409 26256 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:08:44.499226 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 1.03267e+06us
I20260709 13:08:44.500209 26417 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.500702 24669 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:44.501591 26270 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.502662 26429 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.503486 26314 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.498561 26256 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.507527 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.485368 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.487134 26343 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.517186 25218 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:08:44.520586 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.520094 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.523442 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.524844 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:44.525103 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:44.525417 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.525728 25215 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.526038 24516 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:44.526315 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.528046 26407 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.529312 24524 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:44.525695 24522 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.494889 26311 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.481827 26416 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.534907 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.531874 26430 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.531872 24521 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
W20260709 13:08:44.538328 26451 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:44.538424 26430 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.540619 26429 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.541265 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1181) took 1015 ms. Trace:
I20260709 13:08:44.541661 24600 rpcz_store.cc:276] 0709 13:08:43.526063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.570827 (+ 44764us) service_pool.cc:224] Handling call
0709 13:08:44.530084 (+959257us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001cbe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:44.541193 (+ 11109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465868160}
I20260709 13:08:44.529347 26238 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:44.542665 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.544504 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.545056 24667 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:44.545146 24599 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:44.545879 26401 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.546166 26416 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.546221 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.547206 24595 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:44.536345 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.548339 24674 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.549384 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.549527 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.550292 24595 raft_consensus.cc:2368] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:44.550752 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.552114 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:44.553505 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:44.554081 24525 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.554289 24669 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:44.540673 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.556568 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.557276 26397 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:44.557185 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.558017 26397 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:44.558432 24591 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:44.559082 26408 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.559634 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.559219 26397 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.560930 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.562093 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.575176 26311 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.578998 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.577136 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.577544 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.579717 24597 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:44.579994 24593 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:44.579885 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.580562 24596 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:44.578465 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:44.544747 26306 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:44.544615 26273 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.583596 24522 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:44.581459 24594 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.588996 24674 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
W20260709 13:08:44.586558 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63268.8us
I20260709 13:08:44.592371 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.593200 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:44.593294 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.593616 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.595135 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.540726 26430 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.598131 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.599385 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.599952 24667 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:44.600010 24599 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:44.598704 24669 raft_consensus.cc:2368] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:08:44.600005 24600 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:44.604228 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.606227 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.606959 24674 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.546394 26401 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.607976 24672 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:44.608451 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.519938 26428 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:44.506649 26323 ts_tablet_manager.cc:1469] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Trace:
0709 13:08:40.214801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.220945 (+  6144us) service_pool.cc:224] Handling call
0709 13:08:40.364869 (+143924us) ts_tablet_manager.cc:934] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
0709 13:08:41.428602 (+1063733us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:41.639302 (+210700us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:41.639420 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:41.696179 (+ 56759us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:41.742248 (+ 46069us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:41.773479 (+ 31231us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:41.773534 (+    55us) inbound_call.cc:177] Queueing success response
0709 13:08:42.904408 (+1130874us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:44.048100 (+1143692us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:44.107244 (+ 59144us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:44.108147 (+   903us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":14891,"mutex_wait_us":72,"raft.queue_time_us":3236,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7405,"tablet-copy.queue_time_us":76181,"tablet-download-pool.queue_time_us":10274,"tablet-download-pool.run_cpu_time_us":1335,"tablet-download-pool.run_wall_time_us":141289,"thread_start_us":493819,"threads_started":2}
I20260709 13:08:44.589766 26271 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.620826 24525 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:08:44.623993 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:44.601716 26357 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.625288 26409 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.619446 26270 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 13:08:44.636183 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.606874 26407 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:44.635960 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 46080.2us
I20260709 13:08:44.627826 26417 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:44.618696 26429 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:44.642701 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:44.643221 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.645087 26409 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.651808 26409 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:44.652776 26453 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:08:44.653878 25213 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.657841 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.658463 24671 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.658888 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.660214 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.661260 26256 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.661449 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.661561 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.662173 24668 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.661938 26256 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.663012 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.663089 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.663990 24670 raft_consensus.cc:2368] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:08:44.663807 26407 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.664423 26256 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.665000 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.664934 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.665632 24672 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.661141 26271 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.665928 26407 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.667047 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.667501 26271 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.668001 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:44.668286 26311 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.660821 24673 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:08:44.668725 26311 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.669207 26311 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:44.671802 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.664366 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:44.673682 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 67702.8us
I20260709 13:08:44.678015 26343 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.679517 26357 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.679857 26283 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3.
I20260709 13:08:44.680855 26429 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:44.681893 26429 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.685626 24671 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:44.688184 26343 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.663255 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.695819 24672 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
W20260709 13:08:44.695626 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 71839.3us
I20260709 13:08:44.698506 24669 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:44.697286 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.701519 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.641070 26414 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:44.706275 26397 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:44.706714 26397 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:44.707075 26397 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.707146 24667 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:44.710417 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.713460 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.713733 24566 leader_election.cc:400] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:08:44.714154 24665 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:44.714682 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:44.716051 26248 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:44.716585 26248 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:44.719830 24639 leader_election.cc:400] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:44.720142 24639 leader_election.cc:403] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.719663 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.727451 26248 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.728856 26384 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.729336 26346 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.729439 26384 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.730027 26346 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.730758 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:44.731369 24672 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:44.731637 24672 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:44.732286 26346 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.733888 26311 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.736464 26256 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:44.736286 26438 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.736907 26256 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:44.737413 26256 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:44.737252 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 59534.3us
I20260709 13:08:44.738713 26438 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.737704 26308 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:44.736071 24672 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.750692 24672 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.754405 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:44.756449 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 64932.5us
I20260709 13:08:44.756738 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.765915 24672 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:44.763633 26343 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.704710 26417 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.749384 26308 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:44.769999 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:44.755955 26427 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:44.771144 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:44.773314 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.777053 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.777220 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.774823 24672 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:44.762187 26283 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:44.760251 26273 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:44.771890 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:44.773439 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.780565 26427 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:44.781261 25219 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:08:44.781183 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:44.778087 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.787374 25216 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.773712 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.782470 25214 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:44.782261 26357 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:44.759784 26315 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:44.765376 26208 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.777246 26430 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.788874 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.856400 24593 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:44.785890 26283 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.857717 26208 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.841817 26438 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.842322 26462 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.860253 26208 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.860654 26462 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.861151 26462 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.863165 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.845676 26357 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.865517 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:44.866900 26357 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.867026 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.867916 24592 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:44.845453 26417 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.748839 26414 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:44.846560 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.847105 26409 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:44.787267 26311 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.765671 24594 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:44.847251 26427 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:44.848052 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50954.4us
W20260709 13:08:44.885984 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.851979 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.850950 24596 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:44.844720 24566 leader_election.cc:400] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:08:44.852362 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.846542 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.886816 24519 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:44.886838 24566 leader_election.cc:403] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:44.775539 26441 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.891633 24674 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:44.854084 26384 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:44.855291 24524 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:44.894749 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.854952 26308 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.843911 25216 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:44.856240 26430 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.858547 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:44.859061 26283 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.843396 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:44.793565 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:44.900571 24597 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 1.
I20260709 13:08:44.859295 25210 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:44.859792 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:44.845918 26270 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:44.923516 26270 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.846377 26346 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:44.850466 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.888203 24595 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:44.889487 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:44.927774 24596 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:44.890192 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45599.6us
I20260709 13:08:44.928539 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:44.929699 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.930276 24523 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:44.930603 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:44.893616 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47121.8us
I20260709 13:08:44.936031 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.936518 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:44.869791 26397 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.893999 26438 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.903677 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:44.906809 26256 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:44.910813 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:44.912493 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:44.913537 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 70244.4us
I20260709 13:08:44.913718 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:44.914052 26283 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.927811 26309 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.962240 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:44.917493 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:44.919467 26456 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 13:08:44.903793 26369 raft_consensus.cc:2764] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:08:44.969571 24599 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:44.968155 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.920694 24593 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:44.922816 26430 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:44.973721 24523 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:44.944350 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.947466 24519 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:44.947738 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:44.958827 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.915925 26401 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:44.926095 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 851) took 1114 ms. Trace:
I20260709 13:08:44.913558 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.965305 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:44.969558 24598 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:44.946688 26298 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.946079 26308 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.949170 26314 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:44.947131 26343 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.949056 26311 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:44.977624 24594 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:44.967761 26309 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.982841 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.949400 26315 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:08:44.940332 26462 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.969744 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:44.948872 26346 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:44.971566 24517 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.001094 24596 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:44.994328 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:44.975766 26273 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:45.030573 26457 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:08:45.032985 26208 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:45.035907 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 91649.7us
I20260709 13:08:45.039850 24519 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:44.994484 26409 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:44.994483 26414 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:45.002954 26300 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.993472 26311 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:45.027707 26309 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:45.048000 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 53725.5us
I20260709 13:08:45.299319 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:45.299856 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:08:45.213792 26458 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.480s	user 0.000s	sys 0.003s
I20260709 13:08:45.273991 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.307785 24671 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:45.300094 24595 raft_consensus.cc:2376] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4. Re-sending same reply.
I20260709 13:08:45.199563 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.258220 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:45.133893 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 190579us
I20260709 13:08:45.103456 26417 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:45.150096 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.151472 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.136785 26208 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:45.113348 26270 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:45.050096 26283 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.093235 26273 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:45.041234 26391 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:45.225651 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:45.150848 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:45.043174 24516 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:45.280707 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.041785 26306 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:45.253865 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.097820 24523 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:45.129933 26256 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:45.101914 26441 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:45.132918 26409 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:45.051201 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.325860 24665 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
W20260709 13:08:45.275292 26471 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:08:45.147796 26466 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:08:45.273825 26475 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:08:45.305462 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:45.085021 26396 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:45.212889 26346 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:45.204358 26397 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:45.214540 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.224761 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-de2b0253cbb445a4bb49f874e70ea972 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:08:44.980479 25210 rpcz_store.cc:276] 0709 13:08:43.811484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.898104 (+ 86620us) service_pool.cc:224] Handling call
0709 13:08:44.426682 (+528578us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:44.904586 (+477904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8547712}
I20260709 13:08:45.312743 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:45.322156 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:45.398931 24524 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:45.385753 26306 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:45.186286 26314 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:45.296772 26311 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:45.330606 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.332508 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.333279 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:45.334851 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.334959 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.403165 24671 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:08:45.317723 26407 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:08:45.403613 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 107245us
I20260709 13:08:45.326805 24670 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:45.354483 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.362612 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.406782 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:45.407449 24596 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:45.407536 24597 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.324229 26417 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:45.337268 24669 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:45.371536 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:45.400935 24666 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:45.409894 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-de2b0253cbb445a4bb49f874e70ea972 on tablet de2b0253cbb445a4bb49f874e70ea972 with peer 983693721af6486c97ece1410a90cf30
W20260709 13:08:45.410246 26476 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:45.373436 25215 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:45.411285 24672 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:45.374909 25219 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:45.375880 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:08:45.358501 26459 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.653s	user 0.001s	sys 0.003s
I20260709 13:08:45.385987 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:45.336331 26391 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.332412 26462 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:45.412047 26407 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:45.392812 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:45.393859 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:45.395067 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.221177 26478 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:45.402652 24667 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:45.403383 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:45.338797 24673 raft_consensus.cc:2368] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3.
I20260709 13:08:45.365473 26283 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:45.316987 24521 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:45.412684 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:45.415730 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:45.416867 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 83681.7us
I20260709 13:08:45.422312 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:45.436594 26314 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:45.437638 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.408529 26417 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.441193 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:08:45.699503 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 270792us
I20260709 13:08:45.704079 26283 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:45.704625 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:45.442790 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.705767 24671 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.706570 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:45.648555 24597 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:45.708648 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.710350 24597 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:45.398559 26396 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:45.748391 24671 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:45.698519 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.714071 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:45.715596 24595 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:45.715097 26306 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:45.716990 24592 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:45.425513 24517 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:45.451849 26416 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.718555 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:45.720278 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:45.775872 24524 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.719105 24525 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.442359 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:45.419162 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:45.721511 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2316) took 1167 ms. Trace:
W20260709 13:08:45.714208 26438 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.765s	user 0.017s	sys 0.010s
I20260709 13:08:45.782280 26438 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:08:45.784116 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:45.721966 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.728583 26283 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:45.769093 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55064us
I20260709 13:08:45.784984 24517 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:45.779664 24520 rpcz_store.cc:276] 0709 13:08:44.546686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.546810 (+   124us) service_pool.cc:224] Handling call
0709 13:08:44.547135 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.547352 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.547378 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.547876 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.591280 (+ 43404us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:44.591319 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.591388 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.357539 (+766151us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:08:45.451678 (+ 94139us) raft_consensus.cc:1685] finished
0709 13:08:45.451701 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.713786 (+262085us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76780288,"thread_start_us":42921,"threads_started":1,"wal-append.queue_time_us":70900}
I20260709 13:08:45.789613 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:45.716432 26407 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:45.773571 24595 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:45.794482 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 366096us
I20260709 13:08:45.649997 26415 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:45.775038 26482 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:45.739527 26256 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.781836 24593 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:45.791957 24521 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:45.791919 26438 raft_consensus.cc:2764] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:45.425704 24523 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:45.792721 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:45.448413 26308 raft_consensus.cc:2764] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:45.796078 24525 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
W20260709 13:08:45.796212 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 392930us
I20260709 13:08:45.447165 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.779626 26238 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:45.800367 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:45.803817 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:45.804164 26396 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:45.832724 26482 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:45.851383 26482 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.832448 26397 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.853333 26397 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:45.792419 26283 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:45.832831 26401 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.812093 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:45.804194 26311 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:45.820310 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:45.877879 24519 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.648759 26478 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:45.824035 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 422325us
I20260709 13:08:45.827304 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:45.418037 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:45.468538 26483 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:08:45.424978 26343 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:45.837729 26309 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.005s
I20260709 13:08:45.524039 26391 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.841255 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:45.843993 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:45.845777 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 511633us
I20260709 13:08:45.846103 24520 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.845870 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:45.891659 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50496.5us
I20260709 13:08:45.885385 26238 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:45.444510 26273 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:45.839247 26298 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:08:45.809984 24524 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:45.855252 26314 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.863958 26346 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.868058 26417 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:45.842257 24591 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:45.871258 24521 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:45.848409 26270 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.872059 26401 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:45.874145 26283 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:45.876938 26397 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:45.877202 24516 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:08:45.879457 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 52310.9us
I20260709 13:08:45.843616 26441 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:08:45.888763 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:45.899143 24517 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:45.915951 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:45.898490 26407 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:45.887924 26343 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:45.898743 26238 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:45.839625 26415 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:45.897867 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50385us
I20260709 13:08:45.901319 24592 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:45.900895 26346 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:45.919255 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:45.922019 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:45.921990 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:45.923144 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:45.927924 25219 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.928637 26488 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:45.930266 26417 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:45.911633 26270 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:45.934705 26270 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:45.913914 26489 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.895179 26309 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:45.926707 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:45.939714 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:45.934904 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 473) took 1514 ms. Trace:
I20260709 13:08:45.924314 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:45.947932 26489 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:45.949064 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:45.950834 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:45.952565 26401 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:45.954409 24672 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:45.954463 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 296) took 1020 ms. Trace:
I20260709 13:08:45.958570 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:45.924121 26343 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.963841 25219 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:45.926345 26407 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:45.969514 25216 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:45.971448 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:45.976723 24519 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:45.977209 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:45.974978 24639 leader_election.cc:400] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:45.986660 24639 leader_election.cc:403] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:45.979080 24671 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:08:45.979272 25214 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:45.978350 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:45.935519 26346 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.975593 24674 rpcz_store.cc:276] 0709 13:08:44.934201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.934431 (+   230us) service_pool.cc:224] Handling call
0709 13:08:44.951869 (+ 17438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:45.028256 (+ 76387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:45.028292 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:45.049883 (+ 21591us) log.cc:844] Serialized 26 byte log entry
0709 13:08:45.293855 (+243972us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:45.293918 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.294197 (+   279us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.954214 (+660017us) raft_consensus.cc:1685] finished
0709 13:08:45.954236 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.954392 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6780,"raft.queue_time_us":29095,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":41387,"thread_start_us":220359,"threads_started":2,"wal-append.queue_time_us":238894}
I20260709 13:08:45.926908 26491 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:45.968050 25211 rpcz_store.cc:276] 0709 13:08:44.420360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.420471 (+   111us) service_pool.cc:224] Handling call
0709 13:08:45.934705 (+1514234us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400478954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:45.934835 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366952320}
W20260709 13:08:45.983227 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 190590us
I20260709 13:08:45.985201 24520 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:45.987252 24671 pending_rounds.cc:85] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 4
I20260709 13:08:45.976436 26488 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:45.990329 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:45.992071 24637 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:45.987555 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:45.996667 26283 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:45.997133 26283 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:45.997546 24516 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:45.993346 24671 pending_rounds.cc:107] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:08:45.982340 26270 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.999027 24671 raft_consensus.cc:2889] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.988813 26208 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.003556 26305 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:08:45.997886 26283 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:45.995491 26401 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:46.014019 26401 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:46.014339 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1080) took 1155 ms. Trace:
I20260709 13:08:46.014467 26401 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.005499 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.007957 26311 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.009197 26309 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.009440 26407 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:45.975973 24593 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:46.016113 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:45.992905 26417 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.028138 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.030112 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:46.040483 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 57291.8us
I20260709 13:08:46.022851 26273 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.023523 26441 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:46.043373 26397 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.045554 26505 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.041895 26314 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:46.048967 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 122897us
I20260709 13:08:46.062461 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.066123 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.066251 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.043356 26482 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.049500 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.068199 24666 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.067852 26505 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.046185 26308 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.069226 26408 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.039203 26238 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.070178 26505 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.070411 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.071141 26408 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.002031 26501 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:46.052368 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.051544 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:46.014863 24591 rpcz_store.cc:276] 0709 13:08:44.859345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.859470 (+   125us) service_pool.cc:224] Handling call
0709 13:08:46.014086 (+1154616us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54001ec8d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:46.014207 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976626432}
I20260709 13:08:46.065538 24674 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.061861 26311 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.068852 26308 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.072559 24672 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.999455 26491 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.072958 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.045859 26416 raft_consensus.cc:2764] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:08:46.080072 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.081820 26510 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:46.082288 26510 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:46.082671 26510 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.086252 26415 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.088035 26482 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.089614 26478 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.090011 26314 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.093502 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.094188 24674 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:46.098907 26491 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:46.065696 26397 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.045722 26270 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:46.102247 26343 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.102674 26270 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.103819 26308 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.073850 26441 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:46.104355 26343 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:46.105433 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54275us
I20260709 13:08:46.105613 26441 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.109375 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.109932 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:46.110111 24667 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:46.109287 26309 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:46.088131 24666 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:46.112085 26314 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:46.113040 26311 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.113689 26311 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:46.114579 26311 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.117619 26489 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.115989 26346 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.113692 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:08:46.122598 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56111.2us
I20260709 13:08:46.127637 24672 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:46.128077 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.104548 26270 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.177707 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:46.141649 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.178604 24595 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:46.178764 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55024.2us
I20260709 13:08:46.179085 24672 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:46.177801 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.181495 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.182292 24597 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:46.182798 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.183904 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.102248 26397 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.186456 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:46.184962 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:46.185621 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:46.123787 26416 raft_consensus.cc:2764] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:46.188614 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:46.127023 26478 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:46.148648 26401 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.130321 26482 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.191390 24672 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:46.183549 24665 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.192188 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.192204 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:46.189513 24668 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:46.193267 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 64803.4us
I20260709 13:08:46.128700 26343 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:46.194608 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 121720us
I20260709 13:08:46.195360 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:46.198444 24519 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:46.196650 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.140945 26408 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:46.187103 26270 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.198375 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.184553 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.200978 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.126828 26391 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.203366 24672 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:46.202693 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:46.205251 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 77253us
I20260709 13:08:46.210050 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.194367 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.195518 26429 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.197494 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.213447 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.215970 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.204238 26343 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.216063 26429 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.219411 24668 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.226176 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.232393 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.213547 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.209450 26283 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:46.209069 26482 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:46.196295 26478 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.212278 26306 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.270835 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:46.271595 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 58127.6us
I20260709 13:08:46.273417 26473 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:46.218348 26417 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.277844 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.225116 24594 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:46.285168 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 75142.7us
W20260709 13:08:46.277891 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 196023us
I20260709 13:08:46.287662 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.206117 26408 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.229460 26484 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:46.292385 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.240339 26283 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:46.277331 26415 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:46.298342 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.238498 26397 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:08:46.277060 26407 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:46.309614 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 87819.4us
I20260709 13:08:46.230368 24516 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:46.310210 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.317493 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.319998 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:46.321947 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.287644 26409 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:46.307503 26283 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.307785 26396 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.295152 26225 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:08:46.313071 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.309186 26415 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:46.297591 26511 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:46.327226 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:46.310803 26489 raft_consensus.cc:2764] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:46.314694 26407 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:46.324936 26308 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:46.347433 26308 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.309442 26238 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.329730 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.331105 26520 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.334038 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.318339 26305 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.333588 26417 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:46.326536 26309 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:46.321039 26416 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.323035 26346 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.361443 26407 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.339824 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.370669 26401 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:46.371006 26514 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.005s
I20260709 13:08:46.398391 26530 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:46.398758 24670 raft_consensus.cc:2410] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:08:46.371311 26509 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:08:46.345178 26415 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.346922 26343 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.346287 26478 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.378481 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.305881 26473 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.390594 26429 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.373900 26510 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.392853 26391 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.389514 26308 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:46.372895 26417 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.338538 26408 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.367709 26270 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.398823 26530 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:46.399122 25214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 489) took 1463 ms (client timeout 1552 ms). Trace:
I20260709 13:08:46.427417 26530 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:46.427454 25214 rpcz_store.cc:269] 0709 13:08:44.935886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.946448 (+ 10562us) service_pool.cc:224] Handling call
0709 13:08:46.398936 (+1452488us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400608e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:46.399065 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336603520}
I20260709 13:08:46.429415 26468 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:46.413321 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 78253.9us
I20260709 13:08:46.417253 24672 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:46.419201 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 186883us
W20260709 13:08:46.422626 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 94231.5us
I20260709 13:08:46.442678 24668 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:46.426151 26473 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.422325 26417 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.431520 26225 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.345364 26482 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.436231 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:46.375972 26496 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:08:46.445734 26273 raft_consensus.cc:2764] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:46.446373 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.446934 24591 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:46.449441 26478 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.374717 26238 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:46.454680 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 125025us
I20260709 13:08:46.508453 24665 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:46.493340 26473 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:08:46.442255 26270 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.463831 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:46.528546 24491 leader_election.cc:400] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3.
W20260709 13:08:46.528968 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 65248.8us
I20260709 13:08:46.529599 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.421347 26488 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:08:46.522964 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86832.4us
I20260709 13:08:46.494498 26225 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.514927 26536 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.529659 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:46.530651 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.500751 26528 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:46.533427 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.525265 26397 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:46.537725 26397 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.537858 26311 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.538172 26397 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.537750 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.545466 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:46.550103 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.551611 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.552388 26308 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.534247 26536 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.528405 26478 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.582718 26311 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:46.583143 26510 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.570564 26535 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:46.584776 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.585031 26416 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:46.587116 26238 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.567869 26534 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:46.534829 26391 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:46.587587 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1204) took 1271 ms. Trace:
I20260709 13:08:46.589013 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:46.617964 26478 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:46.592437 26532 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:08:46.543768 26283 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.593971 26225 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:46.594039 26528 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.623754 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.625902 24597 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 2: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:46.593920 26530 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.596349 26397 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.587153 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1312) took 1240 ms. Trace:
I20260709 13:08:46.636018 24517 rpcz_store.cc:276] 0709 13:08:45.346462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.854663 (+508201us) service_pool.cc:224] Handling call
0709 13:08:45.854950 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.917418 (+ 62468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.586919 (+669501us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b540030eb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:46.587093 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78817024}
W20260709 13:08:46.601269 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 58894.8us
I20260709 13:08:46.534875 26270 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.637123 26528 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.621698 26534 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:46.638401 26534 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.638840 26270 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.638764 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.639485 26534 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.603593 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:46.601351 26531 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:46.607527 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:46.602176 26516 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.609707 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.652159 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.652976 24597 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:46.598594 26417 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.610831 25214 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:46.613714 26462 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.614632 26536 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.671394 26468 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:46.671728 26536 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.673362 26528 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.673861 26528 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.608496 26401 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:08:46.615026 26311 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.615834 26485 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:46.592603 26407 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:46.617470 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 65925.8us
I20260709 13:08:46.582798 26346 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:46.633987 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.679622 26415 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.621978 24599 rpcz_store.cc:276] 0709 13:08:45.315897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.794031 (+478134us) service_pool.cc:224] Handling call
0709 13:08:45.833881 (+ 39850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.895828 (+ 61947us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:45.903705 (+  7877us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.001863 (+ 98158us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.004016 (+  2153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:46.004071 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:46.004124 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.587388 (+583264us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b540013fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:46.587431 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:46.587535 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1971,"prepare.queue_time_us":8212,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":74,"raft.queue_time_us":4236,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"spinlock_wait_cycles":141242624,"thread_start_us":91472,"threads_started":1,"wal-append.queue_time_us":159524}
I20260709 13:08:46.635316 26283 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.649152 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:46.620879 26538 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.661630 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.677959 26513 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:46.678730 26397 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.679015 26401 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:46.681551 26529 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:46.682104 26485 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.683676 26417 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.621872 26391 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:46.642515 26531 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:46.680223 26530 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.804030 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.832499 26315 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.833236 26529 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:46.833104 26401 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:46.835341 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.832060 26346 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:46.835245 24596 raft_consensus.cc:2410] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:46.833212 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:46.836309 26346 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.839663 26273 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:46.840049 26273 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:46.840865 26273 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:46.841964 26528 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.832039 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:08:46.741729 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 55778.5us
I20260709 13:08:46.843600 25213 raft_consensus.cc:2368] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:46.842792 24596 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:46.664211 24591 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:46.837908 26529 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:46.737171 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51863.5us
I20260709 13:08:46.851260 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.851992 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.858606 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:46.859247 24599 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:46.861619 24490 leader_election.cc:400] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:46.862061 24490 leader_election.cc:403] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.838904 26391 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.838490 26485 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:46.864209 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.864305 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.846657 26315 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:46.865352 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:46.872284 24519 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:46.865813 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.829480 26407 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.833892 26415 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.868834 24520 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:46.865093 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.830132 26311 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.882362 24420 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 243) took 5325 ms. Trace:
I20260709 13:08:46.215768 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:46.840314 26401 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.847179 26531 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.773141 26308 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:46.888753 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:46.897778 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.900378 24524 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:46.816344 26468 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:46.760113 26520 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:08:46.883112 26315 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.910244 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.916944 24519 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:46.868150 26283 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.874513 26529 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.918305 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.892505 24420 rpcz_store.cc:276] 0709 13:08:41.556760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.556908 (+   148us) service_pool.cc:224] Handling call
0709 13:08:46.882271 (+5325363us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:44.469858 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:44.504088 (+ 34230us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:44.504149 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:08:44.504172 (+    23us) tablet.cc:662] Decoding operations
0709 13:08:44.504798 (+   626us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:44.504900 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:44.504938 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:44.505428 (+   490us) tablet.cc:701] Row locks acquired
0709 13:08:44.505472 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:08:44.505646 (+   174us) write_op.cc:270] Start()
0709 13:08:44.505779 (+   133us) write_op.cc:276] Timestamp: P: 1783602524505588 usec, L: 0
0709 13:08:44.505822 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:08:44.530030 (+ 24208us) log.cc:844] Serialized 925 byte log entry
0709 13:08:45.102257 (+572227us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:08:45.421360 (+319103us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.785829 (+364469us) write_op.cc:301] APPLY: starting
0709 13:08:45.785924 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.786848 (+   924us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.786934 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.804741 (+ 17807us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.805029 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:45.805100 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:45.805358 (+   258us) log.cc:844] Serialized 29 byte log entry
0709 13:08:45.805535 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.805619 (+    84us) write_op.cc:454] Released schema lock
0709 13:08:45.805678 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.806063 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.809358 (+  3295us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":348329,"apply.run_cpu_time_us":2513,"apply.run_wall_time_us":20236,"num_ops":2,"prepare.queue_time_us":104689,"prepare.run_cpu_time_us":13082,"prepare.run_wall_time_us":139370,"raft.queue_time_us":63324,"raft.run_cpu_time_us":5814,"raft.run_wall_time_us":282340,"replication_time_us":915376,"spinlock_wait_cycles":43778304,"thread_start_us":389527,"threads_started":4,"wal-append.queue_time_us":156179,"wal-append.run_cpu_time_us":34065,"wal-append.run_wall_time_us":2110224}]]}
I20260709 13:08:46.897863 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.913059 26208 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:46.938115 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:46.941754 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.944380 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.945134 24672 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.950206 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:46.953131 24519 raft_consensus.cc:2376] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4. Re-sending same reply.
I20260709 13:08:46.917938 26315 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.954125 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.961671 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.963227 24674 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:46.937891 26545 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.909195 26485 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:08:46.942516 26208 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:46.987478 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.952018 26528 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.002431 26528 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.004727 26528 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:46.992449 24520 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:47.005791 26315 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.006892 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:47.008150 26315 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:47.008880 24672 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:46.993510 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:47.025269 26308 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:47.030095 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:47.031320 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:47.032341 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:47.034380 24665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1211) took 1709 ms (client timeout 2121 ms). Trace:
W20260709 13:08:47.034818 24665 rpcz_store.cc:269] 0709 13:08:45.325558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.400444 (+ 74886us) service_pool.cc:224] Handling call
0709 13:08:47.034215 (+1633771us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540017eb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:47.034321 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675361664}
I20260709 13:08:46.993975 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:46.990399 26401 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.038616 24524 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:47.039031 26346 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:46.965039 26535 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:47.041589 26520 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.042006 26520 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:47.042366 26520 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.042189 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:47.042923 24595 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.992796 26208 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.990659 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:46.997908 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:46.990141 26311 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.952639 24518 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:47.044971 24671 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:47.059043 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:47.060497 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 67053.7us
I20260709 13:08:46.995724 26516 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.068464 24595 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
W20260709 13:08:47.073468 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 415496us
I20260709 13:08:47.074272 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:47.040990 26535 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.095559 26545 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:47.096341 26545 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:47.097606 26545 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:47.107735 24598 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:47.095633 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:47.032822 26391 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.124707 24668 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:47.062170 26248 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:08:47.073768 26534 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:47.129233 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.104087 26536 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:47.073935 26311 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.140053 24598 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:47.063089 26501 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:47.151947 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.074926 24670 raft_consensus.cc:2376] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5. Re-sending same reply.
I20260709 13:08:47.075801 26516 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:47.170439 24669 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:47.174085 24673 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:47.157569 26346 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:47.167142 26501 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.173593 26536 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.169474 26548 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:47.199566 26550 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:47.210397 26391 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:47.220189 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1198) took 1911 ms. Trace:
I20260709 13:08:47.220826 24592 rpcz_store.cc:276] 0709 13:08:45.308694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.785808 (+477114us) service_pool.cc:224] Handling call
0709 13:08:45.786124 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.937439 (+151315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.219836 (+1282397us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540025e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:47.220106 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238483200}
I20260709 13:08:47.222460 24518 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:47.223807 24518 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:47.224417 26531 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:47.225430 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 180484us
I20260709 13:08:47.225920 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 309) took 1304 ms. Trace:
I20260709 13:08:47.228513 24491 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:47.231122 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.185911 26501 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.230906 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.226280 24669 rpcz_store.cc:276] 0709 13:08:45.921568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.749735 (+828167us) service_pool.cc:224] Handling call
0709 13:08:46.784302 (+ 34567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.171139 (+386837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.225709 (+ 54570us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400046fd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:47.225867 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884983168}
I20260709 13:08:47.235013 25214 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:47.238129 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:47.237340 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:47.239789 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:47.251585 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:47.246419 26538 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.268568 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:47.270191 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:47.274011 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:47.274940 24666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1215) took 1195 ms (client timeout 1535 ms). Trace:
W20260709 13:08:47.275437 24666 rpcz_store.cc:269] 0709 13:08:46.079647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.273729 (+1194082us) service_pool.cc:224] Handling call
0709 13:08:47.274875 (+  1146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:47.247035 26544 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.285923 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:47.286204 26544 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:47.286738 25212 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:47.286844 26544 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.287974 25215 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:08:47.303377 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 859945us
I20260709 13:08:47.285645 26535 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:47.212284 26536 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.240754 26407 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:47.257786 26417 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:47.314203 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 62713.2us
I20260709 13:08:47.314790 26528 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:47.318138 26408 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:47.324011 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:47.244324 26428 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:08:47.243826 26480 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:08:47.245774 26208 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.334551 26408 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.358827 26314 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:47.388156 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:47.426810 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:47.411155 26416 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:08:47.353041 26407 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:47.437855 25216 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:08:47.552573 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 228643us
W20260709 13:08:47.560461 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 464861us
W20260709 13:08:47.552772 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 126069us
I20260709 13:08:47.571569 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:47.574697 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:47.579138 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.488824 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 86731.8us
I20260709 13:08:47.572539 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:47.584662 24566 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:47.588758 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.401878 26417 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:47.463198 26428 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:47.595988 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:47.462067 26309 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:47.601636 24598 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:47.601521 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.598078 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.549712 26408 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:47.609248 26309 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.612936 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:47.613740 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:47.613831 26536 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:47.600458 26548 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:47.617779 26548 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.620419 26548 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:47.623427 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.624083 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:47.624495 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:47.625435 26407 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:47.629241 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:47.588533 26346 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.630004 24516 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.630077 26346 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.632355 26346 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:47.636682 26314 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:47.638058 26520 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.005s
I20260709 13:08:47.638489 26520 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:47.640569 26520 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:47.643280 26544 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.598502 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:47.590149 26480 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:47.583899 26391 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:47.645510 26480 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:47.597167 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3629983099999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:08:47.648581 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3204405540000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:08:47.649166 24669 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
W20260709 13:08:47.650610 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.599064 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:47.657943 24600 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:47.549912 26516 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:47.549495 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.532444 26311 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:47.477988 26557 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:47.651783 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:47.661417 24667 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.651829 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:47.584458 26397 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:08:47.593990 26534 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:08:47.674105 25218 raft_consensus.cc:2368] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:08:47.653620 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:47.646435 26480 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.650259 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:47.659724 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.663708 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:47.675580 25217 raft_consensus.cc:2368] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:47.674387 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:47.601306 26428 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:47.678246 26516 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:47.678560 26391 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:47.679769 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:47.712347 24521 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:47.682006 26534 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:47.683101 26283 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.762s	user 0.007s	sys 0.004s
I20260709 13:08:47.686658 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:47.689306 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:47.698704 24667 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
W20260709 13:08:47.722971 24667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 312) took 1640 ms (client timeout 1789 ms). Trace:
I20260709 13:08:47.715286 26516 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:47.677731 26557 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:48.093813 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 443580us
I20260709 13:08:47.854032 25214 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:48.095676 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:48.111989 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:47.716207 26428 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:47.717278 26534 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:47.727515 26542 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.948s	user 0.010s	sys 0.000s
W20260709 13:08:47.723419 24667 rpcz_store.cc:269] 0709 13:08:46.082832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.651514 (+1568682us) service_pool.cc:224] Handling call
0709 13:08:47.722891 (+ 71377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:48.117655 24523 raft_consensus.cc:2376] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4. Re-sending same reply.
W20260709 13:08:48.122411 24523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1326) took 1268 ms (client timeout 1589 ms). Trace:
W20260709 13:08:48.087381 24518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.018s	sys 0.062s
I20260709 13:08:48.123219 26311 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:48.123533 24518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.018s	sys 0.062s
I20260709 13:08:48.123929 26311 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:47.720573 26283 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:47.728802 26225 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:48.086696 26544 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:47.719731 26391 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:47.908579 26415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.004s	sys 0.014s
W20260709 13:08:48.122944 24523 rpcz_store.cc:269] 0709 13:08:46.854278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.883418 (+ 29140us) service_pool.cc:224] Handling call
0709 13:08:48.111693 (+1228275us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:48.122317 (+ 10624us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18014976}
I20260709 13:08:47.728554 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.929736 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:47.724304 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:48.130630 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:08:48.131718 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.086163 26248 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.959787 26397 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.135532 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.002s	sys 0.011s
I20260709 13:08:48.111624 26545 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.134007 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:08:48.139385 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.026s
I20260709 13:08:47.960057 26462 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.132959 26315 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:48.162330 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.002s	sys 0.011s
I20260709 13:08:48.163234 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:48.165056 24519 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:48.164973 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.005s	sys 0.026s
W20260709 13:08:48.140700 24591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.007s
W20260709 13:08:48.162541 24596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.036s	sys 0.072s
W20260709 13:08:48.192035 24596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.036s	sys 0.072s
I20260709 13:08:48.129634 26225 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:48.140079 26415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.005s	sys 0.015s
W20260709 13:08:48.165489 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.019s	sys 0.010s
W20260709 13:08:48.195818 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.019s	sys 0.010s
I20260709 13:08:48.159451 26311 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:48.168624 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 784312us
W20260709 13:08:48.170051 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 585436us
I20260709 13:08:48.203547 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:48.159409 26407 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.018s
I20260709 13:08:48.132084 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:48.189548 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:08:48.194183 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 492324us
I20260709 13:08:47.846680 26417 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.207232 24519 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:48.197423 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:08:48.161736 26501 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.895s	user 0.006s	sys 0.004s
I20260709 13:08:48.208443 26501 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.166796 26544 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:48.191852 24591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.009s	sys 0.007s
I20260709 13:08:48.135790 26314 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:48.213141 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.215790 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:48.218555 24674 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.218700 24667 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 4 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:48.217118 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:48.220098 24669 raft_consensus.cc:2376] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5. Re-sending same reply.
W20260709 13:08:48.206909 26407 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.003s	sys 0.018s
I20260709 13:08:48.140262 26391 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:48.214593 26488 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.016s	sys 0.052s
W20260709 13:08:48.206583 26300 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.016s	sys 0.013s
I20260709 13:08:48.164109 26248 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.166744 26397 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:48.246047 26569 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:48.246902 26569 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.247035 26397 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:48.233711 24668 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:08:48.248968 26564 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:08:48.249305 26309 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:48.249538 24521 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:48.250185 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 876) took 2065 ms. Trace:
I20260709 13:08:48.250432 26248 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:48.240767 26300 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.016s	sys 0.013s
I20260709 13:08:48.195034 26315 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:48.252257 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.171069 26462 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:48.220722 26562 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.545s	user 0.001s	sys 0.000s
I20260709 13:08:48.213727 26311 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.234474 26408 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.242751 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 329) took 1015 ms. Trace:
I20260709 13:08:48.242935 26208 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:48.244612 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:48.248286 26563 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:08:48.250589 25210 rpcz_store.cc:276] 0709 13:08:46.184588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.188066 (+  3478us) service_pool.cc:224] Handling call
0709 13:08:47.223193 (+1035127us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:47.223411 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.223809 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.223842 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.224336 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.550895 (+326559us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:47.551685 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.551841 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.249893 (+698052us) raft_consensus.cc:1685] finished
0709 13:08:48.249911 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.250119 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3269,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8224,"spinlock_wait_cycles":4146944,"thread_start_us":323907,"threads_started":1,"wal-append.queue_time_us":611998}
I20260709 13:08:48.216180 25211 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:08:48.251906 26391 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:48.238248 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 49594.7us
I20260709 13:08:48.233068 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:48.257486 24520 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:48.262568 24519 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:48.237038 26545 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:48.281127 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48119.8us
I20260709 13:08:48.237419 26567 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:48.282220 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:48.282328 26567 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.283236 26407 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:48.284005 26283 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.284653 26568 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:48.285987 26516 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:48.284667 26407 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:48.287308 26407 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:48.250590 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:48.240468 26488 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.016s	sys 0.053s
I20260709 13:08:48.292785 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.304747 24668 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:08:48.293926 24639 leader_election.cc:400] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:08:48.271999 24674 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:48.168013 26534 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.306059 24639 leader_election.cc:403] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:08:48.307736 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:48.272202 26493 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.313958 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:48.315251 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:48.287837 26557 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:48.232683 26314 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:48.297863 24516 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.003s
W20260709 13:08:48.328713 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 126619us
W20260709 13:08:48.353950 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.362407 24637 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.534s (SENT)
I20260709 13:08:48.270164 26311 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.274472 26408 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:48.368523 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:08:48.368861 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 156471us
I20260709 13:08:48.372895 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:48.328668 24421 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 3 to 4, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 4 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.322270 26516 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:48.325244 26501 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:48.327780 26557 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.391732 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.391105 24421 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.319126 26571 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:48.275499 26225 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:48.394677 24637 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.865s (SENT)
I20260709 13:08:48.398375 24674 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:48.326484 24516 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:48.402372 24421 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:48.381558 26534 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.324011 26493 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.382896 26462 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:48.412823 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 209366us
I20260709 13:08:48.394212 26545 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.422230 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.422891 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.423460 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:48.423870 24672 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:48.424173 24669 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.395934 26315 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:48.390538 26572 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.428297 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.400656 26571 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:48.435340 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.435599 24672 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:48.407572 26516 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:48.437577 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:48.437765 24672 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:48.419111 26485 raft_consensus.cc:476] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:48.410674 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2344) took 1091 ms. Trace:
I20260709 13:08:48.443894 24665 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:48.454867 24516 rpcz_store.cc:276] 0709 13:08:47.319438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.362258 (+ 42820us) service_pool.cc:224] Handling call
0709 13:08:48.405953 (+1043695us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:48.455139 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1223) took 1528 ms. Trace:
I20260709 13:08:48.455955 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:48.457103 26572 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:48.457357 24665 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:48.441496 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:48.457684 26572 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.444036 26570 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:48.264709 24518 rpcz_store.cc:276] 0709 13:08:47.227796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.310610 (+ 82814us) service_pool.cc:224] Handling call
0709 13:08:47.310965 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.311369 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.311402 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.311912 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.124258 (+812346us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:48.124312 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.124400 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.242493 (+118093us) raft_consensus.cc:1685] finished
0709 13:08:48.242523 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.242686 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2308,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":811844,"threads_started":1,"wal-append.queue_time_us":898927}
W20260709 13:08:48.444689 26574 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:08:48.461182 26566 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 13:08:48.455576 24671 rpcz_store.cc:276] 0709 13:08:46.926426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.926615 (+   189us) service_pool.cc:224] Handling call
0709 13:08:46.926987 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.067787 (+140800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.454904 (+1387117us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400404f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:48.455071 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270896512}
I20260709 13:08:48.465823 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:48.466917 26531 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:48.466980 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.470328 26273 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.471868 26311 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:48.472762 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:48.473484 24516 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:48.474414 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:48.474942 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:48.475713 24522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1325) took 1621 ms (client timeout 1534 ms). Trace:
I20260709 13:08:48.476045 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:48.477391 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:48.477787 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1335) took 1129 ms. Trace:
W20260709 13:08:48.478051 24525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1327) took 1623 ms (client timeout 1865 ms). Trace:
W20260709 13:08:48.478442 24525 rpcz_store.cc:269] 0709 13:08:46.854541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.873835 (+ 19294us) service_pool.cc:224] Handling call
0709 13:08:48.477267 (+1603432us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:48.477999 (+   732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26717440}
I20260709 13:08:48.479070 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:48.476056 24522 rpcz_store.cc:269] 0709 13:08:46.853991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.861907 (+  7916us) service_pool.cc:224] Handling call
0709 13:08:48.474816 (+1612909us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:48.475645 (+   829us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42293120}
I20260709 13:08:48.481120 24522 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:48.481601 26314 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:48.482676 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2346) took 1150 ms. Trace:
W20260709 13:08:48.449631 26575 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:08:48.483021 24519 rpcz_store.cc:276] 0709 13:08:47.332081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.219848 (+887767us) service_pool.cc:224] Handling call
0709 13:08:48.220119 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.273138 (+ 53019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.482486 (+209348us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b54002f0154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:48.482629 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85248896}
I20260709 13:08:48.452219 26489 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.453751 26462 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.483933 26489 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:48.484153 26462 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.485220 26489 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:48.486338 26462 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:48.486761 26489 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.487013 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.487703 24668 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:48.487804 26428 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.488581 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.483883 26572 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:48.489455 24523 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:48.490631 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2340) took 1173 ms. Trace:
I20260709 13:08:48.490954 24523 rpcz_store.cc:276] 0709 13:08:47.316843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.164614 (+847771us) service_pool.cc:224] Handling call
0709 13:08:48.489159 (+324545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.489846 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.490456 (+   610us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400440f50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:48.490577 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745747712}
I20260709 13:08:48.436726 26571 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.478191 24521 rpcz_store.cc:276] 0709 13:08:47.348120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.476947 (+1128827us) service_pool.cc:224] Handling call
0709 13:08:48.477281 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.477462 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.477490 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:48.477537 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:48.477568 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.477625 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.477737 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:48.480021 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1225) took 1550 ms. Trace:
I20260709 13:08:48.494841 24673 rpcz_store.cc:276] 0709 13:08:46.929405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.929552 (+   147us) service_pool.cc:224] Handling call
0709 13:08:46.952259 (+ 22707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.174518 (+222259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.479816 (+1305298us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540044e654. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:48.479970 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499704704}
I20260709 13:08:48.495937 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:48.499780 24669 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
W20260709 13:08:48.481699 24520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 327) took 1513 ms (client timeout 1669 ms). Trace:
I20260709 13:08:48.446094 26516 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:48.450196 26408 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:48.501322 24520 rpcz_store.cc:269] 0709 13:08:46.968404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.006651 (+ 38247us) service_pool.cc:224] Handling call
0709 13:08:48.481549 (+1474898us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400440f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:48.481647 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854528768}
I20260709 13:08:48.504055 24668 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:48.418322 24421 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 2 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.513108 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:48.514727 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.522938 24669 raft_consensus.cc:2410] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:48.526307 24490 leader_election.cc:400] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:48.528770 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:48.511771 24421 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 3 to 4, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 4 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.560467 24674 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:48.494840 24521 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:48.487031 24518 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.542007 24421 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 2 to 3, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:08:48.573745 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:48.581192 24596 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:48.600515 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 278821us
W20260709 13:08:48.607690 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 216168us
I20260709 13:08:48.562527 26417 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:48.626989 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 258094us
W20260709 13:08:48.649407 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.657387 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.658010 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:48.659168 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:48.662685 24596 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:48.662837 24599 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:48.662876 24600 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.660570 24519 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:48.663897 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 135202us
I20260709 13:08:48.664489 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.667158 24668 raft_consensus.cc:2410] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:48.601786 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:48.677205 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45144.3us
I20260709 13:08:48.673765 24598 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:48.673897 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:48.675746 26587 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.677521 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1097) took 1095 ms. Trace:
I20260709 13:08:48.685565 24599 rpcz_store.cc:276] 0709 13:08:47.582462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.589496 (+  7034us) service_pool.cc:224] Handling call
0709 13:08:48.657864 (+1068368us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:48.677465 (+ 19601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10817920}
I20260709 13:08:48.681466 24668 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:48.674084 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 366389us
I20260709 13:08:48.681844 24520 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:48.682600 26531 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:48.684198 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 124234us
I20260709 13:08:48.638520 26408 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:48.732648 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 52982.9us
I20260709 13:08:48.698299 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:48.650632 26544 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:08:48.735522 24596 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:48.737035 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:48.762744 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:48.762979 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.692436 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:48.766161 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:48.767733 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:48.768940 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:48.771205 24599 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:08:48.774595 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 82227us
I20260709 13:08:48.692663 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:48.694928 26587 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:48.787127 26587 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:48.672819 26417 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:48.691902 26531 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.806603 24598 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:48.782243 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:48.732462 26520 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.789657 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:48.812834 24668 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:48.691255 26415 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:48.692883 24670 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:48.732954 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1096) took 1150 ms. Trace:
I20260709 13:08:48.802451 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:48.802659 24594 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:48.803403 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:48.754292 26283 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:48.807713 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:48.831383 24596 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:48.832352 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:48.693470 24592 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:48.811537 26531 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:48.780131 26346 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.759019 26590 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:08:48.779049 26578 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.779729 26529 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:48.777012 26270 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.762082 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:48.822906 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:48.788084 26485 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:48.838042 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 354) took 2157 ms. Trace:
I20260709 13:08:48.838658 24671 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:48.846781 24668 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:48.812526 26428 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:48.798113 26480 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:48.798615 26488 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:48.844635 24598 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:48.781605 26408 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.852453 26283 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.881486 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:48.758533 26592 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:08:48.887957 24518 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:48.890656 26493 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:48.829864 26520 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:48.824254 26315 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.830123 24591 rpcz_store.cc:276] 0709 13:08:47.582297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.614795 (+ 32498us) service_pool.cc:224] Handling call
0709 13:08:47.615028 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:47.615227 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:47.615541 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.635079 (+1019538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:48.638990 (+  3911us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:48.664767 (+ 25777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.677134 (+ 12367us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.705237 (+ 28103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6988,"prepare.queue_time_us":239,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":28817,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"spinlock_wait_cycles":24960,"thread_start_us":965917,"threads_started":2,"wal-append.queue_time_us":709566}
I20260709 13:08:48.841164 26593 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:48.935951 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:48.937583 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.093040 26571 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.599s	user 0.004s	sys 0.004s
I20260709 13:08:48.914518 26314 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:49.104184 26315 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:49.104517 26571 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.105020 26315 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.106719 26571 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.107632 26315 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:48.915908 26578 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:49.108352 26578 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:49.099871 26408 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:48.992926 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.123132 24517 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:08:49.123714 24517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1316) took 2272 ms (client timeout 1750 ms). Trace:
I20260709 13:08:49.101263 26593 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.124150 26567 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:48.965713 26488 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:48.938262 26480 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.103869 24668 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 1.
I20260709 13:08:48.993822 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:49.104882 26314 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:49.078905 26534 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.000s
I20260709 13:08:48.873873 26309 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:48.894292 26529 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.133868 24666 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:49.109305 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.110391 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:49.110685 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.111481 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.109050 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 318) took 2142 ms. Trace:
I20260709 13:08:49.139452 26415 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:49.132498 26593 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.114387 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.115346 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:49.116313 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:49.116379 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.117112 26612 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:49.120654 26416 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.113358 26578 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.109637 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:48.966235 26417 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:49.127252 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.935565 26485 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:49.137378 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:49.094060 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 325225us
I20260709 13:08:49.098430 24600 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:49.134255 24673 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:49.131763 26489 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.004s
I20260709 13:08:49.129277 26225 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.896153 24595 rpcz_store.cc:276] 0709 13:08:46.680540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.071184 (+390644us) service_pool.cc:224] Handling call
0709 13:08:47.071568 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.178922 (+107354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.178964 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.179908 (+   944us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.292028 (+112120us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:47.292086 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.807899 (+1515813us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540033de54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:48.807971 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.808038 (+    67us) raft_consensus.cc:1685] finished
0709 13:08:48.808060 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.837953 (+ 29893us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":955,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4643,"spinlock_wait_cycles":245873024,"thread_start_us":97149,"threads_started":1,"wal-append.queue_time_us":409267}
W20260709 13:08:49.110033 25213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 499) took 1487 ms (client timeout 1817 ms). Trace:
I20260709 13:08:49.113298 25219 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:49.155045 24524 rpcz_store.cc:276] 0709 13:08:46.966555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.039311 (+ 72756us) service_pool.cc:224] Handling call
0709 13:08:47.068045 (+ 28734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.068469 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.068510 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.079332 (+ 10822us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.191428 (+112096us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:47.191497 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.191603 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.255507 (+ 63904us) raft_consensus.cc:1685] finished
0709 13:08:47.255535 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.108757 (+1853222us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b5400113d50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:49.108984 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1003,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":28880,"spinlock_wait_cycles":65315200,"thread_start_us":52374,"threads_started":1,"wal-append.queue_time_us":142627,"wal-append.run_cpu_time_us":1948,"wal-append.run_wall_time_us":1004051}
I20260709 13:08:49.154768 26529 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:49.125267 24517 rpcz_store.cc:269] 0709 13:08:46.851398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.855849 (+  4451us) service_pool.cc:224] Handling call
0709 13:08:48.964346 (+2108497us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21eee 0000000000375939 00007f17c0e951e0 00007f17c0f5e0c4 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:49.123642 (+159296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18716032}
W20260709 13:08:49.163516 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48300.9us
I20260709 13:08:49.217240 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:49.165477 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.164397 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:49.211901 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 74658.8us
I20260709 13:08:49.150867 26611 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:49.214417 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.151101 26569 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.162704 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:49.213774 25213 rpcz_store.cc:269] 0709 13:08:47.622619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.622773 (+   154us) service_pool.cc:224] Handling call
0709 13:08:49.109837 (+1487064us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54002e59d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:49.109977 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779457792}
I20260709 13:08:49.154537 26603 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:49.153757 26311 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:49.217022 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.218762 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.163961 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.220376 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.231505 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:49.160346 26415 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.213518 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1230) took 1891 ms. Trace:
I20260709 13:08:49.247884 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.225278 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:49.210832 26534 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:49.252055 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.253021 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.154989 25212 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:49.227617 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.159976 26608 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:49.229987 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:49.230288 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.228356 26569 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.233507 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.257331 26501 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.257436 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.257856 26501 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.258291 26501 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.254263 26618 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:49.234452 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.154934 26309 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.260995 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:49.261215 26588 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.261734 26618 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.262604 26309 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:49.263581 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.264588 25213 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:49.232932 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:49.235245 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.235571 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.228159 26611 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.238058 26480 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:49.234690 26391 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.238773 26311 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.169632 26593 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:49.165664 26567 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.155591 26580 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:49.216336 26408 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.243018 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:49.244798 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.249661 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.284610 24520 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:49.253479 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:49.255208 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.279775 26567 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.286356 26567 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.286737 26311 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.287218 24517 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:49.287309 26311 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.231086 26578 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.263149 26488 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:49.267580 26618 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.288146 26311 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.288769 26618 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:49.289144 26618 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:49.272270 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.278672 24596 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:49.251106 26534 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:49.259966 26270 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:49.229748 26489 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:08:49.260241 26300 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.279546 26485 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.269994 26592 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:49.290616 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:49.265537 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:49.296614 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:49.277729 24670 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:49.331689 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.331939 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.333753 24519 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
W20260709 13:08:49.335520 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44996.4us
I20260709 13:08:49.330971 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:49.335672 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 70207.4us
I20260709 13:08:49.297216 26557 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.241832 26603 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.343473 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:49.321942 26270 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:49.321300 26416 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:49.364323 25185 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.738s (SENT) [suppressed 17 similar messages]
I20260709 13:08:49.264385 26608 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.372751 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.281880 26612 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:08:49.344730 26604 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:49.285346 26580 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.377334 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:49.379276 26580 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.317999 26588 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:49.377403 26604 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:49.373595 24672 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:49.342696 26309 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.381947 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:49.383318 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 118666us
I20260709 13:08:49.332947 26592 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:49.284498 26593 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.248274 24666 rpcz_store.cc:276] 0709 13:08:47.322262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.329056 (+  6794us) service_pool.cc:224] Handling call
0709 13:08:49.133335 (+1804279us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5800170798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21eee 0000000000375939 00007f17c0e951e0 00007f17c0f5e0c4 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:49.133496 (+   161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.155492 (+ 21996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.210147 (+ 54655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64392064}
I20260709 13:08:49.343235 26619 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.345250 26391 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.390115 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:49.371160 26270 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:49.372274 26273 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.368171 26488 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:49.394248 24668 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:49.380157 26557 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.375351 26314 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.389159 26604 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.389799 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.388756 26309 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.412461 24595 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:49.416899 26391 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.402591 26580 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:49.393903 26592 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.420503 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.460158 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.449800 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.405364 26488 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:49.453811 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.384289 26534 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.413889 26300 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.371769 26618 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.434090 26608 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.451393 26309 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.435817 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.433458 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.416417 26590 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:08:49.466355 26488 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.400497 26619 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.427047 26314 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:08:49.489439 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.476526 24665 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:08:49.496764 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 69318.9us
I20260709 13:08:49.409591 26273 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:49.478127 26534 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:49.477315 26569 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.509311 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.416106 26557 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.496412 26618 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.498353 26611 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.475710 26300 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.496039 24666 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 1.
I20260709 13:08:49.508667 26489 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.527923 24669 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:49.545679 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 122500us
I20260709 13:08:49.482442 26623 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:08:49.523056 26626 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.564368 26634 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:49.566294 26634 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:49.527491 26557 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:49.549774 26611 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.561977 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:49.610409 26630 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:08:49.610289 26631 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:49.611094 26619 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.611223 26633 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:49.558068 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.661834 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:49.663360 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:49.568343 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 93081.1us
I20260709 13:08:49.550264 26628 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:49.559175 26531 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.685s	user 0.007s	sys 0.005s
I20260709 13:08:49.635054 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.636370 26273 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:49.682916 26567 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:49.622475 26551 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 2.455s	user 0.024s	sys 0.033s
W20260709 13:08:49.642201 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 144795us
I20260709 13:08:49.690316 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:49.645922 26604 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.553542 26489 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.650715 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:49.699354 24668 raft_consensus.cc:2376] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4. Re-sending same reply.
W20260709 13:08:49.641669 26615 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:49.562827 26629 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:08:49.684983 26567 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.656415 26300 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.657380 25216 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:49.654525 26529 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.656767 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.660153 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.676748 26309 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.660424 26592 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.584000 26593 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.675423 26416 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.562042 26314 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
W20260709 13:08:49.675740 25212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 519) took 1822 ms (client timeout 1764 ms). Trace:
I20260709 13:08:49.677058 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:49.719856 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 259761us
I20260709 13:08:49.677357 24665 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:49.678906 26417 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.679874 25214 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 2 LEARNER]: Advancing to term 3
I20260709 13:08:49.731050 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.680078 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:49.678951 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:49.582571 26603 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.690955 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.700362 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:49.561929 26580 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:08:49.751339 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.702171 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.705299 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.644555 26415 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.710601 26311 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.645555 26611 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.720918 25218 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:49.721678 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:08:49.726198 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.670529 26633 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.653553 26631 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.696869 26501 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.795356 26628 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:49.717270 26567 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:08:49.731729 24668 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:49.796486 26611 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.716477 26578 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:49.797317 26578 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:49.797752 26578 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.798810 26631 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.800604 25210 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:49.710852 26568 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:08:49.689599 26531 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:49.787910 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 66320us
I20260709 13:08:49.828423 26531 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.829519 24524 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 8: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:49.830662 26309 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:49.831853 26391 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.833050 26578 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.835161 26633 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.835345 25219 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:49.838313 26578 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.790035 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.841068 24600 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:49.841856 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:49.842072 26415 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:49.842398 24600 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.844228 24665 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:49.847178 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:49.847796 24595 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.790817 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.719646 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.854379 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.855611 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:49.856153 24592 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.749747 26637 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:49.857115 25216 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:49.857585 26489 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.857365 26637 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.858350 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:49.859064 25216 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.802030 25210 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:49.860196 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 350) took 3165 ms. Trace:
I20260709 13:08:49.826234 26580 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.860574 24597 rpcz_store.cc:276] 0709 13:08:46.623152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.845498 (+222346us) service_pool.cc:224] Handling call
0709 13:08:46.845797 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.855513 (+  9716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.855558 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.863289 (+  7731us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.972490 (+109201us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:46.972535 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.972599 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.473715 (+2501116us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:08:49.764183 (+290468us) raft_consensus.cc:1685] finished
0709 13:08:49.764214 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.788955 (+ 24741us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":13655,"spinlock_wait_cycles":18322304,"thread_start_us":60017,"threads_started":1,"wal-append.queue_time_us":224333}
I20260709 13:08:49.881729 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.882498 24597 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:08:49.758443 26604 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:49.753211 26529 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:49.720417 25212 rpcz_store.cc:269] 0709 13:08:47.853389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.869432 (+ 16043us) service_pool.cc:224] Handling call
0709 13:08:49.675538 (+1806106us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b540007bcd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:49.675666 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279278336}
W20260709 13:08:49.891288 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 186077us
I20260709 13:08:49.859678 26637 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:49.766762 25215 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:49.892292 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 190218us
I20260709 13:08:49.902370 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.903417 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.903965 24519 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:49.893704 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.894102 25216 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:08:49.907094 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:49.885358 25214 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:49.756580 26270 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:49.896557 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 196265us
I20260709 13:08:49.909186 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.910020 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:49.899976 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:49.911550 24523 raft_consensus.cc:2376] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5. Re-sending same reply.
I20260709 13:08:49.912202 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.912652 24523 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:49.895388 24600 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:49.919307 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:49.895596 26416 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.895418 26611 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:49.803071 26311 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:49.931753 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:49.949918 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:49.935824 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:49.763406 26643 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.173s
I20260709 13:08:49.909051 26637 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.915450 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.966809 24595 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:49.922227 26613 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.916328 26489 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.927891 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.921969 26581 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:49.953019 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:49.982481 24596 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:49.945168 26631 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.983757 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:49.984814 24520 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:49.968456 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.947302 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:49.918609 26534 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:08:49.987943 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:49.994303 24597 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:49.990651 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 366) took 1186 ms. Trace:
I20260709 13:08:49.995395 24600 rpcz_store.cc:276] 0709 13:08:48.804428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.989636 (+1185208us) service_pool.cc:224] Handling call
0709 13:08:49.990019 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.990242 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.990280 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.990340 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:49.990388 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.990454 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.990580 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:49.958456 26572 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:50.004441 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 141473us
I20260709 13:08:49.970840 26611 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:50.014542 24525 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:50.014747 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:49.997311 26603 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:49.993793 26648 raft_consensus.cc:2764] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:50.001005 26572 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.002967 26531 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:50.001775 26581 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:50.007786 26568 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.992316 26488 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:49.997582 26489 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.082836 26581 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.055567 26649 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:50.060690 26572 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.057803 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:50.045709 26603 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:50.044929 26567 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:08:50.115484 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 107090us
I20260709 13:08:49.987427 26613 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.108126 26649 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:50.071832 26531 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.113962 26603 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.133213 26311 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:50.137071 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.137770 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.135581 26650 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:08:50.089749 26568 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.156761 25212 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:50.184449 26567 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:50.185197 26567 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.187368 26567 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.189774 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 365) took 1385 ms. Trace:
I20260709 13:08:50.190198 24592 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:50.191066 26629 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:50.199440 24597 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:50.206490 24598 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:50.210671 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1232) took 1093 ms. Trace:
I20260709 13:08:50.211187 24598 rpcz_store.cc:276] 0709 13:08:49.117027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.678694 (+561667us) service_pool.cc:224] Handling call
0709 13:08:50.210593 (+531899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.151665 26534 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.214776 26531 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.216796 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:50.202451 26270 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:50.119000 26611 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.220626 24593 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:50.231256 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1231) took 1114 ms. Trace:
I20260709 13:08:50.279408 24598 rpcz_store.cc:276] 0709 13:08:49.116737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.230416 (+1113679us) service_pool.cc:224] Handling call
0709 13:08:50.230732 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.230906 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.230935 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.230986 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:50.231019 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.231075 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.231189 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.225221 26346 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:50.279217 26648 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.279553 26567 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.224032 26534 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.279352 26397 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:50.285390 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:50.331190 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1230) took 1214 ms. Trace:
I20260709 13:08:50.344616 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 367) took 1539 ms. Trace:
I20260709 13:08:50.345000 24592 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:50.294193 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 364) took 1487 ms. Trace:
I20260709 13:08:50.290700 26531 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:50.190261 24591 rpcz_store.cc:276] 0709 13:08:48.804121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.188741 (+1384620us) service_pool.cc:224] Handling call
0709 13:08:50.189132 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.189348 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.189421 (+    73us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.189473 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:50.189517 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.189582 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.189706 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.344278 24600 rpcz_store.cc:276] 0709 13:08:49.116428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.002117 (+885689us) service_pool.cc:224] Handling call
0709 13:08:50.002472 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.002711 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:50.212600 (+209889us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.330846 (+118246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.330896 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:50.330938 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.331005 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.331134 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3483,"prepare.queue_time_us":291892,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":92,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4948,"thread_start_us":275100,"threads_started":2}
I20260709 13:08:50.228785 26649 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.332274 26488 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:50.346046 26415 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:50.330319 26567 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.341115 26489 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:50.297600 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:50.336951 26613 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:50.386137 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:50.389029 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:50.389446 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:50.390672 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:50.391350 26643 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.391968 26643 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.392198 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:50.392529 26545 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.392467 26643 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.393113 26545 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.394868 26643 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:50.395097 26545 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:50.341629 26397 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.397044 26397 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:50.347060 24593 rpcz_store.cc:276] 0709 13:08:48.803798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.162427 (+1358629us) service_pool.cc:224] Handling call
0709 13:08:50.162967 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.281349 (+118382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.291371 (+ 10022us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.396822 26391 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:50.358626 26567 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.360280 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:50.361268 24674 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:50.362076 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:50.365110 26415 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:50.366643 26659 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:08:50.368448 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 330) took 1903 ms. Trace:
W20260709 13:08:50.369801 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.370898 26633 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:50.371733 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:50.374119 26592 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:50.374876 26283 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.353868 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:50.383960 24598 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:50.426513 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1233) took 1309 ms. Trace:
I20260709 13:08:50.426909 24598 rpcz_store.cc:276] 0709 13:08:49.117562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.282743 (+1165181us) service_pool.cc:224] Handling call
0709 13:08:50.383564 (+100821us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:50.383768 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.426260 (+ 42492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.426459 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7575936}
I20260709 13:08:50.350513 26531 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.385999 26534 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:50.397907 25217 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:50.329028 26648 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:50.406394 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44382.4us
I20260709 13:08:50.405035 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:50.408986 24667 rpcz_store.cc:276] 0709 13:08:48.465193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.819572 (+354379us) service_pool.cc:224] Handling call
0709 13:08:48.820024 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.824200 (+  4176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.824244 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.844020 (+ 19776us) log.cc:844] Serialized 26 byte log entry
0709 13:08:50.201525 (+1357505us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b18002d8f80. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:08:50.223840 (+ 22315us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:50.223907 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.224105 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.368162 (+144057us) raft_consensus.cc:1685] finished
0709 13:08:50.368182 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.368381 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3645,"raft.queue_time_us":4304,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":11446,"spinlock_wait_cycles":18833664,"thread_start_us":22011,"threads_started":1,"wal-append.queue_time_us":1497827}
I20260709 13:08:50.422741 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:50.406790 26545 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.437507 24593 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:08:50.437676 25217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:08:50.437780 26545 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.438489 25217 raft_consensus.cc:606] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:50.439430 26531 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.439704 25217 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:50.439872 26545 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:50.435823 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:50.411926 26633 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:50.440694 24598 raft_consensus.cc:2376] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5. Re-sending same reply.
I20260709 13:08:50.408381 26568 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:50.405265 26391 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:50.402536 26645 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:50.441308 24671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 324) took 1978 ms (client timeout 1738 ms). Trace:
I20260709 13:08:50.441572 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:50.454349 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:50.445809 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 343) took 1200 ms. Trace:
I20260709 13:08:50.456429 24524 rpcz_store.cc:276] 0709 13:08:49.245565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.254287 (+  8722us) service_pool.cc:224] Handling call
0709 13:08:50.445591 (+1191304us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54000dcad4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:50.445738 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299678080}
W20260709 13:08:50.457840 24671 rpcz_store.cc:269] 0709 13:08:48.462867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.466742 (+  3875us) service_pool.cc:224] Handling call
0709 13:08:50.441171 (+1974429us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54001388d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:50.441253 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853006080}
I20260709 13:08:50.412057 26397 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:50.446647 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:50.453142 24591 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:08:50.450771 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45808.6us
I20260709 13:08:50.474742 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:50.469475 26397 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.422185 26643 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:08:50.484314 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:50.487186 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:50.442485 26520 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:50.472473 26662 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:50.470486 26642 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:50.499046 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:50.425786 26544 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:08:50.502897 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 371) took 1248 ms. Trace:
I20260709 13:08:50.511996 24599 rpcz_store.cc:276] 0709 13:08:49.254690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.501934 (+1247244us) service_pool.cc:224] Handling call
0709 13:08:50.502306 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.502514 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.502538 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.502601 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:50.502629 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.502678 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.502795 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.440729 26545 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.472577 26641 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:50.444808 24518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1339) took 2159 ms (client timeout 2166 ms). Trace:
I20260709 13:08:50.496120 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1235) took 1374 ms. Trace:
I20260709 13:08:50.510142 26569 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:50.493978 26397 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:50.520233 26417 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.779s	user 0.008s	sys 0.004s
I20260709 13:08:50.517158 26641 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:50.543013 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44079.3us
I20260709 13:08:50.500177 26607 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:08:50.517944 26643 consensus_queue.cc:1243] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:50.521240 26642 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:50.441407 26633 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:50.519568 24518 rpcz_store.cc:269] 0709 13:08:48.285045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.464473 (+179428us) service_pool.cc:224] Handling call
0709 13:08:48.478940 (+ 14467us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:50.444586 (+1965646us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b540018a954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:50.444734 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48649856}
I20260709 13:08:50.555873 26672 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:50.556296 26672 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:50.518965 26572 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.544900 26417 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.564824 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1104) took 1193 ms. Trace:
I20260709 13:08:50.565336 24593 rpcz_store.cc:276] 0709 13:08:49.371064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.543021 (+1171957us) service_pool.cc:224] Handling call
0709 13:08:50.554440 (+ 11419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.564346 (+  9906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.564384 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.564457 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:50.564527 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.564626 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.564755 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.566075 26648 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.516631 26391 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.546380 26670 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:50.546146 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:50.517725 26545 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.557143 26672 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.533121 24591 rpcz_store.cc:276] 0709 13:08:49.118168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.351845 (+1233677us) service_pool.cc:224] Handling call
0709 13:08:50.407747 (+ 55902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.472009 (+ 64262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.492368 (+ 20359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:50.738090 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 369) took 1932 ms. Trace:
I20260709 13:08:50.735780 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2452) took 1328 ms. Trace:
I20260709 13:08:50.736479 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 525) took 1529 ms. Trace:
I20260709 13:08:50.739933 24597 rpcz_store.cc:276] 0709 13:08:48.805447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.995120 (+1189673us) service_pool.cc:224] Handling call
0709 13:08:50.199155 (+204035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.200072 (+   917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.737919 (+537847us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400193cd0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:50.738035 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432358272}
I20260709 13:08:50.740052 24669 rpcz_store.cc:276] 0709 13:08:49.407828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.407987 (+   159us) service_pool.cc:224] Handling call
0709 13:08:49.408358 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.528302 (+119944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.735519 (+1207217us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400404a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:50.735713 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274173824}
I20260709 13:08:50.740446 25219 rpcz_store.cc:276] 0709 13:08:49.207142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.718148 (+511006us) service_pool.cc:224] Handling call
0709 13:08:49.718407 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.835894 (+117487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.736254 (+900360us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54004ee3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:50.736421 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268451200}
W20260709 13:08:50.668253 26667 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:08:50.737417 26633 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.615718 26649 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.566780 24593 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:50.748543 24599 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:50.734127 26501 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.749630 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:50.664755 26485 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.753537 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 178869us
W20260709 13:08:50.755456 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.567191 26642 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.185s
I20260709 13:08:50.753118 24666 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:50.628351 26603 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.750485 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:50.751699 26672 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.743772 26645 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:08:50.760555 26671 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.764875 26671 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.745347 26670 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.703161 26641 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.758571 26643 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:50.780150 24598 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:50.752880 26649 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:50.783399 25213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 528) took 1550 ms (client timeout 1683 ms). Trace:
W20260709 13:08:50.793180 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.793788 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:50.793866 24597 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:50.794078 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:50.810722 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.810699 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:50.847322 24519 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
W20260709 13:08:50.845674 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56827.2us
W20260709 13:08:50.847048 25213 rpcz_store.cc:269] 0709 13:08:49.232530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.234175 (+  1645us) service_pool.cc:224] Handling call
0709 13:08:50.783160 (+1548985us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b54006e46d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:50.783325 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11258624}
W20260709 13:08:50.844553 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 352992us
I20260709 13:08:50.762292 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1105) took 1387 ms. Trace:
I20260709 13:08:50.791136 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:50.760942 26485 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:50.782956 26624 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.312s	user 0.003s	sys 0.000s
W20260709 13:08:50.784319 26674 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:08:50.794665 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:50.794373 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:50.945962 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:50.946725 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:50.955669 25213 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:50.785765 25211 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:50.948009 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.793494 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:50.795207 26671 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.818784 26641 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.981119 26225 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.981998 26225 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:50.986248 26225 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:50.947233 26208 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.027442 24522 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:50.781013 26643 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.025964 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:08:51.024266 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 58738.4us
I20260709 13:08:51.039184 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:51.026084 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 175278us
I20260709 13:08:51.040393 24597 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:50.942543 26501 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:08:51.034762 26225 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.963003 26676 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:51.021633 24521 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:51.023679 26671 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.023427 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:50.993784 26572 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.066442 26677 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.066671 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:51.066995 26677 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.068336 26670 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.071417 26649 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.063443 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.058807 26225 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.068451 24521 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:51.045758 26480 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.061173 26676 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.084424 26676 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.086380 26225 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.087409 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1106) took 1257 ms. Trace:
I20260709 13:08:51.077162 26677 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.087807 24591 rpcz_store.cc:276] 0709 13:08:49.829543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.750058 (+920515us) service_pool.cc:224] Handling call
0709 13:08:50.752542 (+  2484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.775655 (+ 23113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.777069 (+  1414us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:50.795622 (+ 18553us) log.cc:844] Serialized 26 byte log entry
0709 13:08:50.960089 (+164467us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:50.969682 (+  9593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.023014 (+ 53332us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.074223 (+ 51209us) raft_consensus.cc:1685] finished
0709 13:08:51.076746 (+  2523us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.087343 (+ 10597us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4548,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":4999,"thread_start_us":151552,"threads_started":1,"wal-append.queue_time_us":256635}
I20260709 13:08:51.092460 26391 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.094619 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1240) took 1938 ms. Trace:
I20260709 13:08:51.095048 24598 rpcz_store.cc:276] 0709 13:08:49.156316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.455351 (+1299035us) service_pool.cc:224] Handling call
0709 13:08:50.455682 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.780753 (+325071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.094318 (+313565us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b540032c154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:51.094543 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745580800}
I20260709 13:08:51.096685 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 895) took 1954 ms. Trace:
I20260709 13:08:51.097199 25215 rpcz_store.cc:276] 0709 13:08:49.141900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.342013 (+200113us) service_pool.cc:224] Handling call
0709 13:08:49.385186 (+ 43173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.913589 (+528403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.096414 (+1182825us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400680e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:51.096614 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789890304}
I20260709 13:08:51.098953 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.099261 26608 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:51.099591 24597 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:51.100123 26608 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:51.100472 26608 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:51.101478 26608 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.102752 26608 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:51.082664 26678 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:08:51.140113 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.141309 25214 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 2: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:51.144761 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.040880 26520 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:51.152935 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.154368 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.155045 25214 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:51.156003 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.156689 25214 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:51.042045 26208 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.161988 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:51.162202 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.171121 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:51.172556 26677 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.173228 26545 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.173825 26545 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:51.173758 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:51.175402 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:51.176474 26676 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:51.176915 26676 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:51.075950 26671 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.177884 25215 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:51.177733 26676 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.178426 26643 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:50.949612 24593 rpcz_store.cc:276] 0709 13:08:49.375061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.566286 (+1191225us) service_pool.cc:224] Handling call
0709 13:08:50.566596 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.753457 (+186861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.762180 (+  8723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:51.178669 26671 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.144083 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:51.185719 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 139069us
I20260709 13:08:51.188735 24524 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:08:51.191555 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:51.202839 26685 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:51.225114 26569 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.225504 26569 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.198589 24517 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:51.225829 26569 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:51.228734 26397 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.002s
I20260709 13:08:51.229188 26397 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:51.202076 26649 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:08:51.193809 24524 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:51.194979 25219 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:51.197983 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.178975 26643 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:51.232637 26643 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.233004 26643 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.233572 26485 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.179620 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.237389 24518 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:51.205780 26545 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.206521 26686 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.241395 26686 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:51.241888 26545 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.243274 24672 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:51.243474 26686 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:51.207772 26501 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.243887 26545 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.244036 26501 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.244359 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:51.211902 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.212212 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.214032 26672 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.200671 26603 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.197415 26311 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.247886 24597 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:51.180075 26677 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.244982 24666 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:51.246937 26685 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:51.290210 26685 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:50.345216 24595 rpcz_store.cc:276] 0709 13:08:48.804748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.991878 (+1187130us) service_pool.cc:224] Handling call
0709 13:08:49.992245 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.992489 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:50.123911 (+131422us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.331460 (+207549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:50.331531 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:50.331597 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.344367 (+ 12770us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.344540 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":294073,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":106,"raft.run_wall_time_us":3470,"spinlock_wait_cycles":15916800,"thread_start_us":323385,"threads_started":2}
I20260709 13:08:51.302933 26677 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.295156 24592 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:08:51.314544 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 270803us
I20260709 13:08:51.268271 26397 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.268420 26270 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.318380 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:51.344075 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.255916 26672 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.243216 26208 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:51.313979 26685 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:51.390282 26346 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.324643 26579 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:51.398121 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 79867.9us
I20260709 13:08:51.399533 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:51.400501 24669 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.378348 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:51.324986 26571 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.408675 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.408368 26545 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.410142 26545 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.398524 26346 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.413997 26346 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.414866 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1234) took 2297 ms. Trace:
I20260709 13:08:51.415210 24600 rpcz_store.cc:276] 0709 13:08:49.117866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.349123 (+1231257us) service_pool.cc:224] Handling call
0709 13:08:51.414220 (+1065097us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:51.414412 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.414574 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.414609 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:51.414646 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:51.414676 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.414723 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.414815 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6587264}
W20260709 13:08:51.417539 25218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 892) took 2291 ms (client timeout 2994 ms). Trace:
I20260709 13:08:51.418198 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.419173 24600 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:51.419966 26544 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:51.420380 26544 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:08:51.421561 26684 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:08:51.421300 26544 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.404328 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:51.423487 26579 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:51.425261 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:51.426914 26672 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.427266 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:51.428001 24524 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.432703 26415 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.436749 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 332) took 3205 ms. Trace:
I20260709 13:08:51.437417 26501 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.438283 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.398857 26670 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.439039 24594 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:51.439523 26670 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.436589 24524 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:51.444309 24520 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:51.425493 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1242) took 2265 ms. Trace:
W20260709 13:08:51.417927 25218 rpcz_store.cc:269] 0709 13:08:49.125822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.164084 (+ 38262us) service_pool.cc:224] Handling call
0709 13:08:51.417326 (+2253242us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54005d0f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:51.417459 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152053120}
I20260709 13:08:51.437207 24522 rpcz_store.cc:276] 0709 13:08:48.230877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.482690 (+251813us) service_pool.cc:224] Handling call
0709 13:08:50.445186 (+1962496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.028203 (+583017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.237869 (+209666us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b540018a954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:51.436542 (+198673us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b540018a950. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:51.436662 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5850793088}
I20260709 13:08:51.444710 24596 rpcz_store.cc:276] 0709 13:08:49.160197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.769642 (+609445us) service_pool.cc:224] Handling call
0709 13:08:51.425319 (+1655677us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001937d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:51.425434 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296606976}
I20260709 13:08:51.326627 26270 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.441378 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:51.410534 26545 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.410429 26686 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:51.464545 24669 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:51.457960 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:51.468866 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.386794 26643 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:51.441579 26670 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.478639 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:51.482561 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.483089 24669 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:51.484004 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:51.481431 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 290123us
I20260709 13:08:51.471722 26415 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:08:51.486191 26691 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:51.486506 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:51.486714 26691 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:51.487215 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:51.487732 26691 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.488763 26225 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.489220 26225 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:51.489604 26225 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.490653 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.492424 26689 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.492792 26689 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.493018 26643 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:51.493116 26689 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.493294 26407 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:51.474602 24670 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:51.495200 26407 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:51.495579 26407 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:51.496639 26270 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.496323 26407 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.497762 24596 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:51.498140 24596 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:51.411118 26571 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:51.500378 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.500494 24594 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:51.499280 24596 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.501363 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:51.501823 24596 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:51.501983 24591 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.477469 26686 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:51.487347 26579 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:51.507884 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:51.504065 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.452701 26569 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.513139 24671 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.500177 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:51.514969 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.535346 24594 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:51.516093 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1244) took 2219 ms. Trace:
I20260709 13:08:51.536193 24599 rpcz_store.cc:276] 0709 13:08:49.296372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.513738 (+1217366us) service_pool.cc:224] Handling call
0709 13:08:50.516113 (+  2375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.752499 (+236386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.515758 (+763259us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54003e8854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:51.516014 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533938432}
I20260709 13:08:51.537637 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.516443 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.520246 26643 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.520077 26480 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:51.478400 26695 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:51.522830 24596 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:08:51.517992 26270 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:08:51.526326 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.526187 26590 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:51.526216 26416 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:51.532543 26225 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.527721 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:51.528369 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:51.588392 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:51.589041 24672 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:51.529141 26633 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.000s
I20260709 13:08:51.530154 26311 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:51.533067 26571 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.539618 24596 pending_rounds.cc:85] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 7
I20260709 13:08:51.597338 24596 pending_rounds.cc:107] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:08:51.597611 24596 raft_consensus.cc:2889] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:51.518828 26485 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 13:08:51.588917 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 60602.7us
I20260709 13:08:51.600412 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:51.600998 24520 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.589639 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:51.529938 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:51.504082 26686 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:51.548868 26671 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.606217 24672 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
W20260709 13:08:51.592947 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.613310 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.543130 26695 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.616801 24671 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:51.625627 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.626161 24671 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:51.621361 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.550205 26416 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:51.602418 26397 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.624622 26633 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.637987 26648 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:51.677313 26633 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.677495 26648 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:51.677721 26633 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.678380 26648 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:51.679392 26648 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.627861 26671 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:51.681915 26485 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:51.682524 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.682435 26485 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.682932 26671 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:51.638549 26397 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.683826 26397 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.684619 26485 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:51.685174 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.634816 26311 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.686256 26311 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:51.688163 26311 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.689147 26545 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.689627 26225 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:51.691210 26545 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.587594 26643 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.692939 26643 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.694579 24668 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:51.695196 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:51.695974 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.648552 24520 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:51.630506 26692 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:51.697412 26692 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:51.651607 26707 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:51.698344 26707 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.676215 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:51.699481 26692 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.699795 24669 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:51.700284 26707 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:51.700240 26416 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.701372 26416 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.630733 26695 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.706383 24674 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:51.707590 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.708107 24674 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:08:51.633490 24593 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:51.697687 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.710041 24520 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:51.649421 26706 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.710745 26706 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.711107 26706 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.711290 26689 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.713974 26569 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.714035 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.714946 24666 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:08:51.715758 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.715866 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.717628 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.717672 24517 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:51.723208 26391 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.723742 26391 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.723847 24591 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:08:51.724248 26391 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:51.728932 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 894) took 2590 ms. Trace:
I20260709 13:08:51.729749 26689 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:51.731249 24671 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:51.734162 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.735004 24668 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:51.708837 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.736620 24674 raft_consensus.cc:2410] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:51.737510 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2347) took 4153 ms. Trace:
W20260709 13:08:51.736536 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 208874us
I20260709 13:08:51.738040 24525 rpcz_store.cc:276] 0709 13:08:47.583659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.479192 (+895533us) service_pool.cc:224] Handling call
0709 13:08:48.479472 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.015020 (+1535548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.737277 (+1722257us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54003ae8d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:51.737444 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3529889024}
I20260709 13:08:51.747092 24669 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:51.758692 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:08:51.884259 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.764534 24668 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:08:51.870718 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47617.5us
I20260709 13:08:51.889533 24674 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:51.864720 24519 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:51.812789 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.826748 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 104742us
I20260709 13:08:51.894667 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:51.827435 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.890472 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.896116 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:51.896311 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.896996 24600 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
W20260709 13:08:51.897887 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.896351 24520 raft_consensus.cc:2410] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:08:51.888641 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 388506us
I20260709 13:08:51.898717 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.894062 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.899581 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:51.899778 24595 raft_consensus.cc:2376] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4. Re-sending same reply.
I20260709 13:08:51.901887 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:51.899732 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.925026 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.789114 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.930478 24668 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:51.931355 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.931986 24668 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:51.932611 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.933522 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.934056 24668 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:51.934787 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.934829 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:51.935465 24668 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:51.932981 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:51.936573 24520 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.865841 26643 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:51.806228 26416 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.903154 26311 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:51.863920 24670 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:51.765148 26671 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:51.923372 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:51.871904 26544 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:51.932924 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:51.938345 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:51.939711 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.927084 24672 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:51.941236 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:52.017871 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 85029.5us
I20260709 13:08:52.018215 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:52.018646 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 77478.7us
I20260709 13:08:52.019279 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.019810 24524 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:51.864940 26569 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:51.882295 26579 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:51.812299 26708 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:51.936184 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.948289 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:51.865746 26688 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:51.729524 25211 rpcz_store.cc:276] 0709 13:08:49.138390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.286567 (+148177us) service_pool.cc:224] Handling call
0709 13:08:50.785454 (+1498887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.969438 (+183984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.728650 (+759212us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54006e46d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:51.728830 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3446235520}
I20260709 13:08:51.811954 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:51.898417 26612 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.903265 26697 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:51.902968 26677 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:51.952554 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56960us
I20260709 13:08:51.954376 26643 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:51.925181 26603 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:51.904731 26689 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:51.891278 26520 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:51.948443 26571 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:51.863766 26695 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.021579 26417 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:52.025794 26569 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.009207 26671 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:51.954139 26311 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.023696 26545 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:51.925175 26314 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:08:52.017334 26619 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:08:51.767590 26397 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.019588 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.067859 24597 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
W20260709 13:08:51.865617 24592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1253) took 1569 ms (client timeout 1552 ms). Trace:
W20260709 13:08:52.055619 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 93574.2us
W20260709 13:08:52.068687 24592 rpcz_store.cc:269] 0709 13:08:50.328961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.345907 (+ 16946us) service_pool.cc:224] Handling call
0709 13:08:51.865303 (+1519396us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540025e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:51.865525 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862921472}
I20260709 13:08:52.055401 26689 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:52.070526 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51968.9us
I20260709 13:08:52.055949 26520 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.071756 26689 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.020799 24524 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:52.072249 24522 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:52.073216 26520 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.074550 24524 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:52.021025 24520 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:52.010145 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:52.026217 24668 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:52.028982 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:51.999230 26415 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:52.025312 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.948632 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:52.060580 25217 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:52.066767 24596 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:52.091269 24672 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:52.062355 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:52.079280 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:51.941908 26705 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
W20260709 13:08:52.039467 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.099005 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.955186 26416 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.032694 26688 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:52.052874 26645 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:51.928678 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.058723 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.058919 24673 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:52.059609 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.113579 25219 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:08:52.086431 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 90727.5us
I20260709 13:08:52.064998 26311 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:52.125566 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.060916 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.093161 24674 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:52.092973 24672 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:08:52.126737 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 65893.7us
W20260709 13:08:52.099502 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 70608.6us
I20260709 13:08:52.127707 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.129012 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:52.090205 24421 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 343) took 7436 ms. Trace:
W20260709 13:08:52.106083 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 175774us
I20260709 13:08:52.107504 24671 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:52.109963 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47755.6us
I20260709 13:08:52.055231 26603 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.057889 26407 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.112939 24519 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:52.087218 24668 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:52.061221 24521 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:52.115301 26653 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.110805 26270 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:08:52.066346 26643 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.105635 26648 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.057261 26571 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:52.143584 26314 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:52.160851 26571 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.064944 26697 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.161659 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.162899 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.163161 26697 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:52.163971 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.058818 26612 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.142204 26603 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.130046 24421 rpcz_store.cc:276] 0709 13:08:44.653567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.653778 (+   211us) service_pool.cc:224] Handling call
0709 13:08:52.090144 (+7436366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:49.006495 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.010275 (+  3780us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.010334 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:08:49.010362 (+    28us) tablet.cc:662] Decoding operations
0709 13:08:49.050645 (+ 40283us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.050747 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.050799 (+    52us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:49.051531 (+   732us) tablet.cc:701] Row locks acquired
0709 13:08:49.051558 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:08:49.051776 (+   218us) write_op.cc:270] Start()
0709 13:08:49.051933 (+   157us) write_op.cc:276] Timestamp: P: 1783602529051697 usec, L: 0
0709 13:08:49.051965 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.052865 (+   900us) log.cc:844] Serialized 2481 byte log entry
0709 13:08:49.276127 (+223262us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.460480 (+184353us) write_op.cc:301] APPLY: starting
0709 13:08:49.467791 (+  7311us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.496153 (+ 28362us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.504728 (+  8575us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.527005 (+ 22277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.527197 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:08:49.527236 (+    39us) write_op.cc:312] APPLY: finished
0709 13:08:49.527466 (+   230us) log.cc:844] Serialized 53 byte log entry
0709 13:08:49.556521 (+ 29055us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.559458 (+  2937us) write_op.cc:454] Released schema lock
0709 13:08:49.561805 (+  2347us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:49.582088 (+ 20283us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.601464 (+ 19376us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":139928,"apply.run_cpu_time_us":4089,"apply.run_wall_time_us":132704,"num_ops":6,"prepare.queue_time_us":359026,"prepare.run_cpu_time_us":6350,"prepare.run_wall_time_us":105310,"raft.queue_time_us":125969,"raft.run_cpu_time_us":8744,"raft.run_wall_time_us":159146,"replication_time_us":202498,"thread_start_us":364280,"threads_started":4,"wal-append.queue_time_us":53846,"wal-append.run_cpu_time_us":25192,"wal-append.run_wall_time_us":1609626}]]}
I20260709 13:08:52.066596 26545 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:52.191762 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.060027 26695 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.063486 26569 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.119107 26397 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.063011 26671 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.061667 26691 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:08:52.154776 26653 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.035172 26633 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.057473 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2364) took 1264 ms. Trace:
W20260709 13:08:52.201476 26714 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:08:52.201614 24516 rpcz_store.cc:276] 0709 13:08:50.796568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.053802 (+257234us) service_pool.cc:224] Handling call
0709 13:08:51.811756 (+757954us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21e9c 00007f17b8e21a5b 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:52.057388 (+245632us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2979712}
I20260709 13:08:52.202975 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.204319 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.064761 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.206331 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.207458 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.208549 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.143496 26722 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:52.209960 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.210562 24525 raft_consensus.cc:2376] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3. Re-sending same reply.
I20260709 13:08:52.211385 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.200635 26311 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.212297 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.213500 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.213727 26311 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.094568 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:52.217198 26653 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.054935 26677 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:52.218609 26677 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:52.088042 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 68575.3us
I20260709 13:08:52.133191 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:52.193975 26545 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.224704 26311 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:52.224838 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 91756.5us
I20260709 13:08:52.225625 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.226512 26311 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:52.226984 26311 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:52.138728 24523 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:08:52.227557 24523 pending_rounds.cc:85] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 5
I20260709 13:08:52.227769 24523 pending_rounds.cc:107] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:08:52.227982 24523 raft_consensus.cc:2889] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:52.228873 26633 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:52.212836 24667 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:52.229591 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:52.139219 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.139901 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.232630 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.127806 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:52.233389 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 105652us
I20260709 13:08:52.142287 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.150226 26391 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.152148 26416 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.152841 26640 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:52.059166 26579 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.101883 26415 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:52.154004 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.159917 26688 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.160367 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2363) took 1367 ms. Trace:
I20260709 13:08:52.090524 26417 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:52.153674 26712 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:52.165062 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.035835 26708 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.270695 26633 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:52.272221 26708 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:52.107975 26645 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:52.272984 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.273204 26645 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.197567 26612 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:52.274324 26645 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.274884 26225 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:52.167259 26648 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:52.275665 26648 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.275770 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.226934 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:08:52.277658 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 50823.1us
I20260709 13:08:52.278967 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.116225 24423 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 3, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:52.234493 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:52.281498 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47095.5us
I20260709 13:08:52.281674 26569 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:52.282361 26569 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:52.281875 24423 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 3, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.283074 26569 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:52.283274 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.283468 26569 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:52.283844 26569 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.284405 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.240060 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.285228 26619 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:52.285975 26592 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:52.286540 26592 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:52.286870 26314 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:52.287388 26314 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:52.287437 26641 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:52.287593 26709 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.288225 26709 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.276863 26689 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:08:52.289831 26689 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:52.290182 26689 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:52.290575 26709 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:52.287460 26592 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.236406 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.237375 24524 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
W20260709 13:08:52.270136 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.294703 24523 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:52.264427 26397 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.204949 24516 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:52.297818 26397 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.300031 26397 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.288256 26314 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.300519 26397 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:52.300963 26314 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.286942 26711 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.301693 26711 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.302070 26711 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.264976 24519 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:08:52.295022 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.200820 26706 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.308692 26720 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:08:52.321235 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.321684 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 234333us
I20260709 13:08:52.242581 26391 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.238883 26640 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:52.232090 26571 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.310487 26415 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.300866 26397 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:08:52.342393 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.343843 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.238834 26309 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.264487 26311 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.349655 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.351302 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.263543 24521 rpcz_store.cc:276] 0709 13:08:50.792902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.087963 (+295061us) service_pool.cc:224] Handling call
0709 13:08:52.001033 (+913070us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:52.024188 (+ 23155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.154143 (+129955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.160303 (+  6160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99056512}
I20260709 13:08:52.312215 26689 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.305444 26225 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:52.249917 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:52.320674 26688 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.314621 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.315428 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.359298 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:52.359836 25214 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.360122 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:52.315805 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.361433 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.284206 24423 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 2, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:08:52.341625 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.354452 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.318130 26713 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:08:52.357770 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 107938us
W20260709 13:08:52.251147 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.247747 26691 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:08:52.363497 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.341907 26640 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.362618 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:52.343505 24666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.010s	sys 0.017s
I20260709 13:08:52.364629 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.239202 26705 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:08:52.366958 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:52.367302 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:52.368165 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:52.369762 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:08:52.388752 24666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.011s	sys 0.018s
I20260709 13:08:52.390911 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.391471 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.391996 24525 raft_consensus.cc:2376] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5. Re-sending same reply.
I20260709 13:08:52.393903 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.395028 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.396138 26711 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.373042 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:52.373952 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.398674 25218 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:52.399300 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 360) took 1097 ms. Trace:
I20260709 13:08:52.399415 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:52.400135 25218 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
I20260709 13:08:52.341269 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.403527 25215 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:52.404127 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:52.400327 26416 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:08:52.375839 26571 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:52.362890 26729 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.349249 26309 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.364091 25219 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:52.378738 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:52.380612 26391 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:52.371498 24423 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 3, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:52.385571 24523 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:52.386636 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.388003 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:52.390134 24597 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:52.397298 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:52.401274 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46906.6us
I20260709 13:08:52.401922 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.392019 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.400976 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.399739 24666 rpcz_store.cc:276] 0709 13:08:51.302120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.715475 (+413355us) service_pool.cc:224] Handling call
0709 13:08:51.715748 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.715941 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:51.716208 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.398953 (+682745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.399005 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.399061 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.399132 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.399243 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7658,"prepare.queue_time_us":2285,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":8172,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"thread_start_us":674722,"threads_started":1,"wal-append.queue_time_us":660425}
I20260709 13:08:52.380226 24598 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [4.4-5.5]
I20260709 13:08:52.405463 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.337625 26603 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.342010 26708 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:08:52.342391 26720 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.406781 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.591719 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.615753 26649 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:52.616317 26649 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:52.616726 26649 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:52.617148 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:52.618489 25210 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:52.620348 24673 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:52.621879 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 215144us
I20260709 13:08:52.622468 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:52.622972 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.623081 24672 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
W20260709 13:08:52.570263 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.625029 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.621480 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:52.622684 24524 raft_consensus.cc:2376] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4. Re-sending same reply.
I20260709 13:08:52.627599 24673 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:52.639454 24565 leader_election.cc:400] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
I20260709 13:08:52.639895 24565 leader_election.cc:403] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:08:52.468607 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.645920 24673 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:52.646705 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:52.408895 24667 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:52.652567 25218 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:52.654594 24669 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:52.654452 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.655097 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:52.408331 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:52.471108 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 190407us
W20260709 13:08:52.419713 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.665514 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.666363 26691 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:52.455729 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:52.667110 24592 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:52.402356 26417 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.265s
I20260709 13:08:52.409137 26309 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.505229 26397 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.409188 26728 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:52.544935 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:52.633910 26705 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:52.669605 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.662338 26391 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.670920 26713 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.672659 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:52.414584 25214 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:52.426201 26416 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.680680 25217 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:52.681872 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.626178 26689 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.626037 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.690399 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.651621 26579 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.680040 25212 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
W20260709 13:08:52.697893 26730 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:08:52.700274 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.706323 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:52.706736 24599 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:08:52.710969 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.698652 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.495086 26545 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:52.409281 26729 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:52.716574 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.701704 26713 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.473214 24517 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:52.686337 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:52.734292 26728 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:52.653870 26725 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:08:52.697103 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:52.697459 26671 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:52.743920 26729 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.687088 26722 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:52.710668 26485 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:52.768663 26485 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:52.729022 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.742925 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:52.771068 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.772473 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:52.775035 26706 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:52.750893 26736 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:52.751312 25212 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:52.752200 26545 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:52.776044 26736 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.752737 26603 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.780540 26723 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.752955 25210 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:52.744900 26544 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:52.745038 26713 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.719199 26695 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:52.711858 24670 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:52.754781 26391 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.733742 26579 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.710757 26416 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.755378 26711 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:52.757787 26314 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:08:52.762629 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.715088 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.716842 26641 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:52.735817 26677 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.778079 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.761030 26397 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:52.735378 26653 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.740149 26648 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:52.765179 26571 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.769641 26485 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:52.797926 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 134748us
I20260709 13:08:52.869836 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:08:52.801007 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.870945 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.834960 26520 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:52.822461 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.874723 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.875151 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:52.826090 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:52.876123 24672 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.783783 26545 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:52.777546 24518 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
W20260709 13:08:52.836097 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 121077us
I20260709 13:08:52.789446 26697 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:52.840243 24671 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:52.839359 25219 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:08:52.840245 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62257.2us
I20260709 13:08:52.797484 26722 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.781164 26723 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:52.909551 24672 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:52.833655 26314 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:52.835639 26641 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.835263 26391 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:52.889446 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 173809us
I20260709 13:08:52.890774 24637 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.860229 26695 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:52.868072 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:52.922658 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.833709 26724 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:08:52.874388 26569 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
I20260709 13:08:52.867699 26571 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:52.907759 25219 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:52.923120 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.929337 26545 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.923270 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.877638 26520 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:52.932569 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.929446 26571 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.938782 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:52.940449 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:52.913774 26723 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.911168 26743 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.915792 26720 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:52.921835 26641 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:52.954103 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 78996.1us
W20260709 13:08:52.954855 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 80189.9us
I20260709 13:08:52.915107 26697 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:52.868420 26640 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:52.926033 26695 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.904740 26649 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:52.964464 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.961899 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:52.963848 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:52.965972 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:52.941045 26391 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:52.950397 26711 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:52.958815 26728 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:53.037850 26737 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:08:52.970979 26695 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:52.959559 26744 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:53.043394 26744 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:53.043749 26736 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.044334 26744 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.045610 26744 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.045670 26653 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:53.045953 26416 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:52.931306 26520 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.054853 26520 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.940874 26741 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:52.940405 26569 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:53.037199 26734 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:08:52.978829 26711 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:53.049124 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 75345.3us
I20260709 13:08:52.967976 26545 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:53.049443 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 392) took 1111 ms. Trace:
W20260709 13:08:53.049592 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 74424.4us
W20260709 13:08:53.152944 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.049777 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.049672 26691 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:53.051899 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:53.060202 24516 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.003s
I20260709 13:08:52.956298 26740 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.053903 26579 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:52.967796 26311 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.004s
I20260709 13:08:53.170539 26311 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.165884 26740 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.171648 26740 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.036466 26748 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:53.173507 26748 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:53.173868 26748 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:53.174731 26748 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.176033 26748 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.180121 24665 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:53.172787 26311 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.182619 26697 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:53.196744 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.960891 26743 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.149608 26603 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.148284 25216 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:52.975132 26747 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:52.933447 26742 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:08:53.153702 24600 rpcz_store.cc:276] 0709 13:08:51.937765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.937879 (+   114us) service_pool.cc:224] Handling call
0709 13:08:52.056362 (+118483us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:52.056549 (+   187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.263672 (+207123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.263708 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.319302 (+ 55594us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.685420 (+366118us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.685475 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.685566 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.047448 (+361882us) raft_consensus.cc:1685] finished
0709 13:08:53.049125 (+  1677us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.049380 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4534,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":62,"spinlock_wait_cycles":12065024,"thread_start_us":503049,"threads_started":2,"wal-append.queue_time_us":475742}
W20260709 13:08:53.154102 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.150501 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:53.159955 24523 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:53.053220 26757 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.153337 26711 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.171785 24595 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:53.149971 26736 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:53.206840 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56440.7us
I20260709 13:08:52.986020 26309 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:53.110684 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 149191us
I20260709 13:08:53.166687 24516 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:53.230820 24522 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:08:53.210223 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 277738us
I20260709 13:08:53.213761 26691 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:53.113852 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 149594us
I20260709 13:08:53.232064 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:53.238782 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:53.207505 26757 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.214946 26648 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.255690 25213 raft_consensus.cc:2368] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:53.158996 26391 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.259750 26677 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
I20260709 13:08:53.251861 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:53.218669 26747 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:53.302817 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68470.9us
I20260709 13:08:53.308158 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:53.332437 26720 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:53.328935 26649 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.423115 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:53.222584 26592 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:08:53.327931 26309 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:53.338891 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.331601 26571 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.234088 26691 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:53.437997 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:53.438351 26691 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.438620 26695 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.423895 26747 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.442653 26723 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.423493 26640 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.444754 26723 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.261659 26757 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.249329 26736 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.105s
W20260709 13:08:53.357431 26729 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.005s
I20260709 13:08:53.251791 26728 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:53.308043 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.303251 24600 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:53.223683 26743 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:53.424599 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 172841us
I20260709 13:08:53.423996 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:53.428390 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:53.430234 26720 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:53.477383 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 548) took 1106 ms. Trace:
I20260709 13:08:53.477900 25213 rpcz_store.cc:276] 0709 13:08:52.371230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.390574 (+ 19344us) service_pool.cc:224] Handling call
0709 13:08:53.477166 (+1086592us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54006e3a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:53.477329 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363981056}
I20260709 13:08:53.479699 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:53.480701 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 910) took 1124 ms. Trace:
I20260709 13:08:53.481055 25218 rpcz_store.cc:276] 0709 13:08:52.356407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.667802 (+311395us) service_pool.cc:224] Handling call
0709 13:08:53.479499 (+811697us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:08:53.480636 (+  1137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19315584}
I20260709 13:08:53.430768 26742 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.482281 26736 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:53.482959 26736 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.485128 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:53.485960 24666 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:53.486868 25210 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:53.486972 26729 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.487709 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 546) took 1117 ms. Trace:
I20260709 13:08:53.488144 25210 rpcz_store.cc:276] 0709 13:08:52.370654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.845263 (+474609us) service_pool.cc:224] Handling call
0709 13:08:53.486275 (+641012us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21e9c 00007f17b8e21a5b 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:53.486481 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.487418 (+   937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.487651 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8051456}
I20260709 13:08:53.431043 26645 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.420053 24597 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
W20260709 13:08:53.433288 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.437775 26709 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:53.426010 26648 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:53.509305 26709 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:53.509495 26648 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.510471 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:53.510286 26709 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.381986 25211 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:53.511348 26709 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.511857 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 531) took 1169 ms. Trace:
I20260709 13:08:53.512259 25211 rpcz_store.cc:276] 0709 13:08:52.342527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.668805 (+326278us) service_pool.cc:224] Handling call
0709 13:08:53.381215 (+712410us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:53.381495 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.511585 (+130090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.511798 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16981248}
I20260709 13:08:53.512921 26416 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.513433 26416 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:53.513695 26743 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.513883 26416 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.514623 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:53.515300 24665 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.518383 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:53.419516 26764 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:53.423725 26741 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.445734 26691 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:53.379499 26761 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:53.447180 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:08:53.450438 26689 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.001s
I20260709 13:08:53.450829 26571 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:53.452263 26745 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:08:53.434569 26649 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:53.453809 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:53.454708 24669 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:53.456489 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.457736 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:53.527311 26705 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.460292 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 913) took 1101 ms. Trace:
W20260709 13:08:53.540848 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 83200.5us
W20260709 13:08:53.541821 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 171015us
W20260709 13:08:53.523031 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.527513 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 390) took 1594 ms. Trace:
I20260709 13:08:53.543399 24599 rpcz_store.cc:276] 0709 13:08:51.933644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.935096 (+  1452us) service_pool.cc:224] Handling call
0709 13:08:51.935380 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.743770 (+808390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.527166 (+783396us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54001ec3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:53.527435 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1773224320}
I20260709 13:08:53.444996 26311 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:53.441031 26695 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.540972 26649 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.541247 25216 rpcz_store.cc:276] 0709 13:08:52.358891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.361227 (+  2336us) service_pool.cc:224] Handling call
0709 13:08:53.460077 (+1098850us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b540066bf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:53.460220 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808198400}
W20260709 13:08:53.591317 26397 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.728s	user 0.012s	sys 0.002s
I20260709 13:08:53.570164 26691 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.535470 26741 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.592016 24596 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
W20260709 13:08:53.586905 26641 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.004s
I20260709 13:08:53.586297 26311 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:53.624826 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.642510 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:53.648785 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.602705 26748 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:53.652460 26713 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.002s
I20260709 13:08:53.653021 26713 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.653280 26416 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.655663 26713 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:53.661571 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.594470 26740 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:53.662235 26758 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:08:53.679953 26520 consensus_meta.cc:287] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.002s
W20260709 13:08:53.683079 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 140496us
W20260709 13:08:53.682613 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 254271us
I20260709 13:08:53.687103 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:53.687786 24597 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:53.687265 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.689234 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.683187 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 206697us
I20260709 13:08:53.688802 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:53.690579 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:53.686926 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:53.692219 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:53.687502 24670 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:53.694576 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:53.696581 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:53.698107 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:53.698669 24520 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:53.701519 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:53.703879 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:53.704051 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:53.704618 24672 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.707005 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:53.707540 24524 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.714998 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:53.716621 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:53.717243 25216 raft_consensus.cc:2368] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:53.717814 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:53.718536 24672 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:53.718627 25218 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:53.683208 26741 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.719887 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:53.720131 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:53.721644 26649 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.722311 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:53.722509 26736 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.723097 24518 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:53.723448 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:53.723984 24520 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.723910 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:53.724440 24665 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:53.724637 24518 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.725564 26545 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:53.725948 26545 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:53.726006 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:53.726370 26545 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.727205 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:53.727870 26645 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.699453 26756 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.730547 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:08:53.753422 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 233961us
I20260709 13:08:53.739715 24597 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:53.636256 26641 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.758751 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:53.760411 24516 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:53.762459 26641 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.764017 26740 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.765950 26729 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.731159 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:53.758972 26648 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:53.759408 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:53.760028 26649 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:53.732129 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:53.682582 26416 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.729972 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:53.766911 24665 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:53.767833 25212 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
W20260709 13:08:53.782037 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49975.8us
I20260709 13:08:53.789495 24524 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:53.781550 24523 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:53.692067 26569 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:53.797214 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.713797 26689 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:53.713451 26705 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:53.755489 26764 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:53.793917 26711 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
W20260709 13:08:53.819499 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60816.6us
I20260709 13:08:53.717360 26760 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:53.817978 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:53.840171 26653 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:53.840647 26653 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.841063 26653 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.772243 24520 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:53.758776 26520 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.849845 26520 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.769996 26723 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:53.853385 26723 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.855974 26723 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:53.698489 26697 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:08:53.852856 26520 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.860360 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 369) took 1242 ms. Trace:
I20260709 13:08:53.860895 24668 rpcz_store.cc:276] 0709 13:08:52.618254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.621778 (+  3524us) service_pool.cc:224] Handling call
0709 13:08:52.622033 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.735526 (+113493us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:52.899704 (+164178us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.476377 (+576673us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18003a0600. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287
0709 13:08:53.476466 (+    89us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.476511 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:53.476556 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.860089 (+383533us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54000474d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:53.860149 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.860291 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":483965,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":3908,"spinlock_wait_cycles":274331008,"thread_start_us":214173,"threads_started":3,"wal-append.queue_time_us":565768}
I20260709 13:08:53.810339 26753 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:53.826268 26729 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:53.838541 26760 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.872210 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:53.925053 24600 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:53.870280 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 161112us
W20260709 13:08:53.886641 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 169567us
I20260709 13:08:53.838119 26736 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:53.817153 26391 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:53.903728 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:53.905182 24599 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.838277 26720 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:53.945895 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 523) took 1628 ms. Trace:
W20260709 13:08:53.871421 26770 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:08:53.825546 26706 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:08:53.829651 26689 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.904807 26603 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.863657 26711 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.948349 26648 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.065943 24523 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.905403 26740 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:53.923048 26729 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:53.930378 26753 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:53.947702 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:53.973142 26775 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.002s
I20260709 13:08:53.837816 26705 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.957980 26391 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.837635 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:53.952523 25182 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:54.111943 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 159487us
I20260709 13:08:53.944921 26645 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:53.955173 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 198370us
I20260709 13:08:53.956676 24670 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:54.119710 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:53.959115 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:54.120868 24672 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
I20260709 13:08:53.960682 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:54.121927 24671 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.121553 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:53.960985 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:53.958072 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 54722.5us
I20260709 13:08:53.964115 24666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:53.957569 26640 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:53.930975 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:53.969285 26782 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.970150 24518 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:53.970049 26545 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.141299 26753 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.142982 26314 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.081836 26648 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:53.964704 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.127584 26706 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:54.145875 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:54.146534 26711 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:54.147150 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.130654 26729 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:53.934762 26760 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.147791 24490 leader_election.cc:400] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:53.910243 26742 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:08:53.975039 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:53.979236 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:54.148924 24524 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 2: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:54.149668 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.150820 24670 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:54.148141 24490 leader_election.cc:403] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.151242 24524 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:08:54.151710 24524 pending_rounds.cc:85] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 4
I20260709 13:08:54.151978 24524 pending_rounds.cc:107] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:08:54.152230 24524 raft_consensus.cc:2889] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.148288 26720 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:08:53.958081 25215 rpcz_store.cc:276] 0709 13:08:52.317810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.337360 (+ 19550us) service_pool.cc:224] Handling call
0709 13:08:52.381885 (+ 44525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.404060 (+ 22175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.945535 (+1541475us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b5400552420. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebddc0 00007f17bbf49a02 00007f17bbf45dd6 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:08:53.945808 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6716800}
I20260709 13:08:54.071328 24600 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:54.148119 26729 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.074127 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:54.074911 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.947878 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:53.962770 26743 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.093909 25217 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.095119 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:08:54.097589 26709 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.005s
I20260709 13:08:54.082439 26740 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:54.101379 26757 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:08:54.065819 26397 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.121639 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.189131 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:54.190567 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.129103 24566 leader_election.cc:400] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
W20260709 13:08:54.191888 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 62957.9us
I20260709 13:08:54.131392 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.193655 24674 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:54.194703 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:54.107746 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:54.074620 26776 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:54.070497 26603 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.214780 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.216584 24667 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:54.217641 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.219034 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:54.072407 24523 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.169335 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:54.220428 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.220850 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:54.221861 24600 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:08:54.176093 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 196957us
I20260709 13:08:54.176412 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.176457 26520 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:54.133894 26225 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:54.178915 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:54.032171 24520 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:54.184504 24665 raft_consensus.cc:2368] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
W20260709 13:08:54.185174 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90251.4us
I20260709 13:08:54.144393 26756 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:54.130470 26569 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:08:54.133761 24666 raft_consensus.cc:606] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:54.199225 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.246495 24669 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:54.208719 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:54.247195 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.213137 24521 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.214752 26692 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:54.255024 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.255998 24670 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:54.218353 24672 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:54.144364 26314 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.259559 24670 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:54.261505 26603 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.222808 24671 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:54.223948 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:54.224716 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.226363 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.232339 24599 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:54.148573 24592 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.234520 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:54.273844 24600 raft_consensus.cc:2368] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3.
I20260709 13:08:54.274668 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:54.275283 24600 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.234488 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:54.242195 26724 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:54.184105 26790 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:54.249727 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:54.232728 26225 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:54.252601 24673 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:54.246037 24666 raft_consensus.cc:614] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:54.198729 26742 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:54.253688 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.253791 24516 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:54.274710 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:54.236845 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:54.295061 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 58326.8us
I20260709 13:08:54.295291 24674 raft_consensus.cc:2410] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:08:54.278728 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44323.5us
I20260709 13:08:54.256188 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1362) took 2114 ms. Trace:
I20260709 13:08:54.179677 26743 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.243854 26709 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:54.251056 26706 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:54.265268 26741 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.287006 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.288564 26740 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.252290 26653 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.254480 26692 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:54.310781 26225 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:54.293236 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 453532us
I20260709 13:08:54.235823 26720 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:08:54.233299 26397 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:54.301890 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 180446us
I20260709 13:08:54.148701 26782 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.305298 26793 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:54.285205 26756 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.306200 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.285302 26569 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:54.216490 26757 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.307732 24673 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 2.
I20260709 13:08:54.309890 26709 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:54.300109 26640 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.312522 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:54.307242 26689 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.236006 26776 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.325874 26640 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.309031 26724 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:08:54.403851 26397 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.311646 26692 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.350220 26743 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.336133 26648 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.315490 26756 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.346483 26653 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.318890 26706 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.314546 24667 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:54.407627 26692 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.404619 26776 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:54.280977 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 108502us
I20260709 13:08:54.332882 26722 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.305192 24600 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:54.296926 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:54.409544 24667 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:54.411641 24667 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:54.411548 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:54.307790 26794 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:54.393489 24524 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:08:54.412895 26794 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.413254 24524 pending_rounds.cc:85] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 5
I20260709 13:08:54.296414 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:54.406589 26756 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.349784 26757 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:54.392411 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 96490.7us
I20260709 13:08:54.350138 26709 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.344072 26782 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.316921 26793 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.413472 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.430061 24600 raft_consensus.cc:2376] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3. Re-sending same reply.
I20260709 13:08:54.430966 24665 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:54.431051 26793 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:54.413573 26794 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.413707 24524 pending_rounds.cc:107] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:08:54.433135 24600 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:54.433445 24524 raft_consensus.cc:2889] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.355894 26760 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.470186 24668 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:08:54.414422 24490 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:54.481624 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 185172us
I20260709 13:08:54.482519 26776 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:54.483351 24637 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 3.182s (SENT) [suppressed 28 similar messages]
I20260709 13:08:54.299109 24517 rpcz_store.cc:276] 0709 13:08:52.142942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.213269 (+ 70327us) service_pool.cc:224] Handling call
0709 13:08:54.237881 (+2024612us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54003ad9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:54.250748 (+ 12867us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555683072}
I20260709 13:08:54.428910 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:54.426023 24596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1261) took 2059 ms (client timeout 1948 ms). Trace:
I20260709 13:08:54.471609 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:54.414536 26640 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.483628 24670 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:54.422670 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.417373 26757 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:54.496541 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 82664.2us
I20260709 13:08:54.501355 24593 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:54.503722 24593 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 5. Ops: []
I20260709 13:08:54.505470 24597 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:54.505796 26689 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:54.507177 26776 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.508960 26603 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.509709 26603 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.510154 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:54.510486 26776 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.512269 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:54.515132 26724 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.515673 26724 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.516083 26724 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.517412 26689 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.517899 26689 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:54.518373 26689 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.517437 26782 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:54.491122 24596 rpcz_store.cc:269] 0709 13:08:52.366299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.367869 (+  1570us) service_pool.cc:224] Handling call
0709 13:08:54.425454 (+2057585us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001ed2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:54.425705 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2763699584}
I20260709 13:08:54.525609 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:54.547863 24594 raft_consensus.cc:2368] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
W20260709 13:08:54.548143 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65004.4us
I20260709 13:08:54.550511 26760 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:54.553251 26757 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:54.554207 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 227993us
I20260709 13:08:54.560477 26802 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.561373 26776 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.562014 26776 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:54.562559 26776 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.567626 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.571122 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:54.571630 24490 leader_election.cc:400] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:54.572127 24490 leader_election.cc:403] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.573777 26391 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:54.573978 26729 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:54.574679 26640 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:54.565147 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63929.9us
I20260709 13:08:54.576937 24597 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:54.575403 26640 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:54.580773 26640 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.575624 26802 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:54.545949 26756 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.596150 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:54.596856 26802 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.601480 24599 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:54.602365 26786 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:54.609022 26786 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:54.608693 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 83263.2us
I20260709 13:08:54.617218 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:54.619738 26649 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.620782 26757 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.617298 24592 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:54.621423 26757 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.622731 24600 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.602227 26391 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.627491 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.629176 24593 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:54.629317 24597 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:54.630852 26415 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:54.631839 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.622783 26757 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.646546 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:08:54.651589 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 78507.3us
I20260709 13:08:54.654783 26592 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:54.656813 26786 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:54.645633 26391 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.649660 24491 leader_election.cc:400] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
W20260709 13:08:54.677556 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.679262 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:54.685534 24592 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:54.687417 26415 raft_consensus.cc:2764] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:54.688202 24592 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:54.690322 26311 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.692014 26677 raft_consensus.cc:1027] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: attempt to promote peer 983693721af6486c97ece1410a90cf30: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:08:54.693698 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:54.693854 26794 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.692764 26677 raft_consensus.cc:2955] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:54.696492 26794 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.672744 26724 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:54.699812 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.702014 26311 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:54.702310 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.701262 26776 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.702852 26545 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.703317 24669 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:54.704700 26776 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.704830 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.705529 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.707284 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:54.707921 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.708367 26391 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:54.683975 26689 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.715299 24666 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.716948 24596 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:54.693729 26756 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.720760 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.723448 24596 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:08:54.727984 24669 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:54.718236 26729 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:54.729338 26729 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.731937 26729 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.734980 26689 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.735474 26790 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:54.736060 26790 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:54.740902 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:54.724236 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 90814.3us
I20260709 13:08:54.741036 26790 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.747143 26724 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.748171 26790 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.749408 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:54.750379 24598 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.755604 26729 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:54.755996 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.756455 26729 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:54.741777 26810 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:54.812728 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:54.788141 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 387) took 1082 ms. Trace:
I20260709 13:08:54.757025 24668 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:54.758921 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:54.804358 26756 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.771370 24519 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:54.766785 24594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1277) took 1333 ms (client timeout 1777 ms). Trace:
I20260709 13:08:54.787132 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 390) took 1080 ms. Trace:
I20260709 13:08:54.787124 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:54.816038 24594 rpcz_store.cc:269] 0709 13:08:53.433242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.433550 (+   308us) service_pool.cc:224] Handling call
0709 13:08:54.766459 (+1332909us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b540025f3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:54.766697 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158315264}
I20260709 13:08:54.793998 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 379) took 2404 ms. Trace:
I20260709 13:08:54.815708 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:54.781540 24670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cf920647a7842d49c08b2453da44143"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:54.817404 24518 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:54.817752 24670 raft_consensus.cc:606] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
W20260709 13:08:54.758045 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.818260 24670 raft_consensus.cc:614] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:54.767815 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:54.793300 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.786188 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1267) took 2413 ms. Trace:
I20260709 13:08:54.775584 26571 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:54.821399 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62656.7us
I20260709 13:08:54.821791 26571 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.823357 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:54.823518 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:54.815272 24525 rpcz_store.cc:276] 0709 13:08:53.705362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.705478 (+   116us) service_pool.cc:224] Handling call
0709 13:08:53.726205 (+ 20727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.098867 (+372662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.098896 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:54.098934 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:54.098961 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.787648 (+688687us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540006dbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:54.787726 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.787945 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856615296}
I20260709 13:08:54.824265 24518 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:54.824397 26571 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.825485 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:54.821301 24591 rpcz_store.cc:276] 0709 13:08:52.372554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.387711 (+ 15157us) service_pool.cc:224] Handling call
0709 13:08:54.141165 (+1753454us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:54.141389 (+   224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.253704 (+112315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.253742 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.260957 (+  7215us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.303510 (+ 42553us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:54.470897 (+167387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.752601 (+281704us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54001caa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:54.752683 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.752784 (+   101us) raft_consensus.cc:1685] finished
0709 13:08:54.752809 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.753058 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352328448,"thread_start_us":34710,"threads_started":1,"wal-append.queue_time_us":46143}
I20260709 13:08:54.826275 24525 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:54.773815 26416 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.827353 26416 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.824272 24519 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:54.778021 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:54.818207 24522 rpcz_store.cc:276] 0709 13:08:52.389628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.389728 (+   100us) service_pool.cc:224] Handling call
0709 13:08:53.230499 (+840771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.231227 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.793517 (+1562290us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400442350. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:54.793801 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915833600}
I20260709 13:08:54.815011 26756 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:54.831133 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 53253.2us
I20260709 13:08:54.816562 24516 rpcz_store.cc:276] 0709 13:08:53.706235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.761218 (+ 54983us) service_pool.cc:224] Handling call
0709 13:08:54.253451 (+492233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.296187 (+ 42736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.786662 (+490475us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54003ad9d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:54.786898 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111431552}
I20260709 13:08:54.832253 26724 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.772465 24520 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:54.797829 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 90747.6us
I20260709 13:08:54.822207 26725 raft_consensus.cc:2764] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:54.831188 26756 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.816937 24524 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 2: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:54.773118 24521 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:08:54.768222 24592 raft_consensus.cc:2410] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:54.770213 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 927) took 1055 ms. Trace:
I20260709 13:08:54.831964 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:54.829672 26729 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:54.845718 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.847929 24670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:37198
I20260709 13:08:54.825507 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:54.846906 25217 rpcz_store.cc:276] 0709 13:08:53.714579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.714681 (+   102us) service_pool.cc:224] Handling call
0709 13:08:53.714948 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.183673 (+468725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.769619 (+585946us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400602054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:54.769975 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871042816}
I20260709 13:08:54.855684 24670 raft_consensus.cc:606] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:54.856647 24670 raft_consensus.cc:614] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:54.860536 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.861361 24596 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:54.862308 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.858918 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:54.780364 26757 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.854283 26729 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:54.875130 24523 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:54.878269 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.875783 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:54.881551 26407 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.882313 26407 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.883313 24591 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:08:54.884009 26391 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.884699 26391 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:54.888473 24595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1260) took 2522 ms (client timeout 1920 ms). Trace:
W20260709 13:08:54.889043 24595 rpcz_store.cc:269] 0709 13:08:52.365937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.367101 (+  1164us) service_pool.cc:224] Handling call
0709 13:08:54.887963 (+2520862us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54003e7954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:54.888214 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797424512}
I20260709 13:08:54.894541 26705 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.888490 24599 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:54.901841 26729 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.903231 26729 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.904282 26648 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:54.904850 26648 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.906559 26671 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:54.906847 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 75005.3us
I20260709 13:08:54.907070 26648 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:54.907449 26671 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:54.908094 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:54.909204 26571 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:54.909961 26571 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:54.911154 26571 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:54.909312 26776 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:54.913322 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.913545 26776 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.914000 26776 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.915664 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:54.916419 24665 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.892508 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:54.922897 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:54.887293 26391 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:54.935015 24594 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:08:54.935611 24673 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.873009 26416 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.931527 24518 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:08:54.951174 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.916997 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:54.918079 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:54.920912 26225 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:54.941277 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 49070us
I20260709 13:08:54.918519 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:54.941473 26520 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:54.945197 26713 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.014s	sys 0.010s
I20260709 13:08:54.945484 26695 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:54.864621 26782 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
W20260709 13:08:54.976454 26774 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.010s	sys 0.013s
I20260709 13:08:54.877806 26725 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:08:54.917784 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.005926 24594 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:54.980988 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.949280 26791 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:54.979903 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:55.008414 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 91539.3us
I20260709 13:08:55.016244 25216 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.017782 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.020375 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:55.021349 26612 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.017782 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:55.021407 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.023545 26407 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.024290 26782 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:55.029250 26416 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.029979 26603 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.031630 24672 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:55.032110 26764 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:55.033279 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.033731 26783 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:08:55.033963 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 124881us
I20260709 13:08:55.036394 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:55.037772 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:54.949214 26728 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:55.040938 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:55.042464 26757 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.043404 26671 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:54.976940 26391 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:54.978205 24665 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:54.945248 26545 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:08:55.046572 26311 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:08:54.974754 26713 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.014s	sys 0.010s
I20260709 13:08:55.050092 26695 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:55.048713 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:54.941280 24593 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:55.054113 26774 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.023s	sys 0.020s
I20260709 13:08:55.079181 25184 leader_election.cc:400] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 2 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3.
I20260709 13:08:55.094499 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.080627 25212 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:55.082077 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:55.082895 24674 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:55.096418 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:55.097558 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.098582 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.099298 24674 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:55.100033 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:55.090574 26416 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.087917 24600 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.087994 24523 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:55.103174 26416 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.090234 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:55.104149 24524 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:55.110167 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.112130 24600 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:55.114130 24524 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:08:55.116629 24674 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:55.120899 25219 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:55.131140 25218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
W20260709 13:08:55.135483 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46903.9us
I20260709 13:08:55.122395 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.131870 25218 raft_consensus.cc:606] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:55.093945 26791 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:55.141148 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73850.1us
I20260709 13:08:55.151983 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:55.156160 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 74169.8us
I20260709 13:08:55.149948 26633 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.135041 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:55.158530 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:55.149893 26795 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.141803 25216 raft_consensus.cc:2955] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:08:55.168735 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:55.144404 26677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51490 (request call id 20) took 16899 ms. Trace:
I20260709 13:08:55.152563 26416 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.181701 26722 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.181932 26747 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:55.182446 26722 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.182885 26722 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.183203 26747 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:55.154584 26695 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.185523 24670 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:55.189232 26795 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.183617 26747 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:55.191154 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.196617 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:55.140036 26764 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.224570 26764 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.229974 26314 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.178536 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.202605 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:55.203358 25211 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:55.175689 26677 rpcz_store.cc:276] 0709 13:08:38.256746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.262594 (+  5848us) service_pool.cc:224] Handling call
0709 13:08:38.320176 (+ 57582us) log.cc:844] Serialized 513 byte log entry
0709 13:08:39.004073 (+683897us) spinlock_profiling.cc:243] Waited 921 us on lock 0x7b1800078d60. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebf142 00007f17bbe9feaa 00007f17bbea6d53
0709 13:08:39.113643 (+109570us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b54003a8520. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbec6b26 00007f17bbec049a 00007f17bbebf714 00007f17bbe9feaa 00007f17bbea6d53 00007f17bbea6cd9 00007f17bbea6c69 00007f17bbea6c31 00007f17bbea5dfd 000000000038f354
0709 13:08:39.324340 (+210697us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b54003a8520. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebf142 00007f17bbe9feaa 00007f17bbea6d53 00007f17bbea6cd9 00007f17bbea6c69 00007f17bbea6c31 00007f17bbea5dfd 000000000038f354 000000000038f199 00007f17b8e59475
0709 13:08:39.632597 (+308257us) spinlock_profiling.cc:243] Waited 7.99 ms on lock 0x7b1800078d60. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbec6b26 00007f17bbec049a 00007f17bbebf714
0709 13:08:39.701346 (+ 68749us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b54003a8520. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbec6b26 00007f17bbec049a 00007f17bbebf714 00007f17bbe9feaa 00007f17bbea6d53 00007f17bbea6cd9 00007f17bbea6c69 00007f17bbea6c31 00007f17bbea5dfd 000000000038f354
0709 13:08:55.124346 (+15423000us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159632,"raft.run_cpu_time_us":40898,"raft.run_wall_time_us":1477837,"spinlock_wait_cycles":58625536,"thread_start_us":361805,"threads_started":1,"wal-append.queue_time_us":358538,"wal-append.run_cpu_time_us":1314,"wal-append.run_wall_time_us":1010491}
I20260709 13:08:55.205468 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:55.238219 26633 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.238723 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:55.239043 26756 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.240025 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:55.240396 26633 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.240679 24516 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:08:55.203639 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:55.208664 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.209489 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.211664 26725 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:55.199685 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:55.215564 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:55.216869 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:55.252154 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48640.6us
I20260709 13:08:55.253136 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:55.232282 26520 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:55.254712 24519 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:55.218176 26695 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.220780 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:55.150548 26391 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.241398 26746 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:55.241914 26493 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:55.242774 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:55.228228 26791 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.205870 26747 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.241596 26748 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:55.244213 26756 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.238235 24490 leader_election.cc:400] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4.
I20260709 13:08:55.238240 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.230581 26314 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:08:55.266741 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 86604.8us
I20260709 13:08:55.270709 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:55.282510 24672 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:55.280825 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.282753 24520 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:55.268452 26520 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.293889 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.298301 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:55.301299 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48322.3us
I20260709 13:08:55.274492 24665 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 1.
I20260709 13:08:55.297118 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:55.305804 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 97438.5us
I20260709 13:08:55.306173 24672 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
W20260709 13:08:55.300711 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 259861us
I20260709 13:08:55.284165 26311 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:55.287318 26640 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:55.272059 26776 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.292214 26695 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.293248 26520 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:55.318835 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 120140us
W20260709 13:08:55.319845 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 126967us
I20260709 13:08:55.299712 26757 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.321954 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:55.324952 24524 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.304021 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:55.255256 26764 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:08:55.309255 26311 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.333768 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.320505 26725 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.316329 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:55.340668 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:55.323115 26640 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:55.338449 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:55.375968 24516 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:55.326843 26416 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.386655 24524 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.343859 26725 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.339820 26311 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:55.388149 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46349.3us
I20260709 13:08:55.395573 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.322968 26756 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:08:55.381431 26823 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:08:55.423834 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85524.9us
W20260709 13:08:55.425031 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 121797us
I20260709 13:08:55.403604 24518 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:55.392935 26713 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:55.470537 24524 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:55.393121 26783 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.402086 26725 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:55.482127 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 148444us
I20260709 13:08:55.401473 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:55.467548 26824 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.267s	user 0.001s	sys 0.001s
I20260709 13:08:55.421813 26633 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.489277 26833 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.491781 26783 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.493271 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:08:55.493423 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63643us
I20260709 13:08:55.493260 26753 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.494352 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.495327 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:55.505592 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:55.510002 26830 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:08:55.511039 26640 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:55.474097 26817 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:08:55.474588 26695 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:55.475765 26713 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:55.380642 26314 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.548950 24665 raft_consensus.cc:2376] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3. Re-sending same reply.
W20260709 13:08:55.552784 24673 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.001s
I20260709 13:08:55.553699 24673 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:55.552722 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:55.569736 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 74521us
I20260709 13:08:55.543829 26416 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.551631 26633 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.535737 26753 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:55.579932 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 104518us
I20260709 13:08:55.551836 26391 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.543577 26695 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.541826 26783 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.550751 26713 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.555177 26834 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.559739 26612 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:08:55.572696 26756 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:55.593143 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:08:55.601470 26820 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:08:55.548032 26833 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.578382 26846 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:55.591185 26776 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.606415 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:08:55.611454 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 184088us
I20260709 13:08:55.602495 26415 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.594638 26764 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 13:08:55.647233 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 332350us
I20260709 13:08:55.610102 26713 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:55.616004 26828 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:08:55.619063 26835 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:08:55.617878 26829 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:55.653775 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.663033 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:08:55.617864 26825 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260709 13:08:55.655601 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57303.5us
I20260709 13:08:55.618271 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:55.689785 24521 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:55.690079 26795 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.690711 24674 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:55.691187 26695 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:55.692003 24674 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:55.693579 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 406) took 1619 ms. Trace:
I20260709 13:08:55.694041 24593 rpcz_store.cc:276] 0709 13:08:54.073735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.669772 (+596037us) service_pool.cc:224] Handling call
0709 13:08:54.671105 (+  1333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.118549 (+447444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.693310 (+574761us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540025bf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:55.693511 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602938624}
I20260709 13:08:55.687242 26415 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.699241 26415 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.700523 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:55.701170 26612 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:55.701746 26795 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.701939 26612 consensus_queue.cc:1243] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:55.702533 26612 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:55.702886 26612 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:08:55.703020 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 485411us
W20260709 13:08:55.702939 26722 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.002s
I20260709 13:08:55.703962 26722 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.705492 26760 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:55.705904 26760 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:55.706130 26722 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:55.675493 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.710013 24674 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.680671 26846 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:55.681490 26847 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.682482 26603 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.611819 26314 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.722774 26747 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.728125 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:55.607990 26756 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.684757 26833 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.632230 26728 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:55.728924 24519 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:55.649730 26757 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.626310 26753 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.699149 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.706969 26760 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:55.712877 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.668776 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:55.618769 26493 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:55.712942 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:55.652493 26391 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:55.617141 26783 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.718050 26847 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:55.719308 26603 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:55.683317 26671 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:55.655122 26842 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:55.740343 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 79045.7us
I20260709 13:08:55.722842 26782 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:55.729259 26415 raft_consensus.cc:2764] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:55.742861 25215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:08:55.703974 26612 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:55.745850 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 132962us
I20260709 13:08:55.745498 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:55.743392 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.731040 26728 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:55.765324 25219 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.762677 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:08:55.767071 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 67983us
I20260709 13:08:55.767084 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.761613 25215 raft_consensus.cc:606] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:55.769894 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.735572 26757 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:55.778290 24674 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:55.778561 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.779461 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:55.779649 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:55.780113 24671 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.781221 26633 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.781569 26603 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.782056 26648 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.782904 26603 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.763353 26671 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:55.786109 26520 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.786553 26671 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.787616 26671 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.787737 24516 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:08:55.789314 26842 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:55.789819 26795 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.791033 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:55.790822 26311 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.792797 26311 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.792999 26633 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.752496 26760 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.793797 26722 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:55.776155 26850 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:08:55.771204 26849 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.796099 24666 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:55.796665 24672 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:55.792809 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:55.830955 26849 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:55.825886 26407 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.831945 26849 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.832177 26407 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.833312 26722 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:55.834340 26722 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.837064 25212 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:55.740770 26391 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:55.806813 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44826.2us
I20260709 13:08:55.809624 24669 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:55.803468 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 135900us
I20260709 13:08:55.766100 26782 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:55.815364 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:08:55.816849 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 82309.7us
W20260709 13:08:55.817871 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 61184.5us
I20260709 13:08:55.818264 26695 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.806049 26783 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.765498 26640 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.767524 26846 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.743008 26416 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.820067 24671 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
W20260709 13:08:55.842762 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 50030.2us
I20260709 13:08:55.841138 26391 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.850893 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.847483 26633 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:55.853576 26783 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.854540 26520 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.867879 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:55.858546 26857 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:08:55.861205 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:55.863803 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:55.834364 26407 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.865795 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:55.852392 26728 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.848297 26415 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.868103 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 122715us
I20260709 13:08:55.886400 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:55.864517 26756 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:55.848803 26753 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:55.888101 26845 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.865578 26850 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.893493 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:55.866953 26633 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:55.897640 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:55.940596 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.950263 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.897768 26612 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.898108 26783 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:55.881242 26757 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:55.898612 26746 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:55.902634 26842 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.906257 26847 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.884747 26416 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:55.964321 26493 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.910856 26787 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.911590 26713 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:55.972173 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:55.917176 26415 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:55.921037 26854 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:55.921092 26695 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:55.922729 26725 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:55.924942 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:08:55.939477 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 58300.7us
I20260709 13:08:55.895557 26782 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.980837 26415 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:55.982690 26725 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:55.983775 26843 consensus_queue.cc:1175] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "983693721af6486c97ece1410a90cf30" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:08:55.986524 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.987192 25216 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:08:55.952025 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 58628.4us
I20260709 13:08:55.949297 25217 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:08:55.989871 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.952822 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.900760 26846 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.951229 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:55.962035 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81435.8us
W20260709 13:08:55.969738 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 108665us
I20260709 13:08:55.936926 26753 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:55.964766 26746 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.951637 26633 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.925071 26391 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:55.960991 26776 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.958660 26520 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.979717 26695 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.033247 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.974716 26314 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:08:55.966796 26783 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.030653 26842 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:55.947479 26833 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:56.054418 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:08:56.076361 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44078.3us
W20260709 13:08:56.056208 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.056502 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 66476.6us
I20260709 13:08:56.079528 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.065176 26753 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.053964 26787 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:56.091230 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.960508 26671 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:08:56.061652 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.063133 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.980902 26782 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.986316 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.976538 26845 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:56.064538 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:56.053964 26853 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:08:56.067859 26847 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.067988 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:56.031535 26756 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:56.044219 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:56.052424 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:56.076983 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:55.975417 26728 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.972108 26416 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.064935 26746 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.084465 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:56.093619 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:56.136407 24669 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.092813 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:56.070446 26493 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:56.109629 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:56.116811 26859 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.119913 24670 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:56.121845 25215 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.123162 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.155040 24600 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.091033 26787 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:56.130156 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:56.133633 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet 30a58475c1d54873be44217fc84b05ec: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:08:56.157322 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66819us
W20260709 13:08:56.141542 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.142364 25214 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:56.125864 24666 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:56.123042 26603 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:56.162323 26713 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:56.163548 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.164239 24518 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:08:56.165587 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.134248 26416 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.161764 24523 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:56.171036 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.103579 26783 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.171883 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.172448 24594 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.162410 26603 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.161057 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.160621 24639 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:08:56.143018 25218 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.167923 26729 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.150121 26641 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:08:56.158041 26747 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:56.196058 26747 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:56.196961 26747 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.198410 26747 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.164492 26713 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:08:56.177971 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.177332 26833 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:56.201519 26833 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:56.201557 24523 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:08:56.201748 26713 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:56.201997 26833 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:56.202198 26713 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:56.179929 26842 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.181131 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.182210 26760 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:56.133872 26756 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.127384 26845 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.190574 26695 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:56.191258 26571 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.193437 26493 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.194756 26391 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.203766 24674 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:56.207212 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.233644 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.174140 26795 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:56.238425 25184 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.877s (SENT)
W20260709 13:08:56.242547 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 82018.2us
I20260709 13:08:56.255522 24522 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:56.232012 24592 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
W20260709 13:08:56.247689 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 167047us
I20260709 13:08:56.229900 26671 consensus_queue.cc:1243] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:56.259675 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.260953 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:08:56.248291 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 377047us
I20260709 13:08:56.264482 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:56.241562 26760 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:56.203095 26713 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.264142 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.264920 25218 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:56.266355 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.263571 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:56.169868 26859 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.217290 26729 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.268953 24594 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.270473 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:56.270988 24522 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:56.271697 26791 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:56.272881 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.273140 26311 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:56.273347 26873 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 13:08:56.274588 26864 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:08:56.277181 24420 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.278144 26520 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:56.279043 24420 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:56.279601 24525 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:56.280494 24669 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:08:56.281716 26713 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.252434 26571 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.273665 26311 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:56.287423 26571 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.288967 26787 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.290067 26787 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.293699 24523 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:56.293759 24519 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:56.301275 26311 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.280696 24420 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 3, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:56.309312 24592 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.309324 26764 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.310350 26764 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.312615 26764 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.317344 26879 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:56.300730 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:56.296880 26760 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.318961 24593 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
W20260709 13:08:56.321149 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.296236 26746 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.323199 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:56.328084 24524 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:56.339670 26859 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.342494 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.345517 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:56.349516 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.346661 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:56.341055 24420 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 4, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.305574 26783 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:56.354000 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.360205 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:08:56.363018 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.341126 26407 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.361146 24420 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:56.358389 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 263581us
I20260709 13:08:56.342573 26571 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.367743 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:56.358966 26520 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.378435 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.359562 26846 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.386273 24519 raft_consensus.cc:2410] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:56.342767 26795 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:56.389961 24594 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:56.350761 26747 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:08:56.366257 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:56.354565 26612 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:08:56.393684 24420 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 4, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.407269 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.386014 26783 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:56.415601 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:56.418890 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63801.1us
I20260709 13:08:56.419924 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:56.420066 24420 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 3, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.397269 26641 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:56.408352 24593 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:56.406842 26776 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:56.424661 26791 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.388518 26407 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.426647 24525 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:56.389297 26520 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.389546 26493 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:56.387832 26571 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.392649 26846 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.432041 24420 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 3, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:56.462265 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55052.4us
I20260709 13:08:56.433763 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:56.463052 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.578826 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.469846 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.579913 24520 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:56.580055 26760 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:56.581187 26874 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:56.581579 26874 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:56.582551 26874 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.582929 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.581262 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:56.583726 24519 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:56.584115 26874 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:56.584257 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.587762 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.588510 26671 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:56.588902 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 228777us
I20260709 13:08:56.590437 24520 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.414357 26764 raft_consensus.cc:2764] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:56.584926 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:56.593117 26883 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:08:56.418076 26783 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:56.406440 26877 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:56.596298 24420 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 1 to 3, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:56.595229 26633 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.514s	user 0.003s	sys 0.007s
W20260709 13:08:56.468178 26882 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:56.603299 26833 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.615797 26833 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.616705 26791 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.468075 24423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 345) took 10941 ms. Trace:
I20260709 13:08:56.603523 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:08:56.605574 26753 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.001s
I20260709 13:08:56.606160 26612 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.470010 26871 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:56.470220 26870 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:56.608179 26416 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.470952 26746 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.590561 26747 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:56.471449 26860 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.296s
I20260709 13:08:56.600497 26783 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.612040 26877 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.468596 26876 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.196s
I20260709 13:08:56.468688 26831 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.497735 26881 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:08:56.622949 24673 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:56.682380 24673 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:56.561950 26729 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.461611 26843 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.637759 24420 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:08:56.590197 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:56.610327 26407 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.626138 26846 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:56.668422 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65000.3us
I20260709 13:08:56.670341 26571 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.675616 26520 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.687184 24523 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:56.694555 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.677114 26764 raft_consensus.cc:2764] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:56.625829 26633 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.698472 24517 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:08:56.700709 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.699832 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.701130 24420 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.703404 24673 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.668210 26753 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.677098 26612 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.713755 24420 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.715081 24673 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:56.716730 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.713687 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:56.717711 26311 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:56.717878 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:56.718166 26311 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:56.718401 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:56.719115 24674 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.646040 24423 rpcz_store.cc:276] 0709 13:08:45.391340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.404332 (+ 12992us) service_pool.cc:224] Handling call
0709 13:08:45.866654 (+462322us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:08:56.324433 (+10457779us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:52.968461 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:53.057335 (+ 88874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:53.057370 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:53.057387 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:53.058055 (+   668us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:53.058108 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:53.058135 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:53.058623 (+   488us) tablet.cc:701] Row locks acquired
0709 13:08:53.058642 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:53.058788 (+   146us) write_op.cc:270] Start()
0709 13:08:53.058895 (+   107us) write_op.cc:276] Timestamp: P: 1783602533058742 usec, L: 0
0709 13:08:53.058917 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:53.059623 (+   706us) log.cc:844] Serialized 1698 byte log entry
0709 13:08:53.945534 (+885911us) op_driver.cc:464] REPLICATION: finished
0709 13:08:54.785984 (+840450us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17b8e3c0ac 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bf97cef0
0709 13:08:55.063034 (+277050us) write_op.cc:301] APPLY: starting
0709 13:08:55.076457 (+ 13423us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:55.124596 (+ 48139us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:55.138097 (+ 13501us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:55.190047 (+ 51950us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:55.190358 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:08:55.190405 (+    47us) write_op.cc:312] APPLY: finished
0709 13:08:55.204894 (+ 14489us) log.cc:844] Serialized 41 byte log entry
0709 13:08:55.339376 (+134482us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:55.391471 (+ 52095us) write_op.cc:454] Released schema lock
0709 13:08:55.430086 (+ 38615us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:55.547900 (+117814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:55.552043 (+  4143us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1369893,"reported_tablets":12,"spinlock_wait_cycles":610788224,"child_traces":[["op",{"apply.queue_time_us":1117187,"apply.run_cpu_time_us":24281,"apply.run_wall_time_us":468620,"num_ops":4,"prepare.queue_time_us":273071,"prepare.run_cpu_time_us":178726,"prepare.run_wall_time_us":469048,"raft.queue_time_us":293339,"raft.run_cpu_time_us":44237,"raft.run_wall_time_us":1151068,"replication_time_us":886403,"spinlock_wait_cycles":28270464,"thread_start_us":2013245,"threads_started":5,"wal-append.queue_time_us":862219,"wal-append.run_cpu_time_us":40713,"wal-append.run_wall_time_us":2211530}]]}
I20260709 13:08:56.722436 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:56.722932 26671 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.724066 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:56.698751 26877 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:56.737782 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.696591 26888 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.702769 26874 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:56.753865 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:56.691210 26843 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.741433 24668 raft_consensus.cc:2410] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:08:56.753851 25213 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:56.755991 24672 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:56.710482 26876 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.714025 26520 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:56.724422 26880 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:56.768420 24673 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:56.762826 24420 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 4, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:56.757668 26311 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.724340 26842 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:56.765473 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 175349us
W20260709 13:08:56.762815 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.695576 26831 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.723579 26671 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.765193 26891 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:56.788578 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:56.789757 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:56.790382 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:56.790512 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:56.800060 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.800267 25215 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.773002 26842 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:56.793437 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 104868us
I20260709 13:08:56.769480 26520 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:56.794725 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:56.778029 26545 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:08:56.798105 26729 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.798012 26871 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.813494 26416 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:56.813687 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.807758 26407 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:56.813726 26871 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.814568 26633 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.816201 24516 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:56.816552 26880 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:56.816985 26880 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.796293 25214 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.804005 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.801024 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.796943 26677 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:56.818351 24597 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.818585 26677 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.819329 24595 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:56.819669 26886 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:56.805410 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.821208 24592 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:56.806191 26757 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:56.824380 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.806635 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.820787 26677 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:56.825567 26892 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:56.825511 26877 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:56.808509 24594 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:08:56.804119 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.826211 26877 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.826894 24599 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
W20260709 13:08:56.803623 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.812764 26729 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:56.825405 24600 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.816147 26871 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:56.828265 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.804138 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.829624 24596 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.837244 24674 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:56.802220 25211 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:56.838572 26545 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:08:56.846511 26545 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:56.846944 26545 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:08:56.847977 26884 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.339s	user 0.000s	sys 0.003s
I20260709 13:08:56.847839 26545 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.851354 25210 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:08:56.851758 25210 pending_rounds.cc:85] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 4
I20260709 13:08:56.852011 25210 pending_rounds.cc:107] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:08:56.852250 25210 raft_consensus.cc:2889] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:56.839643 26776 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.853189 26641 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:56.853700 26776 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.854466 26729 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.807408 26842 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.855791 26776 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.856961 26633 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:56.857388 26633 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:56.857766 26633 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.852157 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:56.846581 24671 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:56.863590 26612 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:56.865427 24639 leader_election.cc:336] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.830s (SENT)
I20260709 13:08:56.809267 26520 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.870687 26877 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.873046 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:56.874329 26671 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.875023 26756 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.875495 26633 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.876830 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.877417 24524 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:08:56.878538 24525 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:56.878675 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.879369 26747 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:56.879870 26747 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.881131 26831 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.864056 26776 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.883740 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.881860 26747 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.885319 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:56.887679 26713 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:56.889429 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.891036 24594 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:08:56.866142 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.797492 26891 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:56.892005 26545 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.893049 26641 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:56.905978 26764 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.897368 24600 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:56.901728 26753 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:56.898226 26834 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:56.920100 26834 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:56.920400 26633 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.920696 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.905234 24596 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:56.897670 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.893657 24665 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.922581 24599 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:56.902830 24595 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:56.902503 24598 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:56.915560 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:56.901332 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:56.905705 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.924853 24673 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.925320 24597 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:56.894694 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:56.926718 24671 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:56.890089 24516 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
W20260709 13:08:56.949990 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 115892us
W20260709 13:08:56.950994 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60502.2us
I20260709 13:08:56.951793 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:56.954023 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:56.954151 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:56.881798 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:56.955075 24597 raft_consensus.cc:2376] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3. Re-sending same reply.
I20260709 13:08:56.959013 24594 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:56.958904 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.917182 26843 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.964665 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.963935 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:56.914582 26791 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:56.962124 24599 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:56.914417 26831 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.921101 26641 consensus_queue.cc:1243] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:56.899963 26493 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:56.977216 24519 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:56.978399 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:56.967387 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:56.913650 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:56.959400 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:08:56.972165 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44230.8us
I20260709 13:08:56.912068 26788 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:08:56.899145 26603 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:56.973909 26416 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:56.952817 26783 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.974248 24520 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:08:56.971239 26791 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:56.996745 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.975672 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:56.987550 24599 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:56.970301 26671 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.962306 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:56.999930 24600 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:56.901211 26776 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.973778 26729 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:56.904174 26845 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.004557 26633 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:57.005105 26633 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:57.006273 26633 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.992694 24673 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:56.970755 26407 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:56.974053 26571 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:08:57.009647 26407 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.010362 26870 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.011865 26407 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:56.956056 26877 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:08:57.013353 26729 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:57.014372 26729 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:56.907083 24593 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:08:56.972726 24597 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:56.987988 24595 raft_consensus.cc:2376] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4. Re-sending same reply.
I20260709 13:08:56.995172 24598 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:56.973520 24521 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
W20260709 13:08:57.001230 24639 leader_election.cc:336] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.973s (SENT)
I20260709 13:08:57.020217 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:57.002308 26671 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.022895 26671 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:57.022723 26520 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.023439 26671 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.023792 26671 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:57.024159 26671 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.993602 26416 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.025308 26416 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:57.028565 24639 leader_election.cc:336] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.997s (SENT)
I20260709 13:08:57.003855 26776 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.029059 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:57.029791 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.030256 26873 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:57.031014 24594 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:56.976719 26493 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:57.022059 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:57.039443 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.041301 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:56.921017 26834 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.042032 24669 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:57.024823 26520 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:57.037843 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.047138 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:57.046985 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:57.047701 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.048231 24665 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:57.049701 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:56.997249 24592 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.050498 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.054720 24672 raft_consensus.cc:2410] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:56.981599 26860 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:08:57.051503 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:57.052206 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.055146 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.058815 24594 raft_consensus.cc:2368] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:56.986897 26713 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:08:56.982909 26831 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.001884 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:57.066114 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.066977 24671 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:57.044708 26764 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:57.073311 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.032470 26842 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.084510 24671 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:57.090209 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.091434 24671 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:57.055164 26849 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:57.050889 26876 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:08:57.106003 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 102242us
I20260709 13:08:57.107934 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.072029 26764 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.113692 24594 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:08:57.120621 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:57.121838 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 137464us
I20260709 13:08:57.124004 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:57.104115 26849 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:57.112695 26520 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.142953 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:57.143646 25214 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:57.144654 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:57.116707 26764 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.148425 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:57.151747 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:57.152822 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:57.154633 24520 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:57.125842 26776 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:08:57.154633 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:57.156414 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.157437 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:57.159041 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.159861 26849 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.167590 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:57.166672 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 162796us
I20260709 13:08:57.160967 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:57.161260 26571 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.171705 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:57.162256 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.146124 26520 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.172459 26311 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.150832 26889 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.161643 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.172843 26311 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:57.178733 26311 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.180807 24595 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:57.153574 26891 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.170137 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:57.165858 26897 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.188549 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.167155 26788 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.134137 26493 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.155236 26407 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:08:57.323987 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55241.2us
I20260709 13:08:57.188870 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.391009 24595 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:08:57.349539 26831 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:57.322755 26545 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:08:57.393821 26545 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:57.394297 26545 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:57.395182 26545 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.396404 26545 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.336572 26843 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.399521 26416 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.400413 26834 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.400182 26843 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.268863 24525 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:57.172047 26571 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.403556 26571 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.269387 26746 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.405800 26746 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:57.406013 26906 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:08:57.406364 26746 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.407051 26677 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.407683 26843 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:57.399160 24596 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:08:57.338552 26783 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:57.411473 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:57.348584 26905 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:08:57.412040 25214 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:57.412223 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:57.280934 26729 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.413126 26729 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.413414 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:57.413976 26831 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.414076 25218 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:57.414496 26831 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.416735 26831 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:57.423543 26753 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:57.423933 26753 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:57.398792 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.411242 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:57.407583 26677 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:57.421612 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:57.413582 26729 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.398241 26788 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.418533 26870 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:57.420682 26880 consensus_meta.cc:287] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.603s	user 0.006s	sys 0.003s
W20260709 13:08:57.462855 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 72253.9us
I20260709 13:08:57.421612 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:57.426563 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:57.204774 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.324662 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 167274us
I20260709 13:08:57.465643 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:57.182502 26871 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:57.271247 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.298437 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.467592 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.467947 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.468166 24671 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:57.179370 26776 consensus_queue.cc:1243] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:57.473212 24671 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.433214 24520 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:57.179713 26520 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.470983 24669 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:08:57.473222 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51705.1us
I20260709 13:08:57.466470 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:57.475441 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:57.475672 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:57.184909 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:57.350449 26722 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.187282 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:57.177479 24666 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:57.476619 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.530145 24672 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:57.530043 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:08:57.531153 26907 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:08:57.531507 26842 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.531985 26416 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.537429 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.538157 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:08:57.539148 26902 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:57.462054 26876 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:57.541332 26677 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.541977 26788 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:57.182308 26603 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.290s
I20260709 13:08:57.542107 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.375277 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 417) took 1141 ms. Trace:
W20260709 13:08:57.527824 26904 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 13:08:57.388051 26791 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.546281 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.546940 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:57.546792 26571 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:57.547495 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.528469 26909 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:08:57.552275 25215 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:08:57.349136 25210 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:57.495059 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:57.430153 26897 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.554621 24669 pending_rounds.cc:85] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 4
I20260709 13:08:57.644714 24669 pending_rounds.cc:107] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:08:57.645124 24669 raft_consensus.cc:2889] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:57.550284 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:57.536898 26311 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.556445 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.451881 26756 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:57.556382 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 142815us
I20260709 13:08:57.441854 26783 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.557636 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.462379 26870 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.560307 24668 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:57.539616 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.473515 26871 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.567978 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:57.663478 24595 raft_consensus.cc:2410] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:08:57.663693 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 95790.1us
I20260709 13:08:57.547539 26891 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.529465 26843 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.550616 26889 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:57.529614 26845 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.584622 26879 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:08:57.556958 26671 consensus_meta.cc:287] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.532s	user 0.003s	sys 0.007s
I20260709 13:08:57.650321 26795 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.477098 26877 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:08:57.559552 26860 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.554313 26722 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:57.590070 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.559798 26873 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:57.561290 24521 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:08:57.563673 26842 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:08:57.581635 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.584367 24593 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:57.550808 26764 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.647095 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
W20260709 13:08:57.650020 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 99806.4us
I20260709 13:08:57.739750 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:57.651180 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:57.472476 26880 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.556196 26746 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:57.632287 26717 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.015s	sys 0.013s
I20260709 13:08:57.665694 24594 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:57.666397 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:08:57.579443 26876 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.569183 26747 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:08:57.472127 26899 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.579816 26887 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:08:57.662427 26788 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.649685 26897 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.669456 26859 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:57.751838 26717 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.015s	sys 0.017s
W20260709 13:08:57.676771 24592 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.001s
I20260709 13:08:57.733594 26722 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:57.734241 26860 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.736907 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 425) took 1448 ms. Trace:
I20260709 13:08:57.674072 26603 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.666375 26783 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.676087 26843 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:57.752849 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86546.4us
I20260709 13:08:57.754083 26571 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.580504 24518 rpcz_store.cc:276] 0709 13:08:56.234047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.239953 (+  5906us) service_pool.cc:224] Handling call
0709 13:08:56.302727 (+ 62774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:56.631974 (+329247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.636766 (+  4792us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:56.694696 (+ 57930us) log.cc:844] Serialized 26 byte log entry
0709 13:08:56.964064 (+269368us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:56.973660 (+  9596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.984361 (+ 10701us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.189360 (+204999us) raft_consensus.cc:1685] finished
0709 13:08:57.268935 (+ 79575us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.350102 (+ 81167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13359,"raft.queue_time_us":333598,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":445529,"threads_started":2,"wal-append.queue_time_us":413715}
I20260709 13:08:57.754568 26909 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:57.795460 24522 rpcz_store.cc:276] 0709 13:08:56.288863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.293066 (+  4203us) service_pool.cc:224] Handling call
0709 13:08:56.293495 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:56.309032 (+ 15537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.309096 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:56.877095 (+567999us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b2c00000c88. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:08:56.877478 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.001767 (+124289us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:57.001819 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.001908 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.682560 (+680652us) raft_consensus.cc:1685] finished
0709 13:08:57.682584 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.736837 (+ 54253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10400,"raft.queue_time_us":10525,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":30673024,"thread_start_us":123828,"threads_started":1,"wal-append.queue_time_us":226741}
I20260709 13:08:57.756453 26893 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:57.756845 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:57.815071 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 58309.1us
I20260709 13:08:57.757391 26713 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:57.757823 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 106757us
I20260709 13:08:57.758527 26641 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:57.743434 26831 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:57.682667 26671 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.772270 24674 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:57.773801 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 282345us
I20260709 13:08:57.675915 26891 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.665493 26871 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:57.780783 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 314714us
I20260709 13:08:57.767817 26845 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.728924 26795 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.835134 26753 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.836038 26311 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.836453 26753 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.837306 26747 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:57.736706 26873 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.769716 26788 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.768229 26899 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.773852 26776 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.771613 26859 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:57.812296 26860 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.755748 26764 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:57.813169 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.819049 26887 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:57.818313 24667 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:57.778874 24592 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:57.819464 26893 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.825457 24525 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:57.880059 24525 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:57.826455 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:57.843421 26834 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.828792 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:57.877439 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 43796.9us
I20260709 13:08:57.808511 26922 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:57.840526 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:57.843963 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:57.847167 24490 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:57.869313 26788 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.864051 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:57.867859 24673 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:08:57.871186 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55324.9us
I20260709 13:08:57.871941 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:57.814265 26677 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:08:57.822217 26831 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:57.875567 26311 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:57.877182 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:57.798162 26889 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:57.864059 26603 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.833986 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:57.851078 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:57.880532 26887 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:57.925061 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 74098.3us
I20260709 13:08:57.918959 26747 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:57.880827 24525 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.889277 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:57.892148 24522 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:57.927304 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:57.868741 26899 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.892159 24520 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:57.928392 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:57.928907 24520 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:57.889041 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63857.6us
I20260709 13:08:57.886536 24665 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:08:57.890872 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62183.3us
I20260709 13:08:57.895290 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:57.896157 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:57.931056 25214 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:57.889735 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:57.926242 26747 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:57.900959 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:57.918318 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:08:57.922796 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.923738 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:57.885722 26845 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.932706 24594 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.884851 26924 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:08:57.943153 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 53947.9us
I20260709 13:08:57.943866 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:57.885627 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.944836 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:57.944927 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:57.945765 25213 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:57.946967 24598 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:57.930647 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:57.931269 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:57.931860 24519 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:57.948215 24665 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.882956 24593 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:57.932071 26545 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.936360 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:57.948879 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:57.937145 26845 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:57.941857 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:57.941965 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:57.937412 26920 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:08:57.901266 26571 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.957543 24523 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:57.908800 26922 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:57.972966 24520 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:57.975203 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:57.976061 24519 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:57.924847 26677 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.891294 26834 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.930833 26887 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.986830 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.987759 24595 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:57.926805 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:58.010615 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:08:57.959728 26919 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.162s	user 0.001s	sys 0.001s
I20260709 13:08:57.957188 26880 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.006078 26922 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.006599 26834 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:58.007606 26571 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:57.988739 26746 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:57.955404 26545 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.033689 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:58.012195 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:58.000227 24594 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:58.019141 24665 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:57.966892 26916 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:57.960332 26633 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:57.981266 26677 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:58.127797 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 207317us
I20260709 13:08:58.008553 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:58.102026 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 261568us
I20260709 13:08:58.058246 26843 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:58.134972 24523 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:58.103061 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:58.126770 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.127010 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 114902us
I20260709 13:08:58.135870 24667 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.989431 26929 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:58.127497 24594 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:58.128803 24595 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:08:58.127969 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:57.933295 26603 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:57.989136 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:57.959668 26924 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.136343 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:57.956370 26930 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.197s
I20260709 13:08:58.139757 24665 raft_consensus.cc:2410] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:58.140959 24519 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:58.134852 24517 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:58.125916 26545 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:58.136225 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.147524 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 205613us
I20260709 13:08:58.108737 26834 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.130494 26880 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:58.103812 26873 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:58.188834 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.151804 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 141250us
I20260709 13:08:57.956507 26859 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.134012 26677 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.187315 24665 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:08:58.185578 26729 consensus_meta.cc:287] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.006s
I20260709 13:08:58.186946 24523 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.112255 26722 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:58.200544 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 186149us
I20260709 13:08:58.058228 26831 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.203768 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:58.141476 26407 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:58.204296 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 72084.5us
I20260709 13:08:58.204620 24665 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:58.151284 26671 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:58.226099 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:58.154390 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 432) took 1182 ms. Trace:
I20260709 13:08:58.232059 24665 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:58.185894 26633 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:58.185875 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.197441 26843 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:58.235713 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 47306.2us
I20260709 13:08:58.235991 26407 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:08:58.253428 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 117187us
I20260709 13:08:58.188464 26942 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:58.198112 26873 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.259351 24521 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:58.260383 24517 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:58.236368 24516 rpcz_store.cc:276] 0709 13:08:56.967039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.974834 (+  7795us) service_pool.cc:224] Handling call
0709 13:08:57.045535 (+ 70701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.082135 (+ 36600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.083844 (+  1709us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.165735 (+ 81891us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.771143 (+605408us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:57.771218 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.779016 (+  7798us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.137291 (+358275us) raft_consensus.cc:1685] finished
0709 13:08:58.137311 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.149342 (+ 12031us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22202,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":16530,"thread_start_us":316394,"threads_started":1,"wal-append.queue_time_us":627738}
I20260709 13:08:58.260972 26633 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.263202 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:58.202255 26783 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.195516 26891 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:58.203200 26722 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.203195 26880 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:08:58.186610 26936 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:08:58.194792 26927 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:08:58.264179 26859 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.198215 26834 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.201994 26729 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.304868 24639 leader_election.cc:400] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
I20260709 13:08:58.262424 26843 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:58.308521 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45418.3us
W20260709 13:08:58.299963 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 168474us
I20260709 13:08:58.144243 26889 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.265589 26942 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.317410 24639 leader_election.cc:403] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:58.318583 26944 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.319339 26633 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.320384 26879 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:58.345006 26928 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 13:08:58.344903 26899 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.321825 26893 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.267335 24666 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:08:58.329408 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:58.332643 25215 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:08:58.307883 26722 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.300865 26940 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:58.333420 26843 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.339754 24667 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:08:58.337864 26944 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.347767 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.364656 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:58.339068 26942 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.317554 26845 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:58.356429 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 51725.9us
I20260709 13:08:58.369135 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:58.370839 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:58.351956 26753 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.345330 26879 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.310110 26873 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.367646 25219 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:08:58.364660 26671 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:58.372051 26940 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:58.385455 26948 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:58.352190 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:58.311625 26945 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:08:58.361052 26633 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:58.380574 26571 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:08:58.383417 24592 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:58.360008 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:58.406697 26879 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.448851 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.452343 26955 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:58.425958 26493 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.426329 26783 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:58.456579 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 96697.1us
I20260709 13:08:58.457242 26954 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 2. Current term is 3.
W20260709 13:08:58.457537 26950 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:08:58.457854 26932 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:08:58.458094 26633 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:08:58.458292 26941 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:08:58.408026 26753 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.380327 26407 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.470950 26953 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:08:58.473830 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.004s
W20260709 13:08:58.477941 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.004s
I20260709 13:08:58.459707 26948 consensus_queue.cc:1243] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:58.402498 26880 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.455566 26603 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:58.459370 26849 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.472779 24591 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:58.465557 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:58.437711 26671 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:58.474788 26871 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
W20260709 13:08:58.488184 26946 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:08:58.495810 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.492942 24523 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:58.488628 26940 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.477056 26955 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:58.497987 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:58.478276 26746 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:58.521421 26942 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.516541 26955 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.506186 26746 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:58.526831 26746 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.534162 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:58.757792 24599 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.528510 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.666968 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:58.758662 26416 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:58.632038 26612 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:58.602993 24672 consensus_meta.cc:287] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 13:08:58.759321 26416 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.760123 24672 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:08:58.495978 26871 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.536449 26899 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.762069 26416 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:58.637387 26873 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:58.763123 26871 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:58.643469 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 447) took 1094 ms. Trace:
I20260709 13:08:58.547727 26834 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:58.637743 26633 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:08:58.764113 24669 rpcz_store.cc:276] 0709 13:08:57.548646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.551624 (+  2978us) service_pool.cc:224] Handling call
0709 13:08:57.551955 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:57.657988 (+106033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.658035 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:57.658702 (+   667us) log.cc:844] Serialized 52 byte log entry
0709 13:08:57.829765 (+171063us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:57.829819 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.844788 (+ 14969us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.643157 (+798369us) raft_consensus.cc:1685] finished
0709 13:08:58.643190 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.643388 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3897,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6394,"thread_start_us":152610,"threads_started":1,"wal-append.queue_time_us":530150}
I20260709 13:08:58.540300 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 440) took 1088 ms. Trace:
W20260709 13:08:58.535766 26870 consensus_meta.cc:287] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.857s	user 0.008s	sys 0.001s
I20260709 13:08:58.762976 26795 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:58.531016 26747 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.767800 26954 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.503726 26729 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.501338 26948 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:58.768606 26954 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:58.667876 26897 consensus_meta.cc:287] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.891s	user 0.005s	sys 0.006s
I20260709 13:08:58.769819 26897 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.769665 26948 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.771139 24522 raft_consensus.cc:2368] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
I20260709 13:08:58.771085 26954 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.759725 26612 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.772050 26612 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.772115 26897 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:58.772473 26948 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.535792 26916 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.513195 26924 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.774369 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:58.703871 26603 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.499120 26953 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:58.768101 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.794557 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:08:58.773480 26916 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:08:58.570742 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 105284us
W20260709 13:08:58.791951 26756 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.130s	user 0.011s	sys 0.000s
I20260709 13:08:58.792651 26876 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.811864 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.812758 24672 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:58.813910 24599 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:08:58.795457 25214 raft_consensus.cc:2410] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:08:58.766693 24670 rpcz_store.cc:276] 0709 13:08:57.452208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.456758 (+  4550us) service_pool.cc:224] Handling call
0709 13:08:57.457613 (+   855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.473876 (+ 16263us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:57.820213 (+346337us) log.cc:844] Serialized 14 byte log entry
0709 13:08:58.127187 (+306974us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.145636 (+ 18449us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.145794 (+   158us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:58.145848 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.145933 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.540078 (+394145us) raft_consensus.cc:1685] finished
0709 13:08:58.540097 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.540218 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19415,"prepare.queue_time_us":83760,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3461,"raft.queue_time_us":122118,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":92604,"spinlock_wait_cycles":963840,"thread_start_us":554423,"threads_started":2,"wal-append.queue_time_us":433324}
I20260709 13:08:58.796038 26870 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.803512 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:58.804095 26717 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:58.805684 26677 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:08:58.804708 26834 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:58.811012 26756 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:58.826154 26887 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.000s
I20260709 13:08:58.833590 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.816548 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:08:58.793552 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.046s	sys 0.095s
I20260709 13:08:58.641883 26943 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:58.708757 26571 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.527758 26955 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.775694 26776 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:58.714663 26671 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.795984 26603 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.834838 24669 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:58.835206 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.046s	sys 0.096s
I20260709 13:08:58.715415 26944 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:58.830601 26520 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.265s	user 0.004s	sys 0.009s
I20260709 13:08:58.850385 26926 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:58.805155 26953 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.846612 26776 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.832597 26753 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:08:58.881735 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.020s
I20260709 13:08:58.835985 26795 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:08:58.831547 26677 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.840214 26942 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.851498 26916 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.871562 26953 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:58.852970 26926 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:08:58.851693 26943 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.856338 26870 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.853909 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:58.827050 26717 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:58.913998 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60170.5us
I20260709 13:08:58.914397 26916 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.830757 26879 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:58.845947 26788 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.926s	user 0.009s	sys 0.002s
I20260709 13:08:58.923043 26788 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:58.928606 26545 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.726s	user 0.006s	sys 0.001s
I20260709 13:08:58.929338 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 446) took 1462 ms. Trace:
I20260709 13:08:58.929881 24674 rpcz_store.cc:276] 0709 13:08:57.467305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.467498 (+   193us) service_pool.cc:224] Handling call
0709 13:08:57.467774 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.823787 (+356013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.929115 (+1105328us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540017f054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:58.929279 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699757952}
I20260709 13:08:58.929921 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:58.931829 24672 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:58.882289 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.020s
I20260709 13:08:58.888517 24669 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:58.850747 26520 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.891188 26746 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.892596 26795 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.832578 26834 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:58.904475 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.839807 26887 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.845650 26571 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:58.903452 26729 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:58.909202 24666 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:58.911126 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.958329 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:08:58.915205 26909 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:58.908885 26843 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.003s
I20260709 13:08:58.936064 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:08:58.970202 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:58.944396 24668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.010s	sys 0.032s
I20260709 13:08:58.944192 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:08:58.971055 24668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.010s	sys 0.032s
I20260709 13:08:58.951223 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:08:58.913203 26859 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.002s
I20260709 13:08:58.952167 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:58.952994 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:08:58.957305 24597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.013s	sys 0.045s
W20260709 13:08:58.937696 24518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.003s	sys 0.018s
I20260709 13:08:58.945858 24672 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:08:58.970364 24669 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.973526 25219 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
W20260709 13:08:58.945586 24593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.006s	sys 0.019s
W20260709 13:08:58.977185 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.016s	sys 0.009s
I20260709 13:08:58.972007 24524 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:58.978112 25216 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
W20260709 13:08:58.978693 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.016s	sys 0.010s
I20260709 13:08:58.956681 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:08:58.972268 24597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.013s	sys 0.046s
I20260709 13:08:58.982656 24669 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:08:58.988250 24520 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.989272 25218 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:58.998660 24520 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:58.976786 26677 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:58.972260 24523 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:58.971613 25214 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:58.956792 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.015s	sys 0.028s
W20260709 13:08:59.018843 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.016s	sys 0.028s
I20260709 13:08:58.958248 26612 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.021286 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.022991 24591 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:59.024358 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:59.025338 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:59.025997 24594 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:58.941241 26545 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:59.024971 24591 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.031193 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:58.958514 26944 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:59.038923 26956 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.039431 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:59.039532 26956 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.040132 24594 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.041817 26520 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:58.978508 24593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.006s	sys 0.019s
I20260709 13:08:59.042809 26956 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:59.032963 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47310.9us
W20260709 13:08:59.032570 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 663528us
I20260709 13:08:59.043452 26859 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:58.961210 26909 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.044456 26909 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.043789 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:59.049938 26891 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:59.050343 26891 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.050673 26891 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.028257 26571 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.059633 24594 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:08:58.972911 26764 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:58.999256 24518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.003s	sys 0.018s
W20260709 13:08:59.061883 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.008s	sys 0.051s
W20260709 13:08:59.036087 25183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.020s	sys 0.018s
W20260709 13:08:59.081517 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.008s	sys 0.051s
I20260709 13:08:59.061579 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:59.063428 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:58.985611 26845 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.081574 25183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.020s	sys 0.018s
W20260709 13:08:59.083841 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.063779 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:59.087144 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:59.087646 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:59.088899 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:59.093538 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:59.003118 26962 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:59.100334 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:08:58.948902 26957 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:08:58.970571 26729 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.033142 26603 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:58.977866 26843 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.092530 26671 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:59.098686 26953 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:59.122851 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 61347.1us
I20260709 13:08:59.141518 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:59.143420 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:08:59.143987 26677 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.146116 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:59.146771 24595 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:59.148005 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:08:59.104476 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.150876 26973 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:59.066859 26944 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.126886 26859 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.114802 25210 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:08:59.065784 26924 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:59.128356 26416 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:59.061054 26955 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.092985 26937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.016s	sys 0.016s
I20260709 13:08:59.139518 25214 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:08:59.144659 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:59.112833 26909 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.103686 26926 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:59.067787 26897 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:59.128271 26876 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:59.091424 26407 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.020s	sys 0.049s
I20260709 13:08:59.172420 26942 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.172676 26407 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.020s	sys 0.049s
I20260709 13:08:59.096163 26520 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:08:59.133671 25211 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:59.096359 26948 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:08:59.130947 26879 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.134275 26717 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:59.096601 26845 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:59.172117 26909 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:59.156031 24665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.009s	sys 0.034s
I20260709 13:08:59.179986 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:59.189023 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:59.158607 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2420) took 1333 ms. Trace:
W20260709 13:08:59.164258 26937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.017s	sys 0.016s
I20260709 13:08:59.199826 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:59.200549 24595 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:08:59.201968 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:59.202172 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:59.203032 24595 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6.
I20260709 13:08:59.203838 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:59.203999 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:59.206866 26845 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:59.178215 26671 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:59.210770 26843 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.175644 26871 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:59.212395 26943 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:59.212103 26871 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.213177 26943 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:59.213691 26943 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.214150 26943 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.174019 26416 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:59.166392 26753 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:59.173229 26942 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:59.222997 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:59.233321 24594 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:59.227061 26944 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.227532 26891 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.228420 26795 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:59.197013 26717 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:59.164866 26859 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:59.196009 24665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.009s	sys 0.034s
I20260709 13:08:59.242249 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2425) took 1399 ms. Trace:
I20260709 13:08:59.174705 26955 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.188149 26493 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:08:59.174664 26776 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.229709 26746 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:59.234794 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.214922 26871 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.259883 24595 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:59.197659 26876 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.220311 26545 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:59.261417 24524 rpcz_store.cc:276] 0709 13:08:57.843356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.843729 (+   373us) service_pool.cc:224] Handling call
0709 13:08:59.241982 (+1398253us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540030fa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:59.242165 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2499007744}
I20260709 13:08:59.271943 26891 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:59.272342 26764 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:08:59.272598 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.272935 26764 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.205031 24592 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:08:59.274982 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:08:59.281718 24594 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:08:59.279559 24490 consensus_peers.cc:597] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7ec39f0d4e04761ae598f1245692799. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:59.283227 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:59.283656 26776 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.284592 26520 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.285547 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:08:59.259713 26717 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.245524 26753 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:08:59.281505 26416 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:59.286804 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:08:59.289698 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:08:59.291980 26520 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:59.292599 26520 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:08:59.293514 26520 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.296207 26747 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.298605 26955 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.299265 26729 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.300187 26753 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.289330 26842 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.302253 26842 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:59.303176 26791 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:59.289696 26717 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:59.310359 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.289485 26948 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:59.328890 24522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2432) took 1434 ms (client timeout 1674 ms). Trace:
W20260709 13:08:59.332129 24522 rpcz_store.cc:269] 0709 13:08:57.893972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.927688 (+ 33716us) service_pool.cc:224] Handling call
0709 13:08:59.324429 (+1396741us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400442854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:08:59.328802 (+  4373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889580416}
I20260709 13:08:59.326766 26963 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.337452 26729 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:59.387562 24523 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:08:59.388985 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:08:59.365061 26940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.020s	sys 0.042s
I20260709 13:08:59.365401 26935 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.313341 26764 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:59.393208 26922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.036s	sys 0.052s
W20260709 13:08:59.476027 26940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.021s	sys 0.042s
I20260709 13:08:59.487627 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.425697 26671 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.505363 24563 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.642s (SENT) [suppressed 7 similar messages]
W20260709 13:08:59.475255 26722 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.070s	user 0.011s	sys 0.011s
W20260709 13:08:59.512303 25217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.025s	sys 0.022s
W20260709 13:08:59.518595 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.518567 25217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.026s	sys 0.023s
W20260709 13:08:59.497208 26922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.037s	sys 0.052s
I20260709 13:08:59.528447 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:59.492245 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:59.391974 26729 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.499387 26545 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:59.499234 26876 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:59.538219 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.518395 26948 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:08:59.519124 26958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.012s	sys 0.036s
I20260709 13:08:59.540524 24522 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:08:59.389032 26963 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.137s
W20260709 13:08:59.524964 26889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.021s	sys 0.031s
W20260709 13:08:59.539800 26849 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.048s	user 0.014s	sys 0.000s
I20260709 13:08:59.534300 26944 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.533718 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.583421 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:08:59.522655 26671 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:59.545660 26958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.012s	sys 0.037s
I20260709 13:08:59.539712 24592 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.631560 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.635283 24522 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:08:59.608945 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57413.9us
W20260709 13:08:59.567420 26889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.021s	sys 0.031s
I20260709 13:08:59.533793 26722 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.533216 26943 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.505067 26935 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.543188 26876 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:59.637537 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.630299 26953 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:59.621368 26942 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:59.621739 26859 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:59.620777 26870 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.548687 26948 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:08:59.198469 24518 rpcz_store.cc:276] 0709 13:08:57.823662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.828366 (+  4704us) service_pool.cc:224] Handling call
0709 13:08:58.324277 (+495911us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21eee 0000000000375939 00007f17c0e951e0 00007f17c0f5e0c4 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:58.324432 (+   155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.324640 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:58.324950 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:08:59.116556 (+791606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:59.128228 (+ 11672us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:59.132371 (+  4143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.141910 (+  9539us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.157470 (+ 15560us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1122,"prepare.queue_time_us":6414,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":23884,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9336,"spinlock_wait_cycles":18453632,"thread_start_us":743684,"threads_started":1}
W20260709 13:08:59.643343 26880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.033s	sys 0.063s
I20260709 13:08:59.637353 24639 leader_election.cc:400] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6.
I20260709 13:08:59.641916 24516 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:08:59.674031 26953 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.708878 24639 leader_election.cc:403] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:08:59.712769 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.717723 24522 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:08:59.718359 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 81174.7us
I20260709 13:08:59.719485 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:08:59.686906 26842 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:59.544891 26545 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:59.697295 26952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.022s	sys 0.048s
W20260709 13:08:59.741007 26952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.023s	sys 0.048s
I20260709 13:08:59.741446 26943 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:08:59.745182 26966 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:08:59.747115 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2539) took 1920 ms. Trace:
W20260709 13:08:59.749770 26974 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:08:59.747584 24668 rpcz_store.cc:276] 0709 13:08:57.826753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.826886 (+   133us) service_pool.cc:224] Handling call
0709 13:08:57.842649 (+ 15763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.875002 (+ 32353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.875047 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.882911 (+  7864us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.971516 (+1088605us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:58.971556 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.971634 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.746833 (+775199us) raft_consensus.cc:1685] finished
0709 13:08:59.746862 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.747038 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7250,"thread_start_us":1027009,"threads_started":1,"wal-append.queue_time_us":1421777}
W20260709 13:08:59.708541 26880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.033s	sys 0.064s
W20260709 13:08:59.752444 26633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.013s	sys 0.029s
W20260709 13:08:59.766784 26633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.013s	sys 0.029s
I20260709 13:08:59.714231 26917 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.730114 26953 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:59.708066 26889 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:59.693928 26870 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:59.780525 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.013s	sys 0.026s
W20260709 13:08:59.783625 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.013s	sys 0.026s
W20260709 13:08:59.783962 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 686004us
I20260709 13:08:59.734278 26944 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6.
W20260709 13:08:59.792089 24672 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.013s	sys 0.038s
W20260709 13:08:59.793300 24672 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.014s	sys 0.038s
W20260709 13:08:59.794900 24673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.006s	sys 0.034s
W20260709 13:08:59.795346 24673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.006s	sys 0.034s
W20260709 13:08:59.802665 24596 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.001s
W20260709 13:08:59.805153 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.016s	sys 0.040s
W20260709 13:08:59.864379 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.016s	sys 0.041s
W20260709 13:08:59.805465 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.864959 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 777335us
W20260709 13:08:59.815089 24599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.051s	sys 0.057s
W20260709 13:08:59.865554 24599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.051s	sys 0.057s
I20260709 13:08:59.865778 24596 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:08:59.789698 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.836350 26880 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:59.766470 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:59.792984 26764 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:59.837579 25184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.017s	sys 0.042s
I20260709 13:08:59.781930 26917 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:08:59.843564 24670 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.028s	sys 0.036s
I20260709 13:08:59.808215 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.813555 26834 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:59.863010 24525 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:59.847473 24517 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.026s	sys 0.033s
I20260709 13:08:59.825281 26729 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:59.809816 24598 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.010s	sys 0.048s
W20260709 13:08:59.826364 24667 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.020s	sys 0.037s
W20260709 13:08:59.861168 26641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.035s	sys 0.032s
W20260709 13:08:59.882609 26961 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:08:59.882275 26880 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:59.882848 26975 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:08:59.883912 26935 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:59.866799 24518 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:08:59.893189 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.867483 24521 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:08:59.893818 26976 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 13:08:59.854245 26965 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:59.827827 26916 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:08:59.799062 26889 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.855196 26842 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.899821 25184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.017s	sys 0.042s
W20260709 13:08:59.925745 26747 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.009s
W20260709 13:08:59.901674 24670 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.029s	sys 0.036s
W20260709 13:08:59.913432 24598 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.010s	sys 0.048s
W20260709 13:08:59.913589 24667 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.020s	sys 0.037s
I20260709 13:08:59.896512 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 963) took 1089 ms. Trace:
I20260709 13:08:59.943925 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 961) took 1186 ms. Trace:
W20260709 13:08:59.952291 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 446937us
W20260709 13:08:59.913236 24517 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.027s	sys 0.033s
I20260709 13:08:59.955478 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.972793 24523 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:59.901101 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:08:59.918875 26641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.035s	sys 0.033s
W20260709 13:08:59.902271 24591 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.005s
I20260709 13:08:59.909765 26917 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:08:59.924497 26968 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.230s	user 0.001s	sys 0.001s
W20260709 13:08:59.918530 26962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.019s	sys 0.019s
W20260709 13:08:59.948143 26979 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:59.909571 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:08:59.969866 26311 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:08:59.997030 26311 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:59.956456 26717 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.002s
I20260709 13:08:59.967271 25215 rpcz_store.cc:276] 0709 13:08:58.757858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.775553 (+ 17695us) service_pool.cc:224] Handling call
0709 13:08:58.775875 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.949571 (+173696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.949618 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.949681 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:58.949743 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.943686 (+993943us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54001b7454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:59.943737 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.943865 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398839552}
I20260709 13:08:59.908294 26948 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:08:59.908245 26876 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:08:59.924046 26671 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:08:59.896106 26960 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.007s	sys 0.031s
I20260709 13:08:59.967124 25217 rpcz_store.cc:276] 0709 13:08:58.807174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.807316 (+   142us) service_pool.cc:224] Handling call
0709 13:08:58.807709 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.830499 (+ 22790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.830531 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.831004 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.522593 (+691589us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:59.522674 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.522810 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.896224 (+373414us) raft_consensus.cc:1685] finished
0709 13:08:59.896251 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.896442 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17926,"raft.queue_time_us":24868,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9379,"thread_start_us":691126,"threads_started":1,"wal-append.queue_time_us":1005839}
W20260709 13:09:00.002995 26960 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.007s	sys 0.032s
I20260709 13:09:00.000511 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:59.992600 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:00.003722 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:00.000578 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:08:59.989387 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:59.974538 26958 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.004886 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:00.005234 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 439) took 2105 ms. Trace:
I20260709 13:09:00.005378 26958 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:08:59.992136 26940 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:09:00.005716 24593 rpcz_store.cc:276] 0709 13:08:57.899406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.059949 (+160543us) service_pool.cc:224] Handling call
0709 13:08:58.134481 (+ 74532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.297538 (+163057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.297574 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.337507 (+ 39933us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.042649 (+705142us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:59.042700 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.042787 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.004961 (+962174us) raft_consensus.cc:1685] finished
0709 13:09:00.004988 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.005153 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32737,"raft.queue_time_us":41989,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":21464,"thread_start_us":804598,"threads_started":2,"wal-append.queue_time_us":1210028}
I20260709 13:09:00.004840 25211 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:00.007634 26958 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:00.008025 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:00.008278 25219 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:00.004662 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:08:59.977571 26987 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.009065 24595 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.009384 26987 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.011646 26987 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:00.013298 25210 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.005863 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:00.017517 24522 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.018643 26889 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.996254 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:00.021651 24523 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:00.022713 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:00.023660 24523 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:08:59.995428 24525 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:09:00.024580 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:08:59.982308 26909 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.001611 26311 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:08:59.968112 26722 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:00.005954 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:00.026324 24523 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.087638 24599 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.084203 24522 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:00.088975 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2437) took 1104 ms. Trace:
I20260709 13:09:00.089411 24522 rpcz_store.cc:276] 0709 13:08:58.984660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.005631 (+1020971us) service_pool.cc:224] Handling call
0709 13:09:00.088890 (+ 83259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.009057 24592 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:08:59.961169 26916 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:08:59.990840 26962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.020s	sys 0.019s
W20260709 13:09:00.003948 26977 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:00.025120 24525 pending_rounds.cc:85] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 4
I20260709 13:09:00.138764 24525 pending_rounds.cc:107] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:09:00.139134 24525 raft_consensus.cc:2889] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:00.090528 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:00.140280 24522 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.097693 24595 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:00.125005 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1322) took 2236 ms. Trace:
I20260709 13:09:00.126406 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:00.127187 26641 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:59.968356 26842 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:00.141911 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2423) took 2317 ms. Trace:
I20260709 13:08:59.983632 24591 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:00.176167 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:00.200364 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.212850 24595 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:00.149294 24599 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:09:00.216202 24523 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:00.216952 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2438) took 1214 ms. Trace:
I20260709 13:09:00.001160 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:00.198350 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:00.217423 24523 rpcz_store.cc:276] 0709 13:08:59.002401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.024291 (+1021890us) service_pool.cc:224] Handling call
0709 13:09:00.216865 (+192574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.209916 24525 rpcz_store.cc:276] 0709 13:08:57.824918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.825022 (+   104us) service_pool.cc:224] Handling call
0709 13:08:57.825350 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.862557 (+2037207us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b58007406d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbea20aa 00007f17bbf24447 00007f17bbf3cfe7 00007f17bbf3e7de 00007f17bbf48b49 00007f17bbf49416 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4
0709 13:09:00.139687 (+277130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.141838 (+  2151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2763052288}
I20260709 13:09:00.224162 24522 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
W20260709 13:09:00.174367 26967 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:00.226799 24525 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:00.227475 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 449) took 1038 ms. Trace:
I20260709 13:09:00.227824 24525 rpcz_store.cc:276] 0709 13:08:59.188901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.226223 (+1037322us) service_pool.cc:224] Handling call
0709 13:09:00.226616 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.227252 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.227427 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9600}
W20260709 13:09:00.171551 26791 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.000s
I20260709 13:09:00.230108 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.218190 24597 rpcz_store.cc:276] 0709 13:08:57.888368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.888519 (+   151us) service_pool.cc:224] Handling call
0709 13:08:57.888855 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.195951 (+307096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.195983 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.202902 (+  6919us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.980589 (+777687us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:58.980652 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.323864 (+343212us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54001937d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:08:59.323935 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.032721 (+708786us) raft_consensus.cc:1685] finished
0709 13:09:00.032744 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.124888 (+ 92144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":748,"raft.queue_time_us":41434,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":25928,"spinlock_wait_cycles":687850752,"thread_start_us":683920,"threads_started":1,"wal-append.queue_time_us":1218409}
I20260709 13:09:00.169169 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.180286 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:00.139840 26889 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.032955 26942 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.193s
I20260709 13:09:00.173700 26880 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:00.212481 26916 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:00.238955 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:00.219257 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 447) took 1203 ms. Trace:
I20260709 13:09:00.033182 26717 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.164204 25210 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:00.169519 26948 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.134445 26909 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.142341 26962 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:00.229573 26753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.000s	sys 0.017s
I20260709 13:09:00.247768 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 444) took 1296 ms. Trace:
I20260709 13:09:00.232764 24518 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.233880 26957 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.248286 24520 rpcz_store.cc:276] 0709 13:08:58.951688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.951882 (+   194us) service_pool.cc:224] Handling call
0709 13:09:00.247570 (+1295688us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b540021dc54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:00.247701 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36988288}
I20260709 13:09:00.211140 26641 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:00.259039 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.250506 26791 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:00.240671 26788 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:00.255934 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:00.272965 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.269503 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.270147 25217 raft_consensus.cc:2410] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:00.271425 25214 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.267148 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.275686 25218 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:00.267684 24593 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:00.250075 26916 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.268791 26791 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:00.270220 26753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.000s	sys 0.018s
I20260709 13:09:00.314539 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.315657 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:00.316148 25217 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.298468 26962 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.241643 24591 rpcz_store.cc:276] 0709 13:08:59.011440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.024112 (+ 12672us) service_pool.cc:224] Handling call
0709 13:09:00.214720 (+1190608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.257071 26957 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.309124 26909 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:00.309909 26641 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.242100 26889 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:00.299307 26717 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:00.290622 26520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.046s	sys 0.054s
I20260709 13:09:00.253755 26948 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:00.339669 25214 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
W20260709 13:09:00.339269 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.034s	sys 0.058s
W20260709 13:09:00.340672 24638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.035s	sys 0.034s
W20260709 13:09:00.345342 24638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.035s	sys 0.034s
W20260709 13:09:00.345504 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 626068us
I20260709 13:09:00.337504 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 446) took 1385 ms. Trace:
I20260709 13:09:00.348361 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:00.347615 24519 rpcz_store.cc:276] 0709 13:08:58.952448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.952577 (+   129us) service_pool.cc:224] Handling call
0709 13:08:59.321769 (+369192us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:08:59.322047 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.364218 (+ 42171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.364258 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:59.364315 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:59.364370 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.337202 (+972832us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54002c24d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:00.337268 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.337420 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53085312}
W20260709 13:09:00.339722 26520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.046s	sys 0.054s
I20260709 13:09:00.345256 26641 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.314123 26916 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:00.366336 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 441) took 1361 ms. Trace:
W20260709 13:09:00.356174 26888 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:09:00.355716 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.399585 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:00.390233 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.407953 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:00.426687 25211 raft_consensus.cc:2368] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:09:00.370334 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 451) took 1136 ms. Trace:
W20260709 13:09:00.432917 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 448239us
I20260709 13:09:00.435590 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:00.417166 26940 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:00.438834 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.416110 26717 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.429314 26842 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:00.465149 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 450) took 1244 ms. Trace:
W20260709 13:09:00.473588 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 82634us
I20260709 13:09:00.466707 24522 rpcz_store.cc:276] 0709 13:08:59.220643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.227483 (+1006840us) service_pool.cc:224] Handling call
0709 13:09:00.227744 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.227954 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:00.240207 (+ 12253us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.463575 (+223368us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.464658 (+  1083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.464719 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:00.464784 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.464885 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.465055 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5678,"prepare.queue_time_us":12690,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":5936,"thread_start_us":217629,"threads_started":1}
I20260709 13:09:00.477355 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 447) took 1524 ms. Trace:
W20260709 13:09:00.478202 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 70350.6us
I20260709 13:09:00.449664 26955 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.447831 26729 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:00.452834 26940 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:00.439098 26722 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:00.471021 26842 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.452383 26717 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.477862 26887 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:00.479697 26996 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:00.490314 26612 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:00.432466 24516 rpcz_store.cc:276] 0709 13:08:59.234429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.239978 (+1005549us) service_pool.cc:224] Handling call
0709 13:09:00.320991 (+ 81013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.338454 (+ 17463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.344155 (+  5701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.345792 (+  1637us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:00.349979 (+  4187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.356882 (+  6903us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.367627 (+ 10745us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:00.496089 27004 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:00.495020 26722 consensus_queue.cc:1243] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:00.490901 26729 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:00.510468 25217 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:00.511883 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:00.512586 26842 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:00.512580 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:00.514609 27002 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:09:00.515791 27003 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:09:00.515806 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.519323 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:00.523963 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 79764.2us
I20260709 13:09:00.525053 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:00.498847 26948 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:00.529513 26940 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.532346 27025 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:00.499434 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.532904 27025 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:00.521279 27001 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:09:00.503719 26996 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:00.513377 26717 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:00.535485 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:01.064435 26978 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.138s	user 0.000s	sys 0.002s
I20260709 13:09:00.525624 26955 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.334018 26729 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:01.334255 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 560) took 1078 ms. Trace:
I20260709 13:09:01.334471 26955 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.330750 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.334728 25218 rpcz_store.cc:276] 0709 13:09:00.255763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.294272 (+ 38509us) service_pool.cc:224] Handling call
0709 13:09:00.535286 (+241014us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:01.334162 (+798876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25285376}
I20260709 13:09:01.335474 25217 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:01.335964 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 972) took 1022 ms. Trace:
I20260709 13:09:01.336158 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.336283 25217 rpcz_store.cc:276] 0709 13:09:00.313683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.517714 (+204031us) service_pool.cc:224] Handling call
0709 13:09:01.335911 (+818197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:00.654412 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 464) took 1725 ms. Trace:
I20260709 13:09:01.337392 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.337456 24673 rpcz_store.cc:276] 0709 13:08:58.929242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.027696 (+ 98454us) service_pool.cc:224] Handling call
0709 13:08:59.028025 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.028228 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:59.795730 (+767502us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.654071 (+858341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.654123 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:00.654164 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.654231 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.654354 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":479023,"prepare.queue_time_us":971298,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":438065,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":19612,"thread_start_us":1151963,"threads_started":2,"wal-append.queue_time_us":605883}
I20260709 13:09:00.639595 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 448) took 1604 ms. Trace:
I20260709 13:09:01.339751 24596 rpcz_store.cc:276] 0709 13:08:59.034858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.034979 (+   121us) service_pool.cc:224] Handling call
0709 13:09:00.639355 (+1604376us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54001cb454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:00.639510 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444958464}
W20260709 13:09:00.581583 27020 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
I20260709 13:09:01.066262 26612 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.741053 26876 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.341254 26955 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:01.341324 26612 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.341938 26955 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.341710 26876 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:01.342451 26955 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.343590 26612 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:01.344038 26876 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:01.218030 26311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.000s	sys 0.009s
I20260709 13:09:00.740662 27005 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.345144 26311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.002s	sys 0.009s
I20260709 13:09:01.060550 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:00.537758 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:00.815567 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.332808 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 807765us
W20260709 13:09:01.347568 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.349167 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:01.333349 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.641209 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 463) took 1712 ms. Trace:
I20260709 13:09:01.350468 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:01.351378 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.580046 26980 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.676s	user 0.004s	sys 0.000s
I20260709 13:09:01.351990 26311 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:00.520685 26842 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:01.353592 26842 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.355091 27025 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:01.355691 27025 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:01.346804 25219 raft_consensus.cc:2410] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:09:00.572674 27010 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:09:01.356918 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 969) took 1044 ms. Trace:
I20260709 13:09:01.357161 27025 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:00.740602 27006 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.357944 27025 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:01.358275 27006 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.359184 27025 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.351125 24672 rpcz_store.cc:276] 0709 13:08:58.928946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.999826 (+ 70880us) service_pool.cc:224] Handling call
0709 13:08:59.000212 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.000490 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:59.794396 (+793906us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.232212 (+437816us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.640547 (+408335us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18001d05c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:09:00.640769 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.640839 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:00.640898 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.640977 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.641138 (+   161us) inbound_call.cc:177] Queueing success response
0709 13:09:00.937992 (+296854us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18001d05c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1
0709 13:09:01.326016 (+388024us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b18001d05c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:09:01.341458 (+ 15442us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18001d05c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59557 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
Metrics: {"mutex_wait_us":99704,"prepare.queue_time_us":982867,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":101,"raft.queue_time_us":420522,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":33529,"spinlock_wait_cycles":18832512,"thread_start_us":1128581,"threads_started":2,"wal-append.queue_time_us":572530}
I20260709 13:09:01.360525 27006 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:00.897728 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:00.578681 25211 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:00.561435 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.361675 25214 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.508638 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1331) took 1208 ms. Trace:
W20260709 13:09:01.220286 26962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.006s	sys 0.022s
I20260709 13:09:00.561959 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2543) took 2287 ms. Trace:
I20260709 13:09:01.372053 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:01.373277 24524 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:01.362375 25218 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:00.386699 24598 rpcz_store.cc:276] 0709 13:08:59.005137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.005303 (+   166us) service_pool.cc:224] Handling call
0709 13:08:59.021714 (+ 16411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.021938 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:59.965697 (+943759us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.363656 (+397959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.363726 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:00.363787 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.364933 (+  1146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.366255 (+  1322us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1177790,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":3099,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":18108,"thread_start_us":1337439,"threads_started":2}
I20260709 13:09:00.709287 26916 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:00.575448 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:00.526180 26722 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:00.937790 27017 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.420s	user 0.001s	sys 0.000s
W20260709 13:09:00.635198 26953 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.001s
I20260709 13:09:00.707612 26834 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.357295 25219 rpcz_store.cc:276] 0709 13:09:00.312749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.060195 (+747446us) service_pool.cc:224] Handling call
0709 13:09:01.356857 (+296662us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:01.374117 26962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.007s	sys 0.023s
W20260709 13:09:01.214929 24667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.011s	sys 0.005s
I20260709 13:09:00.479383 24517 rpcz_store.cc:276] 0709 13:08:58.952817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.955214 (+  2397us) service_pool.cc:224] Handling call
0709 13:08:59.002805 (+ 47591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.066673 (+ 63868us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:59.992542 (+925869us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.443653 (+451111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.448608 (+  4955us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:00.455638 (+  7030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.471212 (+ 15574us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.477285 (+  6073us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":201312,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":127,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7785,"thread_start_us":1265222,"threads_started":2}
I20260709 13:09:01.334813 26889 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:01.332957 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 813641us
I20260709 13:09:01.369334 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 561) took 1097 ms. Trace:
I20260709 13:09:01.371343 25216 raft_consensus.cc:2376] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5. Re-sending same reply.
I20260709 13:09:01.426141 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 975) took 1010 ms. Trace:
W20260709 13:09:00.938066 27011 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.452s	user 0.001s	sys 0.000s
W20260709 13:09:01.375322 24638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.009s	sys 0.005s
I20260709 13:09:00.931123 26942 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:01.215211 24670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.015s
W20260709 13:09:01.434593 24670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.009s	sys 0.018s
W20260709 13:09:01.349015 26926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.010s	sys 0.003s
W20260709 13:09:00.854578 27008 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.357s	user 0.001s	sys 0.001s
I20260709 13:09:01.378242 24674 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:09:01.372159 24665 rpcz_store.cc:276] 0709 13:08:58.274919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.275786 (+   867us) service_pool.cc:224] Handling call
0709 13:08:58.276230 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.364093 (+ 87863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.364134 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.404918 (+ 40784us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.262618 (+857700us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:59.262679 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.533528 (+1270849us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b540044e154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:00.533573 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.533616 (+    43us) raft_consensus.cc:1685] finished
0709 13:09:00.533629 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.561844 (+ 28215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44593,"raft.queue_time_us":24689,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":16229,"spinlock_wait_cycles":146130176,"thread_start_us":758021,"threads_started":1,"wal-append.queue_time_us":1100543,"wal-append.run_cpu_time_us":4137,"wal-append.run_wall_time_us":1448195}
I20260709 13:09:01.392581 25213 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:01.396144 24524 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:00.960590 26860 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.157518 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 809160us
I20260709 13:09:01.445271 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 971) took 1131 ms. Trace:
I20260709 13:09:01.445640 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:01.446007 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 95627.2us
I20260709 13:09:01.446260 24665 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.573475 26870 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:00.740818 26965 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.405717 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:00.741308 26944 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:01.407424 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:00.753012 27009 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
W20260709 13:09:00.817036 27000 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.386s	user 0.001s	sys 0.001s
I20260709 13:09:00.762890 26764 raft_consensus.cc:2764] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:00.786867 26641 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.058557 26957 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:01.415575 25214 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:00.577720 27021 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:01.411392 24667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.013s	sys 0.006s
I20260709 13:09:01.345539 27005 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.373801 26831 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.420843 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:01.536623 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 973) took 1184 ms. Trace:
W20260709 13:09:01.430052 24638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.009s	sys 0.005s
I20260709 13:09:01.571221 24520 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:01.374842 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 592) took 1073 ms. Trace:
I20260709 13:09:01.423959 25212 rpcz_store.cc:276] 0709 13:09:00.272375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.274543 (+  2168us) service_pool.cc:224] Handling call
0709 13:09:00.537580 (+263037us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:01.369261 (+831681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28771584}
I20260709 13:09:01.426573 25216 rpcz_store.cc:276] 0709 13:09:00.415640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.521956 (+106316us) service_pool.cc:224] Handling call
0709 13:09:01.426068 (+904112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.432874 26955 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:01.433472 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:01.439203 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:01.440724 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 108431us
I20260709 13:09:01.450904 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:01.451610 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.445681 25213 rpcz_store.cc:276] 0709 13:09:00.313391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.575130 (+261739us) service_pool.cc:224] Handling call
0709 13:09:01.445200 (+870070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.475842 24673 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:01.438540 26926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.010s	sys 0.003s
I20260709 13:09:01.476660 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.478091 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.430100 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.479068 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.479732 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.410835 26953 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:01.489459 26311 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:01.489601 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:01.496667 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:01.487253 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:01.480731 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 93171us
I20260709 13:09:01.417908 26834 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.512094 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:01.498126 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:01.496265 27011 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:01.512140 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.478691 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 566) took 1166 ms. Trace:
I20260709 13:09:01.478380 26996 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:01.489871 26633 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.510913 24518 consensus_meta.cc:287] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.240s	user 0.016s	sys 0.000s
I20260709 13:09:01.440404 26942 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:01.534904 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:01.537170 24665 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:01.563139 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 462) took 2634 ms. Trace:
I20260709 13:09:00.753603 26880 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.496628 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:01.454393 26860 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.572359 25218 rpcz_store.cc:276] 0709 13:09:00.301619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.361840 (+1060221us) service_pool.cc:224] Handling call
0709 13:09:01.362172 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.374595 (+ 12423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.374788 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.573042 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:01.570048 25214 rpcz_store.cc:276] 0709 13:09:00.352709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.897378 (+544669us) service_pool.cc:224] Handling call
0709 13:09:01.536541 (+639163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.531457 27032 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:01.490873 26944 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:01.604274 24599 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:01.603811 24597 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:01.605691 24596 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:01.535112 26671 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.540808 27029 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.565555 27024 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.481492 26965 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.537657 26641 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.568660 26791 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:01.672688 26311 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:01.787372 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 300218us
I20260709 13:09:01.787593 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.788725 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.568702 26873 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:01.680071 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:01.829417 25212 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.829598 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.606745 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:01.830325 24665 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:01.830422 24524 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:01.669245 24666 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
W20260709 13:09:01.790745 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 294149us
I20260709 13:09:01.795439 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.840894 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:01.532243 27030 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.770752 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.789476 25219 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
W20260709 13:09:01.789529 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.796538 24669 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:01.373885 24592 rpcz_store.cc:276] 0709 13:08:59.295400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.130106 (+834706us) service_pool.cc:224] Handling call
0709 13:09:00.130450 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.173714 (+ 43264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.173771 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.174465 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.455176 (+280711us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:00.462739 (+  7563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.471411 (+  8672us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.497778 (+ 26367us) raft_consensus.cc:1685] finished
0709 13:09:00.497802 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.503936 (+  6134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11473,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":22718,"thread_start_us":262455,"threads_started":1,"wal-append.queue_time_us":297680,"wal-append.run_cpu_time_us":2138,"wal-append.run_wall_time_us":1039695}
I20260709 13:09:01.571817 27006 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.829792 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:01.774706 27026 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.293s	user 0.000s	sys 0.000s
I20260709 13:09:01.777191 27028 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.681318 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.833259 24521 raft_consensus.cc:2376] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6. Re-sending same reply.
I20260709 13:09:01.739565 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1327) took 2446 ms. Trace:
I20260709 13:09:01.680604 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.836263 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.565850 27021 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:01.783699 24637 connection.cc:256] RPC call timeout handler was delayed by -1.3177127150000842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
I20260709 13:09:01.791344 24522 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.808194 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:01.602690 26955 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.578094 26842 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.831409 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.896929 24665 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:01.790606 26965 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:01.624075 24591 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:01.884147 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.907976 25214 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:01.883708 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.593600 26764 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:01.889885 24594 rpcz_store.cc:276] 0709 13:08:59.292748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.306306 (+ 13558us) service_pool.cc:224] Handling call
0709 13:08:59.334025 (+ 27719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.334501 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.334544 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:59.366991 (+ 32447us) log.cc:844] Serialized 513 byte log entry
0709 13:08:59.999491 (+632500us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:59.999552 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.999616 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.739277 (+1739661us) raft_consensus.cc:1685] finished
0709 13:09:01.739307 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.739487 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":499774,"threads_started":1,"wal-append.queue_time_us":929237}
I20260709 13:09:01.892628 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.790374 24667 rpcz_store.cc:276] 0709 13:08:58.928655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.984472 (+ 55817us) service_pool.cc:224] Handling call
0709 13:08:59.062376 (+ 77904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.062590 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:59.971658 (+909068us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.562738 (+1591080us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.562804 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:01.562848 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.562926 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.563070 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":364733,"prepare.queue_time_us":938062,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":978551,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":79,"thread_start_us":2070007,"threads_started":3,"wal-append.queue_time_us":497862}
I20260709 13:09:01.897847 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.920284 24665 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:01.574941 26876 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.893465 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:01.793244 27031 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:09:01.902144 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 404070us
I20260709 13:09:01.920885 24598 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
W20260709 13:09:01.791496 25210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 582) took 1819 ms (client timeout 2216 ms). Trace:
I20260709 13:09:01.903383 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.925773 24673 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:09:01.926712 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.927906 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:01.904398 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:01.904356 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 63542.6us
I20260709 13:09:01.934764 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:01.880357 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.842367 27034 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:09:01.913314 24637 connection.cc:256] RPC call timeout handler was delayed by -1.1366872919999196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
I20260709 13:09:01.915664 25212 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
W20260709 13:09:01.938445 24637 connection.cc:256] RPC call timeout handler was delayed by -1.0754872919999343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 13:09:01.939296 25214 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:01.790716 26717 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:01.917809 25213 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:09:01.736922 26722 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.921442 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:01.944296 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:01.903383 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:01.798666 26870 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:01.882714 27041 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:09:01.837409 24518 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:01.923579 24517 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:01.924692 24491 connection.cc:256] RPC call timeout handler was delayed by -1.4178328730000658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:09:01.957336 24491 connection.cc:256] RPC call timeout handler was delayed by -1.0641328730000623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 13:09:01.959816 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:01.960100 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:01.960515 24521 raft_consensus.cc:2368] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
I20260709 13:09:01.865345 26633 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.865657 26880 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.954126 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.955605 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 976) took 1443 ms. Trace:
I20260709 13:09:01.842200 26834 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:01.900684 26545 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:01.902920 27021 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.940068 26916 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:01.954974 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.895445 27006 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.987250 24594 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:01.899394 27047 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:01.918195 27037 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.962815 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:01.963622 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:01.995242 24598 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.922636 26965 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.971308 25213 rpcz_store.cc:276] 0709 13:09:00.511954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.917190 (+1405236us) service_pool.cc:224] Handling call
0709 13:09:01.917529 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:01.955271 (+ 37742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.955548 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.791054 27029 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.969472 26717 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:01.974102 24639 leader_election.cc:400] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:09:02.019732 24639 leader_election.cc:403] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:01.979171 24522 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:02.022223 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:02.023794 24522 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:02.024494 24525 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: [4.6-6.7]
W20260709 13:09:01.985683 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 382138us
I20260709 13:09:01.993389 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:01.961723 27018 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.916576 26842 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.892072 27030 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.918852 26955 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.004370 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:01.989156 26545 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:02.005669 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:02.071767 24519 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:01.994462 27037 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.925966 26764 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:01.969762 24518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 457) took 2056 ms (client timeout 2159 ms). Trace:
I20260709 13:09:01.865303 27032 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:01.830811 27024 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:02.027115 25215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 587) took 1835 ms (client timeout 2169 ms). Trace:
I20260709 13:09:02.055089 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:02.066653 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 92675.4us
I20260709 13:09:01.991066 26834 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:02.086084 25215 rpcz_store.cc:269] 0709 13:09:00.192131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.192266 (+   135us) service_pool.cc:224] Handling call
0709 13:09:02.026928 (+1834662us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540034e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:02.027060 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816925056}
I20260709 13:09:01.987944 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:02.032680 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:02.069720 24594 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:01.964218 26889 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:01.992828 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:01.905431 27028 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:01.943197 26876 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:01.789739 26671 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:01.964821 26722 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:01.925483 25210 rpcz_store.cc:269] 0709 13:08:59.972212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.986039 (+ 13827us) service_pool.cc:224] Handling call
0709 13:09:01.791311 (+1805272us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b540009e7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:01.791440 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21868800}
I20260709 13:09:02.075960 24674 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:02.086045 27050 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:02.125388 27050 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:02.125823 27050 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.130836 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 448) took 2953 ms. Trace:
I20260709 13:09:02.131268 24523 rpcz_store.cc:276] 0709 13:08:59.178224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.226149 (+1047925us) service_pool.cc:224] Handling call
0709 13:09:01.160028 (+933879us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21eee 0000000000375939 00007f17c0e951e0 00007f17c0f5e0c4 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:09:01.160249 (+   221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.349828 (+189579us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:01.482915 (+133087us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.696766 (+213851us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.735180 (+ 38414us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.735427 (+   247us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:01.735491 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.735671 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.130534 (+394863us) raft_consensus.cc:1685] finished
0709 13:09:02.130628 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.130765 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191361,"prepare.queue_time_us":574617,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":189521,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":21842,"spinlock_wait_cycles":5872256,"thread_start_us":232254,"threads_started":2,"wal-append.queue_time_us":578914}
I20260709 13:09:02.136260 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:01.790138 25211 rpcz_store.cc:276] 0709 13:09:00.312101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.408893 (+1096792us) service_pool.cc:224] Handling call
0709 13:09:01.409240 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.430566 (+ 21326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.434702 (+  4136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.436326 (+  1624us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:01.441182 (+  4856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.445217 (+  4035us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.474005 (+ 28788us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1159,"raft.queue_time_us":11157,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13421}
I20260709 13:09:02.140657 26641 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:02.144702 26831 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.543s	user 0.001s	sys 0.005s
I20260709 13:09:02.146026 26633 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.146605 26633 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:02.147143 26633 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:02.149451 24666 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:02.152446 26873 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:02.152885 26873 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.071306 27018 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.088881 27005 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.082209 24598 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:01.964900 26870 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.000635 26965 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:02.085980 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:02.003320 24516 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:02.000324 27047 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.103015 26953 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:02.093115 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:02.095528 24599 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:02.102097 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.083729 27037 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.238488 24597 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:09:02.239738 26870 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.073966 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.000702 26916 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:02.107937 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 299813us
I20260709 13:09:02.074311 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:02.112330 27012 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:02.089219 27052 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:02.114137 27028 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:02.115104 27036 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:09:02.087492 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:02.220072 26965 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.238384 24519 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:02.084427 24518 rpcz_store.cc:269] 0709 13:08:59.913517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.974710 (+ 61193us) service_pool.cc:224] Handling call
0709 13:09:01.964969 (+1990259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.089382 26717 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.243594 26880 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.458814 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:02.434509 27021 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.459650 27054 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:02.459791 24596 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:02.459985 26870 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:02.460249 27054 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:02.214370 26545 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.242334 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.461805 27054 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.462379 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:02.463587 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.464037 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 559) took 2209 ms. Trace:
I20260709 13:09:02.346814 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:02.464411 25217 rpcz_store.cc:276] 0709 13:09:00.254456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.338334 (+1083878us) service_pool.cc:224] Handling call
0709 13:09:01.338617 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.338932 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.338957 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.339383 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.566130 (+226747us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:01.566188 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.566276 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.463848 (+897572us) raft_consensus.cc:1685] finished
0709 13:09:02.463866 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.463973 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5233,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":226363,"threads_started":1,"wal-append.queue_time_us":555383}
I20260709 13:09:02.465641 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:02.241791 24525 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:02.466501 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:02.241506 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:02.467157 24522 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
W20260709 13:09:02.467851 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.242492 27038 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.189270 26876 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:02.216121 26969 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.468961 27052 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.469815 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:02.220387 26633 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.470970 26633 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:02.471081 27037 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:02.471961 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.244249 26860 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:02.473387 26633 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:02.473829 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 511148us
I20260709 13:09:02.474131 26633 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:02.371563 27050 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:02.351955 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 407734us
W20260709 13:09:02.472960 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 385509us
I20260709 13:09:02.458114 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.471473 27052 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.469630 26969 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:02.473933 26876 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:02.495416 24638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.000s	sys 0.020s
W20260709 13:09:02.494794 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 462159us
W20260709 13:09:02.495906 24638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.000s	sys 0.020s
I20260709 13:09:02.477699 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:02.500964 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:02.502804 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:02.503594 24672 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.505183 24563 leader_election.cc:400] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
I20260709 13:09:02.241007 27018 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.468088 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:02.479043 24523 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:02.527338 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.467916 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.468844 27038 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.478595 26942 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:02.474717 26633 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:02.539315 24672 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:02.476074 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.464740 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.484328 26955 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.523802 27052 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.540479 24517 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:02.637656 24671 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.013s
W20260709 13:09:02.532222 27039 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.020s	sys 0.021s
I20260709 13:09:02.528543 27028 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.620754 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:02.474785 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:02.689985 24668 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
W20260709 13:09:02.690327 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 215609us
I20260709 13:09:02.523305 27012 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:02.662266 24671 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.007s	sys 0.013s
I20260709 13:09:02.616859 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:02.695595 24672 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:02.538594 26876 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.468390 26873 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.692327 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:02.528280 26831 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
W20260709 13:09:02.713680 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 247241us
I20260709 13:09:02.541805 27038 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.718011 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:02.702258 26955 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.689145 27052 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:02.710420 27060 ts_tablet_manager.cc:933] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
I20260709 13:09:02.710489 24600 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:09:02.711297 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:02.666975 26889 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:02.716063 25217 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 3 LEARNER]: Advancing to term 5
I20260709 13:09:02.543912 27006 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:02.697511 26940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.015s	sys 0.044s
I20260709 13:09:02.725684 26955 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:02.847596 26940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.016s	sys 0.045s
W20260709 13:09:02.689302 27039 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.021s	sys 0.021s
I20260709 13:09:02.704042 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2454) took 1203 ms. Trace:
I20260709 13:09:02.849088 26955 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.849187 24517 rpcz_store.cc:276] 0709 13:09:01.496787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.001557 (+504770us) service_pool.cc:224] Handling call
0709 13:09:02.699908 (+698351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.719120 25219 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:02.621538 26880 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.689668 27028 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.855938 27028 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.856194 27052 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:02.856475 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 460) took 1291 ms. Trace:
I20260709 13:09:02.856879 24596 rpcz_store.cc:276] 0709 13:09:01.565264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.971131 (+405867us) service_pool.cc:224] Handling call
0709 13:09:02.856301 (+885170us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540018fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:02.856418 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997482752}
I20260709 13:09:02.857761 26764 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:02.858057 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.858752 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 464) took 1458 ms. Trace:
I20260709 13:09:02.859210 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.859134 24516 rpcz_store.cc:276] 0709 13:09:01.400237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.406570 (+  6333us) service_pool.cc:224] Handling call
0709 13:09:02.858598 (+1452028us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540030f554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:02.858698 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890528640}
I20260709 13:09:02.859853 24596 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:02.860625 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.704250 24593 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:02.861580 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 469) took 1064 ms. Trace:
I20260709 13:09:02.861958 24593 rpcz_store.cc:276] 0709 13:09:01.797583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.467677 (+670094us) service_pool.cc:224] Handling call
0709 13:09:02.861520 (+393843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.862900 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.866839 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 977) took 2353 ms. Trace:
I20260709 13:09:02.867386 25214 rpcz_store.cc:276] 0709 13:09:00.513188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.916537 (+1403349us) service_pool.cc:224] Handling call
0709 13:09:01.939044 (+ 22507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.939786 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.866563 (+926777us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b540066bf50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:02.866760 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50822528}
I20260709 13:09:02.851629 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:02.869771 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.870232 27064 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.766249 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 472) took 1164 ms. Trace:
I20260709 13:09:02.762125 26916 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.720379 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1346) took 1223 ms. Trace:
I20260709 13:09:02.716684 24591 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:02.692742 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:02.894088 24666 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.895684 27064 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:02.910403 24667 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:02.911092 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2564) took 1129 ms. Trace:
I20260709 13:09:02.911375 24667 rpcz_store.cc:276] 0709 13:09:01.781738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.953854 (+172116us) service_pool.cc:224] Handling call
0709 13:09:02.910026 (+956172us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b5800170798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:09:02.910224 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.910860 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.911040 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8419712}
I20260709 13:09:02.912703 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:02.714044 26876 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:02.872743 26545 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:09:02.750042 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:02.918314 25215 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:02.765621 27050 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.804090 26873 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.713522 27058 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:02.764417 26944 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:02.763072 27047 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.828781 27067 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:02.831720 27056 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:09:02.833199 27013 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:09:02.800472 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:02.846711 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.855136 26880 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:02.870401 24594 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
W20260709 13:09:02.921551 27043 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.954s	user 0.001s	sys 0.014s
W20260709 13:09:02.739653 24490 connection.cc:256] RPC call timeout handler was delayed by -1.851006386999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 13:09:02.934242 24490 connection.cc:256] RPC call timeout handler was delayed by -1.8051063870000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 13:09:02.722426 26671 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:02.874302 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1343) took 1524 ms. Trace:
I20260709 13:09:02.880631 24592 rpcz_store.cc:276] 0709 13:09:01.497298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.464506 (+967208us) service_pool.cc:224] Handling call
0709 13:09:02.715808 (+251302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.893419 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 464) took 1327 ms. Trace:
I20260709 13:09:02.913144 25217 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:02.769524 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:02.761554 27059 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:02.946729 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 254456us
I20260709 13:09:02.920362 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.922576 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2457) took 1344 ms. Trace:
I20260709 13:09:02.948251 24596 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:02.947938 24522 rpcz_store.cc:276] 0709 13:09:01.577865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.530214 (+952349us) service_pool.cc:224] Handling call
0709 13:09:02.530572 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.922108 (+391536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.922153 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.922213 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:02.922263 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.922347 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.922506 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":230410,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":391009,"threads_started":1}
I20260709 13:09:02.915349 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:02.931921 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:02.954324 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:02.955243 24594 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5.
I20260709 13:09:02.801126 26633 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:02.935600 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:02.935814 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1189) took 1456 ms. Trace:
I20260709 13:09:02.957592 24597 rpcz_store.cc:276] 0709 13:09:01.479693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.835941 (+356248us) service_pool.cc:224] Handling call
0709 13:09:02.935643 (+1099702us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54003e8d54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:02.935758 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806106368}
I20260709 13:09:02.958675 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.959461 24597 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:09:02.938016 24669 rpcz_store.cc:276] 0709 13:09:01.349445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.349565 (+   120us) service_pool.cc:224] Handling call
0709 13:09:01.349904 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.870309 (+520405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.874082 (+1003773us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400404054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:02.874250 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026548992}
I20260709 13:09:02.960275 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:02.961165 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:02.961573 24669 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:02.876034 24520 rpcz_store.cc:276] 0709 13:09:01.602178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.765268 (+1163090us) service_pool.cc:224] Handling call
0709 13:09:02.765619 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.765888 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.765913 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.765963 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:02.766001 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.766068 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.766194 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83971,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97}
I20260709 13:09:02.923367 27058 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:02.924351 27067 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:02.956574 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:02.940166 24591 rpcz_store.cc:276] 0709 13:09:01.566419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.475693 (+909274us) service_pool.cc:224] Handling call
0709 13:09:02.893340 (+417647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.972265 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:02.936342 25211 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:09:02.965036 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.977017 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:02.980017 24672 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:02.978773 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.947404 27059 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:02.988309 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 53426.6us
I20260709 13:09:02.982358 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:02.988945 24490 connection.cc:256] RPC call timeout handler was delayed by -1.70854937099989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:09:02.982882 24597 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:02.989843 24490 connection.cc:256] RPC call timeout handler was delayed by -1.5900063870000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 13:09:02.990247 24490 connection.cc:256] RPC call timeout handler was delayed by -1.5072063869999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:09:02.990564 24490 connection.cc:256] RPC call timeout handler was delayed by -1.4703063870000506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 13:09:02.990953 24490 connection.cc:256] RPC call timeout handler was delayed by -1.4280063869999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 13:09:02.991679 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:02.974712 27054 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.020s	sys 0.027s
I20260709 13:09:02.964649 24593 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.973460 27067 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.003806 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:02.997735 27059 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:02.977913 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:03.009887 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1334) took 4121 ms. Trace:
I20260709 13:09:03.014446 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.015080 24672 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:09:03.014063 24670 rpcz_store.cc:276] 0709 13:08:58.888342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.888521 (+   179us) service_pool.cc:224] Handling call
0709 13:08:58.888851 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.973563 (+ 84712us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:59.966311 (+992748us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.434950 (+1468639us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.435022 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:01.435082 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.009646 (+1574564us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54001392d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:03.009695 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.009829 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":322204,"prepare.queue_time_us":984013,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":975203,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"spinlock_wait_cycles":194218112,"thread_start_us":2079062,"threads_started":3,"wal-append.queue_time_us":512048,"wal-append.run_cpu_time_us":17895,"wal-append.run_wall_time_us":1992696}
W20260709 13:09:03.008698 27054 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.021s	sys 0.027s
I20260709 13:09:03.006090 26969 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:02.990603 27073 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:02.939589 26889 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.025213 24669 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:03.036768 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.037895 24669 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:09:03.039227 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:02.993511 27038 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:02.988523 27060 tablet_copy_client.cc:323] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.129:45343
I20260709 13:09:03.042124 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:03.042487 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50887us
I20260709 13:09:03.046547 26876 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.046504 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:03.023442 24591 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:09:03.048463 24591 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.049283 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1342) took 1553 ms. Trace:
I20260709 13:09:03.051544 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:03.046545 24669 raft_consensus.cc:2410] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:03.057672 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.059091 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.060122 24669 raft_consensus.cc:2410] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:09:03.037344 27073 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.036751 24592 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:03.064435 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.067884 24669 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:03.069059 27072 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:09:03.069268 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.021039 27028 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.070724 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.073614 24669 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:03.074615 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:03.078576 27024 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.078977 27028 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.079702 27029 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.080745 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2560) took 1516 ms. Trace:
I20260709 13:09:03.081133 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2453) took 1584 ms. Trace:
I20260709 13:09:03.081404 24672 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5.
I20260709 13:09:03.081542 24518 rpcz_store.cc:276] 0709 13:09:01.496520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.473926 (+977406us) service_pool.cc:224] Handling call
0709 13:09:02.474269 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:02.474623 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.474651 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:02.475290 (+   639us) log.cc:844] Serialized 52 byte log entry
0709 13:09:02.901254 (+425964us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.901682 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.904698 (+  3016us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.905784 (+  1086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.905911 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.080875 (+174964us) raft_consensus.cc:1685] finished
0709 13:09:03.080900 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.081060 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":653,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":265970,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":15034,"thread_start_us":402629,"threads_started":1,"wal-append.queue_time_us":459922}
I20260709 13:09:03.059396 24666 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:03.081138 24665 rpcz_store.cc:276] 0709 13:09:01.564646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.978272 (+413626us) service_pool.cc:224] Handling call
0709 13:09:03.079832 (+1101560us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b5800170798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:09:03.080032 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.080402 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.080443 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.080487 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:03.080519 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.080580 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.080689 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11531648}
I20260709 13:09:03.029687 27075 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:09:03.082926 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.088438 24672 raft_consensus.cc:2410] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:03.074208 27086 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:03.092312 24666 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:03.092494 27038 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:03.093225 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:03.065253 27073 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.096148 26842 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.086170 27071 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:03.022955 27058 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.049746 24591 rpcz_store.cc:276] 0709 13:09:01.496341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.047819 (+1551478us) service_pool.cc:224] Handling call
0709 13:09:03.048258 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.048955 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.049212 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:03.094033 26965 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.002s
I20260709 13:09:03.067041 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1421) took 1106 ms. Trace:
I20260709 13:09:03.119733 24669 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:03.140584 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1427) took 1181 ms. Trace:
I20260709 13:09:03.141112 24669 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.140995 24525 rpcz_store.cc:276] 0709 13:09:01.959597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.054754 (+ 95157us) service_pool.cc:224] Handling call
0709 13:09:03.140435 (+1085681us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54002c24d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:03.140531 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357210368}
I20260709 13:09:03.142655 24598 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:03.124413 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2455) took 1627 ms. Trace:
I20260709 13:09:03.125203 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1341) took 1629 ms. Trace:
I20260709 13:09:03.143249 24519 rpcz_store.cc:276] 0709 13:09:01.497028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.476437 (+979409us) service_pool.cc:224] Handling call
0709 13:09:02.476753 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.975095 (+498342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.975136 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.975690 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.041994 (+ 66304us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:03.042028 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.042092 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.124202 (+ 82110us) raft_consensus.cc:1685] finished
0709 13:09:03.124219 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.124338 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":283927,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":563771,"threads_started":2,"wal-append.queue_time_us":137997}
I20260709 13:09:03.143395 24597 rpcz_store.cc:276] 0709 13:09:01.495965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.992459 (+1496494us) service_pool.cc:224] Handling call
0709 13:09:02.992825 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.993233 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.993261 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.994509 (+  1248us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.046106 (+ 51597us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:03.046147 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.046211 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.124923 (+ 78712us) raft_consensus.cc:1685] finished
0709 13:09:03.124949 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.125134 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2139,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":51161,"threads_started":1,"wal-append.queue_time_us":78691}
I20260709 13:09:03.126053 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.146811 24665 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:03.150398 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1347) took 1652 ms. Trace:
I20260709 13:09:03.143249 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1344) took 1646 ms. Trace:
I20260709 13:09:03.157737 24665 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:03.162667 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:03.164886 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.170205 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:03.151415 24598 rpcz_store.cc:276] 0709 13:09:01.496812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.142236 (+1645424us) service_pool.cc:224] Handling call
0709 13:09:03.142500 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.143036 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.143195 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:03.172348 24600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1172) took 5266 ms (client timeout 2030 ms). Trace:
I20260709 13:09:03.172642 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:03.173843 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:03.171768 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.174854 24674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1346) took 1782 ms (client timeout 1754 ms). Trace:
I20260709 13:09:03.174952 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:03.175293 24674 rpcz_store.cc:269] 0709 13:09:01.379192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.439463 (+ 60271us) service_pool.cc:224] Handling call
0709 13:09:03.161385 (+1721922us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400404554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:03.161530 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076398464}
I20260709 13:09:03.150941 24597 rpcz_store.cc:276] 0709 13:09:01.497600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.145846 (+1648246us) service_pool.cc:224] Handling call
0709 13:09:03.146211 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.149957 (+  3746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.150014 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.150070 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:03.150114 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.150193 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.150332 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3188,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102}
W20260709 13:09:03.172915 24600 rpcz_store.cc:269] 0709 13:08:57.895501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.895623 (+   122us) service_pool.cc:224] Handling call
0709 13:09:03.161256 (+5265633us) spinlock_profiling.cc:243] Waited 4.6 s on lock 0x7b540032c154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:03.161412 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10579767552}
I20260709 13:09:03.206449 24600 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:03.204200 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:03.132762 24592 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:03.139446 27083 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:03.222965 24674 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:03.223667 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.211534 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 467) took 1637 ms. Trace:
W20260709 13:09:03.221442 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 144541us
I20260709 13:09:03.212883 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 459) took 1647 ms. Trace:
I20260709 13:09:03.202181 26876 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:03.237416 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:03.202171 27058 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.244248 24665 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:03.171859 27029 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:03.173126 27085 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:03.240216 24670 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:03.226419 24597 rpcz_store.cc:276] 0709 13:09:01.565009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.176288 (+1611279us) service_pool.cc:224] Handling call
0709 13:09:03.212242 (+ 35954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.212421 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.212455 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.212504 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:03.212545 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.212725 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.212833 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:03.207830 26671 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:03.152911 26965 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.245193 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.222527 26764 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:03.182092 27028 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:09:03.172910 26860 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:09:03.182672 26545 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:03.225216 24600 rpcz_store.cc:276] 0709 13:09:01.574416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.178871 (+1604455us) service_pool.cc:224] Handling call
0709 13:09:03.206004 (+ 27133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.211219 (+  5215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.211477 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:03.180953 26916 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:03.284538 24673 raft_consensus.cc:2410] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:03.247298 27012 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.286554 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.287181 24665 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:03.182538 26873 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:03.277580 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 106126us
I20260709 13:09:03.285511 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.279263 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 452) took 1716 ms. Trace:
I20260709 13:09:03.289551 26873 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.274844 26764 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:03.270455 26671 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.293799 24674 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:03.293572 24595 rpcz_store.cc:276] 0709 13:09:01.563225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.161831 (+1598606us) service_pool.cc:224] Handling call
0709 13:09:03.162224 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.169383 (+  7159us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:03.201748 (+ 32365us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.278957 (+ 77209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.279004 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:03.279046 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.279104 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.279211 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37629,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":83,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":107,"thread_start_us":76599,"threads_started":1,"wal-append.queue_time_us":87817}
I20260709 13:09:03.285367 26545 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.299216 24600 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.274122 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.290303 26916 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:03.286595 27085 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:03.297690 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 54275.7us
I20260709 13:09:03.324142 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:03.333833 24665 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:03.334203 24667 raft_consensus.cc:2376] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5. Re-sending same reply.
I20260709 13:09:03.287819 27088 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:03.323400 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:03.337296 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.332134 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:03.337911 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:03.339596 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:03.340639 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.341132 24525 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:03.342152 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.346836 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.347447 24524 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:03.348157 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.348857 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.349737 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.350162 24525 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 2.
I20260709 13:09:03.350723 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.353493 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.309595 26764 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.355021 24600 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:03.354946 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.306438 26873 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:03.356228 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.329865 26671 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:03.309974 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 462) took 1744 ms. Trace:
I20260709 13:09:03.359452 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.338660 27088 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.360641 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:03.361552 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 124228us
I20260709 13:09:03.384624 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:03.385061 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:03.334671 27075 consensus_queue.cc:1243] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:03.330955 26545 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.292579 27012 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:03.373835 27027 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 1.806s	user 0.015s	sys 0.003s
I20260709 13:09:03.367385 26949 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.330524 26916 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:03.355669 27094 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:03.358239 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:03.381111 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:03.356022 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.410508 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 52298.3us
W20260709 13:09:03.411867 25185 connection.cc:256] RPC call timeout handler was delayed by -1.167395115999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:09:03.412206 25185 connection.cc:256] RPC call timeout handler was delayed by -1.122751309000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
I20260709 13:09:03.412163 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:03.412674 25185 connection.cc:256] RPC call timeout handler was delayed by -1.0921513089999735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 13:09:03.411389 24674 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:09:03.408985 27103 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:03.413599 27103 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.415745 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:03.387552 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 465) took 1820 ms (client timeout 1648 ms). Trace:
I20260709 13:09:03.390174 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:03.374156 26860 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:03.420177 27092 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:03.420861 26860 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:03.421358 26860 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.421780 26860 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:03.418360 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:03.409971 27094 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:03.422289 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.423324 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.430373 24670 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:03.392226 27047 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:03.139655 24516 rpcz_store.cc:276] 0709 13:09:01.958046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.860013 (+901967us) service_pool.cc:224] Handling call
0709 13:09:02.860353 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.860702 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.860739 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.885034 (+ 24295us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.983910 (+ 98876us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:02.983957 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.984042 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.050158 (+ 66116us) raft_consensus.cc:1685] finished
0709 13:09:03.052920 (+  2762us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.064649 (+ 11729us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2745,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":38582,"threads_started":1,"wal-append.queue_time_us":93807}
I20260709 13:09:03.388275 24517 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:03.380131 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:03.428252 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:03.431488 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.375283 27085 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.417352 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.405230 27044 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:03.430490 27091 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:03.493806 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 190173us
I20260709 13:09:03.436904 24669 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:03.490005 24670 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:03.416832 24599 rpcz_store.cc:269] 0709 13:09:01.566656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.794946 (+228290us) service_pool.cc:224] Handling call
0709 13:09:03.387320 (+1592374us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540025c454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:03.387462 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583979264}
I20260709 13:09:03.429279 26969 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:03.423993 27075 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:03.495303 24674 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:03.424198 27103 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.436993 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:03.442119 27047 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.498122 24669 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:03.393563 27088 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.506711 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 470) took 1702 ms. Trace:
I20260709 13:09:03.484906 27050 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:03.511893 24597 rpcz_store.cc:276] 0709 13:09:01.804596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.246721 (+1442125us) service_pool.cc:224] Handling call
0709 13:09:03.276694 (+ 29973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.276922 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:03.286844 (+  9922us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.506267 (+219423us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.506330 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:03.506388 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.506468 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.506631 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10591,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1960,"thread_start_us":219054,"threads_started":1}
I20260709 13:09:03.427145 27059 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:03.518289 27059 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.518795 27059 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.427013 27024 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:09:03.502327 27098 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:03.416298 26949 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.525338 27098 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:03.525797 27098 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.528275 26949 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.506150 27021 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.529938 27094 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:03.530637 24593 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:09:03.531009 24593 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:03.531392 27104 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.531877 27104 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.534209 27104 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:03.491904 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:03.538722 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 200902us
I20260709 13:09:03.516830 27088 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.517877 24672 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:03.503461 27091 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.433988 27071 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:09:03.540079 25184 leader_election.cc:400] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5.
I20260709 13:09:03.543370 24674 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:09:03.538182 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 124452us
I20260709 13:09:03.506994 27075 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.552843 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:03.565235 25184 leader_election.cc:403] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:09:03.570096 24566 leader_election.cc:336] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.531s (SENT)
I20260709 13:09:03.570259 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:03.571882 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:03.378396 24591 rpcz_store.cc:276] 0709 13:09:01.565741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.181829 (+1616088us) service_pool.cc:224] Handling call
0709 13:09:03.243239 (+ 61410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.274946 (+ 31707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.277454 (+  2508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.280122 (+  2668us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:03.284474 (+  4352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.288067 (+  3593us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.304678 (+ 16611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:03.514181 27047 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:03.572875 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 85471.8us
W20260709 13:09:03.575085 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 146922us
I20260709 13:09:03.486840 26916 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.549304 24666 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.576439 26965 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:03.625805 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55693.1us
I20260709 13:09:03.544999 27091 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.639843 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:03.553777 27088 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:03.566368 27075 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:03.686262 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 189805us
W20260709 13:09:03.724282 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.743821 27059 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.539088 27050 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:09:03.757409 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 185580us
I20260709 13:09:03.775264 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:03.797868 27100 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:09:03.799484 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 454) took 2235 ms. Trace:
I20260709 13:09:03.799945 24598 rpcz_store.cc:276] 0709 13:09:01.563747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.171255 (+1607508us) service_pool.cc:224] Handling call
0709 13:09:03.208045 (+ 36790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.208330 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.208370 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.214670 (+  6300us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.425862 (+211192us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:03.425903 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.425970 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.799215 (+373245us) raft_consensus.cc:1685] finished
0709 13:09:03.799242 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.799410 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":149512,"threads_started":1,"wal-append.queue_time_us":305196}
I20260709 13:09:03.803035 27098 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:03.627612 26834 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:03.687558 27088 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:03.946594 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.747201 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 471) took 1715 ms. Trace:
W20260709 13:09:03.899528 27097 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 13:09:03.933641 27088 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:03.949893 27073 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.781s	user 0.007s	sys 0.002s
W20260709 13:09:03.992195 26545 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.000s
I20260709 13:09:03.899930 27012 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:03.913545 27102 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:03.987905 27050 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:03.998844 27108 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:03.774454 27105 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:04.104506 27058 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.002s
I20260709 13:09:03.959223 26834 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:03.993178 24592 rpcz_store.cc:276] 0709 13:09:02.031695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.276429 (+1244734us) service_pool.cc:224] Handling call
0709 13:09:03.297602 (+ 21173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.331547 (+ 33945us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:03.379784 (+ 48237us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.571250 (+191466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.573856 (+  2606us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:03.603539 (+ 29683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.668702 (+ 65163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.694866 (+ 26164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10896,"prepare.queue_time_us":25023,"prepare.run_wall_time_us":51,"raft.queue_time_us":25786,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":20112,"spinlock_wait_cycles":13124352,"thread_start_us":133048,"threads_started":1,"wal-append.queue_time_us":412655}
I20260709 13:09:04.104013 26545 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.117120 27108 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.169001 26834 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:04.199374 26834 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:04.183490 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.169992 27107 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:09:04.123255 27102 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:04.214632 26671 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.001s
W20260709 13:09:04.216603 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 641947us
I20260709 13:09:04.219050 26916 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.220393 27120 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.221122 27114 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:04.223330 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 448268us
I20260709 13:09:04.189253 24670 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:04.123042 27105 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:09:04.198223 27067 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.174s	user 0.009s	sys 0.004s
W20260709 13:09:04.188019 26764 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.809s	user 0.002s	sys 0.006s
W20260709 13:09:04.226802 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.032s
W20260709 13:09:04.286470 27075 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.000s
I20260709 13:09:03.781186 27106 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:04.231081 27047 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.000s
I20260709 13:09:04.234020 27098 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:04.241045 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.001s	sys 0.009s
I20260709 13:09:04.207109 26545 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:04.298468 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.002s	sys 0.009s
W20260709 13:09:04.277617 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 655168us
I20260709 13:09:04.278880 27030 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.305370 27083 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:04.287173 26834 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:04.280314 27032 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:04.280881 26722 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.189638 27108 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.308619 26834 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:04.291767 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.032s
W20260709 13:09:04.313690 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 673955us
I20260709 13:09:04.314625 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:04.227212 27115 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:04.315539 27115 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:04.316064 27115 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:04.285627 27102 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.293965 27114 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:04.290320 27120 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:04.295656 26860 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.863s	user 0.004s	sys 0.007s
I20260709 13:09:04.292735 27058 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.325376 27058 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:04.327445 27058 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:04.288841 27091 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.004s
W20260709 13:09:04.322773 27085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.008s
W20260709 13:09:04.329173 27085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.005s	sys 0.008s
I20260709 13:09:04.328795 27091 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.330941 27091 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.131737 27073 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.332022 27120 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.333379 24525 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:04.332952 27102 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.332950 27073 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.292794 27067 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.335142 27102 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:04.335745 27067 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.296763 26764 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:04.301271 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:04.278954 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.288442 26671 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:04.337456 25210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 602) took 1615 ms (client timeout 2094 ms). Trace:
I20260709 13:09:04.337733 26764 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:04.337868 25210 rpcz_store.cc:269] 0709 13:09:02.721622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.738101 (+ 16479us) service_pool.cc:224] Handling call
0709 13:09:04.278748 (+1540647us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:04.337395 (+ 58647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3886336}
W20260709 13:09:04.299181 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 612029us
I20260709 13:09:04.322386 27098 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:09:04.338768 26671 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.338802 26860 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.324227 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:04.339421 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:04.332660 27088 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.317785 27047 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.340148 27114 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:04.340463 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:04.340806 27114 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.341404 25185 leader_election.cc:400] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5.
I20260709 13:09:04.341497 27114 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:04.341976 27114 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:04.342378 27114 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:04.318280 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 99867us
W20260709 13:09:04.323163 26873 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.942s	user 0.007s	sys 0.003s
I20260709 13:09:04.291165 27105 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.324741 27117 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:04.341738 27047 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:04.346104 27103 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.831s	user 0.008s	sys 0.003s
I20260709 13:09:04.347951 26873 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.359287 27021 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:04.359722 27021 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:04.297329 27075 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:04.341542 27088 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.346352 27110 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.358619 27103 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.431069 26860 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:04.431978 27103 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.425828 27037 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.426002 26873 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:04.429914 24523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1422) took 2471 ms (client timeout 1926 ms). Trace:
W20260709 13:09:04.434680 24523 rpcz_store.cc:269] 0709 13:09:01.958335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.139897 (+181562us) service_pool.cc:224] Handling call
0709 13:09:04.429749 (+2289852us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b54000bd1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:04.429857 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19323136}
I20260709 13:09:04.360962 27091 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:04.361579 27085 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:04.463959 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 117866us
I20260709 13:09:04.347236 27108 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:04.473397 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 182714us
W20260709 13:09:04.472442 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 125713us
W20260709 13:09:04.470494 24666 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.779s	user 0.006s	sys 0.004s
I20260709 13:09:04.477273 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.476711 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:04.480047 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.480214 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:04.478919 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:04.478814 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 94908.5us
I20260709 13:09:04.482712 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.484247 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.466130 27102 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:09:04.429373 27021 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.485844 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.500115 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:04.486629 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.487141 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.490800 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.491648 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.496769 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:04.503294 24672 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.496166 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:04.464439 27091 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.465587 27085 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:04.504391 24669 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
W20260709 13:09:04.507408 24491 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.975s (SENT) [suppressed 56 similar messages]
I20260709 13:09:04.515031 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:04.525951 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:04.527063 24598 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:09:04.433779 27110 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.536479 27110 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.537529 27125 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.537832 27122 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:04.515779 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.542917 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.544042 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.480568 24666 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:04.524866 27115 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.506198 27037 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:09:04.482978 27114 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:04.545308 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:04.549549 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47215.7us
I20260709 13:09:04.545047 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.546379 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.579087 25212 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:04.547961 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 72814.6us
I20260709 13:09:04.505146 27128 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:04.549568 27112 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.542940 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.558070 27108 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:04.581878 24672 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:04.556810 25213 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:04.597307 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.582937 24597 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:04.598392 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.586153 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.543874 27075 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:04.595570 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:04.599789 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.546434 27124 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.617807 27124 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.549834 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:04.561278 24666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 2582) took 1237 ms (client timeout 1647 ms). Trace:
I20260709 13:09:04.561012 27105 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:04.621568 24666 rpcz_store.cc:269] 0709 13:09:03.324062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.411360 (+ 87298us) service_pool.cc:224] Handling call
0709 13:09:04.550282 (+1138922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:04.562690 27115 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:04.623245 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2458) took 2942 ms. Trace:
I20260709 13:09:04.623656 24517 rpcz_store.cc:276] 0709 13:09:01.680774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.850042 (+1169268us) service_pool.cc:224] Handling call
0709 13:09:02.869363 (+ 19321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.490797 (+621434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.623022 (+1132225us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b5400442854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:04.623185 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166178560}
I20260709 13:09:04.574909 27110 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:09:04.625384 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.600742 27128 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.601413 24598 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.564615 27106 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5.
I20260709 13:09:04.610262 27114 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:04.526046 27126 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:09:04.563560 27085 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:04.562358 27091 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.625463 27110 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:04.614660 27079 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.487s	user 0.023s	sys 0.016s
I20260709 13:09:04.629431 25216 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:04.629570 25217 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:04.625499 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:04.630673 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 150526us
I20260709 13:09:04.647187 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:04.631313 25213 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:04.633639 24598 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:04.636298 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:04.583437 27117 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:04.649398 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:04.648821 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:04.654565 24596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1194) took 1952 ms (client timeout 2114 ms). Trace:
W20260709 13:09:04.658602 24596 rpcz_store.cc:269] 0709 13:09:02.701951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.952808 (+250857us) service_pool.cc:224] Handling call
0709 13:09:04.625350 (+1672542us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:04.654504 (+ 29154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21569408}
I20260709 13:09:04.660240 25213 raft_consensus.cc:2368] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:09:04.634500 25211 raft_consensus.cc:2376] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4. Re-sending same reply.
I20260709 13:09:04.663188 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.664611 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.665263 26873 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.668008 27012 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.668709 27012 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.666232 27075 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.668246 27076 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:04.666580 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.661882 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.674137 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.702649 25214 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
W20260709 13:09:04.708163 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61085.3us
I20260709 13:09:04.709353 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2565) took 2927 ms. Trace:
W20260709 13:09:04.677009 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.671391 27012 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.721364 25211 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:04.714449 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.715301 25182 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:04.715057 24671 rpcz_store.cc:276] 0709 13:09:01.782033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.085251 (+303218us) service_pool.cc:224] Handling call
0709 13:09:02.105149 (+ 19898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.108880 (+  3731us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:02.695148 (+586268us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.925230 (+230082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.925301 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.925369 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.709118 (+1783749us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b54000497d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:04.709166 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.709291 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1156,"prepare.queue_time_us":643463,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":1295,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":4955,"spinlock_wait_cycles":7967616,"thread_start_us":800724,"threads_started":2,"wal-append.queue_time_us":295532,"wal-append.run_cpu_time_us":1140,"wal-append.run_wall_time_us":1014024}
W20260709 13:09:04.805327 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 89959us
I20260709 13:09:04.725979 25213 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:04.654479 27047 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:04.721966 26969 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:04.759248 27059 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.655045 27085 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:04.822520 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.822954 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:04.823848 25213 raft_consensus.cc:2368] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:04.823194 27085 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.646121 27105 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:04.713528 27106 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:04.645483 27110 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:04.748782 27124 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.751683 27128 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.762290 27117 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.752278 27125 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:04.840819 27110 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.843946 27110 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.811758 27123 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.821980 26969 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.826308 27119 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:04.807852 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.832866 27059 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:04.850286 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:04.850849 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.851249 27119 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:04.849726 27059 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.834388 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.835971 27136 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:04.836045 27094 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.869917 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.870191 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.870918 25214 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:04.871456 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.872026 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.868774 27136 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:04.873234 27136 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.835099 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:04.847338 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:04.874933 24666 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.875072 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.847658 27123 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.878161 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.878552 27123 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.879172 27123 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.879884 27123 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.848598 24672 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:04.852948 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.866506 27012 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.853001 27119 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.857945 27059 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.882647 27012 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:04.886353 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 55756.3us
I20260709 13:09:04.886893 26880 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:04.887393 25211 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 2.
I20260709 13:09:04.886704 27012 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:04.872772 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.879310 25219 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:04.881669 27077 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.708s	user 0.016s	sys 0.024s
I20260709 13:09:04.867070 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.872987 25214 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:04.904121 24665 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:04.835101 27047 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:04.914431 27047 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:04.916148 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:04.917480 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.919169 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.920456 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.924226 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.928787 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:04.924618 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:04.926116 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.923020 25215 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:04.926241 26880 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:04.926528 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 95081.6us
I20260709 13:09:04.939354 26880 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.951944 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.955368 27086 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:04.955888 27086 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:04.960049 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 120933us
I20260709 13:09:04.950073 27106 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:04.960844 27136 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.962049 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:04.962363 27106 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:04.963469 27096 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.531s	user 0.000s	sys 0.031s
I20260709 13:09:04.963917 27136 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:04.965183 26969 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:04.966951 26860 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:04.946262 26880 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.963927 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:04.969616 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:04.969990 24665 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:04.971520 25219 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:04.974684 25214 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:04.979346 27129 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:04.979948 27129 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:04.982378 27085 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:04.983129 24673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 2554) took 3573 ms (client timeout 4539 ms). Trace:
W20260709 13:09:04.960278 27090 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.818s	user 0.000s	sys 0.031s
I20260709 13:09:05.004142 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:05.004818 27123 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.005440 27037 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:05.006008 25213 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:09:05.006392 27037 consensus_queue.cc:1243] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:05.007030 26926 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:05.007573 26926 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:05.008179 27108 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:05.008714 27125 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:05.009312 26860 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:05.009146 26926 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:04.989396 27028 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:05.012056 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:05.012292 27028 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:04.991508 27021 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.993661 27142 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.994406 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:04.996610 24523 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:04.997692 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.019814 24516 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:05.020881 26873 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:04.998413 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.021770 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:05.022063 24519 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:09:05.021903 26873 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.023245 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:04.999742 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:05.024778 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 450276us
I20260709 13:09:04.998768 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.025837 24522 raft_consensus.cc:2410] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:05.000689 24535 tablet_copy_service.cc:140] P 0131806e3b9647128f32db1ab8d314fc: Received BeginTabletCopySession request for tablet e7ec39f0d4e04761ae598f1245692799 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:53446)
I20260709 13:09:05.026556 24535 tablet_copy_service.cc:161] P 0131806e3b9647128f32db1ab8d314fc: Beginning new tablet copy session on tablet e7ec39f0d4e04761ae598f1245692799 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:53446: session id = 983693721af6486c97ece1410a90cf30-e7ec39f0d4e04761ae598f1245692799
I20260709 13:09:05.027027 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.027976 24522 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6.
W20260709 13:09:04.999998 24525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1440) took 1655 ms (client timeout 2091 ms). Trace:
I20260709 13:09:05.007622 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 490) took 1836 ms. Trace:
I20260709 13:09:05.029628 24518 raft_consensus.cc:2368] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:09:05.029819 24670 rpcz_store.cc:276] 0709 13:09:03.171113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.497780 (+326667us) service_pool.cc:224] Handling call
0709 13:09:03.498162 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.288576 (+790414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.007156 (+718580us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540017f554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:05.007440 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588662144}
I20260709 13:09:05.030651 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:05.029305 24525 rpcz_store.cc:269] 0709 13:09:03.344107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.350578 (+  6471us) service_pool.cc:224] Handling call
0709 13:09:04.999542 (+1648964us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b540006dbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:04.999812 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258533760}
I20260709 13:09:05.031782 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.031965 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.032569 24525 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:04.956993 27086 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:05.033736 27086 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.035684 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:05.025755 24524 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:05.025074 26873 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:04.983703 24673 rpcz_store.cc:269] 0709 13:09:01.409955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.927670 (+517715us) service_pool.cc:224] Handling call
0709 13:09:04.982604 (+3054934us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400046fd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:04.982893 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3118003584}
I20260709 13:09:05.042511 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.022639 27037 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.000633 27129 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.033648 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.045516 27125 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.045883 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.046105 27125 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.976364 25214 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:05.046693 27125 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.028797 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.050076 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.053896 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:05.056162 27112 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:05.056708 27112 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:05.003324 24521 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:05.013731 25219 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:05.048820 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:05.046759 27129 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.068431 24519 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
W20260709 13:09:05.074429 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 50629.5us
I20260709 13:09:05.074716 27028 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.046792 25211 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:05.077404 27123 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.078949 24490 leader_election.cc:400] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:05.079346 24490 leader_election.cc:403] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:05.079968 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.080483 27136 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:05.081362 26633 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.081732 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.079066 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:05.082947 24593 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:05.084499 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.081911 27136 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:05.085314 27136 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:05.085390 27126 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:05.086068 27126 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:05.086398 27131 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:05.087261 24595 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:05.087636 27131 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:05.080976 24591 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:05.088045 27131 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:05.086411 27094 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:05.089758 27094 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:05.090251 27094 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:05.092588 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.021409 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.093382 24596 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.093842 24516 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:05.093684 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.032816 24518 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:05.094513 27142 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.095108 25212 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:05.087076 27126 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.088619 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.013166 26926 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.096761 24598 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.104863 26880 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.107445 26880 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.110199 25213 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:05.118547 24525 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:05.118875 27071 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:05.119496 27071 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.121955 24597 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:05.121843 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.123201 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.123344 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.123828 24597 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:05.124186 24600 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.124680 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.089913 27131 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.126257 27131 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.129132 27071 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.129604 27136 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.131245 27136 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.131291 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.132299 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1443) took 1787 ms. Trace:
I20260709 13:09:05.097431 27125 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.134063 24520 rpcz_store.cc:276] 0709 13:09:03.344723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.359997 (+ 15274us) service_pool.cc:224] Handling call
0709 13:09:05.044282 (+1684285us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:05.131013 (+ 86731us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21e9c 00007f17b8e21a5b 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:05.132236 (+  1223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37855232}
I20260709 13:09:05.091717 27094 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.138273 24598 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:05.129225 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.115674 26969 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.146576 27125 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:05.146984 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:05.149425 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:05.149516 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.163177 24674 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:05.164693 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.165050 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.141995 24594 raft_consensus.cc:2376] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5. Re-sending same reply.
I20260709 13:09:05.176448 24596 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:05.177227 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:05.177502 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 60123.8us
I20260709 13:09:05.177902 24597 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.178864 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:05.182283 27086 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:05.182673 27086 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:05.183061 27086 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.185477 25213 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:05.185909 24665 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:05.187299 27094 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.069337 27112 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.189427 27054 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:05.189962 27054 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:05.190088 27076 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53434 (request call id 11) took 8848 ms. Trace:
W20260709 13:09:05.197324 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 175886us
W20260709 13:09:05.201246 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 248499us
I20260709 13:09:05.200385 24522 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:05.202488 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.202121 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:03.093190 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:05.271940 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.303623 25212 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:05.272590 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:05.188915 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.198618 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.190459 27054 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:05.198288 27144 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:09:05.231280 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:05.185473 24593 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:05.165679 27071 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.326923 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.327726 24674 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:05.329531 24594 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:05.330367 24518 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:05.331493 24595 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.201886 27119 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.193744 27142 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.230429 26873 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.165899 27037 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:05.316371 26880 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.355016 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.365018 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:05.366643 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 185581us
I20260709 13:09:05.370600 24600 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:05.371474 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.352149 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.381978 24597 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:05.381485 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:05.387092 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.388046 27029 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:05.388679 27029 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:05.390920 27029 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:05.392082 27147 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:05.395087 27021 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:05.396639 27021 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:05.397011 27021 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.397337 27021 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.378304 26880 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.399293 26880 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:05.399802 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 58031us
I20260709 13:09:05.400622 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:05.402217 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:05.385540 24594 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:09:05.404985 24596 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:05.407212 24595 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:05.408460 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.343959 27071 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.409811 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.362833 24666 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:05.410931 24594 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:05.365695 27028 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:05.386986 27119 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.415141 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.415836 24593 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.416339 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.416671 27119 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:05.418196 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.417989 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.418216 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.420197 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:05.420691 26880 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.423836 24596 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:05.424243 27128 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:05.424527 27105 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:09:05.430380 27148 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:09:05.414774 24599 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:05.433457 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.440795 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.446419 24595 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:05.365577 26873 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:05.443368 24597 raft_consensus.cc:2376] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8. Re-sending same reply.
I20260709 13:09:05.448763 24600 raft_consensus.cc:2368] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:05.406809 25211 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:05.441587 27128 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.445806 26969 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:05.457573 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:05.437505 26880 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:05.405274 27037 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.459043 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.454393 27142 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:09:05.466807 26633 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:05.467371 27123 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:05.457057 27126 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.474489 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.477109 27071 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.477469 27160 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:05.477702 27105 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.478173 27105 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.478495 27105 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.479193 27029 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:05.477495 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 113691us
I20260709 13:09:05.482301 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.483877 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.484581 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.485291 26969 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.463280 26880 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.460680 27128 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.460961 24516 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:05.491670 27037 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.494269 27054 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.476882 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.465117 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.465662 27047 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:05.497673 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.461479 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:05.463265 24596 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:09:05.507826 24594 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
W20260709 13:09:05.509400 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 66551.9us
I20260709 13:09:05.514758 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.515702 24600 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:05.517726 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.518478 24597 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:05.493197 26889 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:09:05.523219 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59587.4us
I20260709 13:09:05.525166 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.524605 27037 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.517046 27136 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:05.539657 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 119559us
I20260709 13:09:05.535766 27037 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:09:05.505141 26633 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:09:05.504690 27028 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:05.532286 24637 connection.cc:256] RPC call timeout handler was delayed by -1.1200786310000694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:09:05.227762 27076 rpcz_store.cc:276] 0709 13:08:56.342035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.347295 (+  5260us) service_pool.cc:224] Handling call
0709 13:08:56.667214 (+319919us) log.cc:844] Serialized 513 byte log entry
0709 13:08:56.851633 (+184419us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180039e9e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:08:56.886155 (+ 34522us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b180039e9e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84ea0a 00007f17ba84e693 00007f17ba84e631
0709 13:08:57.013191 (+127036us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b2c00000c88. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84ea0a 00007f17ba84e693 00007f17ba84e631 00007f17bbf82b52 00007f17bbf82cf5 00007f17bbebf691 00007f17bbe9feaa 00007f17bbea6d53 00007f17bbea6cd9 00007f17bbea6c69
0709 13:08:57.018201 (+  5010us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b18001d7f60. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf82d01 00007f17bbebf691 00007f17bbe9feaa 00007f17bbea6d53 00007f17bbea6cd9 00007f17bbea6c69 00007f17bbea6c31 00007f17bbea5dfd 000000000038f354 000000000038f199
0709 13:08:57.409511 (+391310us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b18001d7f60. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf82d01 00007f17bbebf691 00007f17bbe9feaa 00007f17bbea6d53 00007f17bbea6cd9 00007f17bbea6c69 00007f17bbea6c31 00007f17bbea5dfd 000000000038f354 000000000038f199
0709 13:08:57.756132 (+346621us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b4c00058440. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba212a20 00007f17ba223a29 00007f17ba22413f 00007f17ba1e82ab 00007f17ba215f3c 00007f17ba2163fe 00007f17ba4a350b 00007f17bbea2381 00007f17bbea026b 00007f17bbea6d53 00007f17bbea6cd9
0709 13:09:05.189877 (+7433745us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17586,"raft.queue_time_us":42447,"raft.run_cpu_time_us":16305,"raft.run_wall_time_us":1361823,"spinlock_wait_cycles":983212160,"thread_start_us":87359,"threads_started":1,"wal-append.queue_time_us":146041,"wal-append.run_cpu_time_us":1565,"wal-append.run_wall_time_us":1002692}
I20260709 13:09:05.547291 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:05.536348 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 59616.5us
I20260709 13:09:05.550200 27131 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:05.527422 27029 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:05.551501 24637 connection.cc:256] RPC call timeout handler was delayed by -1.0858786310000141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:09:05.562283 24637 connection.cc:256] RPC call timeout handler was delayed by -1.0768786309999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:09:05.562625 24637 connection.cc:256] RPC call timeout handler was delayed by -1.001278630999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
I20260709 13:09:05.560416 24595 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:05.564658 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.565459 24517 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6.
W20260709 13:09:05.548826 27156 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:09:05.550119 27054 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.605858 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.611605 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.555991 27136 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:05.613400 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.615199 25212 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
W20260709 13:09:05.618949 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 153926us
W20260709 13:09:05.617439 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 71340.8us
I20260709 13:09:05.621873 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.604909 27160 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:05.614936 24591 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: [6.8-7.9]
I20260709 13:09:05.559238 26889 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:09:05.632560 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:05.620652 27170 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.637349 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63161.4us
I20260709 13:09:05.641161 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:05.642992 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.644064 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:05.645684 24520 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:05.651667 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:05.648298 27129 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.002s
I20260709 13:09:05.640893 27029 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:09:05.649477 27076 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:05.663755 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:05.671229 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 53341.3us
I20260709 13:09:05.632794 27086 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.673120 25216 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:05.675130 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:05.679370 24669 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:05.681631 27122 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:05.681875 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.682716 24518 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.682993 24665 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:05.685443 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.685578 27160 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.686362 24523 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:09:05.682154 27122 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:05.695302 27122 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.697752 24524 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:05.690644 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.699519 24520 raft_consensus.cc:2376] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9. Re-sending same reply.
I20260709 13:09:05.691185 26880 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:05.687705 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:05.702816 24670 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:05.706337 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.706403 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.707301 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:05.696853 27122 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.711221 24523 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:05.711938 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67938.3us
I20260709 13:09:05.712903 24520 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:05.711709 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.716274 24521 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.719383 24524 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:05.722990 24672 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:05.699904 27076 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:05.725492 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.729910 24595 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:05.726195 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:05.728688 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.730688 24665 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:05.677440 27021 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.732483 27167 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:09:05.733044 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55179.1us
I20260709 13:09:05.744396 24520 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:05.733911 24593 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:05.734136 26880 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:05.737322 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.722666 24516 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:05.675197 27136 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.738514 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.757862 24597 raft_consensus.cc:2368] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:05.711078 26873 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:05.738291 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:05.750634 24491 leader_election.cc:336] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.754s (SENT)
I20260709 13:09:05.675263 27170 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:05.740428 24594 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:05.755434 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.760355 27089 raft_consensus.cc:1027] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: attempt to promote peer 983693721af6486c97ece1410a90cf30: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:09:05.762094 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:05.736794 27163 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.767493 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:05.779544 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:05.768131 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68978.1us
I20260709 13:09:05.753206 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.769665 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.731367 27129 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:05.749217 27142 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:05.782934 24674 raft_consensus.cc:2376] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7. Re-sending same reply.
I20260709 13:09:05.787086 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.791698 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.794253 27089 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.799785 24669 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:09:05.800767 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.801569 24595 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:05.794370 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 43917.8us
I20260709 13:09:05.802388 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:05.809017 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.802649 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.803267 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.785193 27028 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:05.803987 27166 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:05.736570 27105 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.804510 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:05.809674 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:05.829398 24596 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:05.783416 26926 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.817232 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.784695 27163 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.815992 25182 leader_election.cc:400] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6.
I20260709 13:09:05.819103 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.784400 27129 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.798828 24667 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:05.809476 27160 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:05.823400 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:05.820569 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.858270 24518 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
W20260709 13:09:05.810922 27094 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.623s	user 0.006s	sys 0.005s
I20260709 13:09:05.848176 24521 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:05.815155 27021 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.809820 27164 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.859447 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.863308 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.850041 24594 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
W20260709 13:09:05.866420 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.813391 27173 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.867494 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:05.868922 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 64508us
I20260709 13:09:05.874104 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.880182 24520 raft_consensus.cc:2368] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:05.874146 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.875000 24600 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:05.883204 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.857285 27129 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.856570 27163 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.886510 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.882376 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:05.889850 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:05.875634 27164 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.879483 27173 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.803951 27076 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.900426 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.900686 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.901311 25219 raft_consensus.cc:2410] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:05.901378 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:05.902155 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:05.902846 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.903580 24518 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:05.903848 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 116440us
I20260709 13:09:05.904316 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.881026 27029 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:05.905263 27021 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:05.905368 27029 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:05.905939 27021 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:05.906512 27105 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:05.906462 27029 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.906867 27021 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:05.908577 27173 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.894337 27167 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.909442 27167 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.909801 27167 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.911164 24595 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:05.903013 25211 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:05.904667 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:05.912038 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:05.905215 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 89421.5us
I20260709 13:09:05.927857 24597 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:05.905438 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.936381 24595 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: [4.4-7.5]
I20260709 13:09:05.893004 26873 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:05.894232 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.889266 27086 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:05.879009 27160 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:05.945369 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:05.894284 27164 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.947495 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.943125 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:05.943804 24668 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:05.943418 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:05.938895 26873 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:05.944941 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:05.953653 24525 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:05.894121 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:05.948205 24421 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:05.957453 27178 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:05.970736 27160 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:05.974045 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47076us
I20260709 13:09:05.976481 25182 leader_election.cc:400] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6.
I20260709 13:09:05.981362 24668 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:05.958422 26873 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.996515 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:06.002323 24666 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:06.006556 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 80755.6us
W20260709 13:09:06.012670 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 72950.6us
I20260709 13:09:05.993124 27187 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.982120 24592 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
W20260709 13:09:05.995118 27128 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.004s
I20260709 13:09:06.019613 24637 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:06.021296 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.021332 27028 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:06.007014 27170 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:05.994527 27094 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.237s
I20260709 13:09:06.235266 24490 leader_election.cc:400] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:05.985239 27125 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:06.022358 27160 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:06.245611 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 224414us
I20260709 13:09:06.246961 24592 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:09:06.235849 27187 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:06.251264 24592 pending_rounds.cc:85] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 4
W20260709 13:09:06.230127 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 288992us
I20260709 13:09:06.251513 27160 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:06.256966 27160 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.258478 27112 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:06.258935 27112 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:06.252790 24592 pending_rounds.cc:107] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:09:06.261142 24592 raft_consensus.cc:2889] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:06.263404 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 243522us
W20260709 13:09:06.254307 27184 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:09:06.022311 27128 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.269585 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.269832 27188 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:06.271086 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.272526 26889 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.273404 26889 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:06.275401 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.272681 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.242266 27028 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:06.266587 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:06.261031 27126 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:06.273725 27076 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.284219 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.291585 24524 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:09:06.293315 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.302485 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 489) took 1209 ms. Trace:
I20260709 13:09:06.283203 27028 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.302911 24599 rpcz_store.cc:276] 0709 13:09:05.096614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.133797 (+ 37183us) service_pool.cc:224] Handling call
0709 13:09:05.384117 (+250320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.445790 (+ 61673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.302245 (+856455us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540021be50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:06.302403 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514947328}
I20260709 13:09:06.286778 27086 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:06.333724 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58120.1us
I20260709 13:09:06.302929 27126 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:06.306460 27163 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.261279 27112 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:06.354449 27189 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.101s	user 0.002s	sys 0.008s
I20260709 13:09:06.303833 27187 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.306033 27170 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.354213 27186 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
W20260709 13:09:06.355226 27183 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
W20260709 13:09:06.361553 27165 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.624s	user 0.004s	sys 0.000s
W20260709 13:09:06.389755 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 147039us
W20260709 13:09:06.390841 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 81201.8us
I20260709 13:09:06.362150 24421 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 3 to 4, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 4 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:06.362412 27117 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:06.363389 27128 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:06.400357 24639 leader_election.cc:400] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
W20260709 13:09:06.399768 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 384079us
I20260709 13:09:06.359424 27163 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:06.401036 24639 leader_election.cc:403] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:06.418264 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:06.418645 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:06.419198 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:06.419276 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:06.397476 27117 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:06.357385 27173 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:06.423849 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.424620 27174 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:06.424813 25210 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:06.425379 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:06.429450 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:06.430038 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:06.430631 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.357896 27126 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.435286 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:06.414232 27187 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:06.438329 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:06.438707 25219 raft_consensus.cc:2368] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:09:06.448051 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:06.440645 25218 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:06.441290 25214 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:06.455878 27163 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:06.456297 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.456475 27163 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:06.457281 27194 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.438580 27086 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.457626 27163 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:06.458559 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:06.459321 27194 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:06.461416 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:06.434353 27136 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:06.465672 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51393.6us
I20260709 13:09:06.466567 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:06.450634 27129 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 13:09:06.467995 25217 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:06.479915 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 59242.4us
I20260709 13:09:06.459822 27194 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:06.489315 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 71768.7us
I20260709 13:09:06.498842 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:06.500751 24566 leader_election.cc:336] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.596s (SENT)
I20260709 13:09:06.463546 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:06.505172 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:06.504330 24490 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.501778 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:06.472415 27136 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:06.515512 27195 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:09:06.515846 27158 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.035s	user 0.002s	sys 0.022s
W20260709 13:09:06.520589 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.522882 24593 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:06.524025 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:06.524394 24593 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:06.525388 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:06.525992 24599 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.526736 27093 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:06.527119 27093 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:06.528071 27093 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.529469 27093 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.532053 27173 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:06.533124 27128 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.533391 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:06.534204 24665 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:06.534297 27194 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:06.538139 27197 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.538746 27197 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:06.540091 27122 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.824s	user 0.001s	sys 0.007s
I20260709 13:09:06.540925 25212 raft_consensus.cc:2410] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:06.542120 26880 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:06.542541 26880 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:06.543377 26880 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.544457 26880 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.496740 27029 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.495872 27129 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.546965 27129 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:06.547693 25210 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:06.543797 27115 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:09:06.549538 27186 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:06.550129 27186 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.550724 24599 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:06.551259 24535 tablet_copy_source_session.cc:215] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:06.552331 24535 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:53446 (request call id 478) took 1556 ms. Trace:
I20260709 13:09:06.552379 27186 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:06.553202 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.553344 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 102552us
I20260709 13:09:06.553785 27129 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:06.554188 27129 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:06.554996 27129 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.555542 27186 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.556025 27186 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.558166 27186 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:06.558979 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:06.450243 27174 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:06.564507 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63806.3us
I20260709 13:09:06.541641 27136 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:06.574076 24566 leader_election.cc:336] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.647s (SENT)
I20260709 13:09:06.574669 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:06.596581 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 127661us
I20260709 13:09:06.597559 25182 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:06.598718 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:06.596462 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 92200.9us
I20260709 13:09:06.600961 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:06.603250 25214 raft_consensus.cc:2368] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:06.603726 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:06.606506 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:06.552778 24535 rpcz_store.cc:276] 0709 13:09:04.995770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.000381 (+  4611us) service_pool.cc:224] Handling call
0709 13:09:06.550919 (+1550538us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540011dd54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf503f7 00007f17c0ee6036 00007f17c0eefa3e 00007f17b87b327b 00007f17c0eef9ba 00007f17c0eeaacc 00007f17c0ee5c7b 00007f17c0eda8d1 00007f17bff8e4b4 00007f17bff8e442
0709 13:09:06.552234 (+  1315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029499648}
I20260709 13:09:06.520895 27028 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:06.610780 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 122152us
I20260709 13:09:06.587250 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.578552 27119 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.565307 25211 raft_consensus.cc:2376] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9. Re-sending same reply.
I20260709 13:09:06.543382 27197 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:06.510316 27200 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:09:06.495184 27117 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.642576 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:06.582796 27160 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:06.625149 26926 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.646224 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:06.650672 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:06.651933 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:06.631237 27037 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.655303 25214 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:06.657733 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 70803.6us
W20260709 13:09:06.658254 24491 leader_election.cc:336] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.975s (SENT)
I20260709 13:09:06.658864 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:06.635743 27029 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.638403 27125 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:06.635201 27122 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:06.695153 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59978.9us
W20260709 13:09:06.702750 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44538.6us
W20260709 13:09:06.706604 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 64103.8us
I20260709 13:09:06.707576 24565 leader_election.cc:400] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:09:06.707844 24565 leader_election.cc:403] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:09:06.713683 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 126508us
I20260709 13:09:06.638738 27086 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:09:06.726619 27086 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:06.726994 27086 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:06.726928 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:06.728243 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.727908 27086 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:06.729175 27198 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:06.729660 24516 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:06.730829 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:06.731153 27112 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.719959 27211 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:09:06.720636 27203 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:09:06.720496 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 71049us
W20260709 13:09:06.722627 27167 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.000s
I20260709 13:09:06.723398 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 626) took 1152 ms. Trace:
I20260709 13:09:06.723573 27028 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:06.733852 25216 rpcz_store.cc:276] 0709 13:09:05.570917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.571031 (+   114us) service_pool.cc:224] Handling call
0709 13:09:06.723198 (+1152167us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b540007bcd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:06.723299 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130608512}
W20260709 13:09:06.733992 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 87859.9us
I20260709 13:09:06.660859 27173 raft_consensus.cc:2764] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:06.733579 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:06.736733 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:06.738718 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.740231 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.740751 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.797335 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:06.798808 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 65324.2us
I20260709 13:09:06.800397 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:06.739343 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:06.819808 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 69366.9us
I20260709 13:09:06.801581 24673 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:06.738252 27086 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.829638 27093 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:09:06.852579 27208 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:09:06.852991 27093 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:06.853523 27093 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:06.854616 27093 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:06.829792 27122 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:06.856654 27172 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.857246 27172 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:06.857501 27122 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.859294 27172 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:06.859814 27124 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:06.860517 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.861173 27198 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:06.862011 25244 heartbeater.cc:646] Failed to heartbeat to 127.22.225.190:40709 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.225.190:40709 timed out after 15.000s (SENT)
I20260709 13:09:06.862375 27198 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.795943 27125 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:06.865322 27125 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:06.866415 27060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7ec39f0d4e04761ae598f1245692799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:06.870046 27105 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:06.871505 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 134835us
I20260709 13:09:06.873181 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:06.879571 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:06.882329 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:06.858172 27160 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:06.884580 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 150936us
I20260709 13:09:06.746346 26926 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4.
I20260709 13:09:06.894155 27209 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 13:09:06.896577 24516 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:09:06.826642 27047 raft_consensus.cc:2764] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:09:06.897918 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 151018us
W20260709 13:09:06.905476 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 105141us
I20260709 13:09:06.908274 27028 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:06.740208 27167 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:06.914193 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.819514 27170 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:06.921428 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:06.953163 27170 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:06.953640 27170 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.953711 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:06.954492 27187 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:06.954852 27187 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.955178 27187 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.915383 27211 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.956866 27028 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:06.957237 27029 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:06.922551 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:06.909819 27210 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:06.931550 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45543.8us
W20260709 13:09:06.933857 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.889048 27037 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:06.940635 27174 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:06.967849 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:06.916098 27126 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:06.940733 25214 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
W20260709 13:09:06.929194 27164 consensus_meta.cc:287] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.982s	user 0.008s	sys 0.004s
I20260709 13:09:06.919761 24516 pending_rounds.cc:85] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 5
I20260709 13:09:06.975575 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:06.976789 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 54310.1us
I20260709 13:09:06.856225 27093 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.014225 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:07.016625 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:07.017566 25214 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:07.020411 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.018232 24598 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:07.070143 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 205934us
I20260709 13:09:06.966970 27210 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.069324 25216 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:06.987670 24516 pending_rounds.cc:107] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:06.988219 26926 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.013777 27128 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.085278 27037 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.094156 27210 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.093515 24516 raft_consensus.cc:2889] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:07.128226 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:07.093853 27126 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:07.091506 27172 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:07.145982 26873 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.138s	user 0.004s	sys 0.008s
I20260709 13:09:07.171783 26873 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.174438 26873 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:07.175215 24670 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:07.151868 27222 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:06.976183 27028 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.015635 27164 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.180738 24597 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.181264 27164 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:07.155181 27128 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.187299 27128 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.189916 27126 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.186682 27172 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:07.193965 27172 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.019868 27071 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
W20260709 13:09:07.152137 27094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.113s	sys 0.126s
W20260709 13:09:07.199362 27094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.113s	sys 0.126s
I20260709 13:09:07.200601 27209 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:07.201313 27209 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.204005 27209 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:07.205746 27167 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:07.214087 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:07.215536 27128 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:07.217118 26880 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.001s
I20260709 13:09:07.222245 27128 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:07.154425 27037 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.225978 27128 raft_consensus.cc:2955] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:07.227281 27037 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:07.162087 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet e6a2e9eb050b40f8b828d36d037224d8: Illegal state: Replica 148dc963cec64232ad3b248abad6f36d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
W20260709 13:09:07.242301 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.243041 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.243414 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.255056 27037 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:07.255847 27037 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:07.258368 27037 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:07.263155 27211 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:07.264963 25219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:07.265661 25219 raft_consensus.cc:606] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:07.287526 25219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28c13259bf74484588e0fb08995091cc"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:07.288261 25219 raft_consensus.cc:606] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:07.288674 25219 raft_consensus.cc:614] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:07.300573 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.301618 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1223) took 1526 ms. Trace:
I20260709 13:09:07.302037 24596 rpcz_store.cc:276] 0709 13:09:05.775018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.300180 (+1525162us) service_pool.cc:224] Handling call
0709 13:09:07.301550 (+  1370us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:07.303352 24669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 2596) took 1565 ms (client timeout 1596 ms). Trace:
W20260709 13:09:07.303894 24669 rpcz_store.cc:269] 0709 13:09:05.738297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.748581 (+ 10284us) service_pool.cc:224] Handling call
0709 13:09:07.303125 (+1554544us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54002ec054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:07.303254 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37702400}
W20260709 13:09:07.310201 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.310648 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.310946 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.310870 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1364) took 1576 ms. Trace:
I20260709 13:09:07.316834 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:07.313673 24598 rpcz_store.cc:276] 0709 13:09:05.734439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.830015 (+ 95576us) service_pool.cc:224] Handling call
0709 13:09:07.310662 (+1480647us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540032c154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:07.310793 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609333504}
I20260709 13:09:07.295571 27170 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:07.343544 24525 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:07.357333 24671 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:07.403637 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:07.436561 26969 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.487787 24525 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.482308 24517 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:07.490074 27187 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
W20260709 13:09:07.512028 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.512662 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:07.521917 27164 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:07.523133 27131 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:07.523576 27131 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:07.524674 26926 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.525498 27124 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.525995 27170 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:07.526099 27124 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.528679 27124 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:07.529754 27181 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.533s	user 0.006s	sys 0.023s
I20260709 13:09:07.531524 24525 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:07.485378 26969 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:07.509696 27112 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.004s
I20260709 13:09:07.529639 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1007) took 1111 ms. Trace:
I20260709 13:09:07.533129 25212 rpcz_store.cc:276] 0709 13:09:06.417883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.418007 (+   124us) service_pool.cc:224] Handling call
0709 13:09:07.529429 (+1111422us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400532354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:07.529580 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279823104}
I20260709 13:09:07.533766 26969 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:07.534770 25212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:07.535326 25212 raft_consensus.cc:606] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:07.521406 27187 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:07.538486 25212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:07.524436 27131 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.539214 27187 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:07.544582 24566 leader_election.cc:336] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.778s (SENT)
W20260709 13:09:07.545992 27223 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:07.546087 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1220) took 2353 ms. Trace:
W20260709 13:09:07.546782 27227 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
W20260709 13:09:07.528736 27119 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.899s	user 0.009s	sys 0.000s
I20260709 13:09:07.548153 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:07.553815 24591 rpcz_store.cc:276] 0709 13:09:05.192364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.487342 (+294978us) service_pool.cc:224] Handling call
0709 13:09:05.548955 (+ 61613us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:05.639535 (+ 90580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.545864 (+1906329us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b54001ec3d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:07.546027 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114707200}
I20260709 13:09:07.580475 27119 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:07.573467 27029 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.013s	sys 0.008s
W20260709 13:09:07.582108 27029 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.013s	sys 0.008s
I20260709 13:09:07.582446 27029 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:07.606352 25184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.001s	sys 0.023s
W20260709 13:09:07.611909 25184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.002s	sys 0.024s
I20260709 13:09:07.519671 27167 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 13:09:07.612808 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 68269.5us
W20260709 13:09:07.613384 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 738877us
I20260709 13:09:07.615651 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:07.598995 27122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.012s	sys 0.012s
W20260709 13:09:07.606511 27198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.000s	sys 0.024s
I20260709 13:09:07.629580 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.630710 24596 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:07.632377 25217 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:09:07.583544 27029 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:09:07.621352 27122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.012s	sys 0.013s
I20260709 13:09:07.641482 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.644379 24598 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:09:07.613683 26969 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.641641 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:07.641500 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.643143 24566 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 3.306s (SENT)
I20260709 13:09:07.643612 24595 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:07.646716 24600 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:07.647228 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:07.613139 27124 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:07.644953 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:07.633847 27198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.024s
I20260709 13:09:07.650424 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:07.681982 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:07.684386 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:07.685091 24521 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:07.685707 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.686856 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.687649 24598 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:07.688472 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:07.689340 24525 raft_consensus.cc:2410] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:07.691277 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.685519 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:07.634183 27174 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:09:07.694165 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:07.692029 24591 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
W20260709 13:09:07.699909 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 61659.2us
W20260709 13:09:07.700443 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 288039us
I20260709 13:09:07.642849 27126 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:09:07.699893 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.703372 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.707558 24599 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:07.707782 24596 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:07.693215 27211 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:07.715169 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.679898 27124 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:07.718678 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.016s	sys 0.008s
W20260709 13:09:07.719404 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.016s	sys 0.008s
I20260709 13:09:07.722337 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1016) took 1259 ms. Trace:
I20260709 13:09:07.722826 25210 rpcz_store.cc:276] 0709 13:09:06.463173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.466269 (+  3096us) service_pool.cc:224] Handling call
0709 13:09:06.506057 (+ 39788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.548118 (+ 42061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.721999 (+1173881us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b54003372d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:07.722246 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95112960}
W20260709 13:09:07.729568 27237 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:09:07.733368 24566 leader_election.cc:336] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.815s (SENT)
W20260709 13:09:07.719697 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 731450us
I20260709 13:09:07.733841 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:07.733779 24521 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:07.735455 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:07.739501 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:07.740314 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.741845 25215 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.740406 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:07.737761 27211 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:07.716951 27108 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.717307 27122 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.745999 24521 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:07.748567 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:07.708992 27198 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:07.742947 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:07.754546 27229 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.755039 27229 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:07.757166 27229 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:07.757333 27129 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.746447 27164 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:07.763214 27093 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 13:09:07.750061 26926 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.769950 27235 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:09:07.753288 27108 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.796299 27108 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:07.763051 27122 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.800065 27122 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:07.802001 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.802762 24596 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
W20260709 13:09:07.803459 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.790005 27164 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:07.804845 27232 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:07.805230 27164 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:07.808696 27210 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.003s
I20260709 13:09:07.809666 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:07.810375 24592 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
W20260709 13:09:07.811192 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.815718 27210 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.817440 25212 raft_consensus.cc:606] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:07.817808 27128 consensus_meta.cc:287] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260709 13:09:07.817848 25212 raft_consensus.cc:614] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:07.820109 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:07.820705 24596 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.832103 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:07.837234 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 83637.5us
W20260709 13:09:07.844271 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.847779 24596 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:07.859706 24520 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
W20260709 13:09:07.865800 24520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1453) took 1996 ms (client timeout 1712 ms). Trace:
W20260709 13:09:07.866406 24520 rpcz_store.cc:269] 0709 13:09:05.864615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.880707 (+ 16092us) service_pool.cc:224] Handling call
0709 13:09:07.831901 (+1951194us) spinlock_profiling.cc:243] Waited 964 us on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:07.860573 (+ 28672us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217344}
I20260709 13:09:07.852576 27210 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:07.791882 27211 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.889593 25215 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:07.894973 26717 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:07.895467 26717 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:07.896443 26717 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.899410 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1369) took 2163 ms. Trace:
I20260709 13:09:07.899940 24594 rpcz_store.cc:276] 0709 13:09:05.735737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.881721 (+145984us) service_pool.cc:224] Handling call
0709 13:09:07.260485 (+1378764us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:09:07.260679 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.260897 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:07.553422 (+292525us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.898709 (+345287us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b18003b51e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a
0709 13:09:07.899016 (+   307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.899067 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:07.899117 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.899190 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.899335 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":377096,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":120,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":11321984,"thread_start_us":399856,"threads_started":2,"wal-append.queue_time_us":181707}
W20260709 13:09:07.920150 27178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.917s	user 0.003s	sys 0.020s
W20260709 13:09:07.921749 27178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.918s	user 0.004s	sys 0.020s
I20260709 13:09:07.922180 27178 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:07.926004 27233 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.322s	user 0.003s	sys 0.000s
W20260709 13:09:07.929726 27244 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
W20260709 13:09:07.943724 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 195321us
I20260709 13:09:07.952214 27093 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:07.952759 27093 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:07.953163 27093 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.935619 27178 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:07.964206 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:07.970042 24490 leader_election.cc:400] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:07.970366 24490 leader_election.cc:403] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:07.989202 27243 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:07.988626 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:07.984419 27229 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.016397 27136 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.028429 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 603) took 1068 ms. Trace:
I20260709 13:09:08.029933 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 525) took 1424 ms. Trace:
I20260709 13:09:08.030304 24670 rpcz_store.cc:276] 0709 13:09:06.605941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.606416 (+   475us) service_pool.cc:224] Handling call
0709 13:09:06.622260 (+ 15844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.175735 (+553475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.029744 (+854009us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400404554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:08.029878 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271156608}
I20260709 13:09:08.028858 25217 rpcz_store.cc:276] 0709 13:09:06.959705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.959856 (+   151us) service_pool.cc:224] Handling call
0709 13:09:06.987717 (+ 27861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.635226 (+647509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.028199 (+392973us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002e59d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:08.028373 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481817984}
I20260709 13:09:08.043787 24591 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:08.044992 24594 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:08.056689 27060 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48942 (request call id 594) took 6726 ms. Trace:
W20260709 13:09:08.059744 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.065778 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.073796 27122 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.078169 27122 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.080437 27122 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.083282 25217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:08.084106 25217 raft_consensus.cc:606] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.085366 27106 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.085974 27188 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:08.090094 24491 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.525s (SENT)
I20260709 13:09:08.086737 27188 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.090576 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.092621 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:08.103348 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:08.105516 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:08.106377 25212 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.086045 27106 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.082082 27115 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:08.111162 27194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.462s	user 0.022s	sys 0.027s
W20260709 13:09:08.127779 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.131034 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.128611 27194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.022s	sys 0.028s
I20260709 13:09:08.139472 24594 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:08.146883 25212 raft_consensus.cc:2410] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:08.114825 27115 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.138767 27187 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.151614 27108 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.157214 27122 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:09:08.160930 27122 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:08.161295 27122 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:08.162094 27122 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.163260 27122 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.165925 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 524) took 1560 ms. Trace:
I20260709 13:09:08.166599 27160 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:08.167133 27160 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:08.168535 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.168558 27108 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.171350 27108 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.154634 27191 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.169185 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 2592) took 2488 ms. Trace:
I20260709 13:09:08.172099 27191 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.172302 24671 rpcz_store.cc:276] 0709 13:09:05.680857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.680996 (+   139us) service_pool.cc:224] Handling call
0709 13:09:06.726794 (+1045798us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800170798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:08.168961 (+1442167us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400406354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:08.169127 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469529088}
I20260709 13:09:08.174408 27191 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:08.178300 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:08.179605 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.180687 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:08.181528 27102 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:08.191286 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.157234 27163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.512s	user 0.022s	sys 0.020s
I20260709 13:09:08.206804 24524 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:08.208053 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:08.213913 27194 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:08.215487 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:08.218858 24674 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.152354 27211 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.214406 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 526) took 1608 ms. Trace:
I20260709 13:09:08.213274 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 527) took 1589 ms. Trace:
I20260709 13:09:08.216538 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:08.166383 24672 rpcz_store.cc:276] 0709 13:09:06.605620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.606349 (+   729us) service_pool.cc:224] Handling call
0709 13:09:06.623220 (+ 16871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.623453 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:06.739138 (+115685us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.148727 (+1409589us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.165584 (+ 16857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.165633 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:08.165676 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.165748 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.165868 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1156763,"prepare.queue_time_us":331561,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":1140497,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":12707,"thread_start_us":385705,"threads_started":3,"wal-append.queue_time_us":606627}
I20260709 13:09:08.221797 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:08.224466 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:08.225226 24668 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:08.227053 24673 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:08.229151 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:08.206820 27102 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.206875 27191 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:08.217332 27163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.570s	user 0.023s	sys 0.021s
I20260709 13:09:08.221351 24667 rpcz_store.cc:276] 0709 13:09:06.623896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.624128 (+   232us) service_pool.cc:224] Handling call
0709 13:09:06.638404 (+ 14276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.638623 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:06.981939 (+343316us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.212798 (+1230859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.212849 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:08.212923 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.213026 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.213216 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":979119,"prepare.queue_time_us":297198,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":985807,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4423,"thread_start_us":583895,"threads_started":3,"wal-append.queue_time_us":373053}
I20260709 13:09:08.230259 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:08.206664 27206 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.211315 27170 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.065012 27060 rpcz_store.cc:276] 0709 13:09:01.329927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.941719 (+611792us) service_pool.cc:224] Handling call
0709 13:09:02.738150 (+796431us) ts_tablet_manager.cc:934] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343)
0709 13:09:06.864783 (+4126633us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:07.806345 (+941562us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:07.806456 (+   111us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:08.004333 (+197877us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:08.056126 (+ 51793us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:08.056464 (+   338us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:08.056571 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":36473,"tablet-copy.queue_time_us":742081,"thread_start_us":402241,"threads_started":2}
I20260709 13:09:08.217370 27108 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:08.234712 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.224763 27209 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:08.241127 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:08.254554 24600 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.241518 27060 tablet_copy_client.cc:806] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:08.241156 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:08.243106 27235 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:08.245379 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:08.246400 27131 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.246894 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.249477 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:08.250707 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:08.267771 24598 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:08.232221 27220 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:08.269331 27220 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.269802 27220 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.239017 27194 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:08.275380 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46342us
I20260709 13:09:08.278724 24421 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 2 to 4, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 4 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.280479 24670 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:08.280845 24670 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:08.232152 27102 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.221211 24665 rpcz_store.cc:276] 0709 13:09:06.606222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.606478 (+   256us) service_pool.cc:224] Handling call
0709 13:09:06.606744 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.606919 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:06.740376 (+133457us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.114534 (+1374158us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b1800293680. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:09:08.214087 (+ 99553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.214138 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:08.214181 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.214243 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.214350 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126985,"prepare.queue_time_us":268690,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2440,"raft.queue_time_us":1278914,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5321,"spinlock_wait_cycles":10193152,"thread_start_us":311482,"threads_started":3,"wal-append.queue_time_us":222642,"wal-append.run_cpu_time_us":1921,"wal-append.run_wall_time_us":1209495}
I20260709 13:09:08.226411 27198 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:08.284163 25213 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:08.309748 24598 raft_consensus.cc:2410] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:09:08.300439 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.310056 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 1.33444e+06us
I20260709 13:09:08.314440 24670 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.253973 27108 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:08.318786 24670 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.309960 27282 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.317720 27108 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.236356 27037 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:09:08.324697 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.231649 27211 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:08.327180 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43985.8us
I20260709 13:09:08.286402 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:08.331213 24674 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:08.284332 27198 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:08.341899 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55571.5us
I20260709 13:09:08.236583 27191 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:08.260520 27209 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:08.282263 27170 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.236493 27280 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:09:08.324771 27060 tablet_copy_client.cc:670] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:08.353046 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.370355 24637 leader_election.cc:400] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:08.349968 27209 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.344686 27282 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.379104 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.341427 27198 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.394404 24600 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:08.258404 27277 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 13:09:08.349397 27281 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:08.348170 27284 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:09:08.413226 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.368062 27231 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:08.375690 27028 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.396983 27115 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.404608 27178 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.370548 27265 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:09:08.406352 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 84893.9us
I20260709 13:09:08.405464 27235 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:08.445852 27235 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.446699 24670 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:08.410866 27281 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:08.436755 27264 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
W20260709 13:09:08.444856 27270 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.233s	user 0.002s	sys 0.002s
I20260709 13:09:08.454767 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1376) took 2687 ms. Trace:
I20260709 13:09:08.455140 24597 rpcz_store.cc:276] 0709 13:09:05.766965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.972119 (+205154us) service_pool.cc:224] Handling call
0709 13:09:05.972421 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.181215 (+1208794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.454520 (+1273305us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001dfe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:08.454680 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778252032}
W20260709 13:09:08.455853 27093 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.502s	user 0.003s	sys 0.006s
I20260709 13:09:08.456264 27093 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.457015 27281 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:08.428293 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 95072.5us
W20260709 13:09:08.459057 24420 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 244) took 16929 ms (client timeout 15000 ms). Trace:
I20260709 13:09:08.463364 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:08.403716 27288 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:09:08.469901 24524 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:08.464610 27029 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:08.473322 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 484744us
I20260709 13:09:08.474699 27229 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:08.475158 27229 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:08.475891 27106 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.475970 27229 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.477221 27047 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:08.477608 27047 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:08.478426 27047 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.479420 27047 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:08.479526 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 389451us
W20260709 13:09:08.480708 24491 leader_election.cc:336] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.631s (SENT)
I20260709 13:09:08.481135 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:08.482105 24491 leader_election.cc:336] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.690s (SENT)
I20260709 13:09:08.482806 27250 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.483603 27273 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.483549 27250 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:08.482901 27240 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.489233 27119 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.489809 27119 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.469353 27282 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:08.495893 27282 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:08.496845 27282 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.466619 24421 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 2 to 4, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 4 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:08.482758 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.494359 27250 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.431010 27187 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.495266 27119 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.502529 25212 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
W20260709 13:09:08.503481 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90353.2us
I20260709 13:09:08.499622 27124 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:08.507784 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.488518 27108 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.505733 24421 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 2 to 4, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 4 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.488656 27220 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.522228 24598 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:08.525547 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.526597 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:08.527215 24592 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:08.532723 24421 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.538327 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:08.538393 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56296us
W20260709 13:09:08.539263 24491 leader_election.cc:336] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.695s (SENT)
I20260709 13:09:08.539731 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:08.542304 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.543327 24421 catalog_manager.cc:5697] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 1 to 2, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 2 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:08.545282 24421 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:08.547335 24421 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:08.549103 24421 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:08.550611 24421 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
W20260709 13:09:08.554955 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47252.2us
W20260709 13:09:08.558261 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.558455 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:08.524923 27117 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.563447 25217 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.564458 25213 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:08.564826 25210 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.567044 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:08.578025 27286 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:08.567659 25210 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:08.579200 27234 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.579938 27213 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:09:08.582405 27281 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.584981 27281 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.585232 27284 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:08.586628 27191 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.559464 27265 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.533762 27124 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.522818 27186 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:09:08.594934 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55699.6us
I20260709 13:09:08.598618 27102 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.600231 27125 raft_consensus.cc:993] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:09:08.614245 27108 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.614637 27188 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.615528 27093 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:08.617048 27220 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.572317 27163 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.617980 27163 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.619966 27163 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:08.625401 27297 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.626626 27290 raft_consensus.cc:993] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: : Instructing follower 96002c98f2d142e4b67dc5105a06079c to start an election
I20260709 13:09:08.628778 27173 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:08.629347 27170 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:08.459522 24420 rpcz_store.cc:269] 0709 13:08:51.529418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.530458 (+  1040us) service_pool.cc:224] Handling call
0709 13:09:08.458841 (+16928383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:57.150846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:57.159942 (+  9096us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:57.160008 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:08:57.160032 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:57.161329 (+  1297us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:57.161406 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:57.161433 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:08:57.417365 (+255932us) tablet.cc:701] Row locks acquired
0709 13:08:57.417417 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:08:57.417606 (+   189us) write_op.cc:270] Start()
0709 13:08:57.417758 (+   152us) write_op.cc:276] Timestamp: P: 1783602537417543 usec, L: 0
0709 13:08:57.417776 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:08:57.418487 (+   711us) log.cc:844] Serialized 5172 byte log entry
0709 13:08:59.098295 (+1679808us) op_driver.cc:464] REPLICATION: finished
0709 13:09:00.244702 (+1146407us) write_op.cc:301] APPLY: starting
0709 13:09:00.244839 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:00.254620 (+  9781us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:00.268208 (+ 13588us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:00.583636 (+315428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:00.583893 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:09:00.583944 (+    51us) write_op.cc:312] APPLY: finished
0709 13:09:00.584286 (+   342us) log.cc:844] Serialized 95 byte log entry
0709 13:09:00.934867 (+350581us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:00.935035 (+   168us) write_op.cc:454] Released schema lock
0709 13:09:00.935087 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:01.347623 (+412536us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:01.373294 (+ 25671us) write_op.cc:454] Released schema lock
0709 13:09:03.309733 (+1936439us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
Metrics: {"mutex_wait_us":624797,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":1134708,"apply.run_cpu_time_us":19811,"apply.run_wall_time_us":693194,"num_ops":13,"prepare.queue_time_us":263138,"prepare.run_cpu_time_us":23696,"prepare.run_wall_time_us":534562,"raft.queue_time_us":741402,"raft.run_cpu_time_us":41023,"raft.run_wall_time_us":1031723,"replication_time_us":1611552,"spinlock_wait_cycles":2432768,"thread_start_us":1971313,"threads_started":5,"wal-append.queue_time_us":1236099,"wal-append.run_cpu_time_us":93377,"wal-append.run_wall_time_us":4882806}]]}
W20260709 13:09:08.640622 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 78848us
W20260709 13:09:08.651223 24565 connection.cc:256] RPC call timeout handler was delayed by -1.0874475930000926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
I20260709 13:09:08.656524 24672 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:09:08.656901 24672 pending_rounds.cc:85] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 8
I20260709 13:09:08.657141 24672 pending_rounds.cc:107] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:09:08.657377 24672 raft_consensus.cc:2889] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.569294 27211 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.629355 27173 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:08.660387 24566 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.005s (SENT)
I20260709 13:09:08.674026 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:08.674172 24491 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.930s (SENT)
I20260709 13:09:08.664516 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:08.659827 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 139185us
I20260709 13:09:08.675585 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.654249 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:08.661188 27115 raft_consensus.cc:1081] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:09:08.679491 27172 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.711669 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:08.716408 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 85364.2us
I20260709 13:09:08.698575 27290 raft_consensus.cc:1081] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Signalling peer 96002c98f2d142e4b67dc5105a06079c to start an election
W20260709 13:09:08.718320 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 76019.5us
I20260709 13:09:08.701843 27284 consensus_queue.cc:1243] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:08.709720 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:09:08.722041 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.722538 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.720980 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 57299us
I20260709 13:09:08.726432 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.727622 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:08.714049 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.707988 27231 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.722975 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:08.754550 24518 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:08.755053 24524 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:08.718667 27170 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.718537 27211 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.750725 25210 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:08.758518 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:08.762796 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 331281us
I20260709 13:09:08.728391 27125 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:08.769690 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.769459 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 109096us
I20260709 13:09:08.772828 27299 raft_consensus.cc:1064] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
W20260709 13:09:08.773576 27295 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:09:08.775954 24491 leader_election.cc:336] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.786s (SENT)
W20260709 13:09:08.776065 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48507.9us
I20260709 13:09:08.776422 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.720080 27172 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.758671 27282 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.750396 27093 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:08.775309 27299 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.766877 27163 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:08.769980 27234 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:09:08.785578 26717 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:08.766548 27125 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.765461 27250 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:08.786257 27115 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.790195 24598 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:08.796149 27298 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.798074 27131 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.804842 27093 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.799707 27172 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.769793 27229 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:08.800902 27047 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.801221 27308 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.766877 27102 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.802763 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.767412 27211 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.759936 27231 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.768165 27128 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:09:08.813740 27229 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.764511 27173 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.813462 27047 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.814049 27115 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.810114 27125 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.817297 27131 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.815665 27297 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:09:08.814430 27093 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:08.831696 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:08.831863 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:08.832285 24665 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.814257 27250 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.833740 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:08.834312 24671 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:08.834676 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:08.834856 27250 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:08.835902 24670 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:08.836796 27047 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:08.828902 27108 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:09:08.824393 27288 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:09:08.821465 27229 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:08.822152 27282 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.845881 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:08.848445 24520 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:08.841360 24518 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:09:08.851722 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:08.852280 24674 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:08.849332 24518 pending_rounds.cc:85] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 5
I20260709 13:09:08.854282 24518 pending_rounds.cc:107] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:08.854620 24518 raft_consensus.cc:2889] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:08.856896 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:08.858490 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:08.860612 27160 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:08.861691 27297 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.862200 27297 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.862476 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:08.863267 24516 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:08.864135 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:08.864296 27297 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.817142 27308 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.864812 27297 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.852931 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:08.877130 24674 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.869872 24521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:53446
I20260709 13:09:08.879205 27306 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:08.864804 27304 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.003s
I20260709 13:09:08.885533 27308 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.885646 25211 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:09:08.887483 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:08.888473 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:08.862509 27129 raft_consensus.cc:993] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:09:08.891750 25215 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:08.851507 27047 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:08.886929 24566 leader_election.cc:336] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 4.539s (SENT)
I20260709 13:09:08.896476 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:08.899425 25212 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:08.900763 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.906112 24665 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:08.885751 27303 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.901050 27197 raft_consensus.cc:1081] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:09:08.901837 27284 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.898705 27250 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.902819 27060 tablet_copy_client.cc:538] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:08.914166 27115 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.914232 27310 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.914747 24517 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:08.915102 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 62523us
I20260709 13:09:08.939155 27303 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:08.899344 27282 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:08.965355 27282 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:08.966218 27282 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:08.915624 27301 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:09:08.916772 27194 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:08.921722 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.931741 24665 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:08.946583 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.874791 27297 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.905414 27047 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:08.947570 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.903123 27173 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.938650 27160 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:08.961992 24674 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:08.963452 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:08.953333 27209 consensus_meta.cc:287] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.005s
W20260709 13:09:08.979744 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.982374 24491 leader_election.cc:336] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.011s (SENT)
I20260709 13:09:08.981230 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:08.947119 27112 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.953629 27131 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:08.959106 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:08.992465 27310 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.993122 27126 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:08.994377 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:09.000278 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.002885 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:09.018353 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:09.005626 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.017454 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:08.894719 27093 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.021632 24668 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:09.025616 24671 raft_consensus.cc:2368] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:09.025751 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.004703 27303 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:09.028131 24639 consensus_peers.cc:597] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.028203 27047 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.021979 27310 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:09.031349 27310 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.017589 27291 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:09.032495 27291 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:09.032931 27291 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.993673 27288 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:09.038307 27231 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:09.039101 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56755.2us
I20260709 13:09:09.040371 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:09.041121 24517 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:09.042706 27302 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.042968 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:09.046248 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:09.047547 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:09.046418 27297 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.048564 27308 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:09.049398 27308 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.049994 27308 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.050639 27308 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:09.050972 27308 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:09.052251 27308 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.053583 27308 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.961376 27250 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:09.056972 27163 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:09.064621 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:09.103623 27213 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:09.104102 27213 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:09.116312 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.117166 24596 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.119036 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.119810 24593 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:09.124039 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.124781 24593 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:09.126154 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.023514 27037 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.004849 27290 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:09:09.130517 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.131650 24595 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:09.131881 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.132839 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.133427 24595 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:09.134356 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.140458 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.141247 24669 raft_consensus.cc:2393] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:09.010852 27209 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:09.143021 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.150475 24671 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:09.143863 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.147866 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:09.154000 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:09.059485 27136 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:09.088335 27297 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:09.156181 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.018684 27112 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.113320 27186 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:09.166643 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 437510us
I20260709 13:09:09.166929 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.111243 27093 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.177348 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:09.180290 24596 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:09.023161 27160 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:09.190404 24521 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.192480 24521 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.100555 27172 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:09:09.192571 25219 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:09.205099 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.207978 24598 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:09.141945 27235 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:09.175516 27128 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:09.174237 27186 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:09.191157 27312 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:09:09.104955 27213 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.191676 27290 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.178892 27136 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:09.293234 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 92349.7us
W20260709 13:09:09.288956 27117 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.003s
I20260709 13:09:09.321584 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.325805 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.327035 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.328050 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.328586 24669 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:09.329816 24666 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:09.331456 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.332484 24673 raft_consensus.cc:2410] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:09.298410 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.151880 27037 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.289746 27128 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.301776 26926 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.306767 27198 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.904s	user 0.007s	sys 0.002s
I20260709 13:09:09.293977 27186 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.290827 27272 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:09:09.166211 27297 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:09.345552 24670 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:09.347275 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.372005 25218 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:09.376353 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.407547 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.382522 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:09.374286 27286 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:09:09.414906 24592 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:09.418545 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.420760 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.421494 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.380560 27213 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.381269 27128 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:09.318439 27310 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:09:09.429561 24597 raft_consensus.cc:2410] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:09.432898 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.431842 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.430472 24521 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.434780 24596 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:09.434808 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.436388 24672 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:09.437290 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:09.439453 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 278760us
I20260709 13:09:09.411850 27224 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.322963 27290 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.441937 24599 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:09.346580 27125 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.449010 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.450148 24669 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:09.453850 24674 raft_consensus.cc:1217] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:09:09.454617 24674 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:09.455474 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.456492 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.457389 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.458720 24596 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:09.440996 27264 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:09:09.382951 26926 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.462078 24521 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:09.464682 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.468008 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.468417 24670 raft_consensus.cc:2368] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:09.468559 24599 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.466300 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.405018 27198 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.469455 24672 raft_consensus.cc:2368] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6.
I20260709 13:09:09.470492 24593 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:09.442687 27302 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:09.470440 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.477638 25213 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:09.478004 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.487825 24669 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:09.490443 24593 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:09:09.479396 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.496735 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.498457 25212 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:09.503368 27284 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:09:09.503790 27284 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:09.510020 24667 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:09.526487 24669 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:09.526589 24670 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:09:09.528692 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.528786 24599 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:09.529458 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:09.530143 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.530824 24599 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:09.447001 27136 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:09.537894 27319 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:09.498020 27209 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:09.460059 27224 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.517997 27112 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:09.572662 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.573215 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.575076 24521 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:09.565562 27297 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.567065 27125 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:09.569706 27291 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.003s
I20260709 13:09:09.518323 27160 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:09.615154 24595 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:09.620700 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:09.621767 24521 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
I20260709 13:09:09.545957 27299 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:09.625945 25218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 605) took 2656 ms (client timeout 2184 ms). Trace:
I20260709 13:09:09.632225 24668 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
W20260709 13:09:09.626505 25218 rpcz_store.cc:269] 0709 13:09:06.962387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.962507 (+   120us) service_pool.cc:224] Handling call
0709 13:09:09.604901 (+2642394us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b540004c4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:09.618569 (+ 13668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5419905280}
I20260709 13:09:09.628244 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:09.634232 27325 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:09:09.637146 27323 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:09:09.638175 27234 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:09.638717 27234 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:09.640112 27308 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.549s	user 0.001s	sys 0.005s
I20260709 13:09:09.639725 27234 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:09.609859 27209 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.641431 27209 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.643391 27234 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.643680 27209 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.618057 27291 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.649379 27299 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:09.650399 27291 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.651491 27299 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.652661 24600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:51506
I20260709 13:09:09.653208 24600 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.653558 24600 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.659482 27198 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.665762 27290 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.603432 27297 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:09.666915 27297 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.666991 26926 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:09.667405 27297 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.664849 27060 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:09:09.693375 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:09.695493 25214 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:09.697305 27229 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.831s	user 0.003s	sys 0.008s
I20260709 13:09:09.697746 27229 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:09.699486 27328 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:09:09.701738 27229 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:09.709709 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:09.700789 27297 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:09.712715 24522 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:09.711122 24520 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
W20260709 13:09:09.681016 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.674963 24594 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:09.717417 24600 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.723088 24595 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:09.730507 24566 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.037s
W20260709 13:09:09.731003 24566 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.000s	sys 0.037s
W20260709 13:09:09.731320 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 533686us
W20260709 13:09:09.735564 24566 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.716s (SENT)
I20260709 13:09:09.736263 24674 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:09.736734 24674 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:09.738314 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.738389 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:09.740139 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:09.738881 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:09.741876 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:09.750442 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.737514 24674 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.753055 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.753721 24674 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:09.744977 24566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 4.913s (SENT) [suppressed 42 similar messages]
I20260709 13:09:09.757969 24600 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:09.736320 27047 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.739353 24516 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:09.769809 27186 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.735422 26926 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:09:09.770990 27306 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:09.773461 27294 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.046s	user 0.000s	sys 0.010s
I20260709 13:09:09.807178 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.774576 24674 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:09.808120 24674 pending_rounds.cc:85] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 6
I20260709 13:09:09.808367 24674 pending_rounds.cc:107] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:09.775125 27297 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.752965 27314 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:09.776342 24600 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:09.753269 27164 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.754087 27172 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:09.790113 24672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:52138
I20260709 13:09:09.812139 24672 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:09.812621 24672 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.792232 27224 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:09.751573 27229 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:09.808606 24674 raft_consensus.cc:2889] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.804047 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:09.810205 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.820721 24671 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.809419 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.821942 24669 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:09.827932 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:09.820248 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:09.833709 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:09.827988 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 282664us
I20260709 13:09:09.834507 24670 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 2.
I20260709 13:09:09.809634 27314 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.815915 27172 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.803630 27047 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.875617 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.833766 27282 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.819133 27229 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.810514 27306 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:09.871762 27314 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:09.890606 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.876104 27172 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.897279 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:09.905728 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.908675 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.901500 27282 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:09.894125 27128 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:09.916316 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.916733 24600 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.912871 27282 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.921949 24523 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:09.921290 27282 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.925850 26926 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.934306 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45255.7us
I20260709 13:09:09.939508 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:09:09.936018 24566 leader_election.cc:336] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.034s (SENT)
I20260709 13:09:09.940598 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:09.945878 24600 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:09.948326 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:09.952114 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:09.952311 24566 leader_election.cc:336] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.199s (SENT)
I20260709 13:09:09.952797 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:09.954016 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:09.951040 27117 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:09.954892 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 134734us
W20260709 13:09:09.938658 27340 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:09.958182 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:09.959036 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.959277 27308 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.962752 24600 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:09.947086 26926 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:09.947399 27093 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.968930 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:09.969157 27344 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:09:09.966780 27160 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:09:09.966879 27209 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:09.954933 27213 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.955055 27284 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:09.972450 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.961000 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 83725us
I20260709 13:09:09.979313 24671 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:09.981035 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:10.013845 25217 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:10.018549 25212 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:10.018973 25212 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:10.010510 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 529) took 1154 ms. Trace:
I20260709 13:09:10.020383 24520 rpcz_store.cc:276] 0709 13:09:08.856424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.856669 (+   245us) service_pool.cc:224] Handling call
0709 13:09:10.010252 (+1153583us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540030fa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:10.010425 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838832896}
I20260709 13:09:10.021826 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:09.955497 27348 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:09.987507 25218 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:10.024837 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:10.019703 25212 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.030992 25212 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.017712 27209 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:10.031977 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:10.029000 25215 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:09.982496 27229 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:09.965518 27188 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:09:09.980758 27047 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.037608 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:10.031894 27209 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.006026 27186 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.040385 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:10.017560 27284 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:10.004068 27302 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:09.996626 27306 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.012990 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:09.986862 27128 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.038445 24672 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.047529 25212 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:09:10.042106 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:10.044410 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 83699.8us
I20260709 13:09:10.052755 24600 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.985919 27093 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.059815 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:10.060765 25210 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:10.061229 25210 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:10.061556 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.062424 25210 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.063271 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.064117 25210 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.064779 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.039289 27235 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:10.049207 26926 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.065939 27160 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.066448 27352 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:10.054745 27351 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:09:10.065825 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.070884 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:10.073920 24666 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:10.074610 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.075929 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:10.077320 25218 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:10.085067 24667 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.080899 25216 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:10.043334 27213 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:10.054056 27284 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.082496 24672 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.083602 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.090077 24665 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:10.087137 27213 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.054234 27302 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.093578 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:10.077898 27235 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.087556 27352 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:10.106376 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:10.110339 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:10.090497 27308 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.104627 27355 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:09:10.093039 27213 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.102449 27112 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.100696 27235 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.126406 25213 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:10.129539 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 75233.1us
I20260709 13:09:10.088862 27353 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:09:10.133298 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:10.138054 24600 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:10.129647 27112 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.143731 27112 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:10.146835 27350 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:09:10.152438 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:10.153519 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.153017 24673 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:10.145645 27172 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:10.148976 27352 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.168114 27211 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.169862 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1396) took 1047 ms. Trace:
I20260709 13:09:10.170276 24594 rpcz_store.cc:276] 0709 13:09:09.122683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.131651 (+  8968us) service_pool.cc:224] Handling call
0709 13:09:10.169667 (+1038016us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b540025eed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:10.169803 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216447744}
I20260709 13:09:10.171247 27093 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.149497 27160 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:10.175967 24594 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:10.172884 27282 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:10.181355 27282 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:10.175920 27351 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:10.185617 27351 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:10.185801 27302 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.186487 27351 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:10.193464 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.193195 25211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 606) took 3230 ms (client timeout 1691 ms). Trace:
W20260709 13:09:10.198706 25211 rpcz_store.cc:269] 0709 13:09:06.963095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.965953 (+  2858us) service_pool.cc:224] Handling call
0709 13:09:10.189365 (+3223412us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54006801d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:10.191469 (+  2104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3100371840}
I20260709 13:09:10.199321 27112 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.203999 25218 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:10.200520 27302 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.163769 27314 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:10.202787 27213 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.206548 27314 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.207093 27172 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.207543 27213 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.212483 24667 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:10.184748 27209 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.218724 27112 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.225211 27284 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.230954 25213 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:10.231508 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.232115 27284 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:10.232329 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:10.208518 25210 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:10.240794 24594 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
W20260709 13:09:10.258770 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 128355us
I20260709 13:09:10.261281 24594 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:10.264285 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:10.265136 24594 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:10.255098 27029 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.272205 27029 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:10.278260 27124 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:10.278723 27124 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:10.279582 27124 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.280573 27124 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:10.284255 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.286737 27235 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:10.297331 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.351922 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.368652 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:10.369575 24595 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:10.313292 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.350116 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1388) took 1237 ms. Trace:
W20260709 13:09:10.327001 27337 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.761s	user 0.002s	sys 0.004s
I20260709 13:09:10.373135 24591 rpcz_store.cc:276] 0709 13:09:09.112794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.138131 (+ 25337us) service_pool.cc:224] Handling call
0709 13:09:09.138394 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.138701 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.138727 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.139118 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.476932 (+337814us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:09.476988 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.477095 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.346400 (+869305us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b240028b728. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8cdf9c4 00007f17b8cddacb 00007f17b8e98dc9 00007f17b8e98a55 00007f17b8e97fb0 00007f17bbb0e488 00007f17bbb0ebe8 00007f17bbae6398 00007f17bbae176a 00007f17bbae0bb6
0709 13:09:10.349743 (+  3343us) raft_consensus.cc:1685] finished
0709 13:09:10.349770 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.350021 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114642,"raft.queue_time_us":588,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":15943,"spinlock_wait_cycles":86569344,"thread_start_us":268979,"threads_started":1,"wal-append.queue_time_us":354926}
I20260709 13:09:10.403714 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:10.323109 27197 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.348023 27302 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:10.379017 27209 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.290520 27029 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:10.421626 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.309731 27173 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:09:10.425021 24595 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:10.426251 24591 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:10.418697 27336 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.419065 27235 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.429839 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1235) took 1109 ms. Trace:
I20260709 13:09:10.430229 24598 rpcz_store.cc:276] 0709 13:09:09.320413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.320556 (+   143us) service_pool.cc:224] Handling call
0709 13:09:09.374017 (+ 53461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.374401 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.374443 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.404842 (+ 30399us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.503977 (+ 99135us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:09.504026 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.504101 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.326622 (+822521us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b240028b728. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8cdf9c4 00007f17b8cddacb 00007f17b8e98dc9 00007f17b8e98a55 00007f17b8e9809d 00007f17bbaca10e 00007f17bbae188c 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221
0709 13:09:10.427817 (+101195us) raft_consensus.cc:1685] finished
0709 13:09:10.427848 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.429772 (+  1924us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1476,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":33472,"spinlock_wait_cycles":96379648,"thread_start_us":63577,"threads_started":1,"wal-append.queue_time_us":134438}
I20260709 13:09:10.419406 27302 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.431826 27336 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.450850 27037 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.415422 27197 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.462991 27336 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.464198 27302 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.471954 27250 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.473992 24597 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:10.474718 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:10.475724 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:10.476378 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:10.477216 27122 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.480578 27172 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:10.480896 27029 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:10.482797 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:10.481729 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:10.501016 24520 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.483426 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 638) took 1920 ms. Trace:
W20260709 13:09:10.488106 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.490720 27164 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.500214 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:10.510416 24521 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.503115 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:10.501489 25219 rpcz_store.cc:276] 0709 13:09:08.563517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.565745 (+  2228us) service_pool.cc:224] Handling call
0709 13:09:08.566118 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.200308 (+634190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.483184 (+1282876us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b5400609ad4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:10.483372 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440154880}
I20260709 13:09:10.512907 24520 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:10.518713 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:10.518826 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:10.533952 24521 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:10.535269 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:10.490592 27172 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:10.535323 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:10.545418 27352 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:10.549513 27352 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.549906 27352 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.515671 27224 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:10.525890 27122 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:10.564574 27122 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:10.565568 27122 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.567885 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1385) took 1456 ms. Trace:
I20260709 13:09:10.568305 24592 rpcz_store.cc:276] 0709 13:09:09.111872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.114293 (+  2421us) service_pool.cc:224] Handling call
0709 13:09:09.134331 (+ 20038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.417096 (+282765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.567640 (+1150544us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540018fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:10.567825 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637109632}
I20260709 13:09:10.550024 27172 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.570912 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:10.571038 27172 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.571776 24594 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:10.572068 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:10.573143 24595 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:10.573858 27060 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:10.550712 27112 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:09:10.574905 27060 tablet_bootstrap.cc:492] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:09:10.550144 27197 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.552695 27325 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:10.544528 27173 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:10.557410 27188 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:10.560600 27345 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.559s	user 0.000s	sys 0.002s
I20260709 13:09:10.562808 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.563511 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.563478 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:10.575718 27060 ts_tablet_manager.cc:1403] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.911s	user 0.031s	sys 0.024s
W20260709 13:09:10.577948 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.556339 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:10.589722 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.590464 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.590801 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.591130 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.579541 24491 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.122s (SENT)
I20260709 13:09:10.591735 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:10.588658 24671 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:10.594647 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:10.606757 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:10.607586 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44198us
I20260709 13:09:10.577606 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.608300 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:10.610664 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.517598 27164 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.610325 27112 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.616138 27112 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.621651 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.622298 24671 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:10.625594 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.631397 24671 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:10.607767 27124 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:10.610009 27188 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:10.576236 27325 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:10.611582 27380 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:10.635147 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.636157 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:10.636987 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 57464.9us
W20260709 13:09:10.651496 24491 leader_election.cc:336] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.188s (SENT)
I20260709 13:09:10.652026 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:10.612380 27125 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:10.612843 27197 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:10.625342 27330 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.612277 27093 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:09:10.659498 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 51258.8us
I20260709 13:09:10.654528 24671 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:10.623594 27250 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:09:10.664395 27164 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.648443 27124 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.667109 27029 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:10.667726 27029 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:10.670909 27197 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:10.672010 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.671926 27197 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.672772 24665 raft_consensus.cc:2410] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:10.659575 27336 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:10.673882 27336 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.676069 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.681790 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2518) took 1070 ms. Trace:
I20260709 13:09:10.682247 24523 rpcz_store.cc:276] 0709 13:09:09.610995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.611278 (+   283us) service_pool.cc:224] Handling call
0709 13:09:10.681559 (+1070281us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540018a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:10.681720 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659959040}
I20260709 13:09:10.683212 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.683570 27302 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:10.683717 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.684092 24668 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:10.684170 27302 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:10.674286 27343 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.767s	user 0.003s	sys 0.000s
I20260709 13:09:10.692554 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.693279 24673 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.689555 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.694986 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:10.701344 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.761830 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.766918 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:10.767979 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 77277.2us
I20260709 13:09:10.691637 27282 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:10.798816 27386 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:10.798941 27282 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.800032 27386 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:10.770047 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:10.770426 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.768971 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 117488us
I20260709 13:09:10.760255 27373 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:10.811790 27373 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.783579 27112 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:10.813803 27250 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:10.813989 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.814275 27373 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.672587 27060 raft_consensus.cc:359] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:10.814851 24665 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:10.814971 27060 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:09:10.815268 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.815692 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.816044 24666 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:10.815758 27060 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:10.784926 27352 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.816977 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.816843 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.817925 24665 raft_consensus.cc:2410] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:10.818162 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.818627 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.818711 27352 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:10.685282 27302 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.819695 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.820837 27336 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.800565 27386 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.794934 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 516) took 1385 ms. Trace:
I20260709 13:09:10.824673 24599 rpcz_store.cc:276] 0709 13:09:09.413146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.531415 (+118269us) service_pool.cc:224] Handling call
0709 13:09:09.536665 (+  5250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.566611 (+ 29946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.566642 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.567070 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.719263 (+152193us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:09.719313 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.719400 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.673725 (+954325us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:10.794557 (+120832us) raft_consensus.cc:1685] finished
0709 13:09:10.794584 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.794858 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29413,"raft.queue_time_us":30498,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":4152576,"thread_start_us":151830,"threads_started":1,"wal-append.queue_time_us":315157}
I20260709 13:09:10.784978 27330 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.760712 27353 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:10.692247 27125 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:10.808158 27093 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:10.828527 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.793040 27029 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:10.833922 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.835005 25215 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:10.835680 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:10.823064 24491 connection.cc:256] RPC call timeout handler was delayed by -1.286541745999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:09:10.770779 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:10.801445 27188 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:10.829560 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.830185 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.840310 24665 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.814278 27250 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:10.818789 24666 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:09:10.852641 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:10.857023 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 86318.2us
I20260709 13:09:10.858047 24665 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:10.859426 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:10.861512 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.864847 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.872288 24673 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
W20260709 13:09:10.866278 24491 connection.cc:256] RPC call timeout handler was delayed by -1.0327417459999424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:09:10.871289 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.866518 27284 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.875787 27284 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.877992 27284 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:10.878932 24665 raft_consensus.cc:2376] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4. Re-sending same reply.
W20260709 13:09:10.883057 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.883138 27093 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:10.880874 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.879807 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.884569 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:10.884666 24666 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.847777 27282 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.885622 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:10.885970 27124 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.845180 27389 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.887087 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.886018 27390 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:10.887770 24665 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:10.892730 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1030) took 1745 ms. Trace:
I20260709 13:09:10.866048 27330 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.833842 27353 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.898913 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:10.900421 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:10.901669 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:10.904588 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.905687 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.893252 25214 rpcz_store.cc:276] 0709 13:09:09.147265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.147393 (+   128us) service_pool.cc:224] Handling call
0709 13:09:09.177980 (+ 30587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.695970 (+517990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.892464 (+1196494us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400571a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:10.892663 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1136540928}
I20260709 13:09:10.909703 24665 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:10.909456 24518 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:10.907313 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:10.914709 24673 raft_consensus.cc:2368] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6.
I20260709 13:09:10.916338 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.892776 27093 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.919735 27060 ts_tablet_manager.cc:1434] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.325s	user 0.009s	sys 0.000s
I20260709 13:09:10.919538 27093 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.890323 27124 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.921976 27353 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:10.921656 27125 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.897794 27385 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:10.890496 27389 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.922420 27124 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.923949 27325 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.924449 27389 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.928200 24524 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:10.926342 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:10.927512 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.924746 24522 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:10.930380 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.931154 24665 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:10.933336 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.934186 24665 raft_consensus.cc:2368] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5.
I20260709 13:09:10.935709 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:10.935884 24520 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:10.937489 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:10.938020 24518 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.924492 27124 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.939707 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.955219 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.955876 25214 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
W20260709 13:09:10.967116 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.921691 27093 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:10.997387 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:11.003952 25214 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:09:11.005693 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:11.008713 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67729us
I20260709 13:09:11.009150 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.933101 27385 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:11.017122 25217 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:11.000286 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:10.998919 24665 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:11.015836 24518 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:11.010134 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:11.024483 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:10.995103 27242 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:10.928982 27388 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:09:11.050172 27160 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:11.050346 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.052964 27360 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:11.053306 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:11.108839 25210 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:09:11.108870 27360 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:11.110324 27360 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.061889 27364 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:11.062055 27386 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:11.063328 27385 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:10.289299 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:11.067986 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:11.068693 24639 leader_election.cc:400] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:11.122658 24639 leader_election.cc:403] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:11.070807 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1403) took 1044 ms. Trace:
I20260709 13:09:11.070917 27355 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:11.115770 27336 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:11.079425 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 544189us
I20260709 13:09:11.079550 27037 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:11.080665 27351 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:11.081709 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:11.155503 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 86925.2us
W20260709 13:09:11.082267 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.082707 27173 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:11.083742 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:11.165637 24674 raft_consensus.cc:2393] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 3: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:11.084317 26926 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.084384 27164 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:10.932789 27250 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.001644 27330 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:09:11.085156 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 466473us
W20260709 13:09:11.085372 27359 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:09:11.085255 27306 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:11.086076 27393 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:11.082878 27047 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:11.087865 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:11.090145 24421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 344) took 14915 ms (client timeout 15000 ms). Trace:
I20260709 13:09:11.098845 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:11.099046 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:11.100785 25212 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:11.102837 24673 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:11.103781 25218 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:11.101780 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:11.106774 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 96707.6us
I20260709 13:09:11.107141 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:11.107595 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:11.111148 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:11.056455 24666 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
W20260709 13:09:11.114593 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.115381 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:11.116107 24667 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:11.122754 24519 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.123118 24597 rpcz_store.cc:276] 0709 13:09:10.026225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.026333 (+   108us) service_pool.cc:224] Handling call
0709 13:09:10.026601 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.474352 (+447751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.070571 (+596219us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54001cbe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:11.070746 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028199168}
I20260709 13:09:11.071260 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.131171 24522 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:11.135931 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:11.075024 27029 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:09:11.151975 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:11.200094 24521 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 3: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:11.200941 25213 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:11.020732 27390 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:11.104573 27242 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:11.155645 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:11.082366 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:11.203094 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.111704 27160 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:11.114989 27364 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:11.160145 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:11.208763 24594 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:11.160073 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:11.209512 24524 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:11.161526 24598 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:11.120507 27360 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.167634 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:11.215418 24596 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:11.167166 27282 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.172350 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:11.173605 24593 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:11.187809 24599 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:11.188021 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:11.188189 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.189047 25219 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:11.188676 24671 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.189405 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:11.189527 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:11.190372 24668 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:11.177526 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:11.223663 24520 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:11.191785 24518 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.224121 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:11.188686 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:11.112161 27210 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:09:11.158157 24591 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:11.205552 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.228724 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:11.229465 24598 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:11.230574 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:11.235281 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63012.3us
I20260709 13:09:11.226943 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:11.198426 27250 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:11.240612 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.240422 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:11.210386 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.241241 24594 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:11.242908 27390 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:11.186810 27355 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:09:11.246567 25219 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:11.177101 27164 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.178534 26926 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.271821 24521 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:11.234336 27336 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:11.203159 27047 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:11.266997 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 104618us
I20260709 13:09:11.267544 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:11.294358 24524 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:11.268339 24674 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:11.268363 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:11.241783 27330 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:11.266041 24671 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:11.250610 27197 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:11.296605 24519 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:11.245684 27398 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:11.299240 24518 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:11.291148 24520 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
W20260709 13:09:11.299525 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.310546 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:11.311966 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:11.317723 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.318321 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.321483 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:11.320815 24668 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:11.323662 24671 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:09:11.297062 27391 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:09:11.331622 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:11.323540 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 152701us
I20260709 13:09:11.297888 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.297325 27330 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:11.307207 27398 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.328150 27131 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:09:11.340797 27112 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.342288 27047 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:11.346330 27397 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.298s	user 0.004s	sys 0.000s
I20260709 13:09:11.351171 24673 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:11.351698 24418 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 4, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 4 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.357479 27399 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:11.359539 27160 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:11.361392 27164 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:11.361977 27029 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:11.364341 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:11.366425 25214 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:11.383463 27314 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:11.356777 24665 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:11.386739 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.391386 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:11.397239 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:11.417879 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:11.418521 27388 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.419095 27388 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:11.420496 27136 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:11.403136 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:11.287111 27173 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:11.421548 24519 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:11.383769 27330 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:11.416052 25214 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:11.393527 27037 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:11.424434 25214 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.421669 27188 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:11.425506 27188 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:11.369392 24674 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:11.425269 27037 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:11.426432 27188 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.425628 25214 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.394620 27168 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:11.431653 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 119754us
W20260709 13:09:11.442885 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 78612.5us
I20260709 13:09:11.390169 27398 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:11.445508 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.489835 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:11.489401 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44556.3us
W20260709 13:09:11.492105 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.429308 24666 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:11.493980 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 256000us
I20260709 13:09:11.494266 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.509459 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:11.517656 24597 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:11.517705 27325 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:11.509877 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:11.519459 24599 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:09:11.510848 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:11.520520 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:11.521585 24519 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:11.512390 24521 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:11.530437 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 110619us
W20260709 13:09:11.489362 27384 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:09:11.532580 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.543320 24665 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 3.
I20260709 13:09:11.443805 27168 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.536350 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:11.488749 27306 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:11.553426 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.545208 24418 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.541419 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:11.557055 25214 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
W20260709 13:09:11.562548 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.576416 24665 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:11.492554 24535 tablet_copy_service.cc:342] P 0131806e3b9647128f32db1ab8d314fc: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-e7ec39f0d4e04761ae598f1245692799 received from {username='slave'} at 127.0.0.1:53446
I20260709 13:09:11.414146 27399 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.535725 27160 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:11.552695 27168 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.576056 27306 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.613984 27306 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:11.598809 24418 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 4, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 4 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.577865 27209 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:09:11.618057 24418 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 7, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.599466 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:11.552182 27386 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:11.622165 27386 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.622592 27386 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.601536 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:11.625593 25218 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:11.625411 27419 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:11.595330 27172 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:11.626648 27172 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:11.627604 27172 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.577695 27415 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:11.629307 27415 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:11.629834 27400 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:09:11.630264 27415 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.631687 27415 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.611755 24535 tablet_copy_service.cc:434] P 0131806e3b9647128f32db1ab8d314fc: ending tablet copy session 983693721af6486c97ece1410a90cf30-e7ec39f0d4e04761ae598f1245692799 on tablet e7ec39f0d4e04761ae598f1245692799 with peer 983693721af6486c97ece1410a90cf30
W20260709 13:09:11.633909 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.612597 27403 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:09:11.599057 27417 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:11.634966 27417 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.635485 27417 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.638557 24523 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:11.620031 24418 catalog_manager.cc:5697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129), VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130), VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131), NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:11.640817 24418 catalog_manager.cc:5697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 4, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 4 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.641724 27366 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:11.642170 27366 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:11.642978 27366 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.644151 27366 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:11.643983 24418 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:09:11.646039 27405 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:09:11.684095 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.575434 27284 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:09:11.685302 27136 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:11.590862 27131 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:09:11.647482 27164 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:09:11.718109 27250 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.662591 27160 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:11.739450 27351 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.001s
I20260709 13:09:11.751078 24671 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:11.751713 24671 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:11.752656 24671 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.762996 24671 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:11.754281 27282 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.003s
I20260709 13:09:11.739274 27250 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:11.785845 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 231473us
I20260709 13:09:11.791086 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:11.776938 27282 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:11.792724 27399 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:11.776253 27417 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:11.797425 27330 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.798503 24524 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:11.798990 27250 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:11.790542 27360 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.571s	user 0.002s	sys 0.009s
I20260709 13:09:11.800199 24672 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:09:11.800357 27330 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:11.800580 24672 pending_rounds.cc:85] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 6
I20260709 13:09:11.801035 24672 pending_rounds.cc:107] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:09:11.801412 24672 raft_consensus.cc:2889] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.802601 27242 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:11.803707 27242 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:11.809019 27414 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:09:11.810534 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.811580 24669 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
W20260709 13:09:11.812062 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.836674 24671 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:09:11.840808 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.843022 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.756471 27136 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:11.847159 27373 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:11.839874 27435 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.853250 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 62282.5us
I20260709 13:09:11.859413 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:11.850369 27434 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:11.856217 27351 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:11.869717 25184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.014s
W20260709 13:09:11.870045 25184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.000s	sys 0.014s
W20260709 13:09:11.870888 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 549488us
I20260709 13:09:11.871915 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:11.865360 27417 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:11.879231 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 423920us
W20260709 13:09:11.881755 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.882476 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 366353us
I20260709 13:09:11.883260 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:11.884339 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 377178us
W20260709 13:09:11.884922 24491 leader_election.cc:336] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.676s (SENT)
I20260709 13:09:11.885289 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:11.886165 24594 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:11.887439 24491 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.895s (SENT)
W20260709 13:09:11.888612 24491 leader_election.cc:336] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.504s (SENT)
I20260709 13:09:11.888947 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:11.897727 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.929409 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.933276 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.971570 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.883863 27197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.009s	sys 0.006s
I20260709 13:09:12.027288 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:12.032191 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.865581 27306 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.867487 27386 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:11.880678 27330 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:12.034811 27197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.009s	sys 0.006s
I20260709 13:09:11.891285 27325 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:12.033043 27416 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:09:11.891341 27417 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:12.034121 27173 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:12.058244 27250 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:12.052860 27428 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.078071 27173 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:12.079690 27413 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260709 13:09:12.080345 27173 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.059207 27386 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:12.028956 27355 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.004s	sys 0.011s
I20260709 13:09:12.026278 27037 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:11.862119 27435 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.075008 27417 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:11.187526 24421 rpcz_store.cc:269] 0709 13:08:56.160829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.161260 (+   431us) service_pool.cc:224] Handling call
0709 13:09:11.072995 (+14911735us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:09.486115 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:09.568136 (+ 82021us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:09.568184 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:09:09.568203 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:09.569434 (+  1231us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:09.569541 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:09.569581 (+    40us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:09.571129 (+  1548us) tablet.cc:701] Row locks acquired
0709 13:09:09.571186 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:09:09.571414 (+   228us) write_op.cc:270] Start()
0709 13:09:09.571599 (+   185us) write_op.cc:276] Timestamp: P: 1783602549571324 usec, L: 0
0709 13:09:09.571628 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:09:09.658474 (+ 86846us) log.cc:844] Serialized 4431 byte log entry
0709 13:09:10.048503 (+390029us) op_driver.cc:464] REPLICATION: finished
0709 13:09:10.113248 (+ 64745us) write_op.cc:301] APPLY: starting
0709 13:09:10.113330 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:10.113607 (+   277us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:10.120546 (+  6939us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:10.165323 (+ 44777us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:10.192479 (+ 27156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:09:10.192525 (+    46us) write_op.cc:312] APPLY: finished
0709 13:09:10.192935 (+   410us) log.cc:844] Serialized 83 byte log entry
0709 13:09:10.198361 (+  5426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:10.198501 (+   140us) write_op.cc:454] Released schema lock
0709 13:09:10.198567 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:10.198970 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:10.199014 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5110169,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":64421,"apply.run_cpu_time_us":5149,"apply.run_wall_time_us":85703,"num_ops":11,"prepare.queue_time_us":520848,"prepare.run_cpu_time_us":61795,"prepare.run_wall_time_us":452692,"raft.queue_time_us":37880,"raft.run_cpu_time_us":13300,"raft.run_wall_time_us":53173,"replication_time_us":476718,"thread_start_us":531690,"threads_started":4,"wal-append.queue_time_us":277036,"wal-append.run_cpu_time_us":9489,"wal-append.run_wall_time_us":1267573}]]}
I20260709 13:09:12.077325 27250 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:12.029603 27336 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:12.088924 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.039s	sys 0.114s
I20260709 13:09:12.037783 27420 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.868772 27434 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.060575 27197 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:12.108194 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.040s	sys 0.114s
W20260709 13:09:12.109771 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 75244.3us
W20260709 13:09:12.160010 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 668519us
I20260709 13:09:12.113993 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:12.089123 27355 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.004s	sys 0.011s
W20260709 13:09:12.093912 27436 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 13:09:12.166016 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52146.3us
I20260709 13:09:12.166646 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:12.163765 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 136569us
I20260709 13:09:12.086138 27364 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:09:12.173573 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.174942 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:12.124559 27387 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.177588 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:12.181720 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:12.177960 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.187788 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:12.191177 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61957.6us
I20260709 13:09:12.188179 27387 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:12.107362 27386 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:09:12.124950 27330 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:09:12.194697 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.197830 27440 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:12.198436 27209 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:12.212455 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:12.214030 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.215473 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.199606 27430 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.296774 27428 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:12.289317 27466 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:09:12.288024 27396 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.289987 27390 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.184098 27108 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:12.176504 27131 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:12.101992 27168 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:12.316025 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 128296us
W20260709 13:09:12.319355 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 108265us
W20260709 13:09:12.323349 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 128714us
I20260709 13:09:12.317193 27440 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:12.300094 27460 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.335063 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:12.288239 27197 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.351495 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:12.351723 24595 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:12.337198 27306 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.356820 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.357962 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:12.360193 24566 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:12.333657 27037 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:12.349282 27131 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.343394 27108 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:12.328429 27424 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:12.331398 27125 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:12.346065 27242 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.005s
I20260709 13:09:12.388278 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.363941 27430 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.369518 27029 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.362243 27398 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.846s	user 0.012s	sys 0.000s
I20260709 13:09:12.355607 27459 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.357651 27224 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:12.353859 27336 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:12.355039 27440 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.162583 27420 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.339032 27396 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.382298 27108 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:12.391925 24593 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:12.339515 27428 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:12.391945 24595 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:12.341699 27390 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:12.396129 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 335925us
I20260709 13:09:12.374984 27131 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:12.383278 27306 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:12.384399 27250 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:12.396199 27037 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:12.440450 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.469650 24516 raft_consensus.cc:2410] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:12.470924 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:12.471719 24520 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.396733 27387 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:12.474655 24593 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:12.412241 27224 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:12.468348 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.437696 27125 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.478422 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.465159 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.406872 27029 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:12.474129 27453 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:09:12.433537 27336 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:12.523449 27396 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.478307 27469 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.483479 27458 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.525388 27458 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.527798 27458 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.433346 27459 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.529955 27473 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.530277 27459 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:12.487047 27442 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:09:12.530534 27473 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:12.532048 27455 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:12.453846 27306 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:12.488152 27443 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.412674 27398 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:12.499046 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 138900us
I20260709 13:09:12.502650 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.483852 27434 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:12.546677 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 102289us
I20260709 13:09:12.524505 27469 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.553397 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:12.497305 24520 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:12.538560 27306 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.536401 27242 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.569283 27336 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:12.569469 27242 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:12.570513 27336 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.570662 27029 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.572134 27242 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:12.572938 27469 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:12.574256 27398 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.498450 27125 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.577059 27125 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:12.577795 27160 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.579835 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.560992 27428 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:12.548652 27224 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.533043 27473 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:12.559325 27456 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:09:12.604614 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1422) took 1093 ms. Trace:
I20260709 13:09:12.604967 24596 rpcz_store.cc:276] 0709 13:09:11.511060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.521661 (+ 10601us) service_pool.cc:224] Handling call
0709 13:09:11.522054 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.810888 (+288834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.810916 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.811318 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.167498 (+356180us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:12.196454 (+ 28956us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.287954 (+ 91500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.288107 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.575364 (+287257us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b1800197020. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:09:12.599444 (+ 24080us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b1800197020. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:09:12.604398 (+  4954us) raft_consensus.cc:1685] finished
0709 13:09:12.604417 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.604556 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29433,"prepare.queue_time_us":23644,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":250413,"raft.run_cpu_time_us":507,"raft.run_wall_time_us":39782,"spinlock_wait_cycles":11737728,"thread_start_us":603402,"threads_started":2,"wal-append.queue_time_us":508044}
I20260709 13:09:12.555357 27424 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:12.608094 27037 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:12.614420 27314 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:12.614954 27314 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:12.615995 27314 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.613137 27424 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.617583 27389 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:12.618031 27389 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:12.618569 27224 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.618952 27389 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:12.620358 27389 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.621291 27325 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:12.625953 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.630484 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 50753.7us
I20260709 13:09:12.631579 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.586933 27168 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.635311 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:12.552045 27396 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:09:12.644956 24597 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:12.647056 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.650177 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.651844 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.630483 27314 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.655804 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.630743 27460 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.656754 27250 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.554286 27463 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:09:12.657168 27108 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.622208 27420 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.662436 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:12.641367 27398 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.661161 27458 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:12.646540 27330 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:12.653940 27242 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.673239 24600 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:12.679611 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:12.656203 27387 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.669567 27443 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.688176 27458 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:12.684783 27336 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:12.697870 27336 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:12.698284 27336 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.700318 27435 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.701368 27389 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.701936 27389 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:12.704402 27389 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:12.705279 27164 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.705847 27037 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:12.706399 27037 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.708496 27037 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.699895 27306 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:12.689468 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 189003us
I20260709 13:09:12.711050 27306 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:12.711670 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:12.711869 24669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 578) took 1645 ms (client timeout 2057 ms). Trace:
W20260709 13:09:12.688786 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 137421us
W20260709 13:09:12.712262 24669 rpcz_store.cc:269] 0709 13:09:11.066323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.155437 (+ 89114us) service_pool.cc:224] Handling call
0709 13:09:12.711705 (+1556268us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b540044dc54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:12.711812 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356466432}
W20260709 13:09:12.714344 27402 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.414s	user 0.003s	sys 0.007s
I20260709 13:09:12.716010 27389 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.716498 27389 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:12.716895 27389 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.718535 26926 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:12.719246 27352 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:09:12.721719 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:12.722435 27108 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:12.673801 27390 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:12.728367 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.731034 24599 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:12.729128 24596 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:12.731986 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.732789 24597 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:12.674808 27330 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:12.730410 27366 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.086s	user 0.013s	sys 0.005s
I20260709 13:09:12.755522 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:12.756528 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:12.746361 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:12.749125 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 198296us
I20260709 13:09:12.759354 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.760079 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:12.764168 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.764878 25214 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 5 LEARNER]: Advancing to term 7
W20260709 13:09:12.777529 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.800818 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 197450us
I20260709 13:09:12.801699 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.801955 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:12.824831 24596 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.720825 27131 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.748409 27330 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.758380 27387 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:12.811213 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51779.3us
I20260709 13:09:12.766201 24600 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.765630 27396 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:12.753971 27440 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.830634 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:12.848462 25212 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:12.827590 27385 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.841782 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:12.850997 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.840859 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.853417 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:12.853775 24598 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:12.851215 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.817463 27172 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:12.815410 25214 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 7 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:12.817392 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:12.817602 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:12.744211 27306 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:09:12.748953 27224 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:09:12.821550 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:12.822171 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.852451 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:12.766783 24595 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:12.871670 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.878604 25218 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:12.762867 27390 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 13:09:12.824270 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 65230us
I20260709 13:09:12.880456 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:12.824963 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.828289 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.882252 24599 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:12.882522 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:12.883352 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.883621 25217 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:12.884121 24599 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:12.761046 27353 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:09:12.815557 27188 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.823001 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 66606.4us
I20260709 13:09:12.879418 25219 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.822986 25211 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:12.854771 24591 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:12.865134 24596 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:12.886516 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:12.898262 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:12.899480 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:12.899719 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:12.900000 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:12.900606 24521 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:12.887315 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.902287 24665 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:09:12.899132 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:12.903903 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:12.903934 24522 raft_consensus.cc:2410] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:12.904524 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:12.910212 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:12.910614 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.910884 24522 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:12.913882 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:12.914705 24665 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:12.916903 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:12.917574 24519 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:12.917812 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:12.881171 27458 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:12.918700 24525 raft_consensus.cc:2368] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4.
I20260709 13:09:12.917740 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:12.921975 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:12.930594 24520 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:12.930706 24665 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:12.924224 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:12.931438 24667 raft_consensus.cc:2410] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:12.924901 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:12.931950 24669 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:12.925675 24671 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:12.887853 27396 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.838548 27430 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.895999 27250 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:12.939124 27336 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:12.870447 27385 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:12.887192 27401 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:13.017807 27385 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.018267 27385 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.018028 27401 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.896214 27407 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:12.958907 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.919523 27360 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:09:12.959635 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:12.855118 27387 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:12.978044 24521 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:12.935382 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:13.026626 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 91318.6us
I20260709 13:09:12.909029 27464 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:12.901957 27420 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:12.927377 27188 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:12.979367 24518 raft_consensus.cc:2368] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4.
I20260709 13:09:12.885303 27242 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:09:12.918771 27302 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:12.934048 27172 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.043030 27172 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:13.044656 27488 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:12.928755 27458 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:12.990761 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 62300.4us
I20260709 13:09:13.045364 27458 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.045670 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:13.045706 27491 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:09:13.049204 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.990927 24599 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:12.933776 27440 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:12.936524 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.000824 27160 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.006475 25219 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:13.057662 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:13.020009 24593 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:12.876590 27389 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:12.944424 27250 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.021157 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:13.025384 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:12.990224 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:12.936780 27029 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:09:12.990312 27434 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:13.038267 24520 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:12.887583 27435 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:13.042438 27302 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.029815 27387 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.088332 24666 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.050827 24599 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:13.034770 27314 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:13.086637 27302 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:13.083552 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 592) took 1835 ms. Trace:
I20260709 13:09:13.038901 27336 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.096179 24672 rpcz_store.cc:276] 0709 13:09:11.247759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.361861 (+114102us) service_pool.cc:224] Handling call
0709 13:09:11.362231 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.801895 (+439664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.083325 (+1281430us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400407254. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:13.083492 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006312704}
I20260709 13:09:13.062539 27360 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.096169 24595 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:13.050974 27407 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:13.141772 27407 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:13.143252 27494 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:09:13.143062 27360 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.037878 27464 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.098089 27435 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.102422 27314 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:13.149183 27314 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.150310 27435 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.152567 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:13.153203 27330 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:13.154335 24519 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:13.146693 27172 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.156424 27464 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.049947 27420 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.158072 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.158716 24519 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:13.111835 27458 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:13.080643 27250 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.159719 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:13.160198 24524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 560) took 1821 ms (client timeout 1722 ms). Trace:
I20260709 13:09:13.160511 27173 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:13.160625 24524 rpcz_store.cc:269] 0709 13:09:11.338542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.339432 (+   890us) service_pool.cc:224] Handling call
0709 13:09:13.160032 (+1820600us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400440f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:13.160131 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874074496}
I20260709 13:09:13.161520 27168 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:13.161697 27173 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:13.161921 27168 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:13.162134 27173 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:13.162472 27168 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.162604 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1261) took 1839 ms. Trace:
I20260709 13:09:13.116223 27188 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.117648 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.118148 27389 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.094062 27434 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.080062 27242 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:13.122570 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:13.080863 27160 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.124643 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 593) took 1726 ms. Trace:
I20260709 13:09:13.126080 27401 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.126012 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:13.163084 24594 rpcz_store.cc:276] 0709 13:09:11.322917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.323041 (+   124us) service_pool.cc:224] Handling call
0709 13:09:11.338410 (+ 15369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.886649 (+548239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.162385 (+1275736us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b540025ba54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:13.162545 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259175296}
I20260709 13:09:13.098176 27388 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.142082 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.110977 27302 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.185017 25216 raft_consensus.cc:2368] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9.
I20260709 13:09:13.185415 24517 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:13.182225 24673 rpcz_store.cc:276] 0709 13:09:11.397917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.398177 (+   260us) service_pool.cc:224] Handling call
0709 13:09:11.398521 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.647846 (+249325us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:12.035892 (+388046us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.119309 (+ 83417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.119381 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:12.119443 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.124327 (+1004884us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400276854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:13.124395 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.124569 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":88257,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":468,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":572755712,"thread_start_us":441292,"threads_started":2,"wal-append.queue_time_us":162826}
I20260709 13:09:13.165505 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.186880 27302 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.186869 24519 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.162024 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.186275 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:13.188652 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 131099us
I20260709 13:09:13.191265 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.164131 24666 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:13.196641 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:13.197053 24518 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:13.198421 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:13.184721 27242 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.162969 27173 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:13.193806 27172 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:13.169608 27387 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:13.199903 27409 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:13.199338 24517 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:13.204305 27242 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:13.218654 27398 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
I20260709 13:09:13.219532 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.212764 27172 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:13.238392 27172 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.222390 27173 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.203743 27418 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:13.205129 27330 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.233780 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:13.201411 27460 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:13.225503 27188 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.241882 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.240744 24519 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:13.259936 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.261055 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.262128 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.262881 24519 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:13.231129 27373 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.269683 24523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 542) took 2358 ms (client timeout 1812 ms). Trace:
I20260709 13:09:13.272619 27420 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.281754 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.281831 24669 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:13.286708 27458 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.289176 27385 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.290992 27314 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.299031 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.301043 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:13.301715 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.306668 24523 rpcz_store.cc:269] 0709 13:09:10.898388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.898561 (+   173us) service_pool.cc:224] Handling call
0709 13:09:13.256096 (+2357535us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b5400441954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:13.256247 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676546432}
I20260709 13:09:13.318536 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:13.240617 27398 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.310168 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.315313 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:13.301229 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.317329 24673 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:13.321491 24669 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 3.
I20260709 13:09:13.322166 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.322489 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:13.324208 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.324220 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:13.325589 24597 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:13.265803 27360 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.330174 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.330816 24523 raft_consensus.cc:2368] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4.
I20260709 13:09:13.331133 25218 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:13.331073 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:13.326906 24669 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:13.327476 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.328117 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:13.334077 25219 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 5: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:13.296255 27172 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.307147 27209 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:13.284704 27250 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.341065 24669 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:13.256785 27418 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:13.343219 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:13.343874 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.352470 24592 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.344892 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.345353 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:13.347573 25215 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:13.354092 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:13.354548 25218 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:13.356287 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:13.352682 24523 raft_consensus.cc:2376] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7. Re-sending same reply.
I20260709 13:09:13.362175 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.363188 25219 raft_consensus.cc:2410] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:13.360837 24597 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:13.365550 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.366245 24519 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:13.362078 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.371495 24674 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:13.372036 24674 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:13.325253 27423 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.325903 27330 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.306775 27188 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.344177 27469 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.399096 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.399338 27469 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.400537 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.401460 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.401578 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.402844 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.403476 25211 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 3.
I20260709 13:09:13.404497 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.404974 27469 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:13.324955 27410 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:13.406687 27410 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.320166 24517 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:13.407548 24674 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:13.408469 24674 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.408597 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.393689 26926 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.409283 24517 raft_consensus.cc:2376] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7. Re-sending same reply.
I20260709 13:09:13.409559 26926 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:13.410380 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.411671 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.343091 27458 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.413542 27458 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.414199 27160 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.415669 27458 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.355011 27284 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:09:13.408615 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:13.417212 24594 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
W20260709 13:09:13.417526 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.418053 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:13.419137 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:13.315085 27373 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.412748 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.381577 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.381839 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.393833 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.355587 27364 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.403523 25210 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.419775 27029 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.427481 27029 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.420486 24594 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:13.423729 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.433053 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.424526 27160 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.433812 24519 raft_consensus.cc:2368] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7.
I20260709 13:09:13.422518 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.422931 24517 raft_consensus.cc:2376] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4. Re-sending same reply.
I20260709 13:09:13.423362 25215 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:13.423223 27373 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.421762 27410 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.424693 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.373325 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.330313 27443 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:09:13.433743 27160 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.555929 25218 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:13.452003 24524 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:13.430373 24673 raft_consensus.cc:2410] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:13.435976 25213 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:13.575551 24674 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 13:09:13.458717 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.592768 25182 leader_election.cc:400] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7.
I20260709 13:09:13.597265 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.368117 27435 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:13.602526 24519 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:13.602792 24674 pending_rounds.cc:85] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 2
I20260709 13:09:13.603317 25182 leader_election.cc:403] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:13.603703 24674 pending_rounds.cc:107] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:13.604202 24674 raft_consensus.cc:2889] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:13.605551 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.606343 24674 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:13.462482 24592 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:13.614602 25215 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 7 LEARNER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:13.615693 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:13.616772 24592 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:13.435520 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:13.599283 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.601253 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.623359 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.597579 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.624034 24674 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:13.432010 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.625032 24668 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:13.368655 27420 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.622267 24594 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:13.598043 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.558606 27387 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.651681 24594 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:13.551451 27029 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:13.629753 27504 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:09:13.630149 27188 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.655512 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:13.655778 27188 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:13.656136 24674 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.656512 27160 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.663100 24674 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:13.665917 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.672144 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.395067 27423 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.636596 24596 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:13.601438 27389 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:13.621414 27388 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.619415 27435 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.643043 27172 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.558454 27434 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.565444 27418 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:13.649271 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.604115 25210 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:13.493312 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.612767 24519 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:13.653146 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:13.654174 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2554) took 1442 ms. Trace:
I20260709 13:09:13.699038 24516 rpcz_store.cc:276] 0709 13:09:12.211985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.212137 (+   152us) service_pool.cc:224] Handling call
0709 13:09:13.651862 (+1439725us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000bccd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:13.654112 (+  2250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338443136}
I20260709 13:09:13.528719 27330 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:13.368453 27209 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.528110 27472 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:09:13.709030 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.634176 24523 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:13.684377 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:13.686143 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.676862 27168 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.005s
W20260709 13:09:13.646118 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.691406 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.675510 27366 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.700877 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 207660us
I20260709 13:09:13.715847 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:13.716711 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.717312 24523 raft_consensus.cc:2376] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7. Re-sending same reply.
I20260709 13:09:13.702135 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:13.717767 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.718113 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.719007 24523 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:13.718331 24517 raft_consensus.cc:2376] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4. Re-sending same reply.
I20260709 13:09:13.719842 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.720044 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:13.720717 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.705497 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.689412 27388 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.712193 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.720860 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.775629 24523 raft_consensus.cc:2376] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7. Re-sending same reply.
I20260709 13:09:13.729799 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:13.742067 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 174657us
I20260709 13:09:13.766165 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:13.742723 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 150136us
I20260709 13:09:13.720810 24670 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.717794 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.718212 24665 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:13.782862 24665 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:13.780090 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:13.775064 24517 raft_consensus.cc:2376] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8. Re-sending same reply.
W20260709 13:09:13.784685 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66960.7us
I20260709 13:09:13.784688 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.785646 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.787060 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.787657 24516 raft_consensus.cc:2368] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4.
I20260709 13:09:13.788252 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.825745 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.826264 24637 leader_election.cc:400] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4.
I20260709 13:09:13.826799 24637 leader_election.cc:403] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:13.826602 24517 raft_consensus.cc:2376] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4. Re-sending same reply.
I20260709 13:09:13.704704 27434 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.830909 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.831084 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:13.786131 27505 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260709 13:09:13.831785 24516 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:13.719172 27420 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:13.836459 27420 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.836726 27388 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.835074 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.746766 27330 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.831863 27465 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:13.764115 27385 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.729627 27396 raft_consensus.cc:476] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:13.845659 27465 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:13.788879 27364 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:13.833859 27160 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.824925 27029 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:13.802886 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.742138 27242 consensus_meta.cc:287] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.003s
I20260709 13:09:13.818454 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.851562 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:13.830693 24665 raft_consensus.cc:2955] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:13.852106 24519 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:13.812911 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.853251 24523 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:13.853144 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.854012 24519 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:13.719019 27472 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.751513 26926 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.848105 27465 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.854836 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.858276 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:13.766633 27423 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.760742 27314 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.719909 27168 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.854188 24670 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:13.764895 27435 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.763010 27209 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:13.852145 25213 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:13.858554 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.865983 24519 raft_consensus.cc:2368] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:13.886436 24523 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:13.865919 25216 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:13.877960 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 100246us
W20260709 13:09:13.860199 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 176302us
I20260709 13:09:13.865572 27516 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:13.880031 27417 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4.
I20260709 13:09:13.877736 27423 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:13.723769 27366 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:13.858049 27242 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.914955 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:13.920100 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 89073.6us
W20260709 13:09:13.920229 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 140192us
I20260709 13:09:13.921861 24516 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:13.921442 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.922749 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.908381 26926 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:13.926333 24674 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:13.924404 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.932456 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.918735 27516 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:13.925875 27029 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.939181 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.939834 24519 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:13.942066 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.942549 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:13.942768 24517 raft_consensus.cc:2368] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:13.944504 27525 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:13.944814 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.945951 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.946609 24517 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:13.947243 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.947717 24517 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:13.948434 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:13.949028 24517 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:13.930698 26926 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:13.949854 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.950433 24517 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:13.951004 26926 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.951224 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.952006 24517 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:13.952198 27168 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.952589 25216 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:13.952677 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.937654 27435 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.953346 24517 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:13.953608 27435 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:13.954314 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.954777 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2561) took 1043 ms. Trace:
I20260709 13:09:13.954612 27435 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:13.955063 24517 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:13.956096 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.956868 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2564) took 1021 ms. Trace:
I20260709 13:09:13.957971 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.960397 25182 leader_election.cc:400] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:13.960711 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.960896 25182 leader_election.cc:403] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:09:13.961371 24519 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:13.962124 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.962522 24519 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:13.963150 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.963658 24519 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:13.955130 24521 rpcz_store.cc:276] 0709 13:09:12.911356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.911692 (+   336us) service_pool.cc:224] Handling call
0709 13:09:12.911962 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.025217 (+113255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.954563 (+929346us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54000bd1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:13.954722 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71425792}
I20260709 13:09:13.966495 25182 leader_election.cc:400] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
W20260709 13:09:13.957257 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 48313.3us
I20260709 13:09:13.967885 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:13.967800 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.967733 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:13.958593 24517 rpcz_store.cc:276] 0709 13:09:12.935304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.955863 (+1020559us) service_pool.cc:224] Handling call
0709 13:09:13.956738 (+   875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.971441 24521 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:13.973348 24637 leader_election.cc:400] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4.
I20260709 13:09:13.973821 24637 leader_election.cc:403] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:13.974346 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1469) took 1047 ms. Trace:
I20260709 13:09:13.978894 27168 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:13.979776 27168 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:13.980142 27168 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:13.980453 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1471) took 1034 ms. Trace:
I20260709 13:09:13.952730 27515 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:13.991106 24517 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:13.998622 24520 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:14.020778 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:14.020851 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:14.021132 24524 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:14.021533 24593 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.022074 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:14.022837 24595 raft_consensus.cc:2410] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:14.023098 24600 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:14.024293 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:13.968752 27440 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.026361 24520 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:09:14.026782 27242 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:14.029654 24593 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:13.999913 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:13.996232 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2562) took 1082 ms. Trace:
I20260709 13:09:14.026778 24520 pending_rounds.cc:85] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 1
I20260709 13:09:14.033332 24520 pending_rounds.cc:107] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:14.033772 24520 raft_consensus.cc:2889] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:13.970898 27524 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:13.972306 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2565) took 1035 ms. Trace:
I20260709 13:09:13.980842 24518 rpcz_store.cc:276] 0709 13:09:12.945811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.117408 (+171597us) service_pool.cc:224] Handling call
0709 13:09:13.980267 (+862859us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5400441e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:13.980396 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27288448}
I20260709 13:09:14.019017 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:14.021646 24594 raft_consensus.cc:2410] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:09:14.050699 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50862.4us
I20260709 13:09:14.042167 24522 rpcz_store.cc:276] 0709 13:09:12.914102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.914246 (+   144us) service_pool.cc:224] Handling call
0709 13:09:12.914559 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.146248 (+231689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.146291 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.146348 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:13.146391 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.995976 (+849585us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540006d1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:13.996019 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.996131 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532306176}
I20260709 13:09:13.977914 24521 rpcz_store.cc:276] 0709 13:09:12.927262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.970832 (+1043570us) service_pool.cc:224] Handling call
0709 13:09:13.971213 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.971965 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.974298 (+  2333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.051124 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1473) took 1028 ms. Trace:
I20260709 13:09:14.056336 24517 rpcz_store.cc:276] 0709 13:09:13.022934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.990616 (+967682us) service_pool.cc:224] Handling call
0709 13:09:13.990931 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.050816 (+ 59885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.051061 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:13.975188 27029 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.981832 27351 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:13.985479 27454 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.480s	user 0.005s	sys 0.003s
I20260709 13:09:14.049499 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:14.019678 27515 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.050184 24519 rpcz_store.cc:276] 0709 13:09:12.936438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.971749 (+1035311us) service_pool.cc:224] Handling call
0709 13:09:13.971999 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.972100 (+   101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.972114 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.972138 (+    24us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:13.972155 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.972186 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.972245 (+    59us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.015669 24637 leader_election.cc:400] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:13.975188 27469 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:13.966562 27522 raft_consensus.cc:2764] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:13.974980 27517 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.073041 27469 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.993510 27516 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.059882 27401 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.082314 27401 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.082726 27401 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.062995 24599 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.991196 27420 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.063812 24600 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.004827 27419 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 3. Current term is 4.
I20260709 13:09:14.060653 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:13.986223 27131 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:14.018708 26926 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:14.064504 27351 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:14.069046 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53529.8us
I20260709 13:09:14.095266 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.096262 27419 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.096783 27419 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:14.097258 27419 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.097311 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:14.069042 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:14.098526 24519 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.060334 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:14.059226 27136 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:14.101943 27136 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.102433 27136 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:14.102464 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:14.103642 27136 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.104403 24522 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.980923 27168 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:14.077111 25211 raft_consensus.cc:2955] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:14.105728 27168 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.061931 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:14.071902 27515 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.080467 27517 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.088512 25184 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.058496 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:14.109372 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50961.8us
I20260709 13:09:14.107601 24520 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.077198 27029 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:14.111598 24520 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:14.107756 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:14.080054 27469 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.116596 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.068038 27423 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:14.121555 24520 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:14.118526 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:14.107399 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 192532us
I20260709 13:09:14.122452 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:14.122802 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:14.123252 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:14.124037 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:14.094094 27529 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.119037 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.126260 24519 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:14.127823 24522 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.109886 27136 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.111096 27517 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.128795 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:14.119820 27522 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:14.111256 27420 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.126592 27417 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.125725 27525 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:14.139714 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:14.143445 24520 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:14.120868 27360 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.145488 24525 raft_consensus.cc:2376] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5. Re-sending same reply.
W20260709 13:09:14.149503 24525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1470) took 1217 ms (client timeout 1524 ms). Trace:
I20260709 13:09:14.135133 27434 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.142967 27522 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.166383 27522 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:14.167076 27526 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
I20260709 13:09:14.146670 27417 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.170923 27417 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.171908 24524 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:14.172243 27506 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.426s	user 0.001s	sys 0.000s
I20260709 13:09:14.131531 27364 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.173736 27364 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.174110 27364 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.174784 24672 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:09:14.175150 24672 pending_rounds.cc:85] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 5
I20260709 13:09:14.175359 24672 pending_rounds.cc:107] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:09:14.175570 24672 raft_consensus.cc:2889] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:14.149848 24525 rpcz_store.cc:269] 0709 13:09:12.931711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.934450 (+  2739us) service_pool.cc:224] Handling call
0709 13:09:14.139575 (+1205125us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:14.149439 (+  9864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4358400}
I20260709 13:09:14.095198 26926 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.178730 27522 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.179513 26926 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:13.985795 27325 raft_consensus.cc:2955] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:14.127864 27373 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.181910 27373 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.182296 27373 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.120608 27160 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:09:14.142125 27409 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:14.154244 27172 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:09:14.125432 27353 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:09:14.148743 27360 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:14.130165 27524 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:14.165337 27029 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:14.131608 27440 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.184441 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:14.129542 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:14.185662 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.169876 24516 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.142194 27420 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:14.135273 27523 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:14.155539 24520 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:14.153716 27434 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:14.188884 26926 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.192945 27360 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.199350 27420 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.193243 27524 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:14.209910 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 80434.2us
I20260709 13:09:14.211619 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.212598 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.215751 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:14.217680 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.204090 27434 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.227569 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.239018 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.230571 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:14.192665 27430 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:14.204484 27472 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7.
I20260709 13:09:14.210731 27160 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.213821 27522 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:14.203800 26926 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.214927 27524 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.223855 27525 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.224993 27435 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.242280 27520 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.263152 27418 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:14.280587 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81753.9us
I20260709 13:09:14.275900 27525 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:14.242107 27314 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:09:14.285645 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 46707.3us
I20260709 13:09:14.286404 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:14.292850 24674 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:09:14.295997 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.299000 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.302029 24674 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:14.276134 27435 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:14.310042 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 92436.8us
I20260709 13:09:14.264091 27172 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:09:14.312194 24672 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:14.321460 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.282034 27409 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:14.322576 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.323772 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.324370 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.325730 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:14.335131 25217 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:14.281508 27540 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.335148 25216 raft_consensus.cc:2368] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7.
W20260709 13:09:14.335525 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.335330 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.341193 27542 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.287173 27525 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.343250 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.345176 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:14.280174 27515 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.313745 27435 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.368988 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.354355 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:14.365067 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 134608us
I20260709 13:09:14.385980 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.337953 27523 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.426749 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:14.428752 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 116160us
I20260709 13:09:14.445758 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.447510 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:14.450273 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.413319 27430 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:14.456816 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.453914 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:14.454679 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.464323 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.453253 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.465802 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.467309 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:14.467867 24525 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:14.385562 27209 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:09:14.386812 27543 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:14.346076 27284 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:09:14.473608 24516 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:14.467794 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:14.475157 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.480001 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.510584 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:14.437242 27387 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.513207 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.513434 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.367910 27539 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 13:09:14.456696 27418 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.429338 27522 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:09:14.456554 27430 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:14.521368 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.529907 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 634) took 1130 ms. Trace:
I20260709 13:09:14.530230 25214 rpcz_store.cc:276] 0709 13:09:13.399230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.402578 (+  3348us) service_pool.cc:224] Handling call
0709 13:09:14.521275 (+1118697us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21eee 0000000000375939 00007f17c0e951e0 00007f17c0f5e0c4 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:14.529851 (+  8576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7401856}
I20260709 13:09:14.531334 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:14.422683 27542 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:09:14.517027 24516 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.525794 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.469467 27396 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.509948 27464 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:14.462411 27532 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.430990 27523 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.513616 27398 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.547365 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:14.538909 27534 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:14.526764 27242 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.535699 27430 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.526163 27387 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:14.550848 27330 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.589787 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:14.648967 27541 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:09:14.663648 27420 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.589349 27168 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:09:14.546947 27532 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.595139 27160 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.703961 27532 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.704396 27160 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.601962 25213 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:14.550463 27542 consensus_queue.cc:1243] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:14.512236 27543 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.626344 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:14.706979 27543 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:14.707223 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80997.4us
I20260709 13:09:14.709414 27396 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:14.709537 27389 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:14.709934 27396 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:14.710943 27389 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:14.710798 27396 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.715375 27543 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.716925 24668 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:14.719568 27485 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.720039 27485 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:14.721055 27485 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:14.722929 27485 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:14.724962 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 438603us
I20260709 13:09:14.725751 27420 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:14.726063 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.722906 27543 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:14.729189 27398 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:14.729552 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:14.731033 25216 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:14.732704 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 278078us
I20260709 13:09:14.543025 27306 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:09:14.564987 27464 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:14.567741 27545 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:09:14.514899 27409 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.529299 27418 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:14.682669 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:14.688354 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.755548 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.689898 24596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1443) took 1371 ms (client timeout 1781 ms). Trace:
I20260709 13:09:14.681362 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:14.756759 24596 rpcz_store.cc:269] 0709 13:09:13.318209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.318319 (+   110us) service_pool.cc:224] Handling call
0709 13:09:14.680782 (+1362463us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54001ecdd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:14.689856 (+  9074us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719753600}
I20260709 13:09:14.596669 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 602) took 1333 ms. Trace:
I20260709 13:09:14.757782 24671 rpcz_store.cc:276] 0709 13:09:13.262755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.263717 (+   962us) service_pool.cc:224] Handling call
0709 13:09:14.595865 (+1332148us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5800170798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:09:14.596075 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.596282 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.596306 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.596345 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:14.596375 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.596487 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.596605 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5268224}
W20260709 13:09:14.693574 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 167848us
I20260709 13:09:14.759176 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.697747 27523 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:14.687355 27373 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.000s
I20260709 13:09:14.733923 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.734423 24490 leader_election.cc:400] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9.
I20260709 13:09:14.763329 24490 leader_election.cc:403] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:14.661536 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.668107 27188 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:14.740854 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:14.767011 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.742846 24565 leader_election.cc:400] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7.
I20260709 13:09:14.763370 25218 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:14.767694 24565 leader_election.cc:403] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:14.744385 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:14.745607 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.768671 24673 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:14.768759 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.769739 24673 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:14.770905 24673 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:14.771044 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:14.746371 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.771682 24596 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:14.687546 27250 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:14.688476 26926 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:14.773357 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:14.774906 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.776561 27563 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:14.777036 27563 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.777446 27563 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.757123 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1485) took 1625 ms. Trace:
I20260709 13:09:14.778505 24523 rpcz_store.cc:276] 0709 13:09:13.131747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.681073 (+1549326us) service_pool.cc:224] Handling call
0709 13:09:14.757042 (+ 75969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.681501 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1442) took 1364 ms. Trace:
I20260709 13:09:14.745324 27172 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.790637 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:14.734103 27398 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.772454 27314 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.780110 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:14.666667 27364 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:14.762599 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.781522 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 47216.3us
I20260709 13:09:14.807103 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.807672 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.808233 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.808753 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:14.779405 24599 rpcz_store.cc:276] 0709 13:09:13.317500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.317619 (+   119us) service_pool.cc:224] Handling call
0709 13:09:13.317848 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.085271 (+767423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.681240 (+595969us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54001941d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:14.681408 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713222016}
W20260709 13:09:14.783424 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 356777us
I20260709 13:09:14.810992 27559 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:14.811285 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:14.811546 27559 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.749887 27515 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:14.813750 27559 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:14.814268 27559 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.815145 24666 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:14.792374 27517 consensus_meta.cc:287] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.001s
W20260709 13:09:14.816402 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45899us
I20260709 13:09:14.780408 27540 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.766090 27188 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:14.822968 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:14.820345 24599 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.798229 27302 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:14.802484 27532 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:14.781415 27373 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.843020 25215 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:14.858472 27546 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:14.866164 27546 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:14.866993 27546 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.868059 27546 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.809870 27389 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9.
I20260709 13:09:14.833459 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:14.872809 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 135548us
W20260709 13:09:14.835356 24639 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.919s (SENT) [suppressed 46 similar messages]
W20260709 13:09:14.876139 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49948.5us
W20260709 13:09:14.842478 25210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1044) took 1515 ms (client timeout 1800 ms). Trace:
W20260709 13:09:14.851071 27136 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.711s	user 0.006s	sys 0.002s
W20260709 13:09:14.860934 27434 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.002s
I20260709 13:09:14.820560 27398 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:14.828456 27330 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.876151 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:14.874584 24600 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.902387 24599 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:14.820222 27224 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.821230 27560 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.900714 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:14.822391 27469 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.692s	user 0.005s	sys 0.005s
W20260709 13:09:14.859059 27419 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.003s
W20260709 13:09:14.900596 25210 rpcz_store.cc:269] 0709 13:09:13.326781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.330626 (+  3845us) service_pool.cc:224] Handling call
0709 13:09:14.842219 (+1511593us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b54003c7b54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:14.842392 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112227200}
I20260709 13:09:14.929606 27469 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:14.860644 27417 consensus_meta.cc:287] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.689s	user 0.004s	sys 0.004s
W20260709 13:09:14.851858 27556 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 13:09:14.845682 27558 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:09:14.910123 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.829932 27168 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:09:14.875422 27325 consensus_meta.cc:287] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.694s	user 0.004s	sys 0.006s
W20260709 13:09:14.920472 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.945887 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45281.1us
W20260709 13:09:14.857740 27360 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.622s	user 0.000s	sys 0.011s
I20260709 13:09:14.925472 27398 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.819139 27396 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:09:14.817332 27172 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:09:14.847421 27387 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:14.950940 25217 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:14.923100 27569 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:14.869055 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 680) took 1018 ms. Trace:
I20260709 13:09:14.814749 27364 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:14.823897 27314 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
W20260709 13:09:14.927924 27401 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.845s	user 0.010s	sys 0.001s
I20260709 13:09:14.923313 27330 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.883164 27567 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.868903 27464 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:14.927240 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 51187.4us
I20260709 13:09:14.874218 27302 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:14.928766 27485 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.958069 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 579) took 1492 ms. Trace:
I20260709 13:09:14.963688 25212 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:14.951191 27516 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.949590 24600 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:14.824141 27517 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:14.984056 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 176477us
I20260709 13:09:14.985334 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:14.985422 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:14.986327 25214 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:14.918310 27434 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:14.949404 27560 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:14.860026 27188 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.982096 27330 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.986413 27396 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.988436 24522 rpcz_store.cc:276] 0709 13:09:13.465971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.110898 (+644927us) service_pool.cc:224] Handling call
0709 13:09:14.127662 (+ 16764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.130879 (+  3217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.957858 (+826979us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5400442350. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:14.958010 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37862272}
I20260709 13:09:14.965118 27387 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:14.996052 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:14.988631 25212 pending_rounds.cc:85] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 5
I20260709 13:09:15.005570 25212 pending_rounds.cc:107] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:15.005904 25212 raft_consensus.cc:2889] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:14.987898 27302 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.986864 27566 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:15.009866 27188 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.010070 27566 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.990944 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:15.001308 27396 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.014986 27396 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.015683 27302 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.017748 27532 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:14.987145 27577 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:15.018337 27434 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:15.018467 27577 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.991560 27569 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:09:14.992264 27516 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:15.002173 27533 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.855s	user 0.002s	sys 0.000s
I20260709 13:09:14.957899 25211 rpcz_store.cc:276] 0709 13:09:13.850215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.851148 (+   933us) service_pool.cc:224] Handling call
0709 13:09:14.076533 (+225385us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:09:14.076725 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.076964 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:14.284980 (+208016us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.794178 (+509198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:14.802927 (+  8749us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:14.815401 (+ 12474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.819680 (+  4279us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.863328 (+ 43648us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61184,"raft.queue_time_us":64470,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5414,"spinlock_wait_cycles":24002176,"thread_start_us":425660,"threads_started":1,"wal-append.queue_time_us":575660}
I20260709 13:09:14.951023 27360 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:14.998536 27524 consensus_meta.cc:287] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.003s
I20260709 13:09:14.946874 27417 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:14.941148 27419 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.012251 27563 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:14.982582 27401 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.016716 27396 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:09:15.005326 27387 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:15.042536 27516 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.012359 27566 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.134946 27540 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:15.135689 27540 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.092672 27366 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:15.097693 27524 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.269972 27560 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:15.463608 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.005s
W20260709 13:09:15.464534 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.008s	sys 0.005s
W20260709 13:09:15.465536 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.467731 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.469128 24639 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.012s	sys 0.018s
W20260709 13:09:15.469710 24639 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.012s	sys 0.018s
W20260709 13:09:15.470513 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 635041us
I20260709 13:09:15.470293 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:15.472854 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.009s
W20260709 13:09:15.473374 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.000s	sys 0.009s
I20260709 13:09:15.479555 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:15.482088 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:15.485623 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:15.486524 24600 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.494755 24592 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:15.491627 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:15.498543 24596 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:15.502553 25212 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:09:15.502851 25216 consensus_meta.cc:287] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.505s	user 0.024s	sys 0.007s
I20260709 13:09:15.503460 25216 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:15.513151 26926 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.513967 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:15.514076 26926 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.515187 24596 raft_consensus.cc:2410] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:15.517589 27029 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.517832 27172 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:15.518864 27302 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.518950 27172 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.518536 27029 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.520991 27360 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.522838 27360 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.523063 27029 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.523319 27314 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:15.523736 27360 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.524137 27314 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.526990 27172 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.527662 27172 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.529259 27360 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.530397 27360 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:15.531275 27314 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.533803 27364 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:15.534618 27364 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:15.524711 27029 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:09:15.528473 27172 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.536463 27364 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.538870 27172 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.539400 27172 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.540069 27172 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.548429 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:15.549206 27373 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.550380 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:15.561528 27417 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.561934 24674 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:15.565227 27419 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.568902 27418 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.571281 27172 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.531893 27360 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.516898 26926 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.615020 24600 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:15.617746 27401 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:15.618929 27430 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.018s
I20260709 13:09:15.623201 27545 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:15.623224 27565 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.640537 27569 consensus_queue.cc:1243] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:15.645771 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2581) took 1306 ms. Trace:
I20260709 13:09:15.645431 27565 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.646276 24520 rpcz_store.cc:276] 0709 13:09:14.339669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.339860 (+   191us) service_pool.cc:224] Handling call
0709 13:09:14.340280 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:14.344575 (+  4295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.344610 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.372434 (+ 27824us) log.cc:844] Serialized 52 byte log entry
0709 13:09:14.514469 (+142035us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:14.522636 (+  8167us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.524710 (+  2074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.524781 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.645121 (+1120340us) raft_consensus.cc:1685] finished
0709 13:09:15.645220 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.645489 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5667,"prepare.queue_time_us":2782,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4981,"raft.queue_time_us":15209,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":55710,"thread_start_us":65782,"threads_started":1,"wal-append.queue_time_us":214654}
I20260709 13:09:15.648356 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 578) took 1463 ms. Trace:
I20260709 13:09:15.650295 27469 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.651511 27398 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.652597 27398 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.656033 24669 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:15.656719 27563 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.657610 24595 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:09:15.706311 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 250209us
I20260709 13:09:15.700065 27401 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.805045 27401 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.809373 27396 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:09:15.639299 27430 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.795746 27419 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.803954 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 131919us
I20260709 13:09:15.808653 27401 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:15.790210 24639 leader_election.cc:336] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.512s (SENT)
W20260709 13:09:15.706779 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 161454us
W20260709 13:09:15.706604 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 631087us
I20260709 13:09:15.705861 27583 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:15.842130 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 55611.2us
W20260709 13:09:15.862250 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 156495us
I20260709 13:09:15.870249 24592 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:15.648836 24598 rpcz_store.cc:276] 0709 13:09:14.185325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.185463 (+   138us) service_pool.cc:224] Handling call
0709 13:09:14.195253 (+  9790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.308816 (+113563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.308845 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.321245 (+ 12400us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.510703 (+189458us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:14.510746 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.647687 (+1136941us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b540002dfd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:15.647767 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.647833 (+    66us) raft_consensus.cc:1685] finished
0709 13:09:15.647852 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.648179 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53596,"raft.queue_time_us":52999,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":19562,"spinlock_wait_cycles":207076736,"thread_start_us":187854,"threads_started":1,"wal-append.queue_time_us":496402}
I20260709 13:09:15.869841 27517 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:15.816193 27136 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.891551 27188 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.881s	user 0.011s	sys 0.011s
W20260709 13:09:15.892657 27435 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.475s	user 0.015s	sys 0.010s
I20260709 13:09:15.804864 27545 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.706408 27532 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.882165 27224 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.882892 27464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.019s	sys 0.035s
I20260709 13:09:15.883744 27430 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.648375 27565 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.705897 27398 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.887430 27563 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.906754 27563 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.892266 27583 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.909178 27563 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:15.909493 27560 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.911217 27583 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.896615 27561 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.912201 27561 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.914175 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:15.915635 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:15.916462 24666 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
W20260709 13:09:15.917205 27464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.019s	sys 0.036s
I20260709 13:09:15.919212 27224 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.920246 27582 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.921113 27582 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:15.924147 27546 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.055s	user 0.009s	sys 0.016s
I20260709 13:09:15.924291 27582 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:15.924427 27168 consensus_meta.cc:287] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.976s	user 0.007s	sys 0.014s
I20260709 13:09:15.893000 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:15.880899 27525 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.494s	user 0.002s	sys 0.026s
I20260709 13:09:15.935969 24666 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.937155 27168 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7.
I20260709 13:09:15.936054 27577 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.943145 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:15.943212 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.950935 27136 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.951445 27594 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:15.951707 27563 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:15.952517 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.951508 24666 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:15.929498 27360 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:15.952350 27594 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:15.957821 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80546.2us
I20260709 13:09:15.960119 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:15.961014 27524 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:15.968621 24637 leader_election.cc:336] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.512s (SENT)
I20260709 13:09:15.969218 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:15.972880 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.962761 27546 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.901899 27435 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.977181 24598 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:15.931131 27419 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.947520 27525 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:15.952370 27563 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:15.987043 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:15.988411 27544 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:15.994012 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:15.998490 24668 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.976392 27364 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:15.977607 27224 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:15.980214 27577 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:15.993566 27544 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:16.015797 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47215.5us
I20260709 13:09:16.018535 27563 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:16.019761 27330 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.018s	user 0.003s	sys 0.019s
I20260709 13:09:16.022385 27419 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.022809 24665 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:16.024468 27435 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.025259 27592 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.026664 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:16.027345 24597 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:16.028051 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 68078.8us
I20260709 13:09:16.029520 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:16.030856 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:16.030962 24593 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:16.031667 24598 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.040766 24597 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:16.041272 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 567) took 1949 ms. Trace:
I20260709 13:09:16.041669 24591 rpcz_store.cc:276] 0709 13:09:14.016423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.016573 (+   150us) service_pool.cc:224] Handling call
0709 13:09:14.017039 (+   466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:14.019372 (+  2333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.019413 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.020049 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 13:09:14.127541 (+107492us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:14.127606 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.135708 (+  8102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.930656 (+794948us) spinlock_profiling.cc:243] Waited 926 us on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:15.900287 (+969631us) raft_consensus.cc:1685] finished
0709 13:09:15.904545 (+  4258us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.966202 (+ 61657us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1815,"raft.queue_time_us":1939,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":2130688,"thread_start_us":102063,"threads_started":1,"wal-append.queue_time_us":116414}
I20260709 13:09:16.043444 27590 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.002784 27136 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.046666 27594 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:15.999400 27188 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:09:16.050215 27188 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:16.050663 27188 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:16.051762 27188 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.055799 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:16.026077 27592 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:16.056509 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 76082.9us
I20260709 13:09:16.070904 24599 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:16.029531 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:16.082543 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:16.083686 24597 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:16.006067 27360 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.020393 27330 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.067966 27561 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:16.111339 27516 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.985s	user 0.016s	sys 0.000s
I20260709 13:09:16.080791 27472 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.119037 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45892.4us
I20260709 13:09:16.120671 27136 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:16.121526 27136 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.083663 27545 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.112533 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.095386 27583 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:16.074524 27546 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.116530 27396 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:16.142856 24519 raft_consensus.cc:2368] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7.
I20260709 13:09:16.138055 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.146762 27532 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:16.147271 24523 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.112658 27224 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:09:16.130056 27516 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.149829 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.150707 27516 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.147075 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.106081 27188 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.153620 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:16.139681 27525 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.107324 27577 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.169572 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:16.169924 27575 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.168s	user 0.002s	sys 0.004s
I20260709 13:09:16.170357 24525 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:16.111380 27544 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.174597 27330 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.166028 27516 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.176154 27516 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.178210 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.178545 27516 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.168210 27594 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:16.142439 27360 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:16.179679 27594 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:16.179975 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.155771 27561 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:16.181243 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 151977us
I20260709 13:09:16.158874 27472 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.180102 27360 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.183976 27472 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.184823 27532 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:16.185387 27532 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:16.186038 27540 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.050s	user 0.014s	sys 0.004s
I20260709 13:09:16.186380 27532 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.186611 27540 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.188866 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.189764 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 618) took 1886 ms. Trace:
I20260709 13:09:16.190171 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.190568 24600 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:16.183887 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.181314 24520 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:16.180188 27594 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.179076 24519 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:16.191337 24524 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:16.190202 24674 rpcz_store.cc:276] 0709 13:09:14.303226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.304070 (+   844us) service_pool.cc:224] Handling call
0709 13:09:14.304408 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.562675 (+1258267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.189442 (+626767us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400407254. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:16.189685 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2890286336}
I20260709 13:09:16.163470 27583 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:16.188902 25216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 686) took 1229 ms (client timeout 1518 ms). Trace:
I20260709 13:09:16.210752 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:16.213325 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45202.2us
W20260709 13:09:16.212368 25216 rpcz_store.cc:269] 0709 13:09:14.959413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.960048 (+   635us) service_pool.cc:224] Handling call
0709 13:09:16.188678 (+1228630us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b5400609ad4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:16.188811 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9051520}
I20260709 13:09:16.168641 27582 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:09:16.219734 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.220223 25212 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:16.220090 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:16.220392 27582 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:16.220820 24674 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:16.221464 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.222011 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:16.223119 24516 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:16.223294 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:16.224066 24674 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
W20260709 13:09:16.224454 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.224910 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:16.209124 27597 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:09:16.189765 27592 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.181597 27396 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.191902 27540 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.254778 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.220839 27582 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:16.257172 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.181386 27561 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.243127 27524 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:16.265177 24520 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:16.266812 27168 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.268879 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.268389 27587 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.282080 27549 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.764s	user 0.002s	sys 0.000s
I20260709 13:09:16.283836 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:16.284606 27465 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.286407 27398 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:16.287583 27569 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:16.288988 27136 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:16.268339 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 137480us
I20260709 13:09:16.289438 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 649) took 1961 ms. Trace:
I20260709 13:09:16.290407 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1057) took 1966 ms. Trace:
I20260709 13:09:16.290030 27524 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.277335 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:16.291926 27591 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.336s	user 0.001s	sys 0.001s
I20260709 13:09:16.268540 27306 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:16.304083 24598 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:16.260152 27560 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:16.260280 27360 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.315650 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:16.298271 27548 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.682s	user 0.001s	sys 0.001s
I20260709 13:09:16.309692 25215 rpcz_store.cc:276] 0709 13:09:14.323997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.324185 (+   188us) service_pool.cc:224] Handling call
0709 13:09:14.842650 (+518465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.868989 (+ 26339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.290041 (+1421052us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54003c7b50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:16.290239 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191650944}
I20260709 13:09:16.325472 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.327761 24521 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.328132 24520 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.317485 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:16.322237 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.309580 25217 rpcz_store.cc:276] 0709 13:09:14.327952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.694904 (+366952us) service_pool.cc:224] Handling call
0709 13:09:14.747206 (+ 52302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.951988 (+204782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.288946 (+1336958us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540034e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:16.289244 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467740032}
I20260709 13:09:16.332046 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.322410 27560 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.323330 25214 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:16.280771 27587 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.278947 27396 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.339368 24521 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:09:16.340262 27589 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.368s	user 0.001s	sys 0.003s
I20260709 13:09:16.343791 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.338958 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:16.351488 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.278683 27577 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.307215 27546 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.270092 27582 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.307518 27583 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.314102 27465 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.356680 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.350713 24591 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:16.353127 24674 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.360082 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.360143 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.365558 25217 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.360790 24594 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.356320 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.334199 25211 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:16.367719 25214 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:16.335253 27565 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:09:16.372342 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 88630.3us
I20260709 13:09:16.386322 24519 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.386452 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.387975 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.361852 27330 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.392066 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.367118 27561 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.395571 25214 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:16.407368 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.408303 24517 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:09:16.412964 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 237707us
I20260709 13:09:16.414505 24521 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.417387 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.393389 27351 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.410688 27582 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.440851 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.453192 27131 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.453289 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.454124 24517 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.453933 27131 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.456051 27131 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:16.457353 27604 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:09:16.458724 27579 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.847s	user 0.001s	sys 0.001s
W20260709 13:09:16.459589 27602 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:09:16.453223 25210 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.461349 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:16.461540 27580 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.671s	user 0.000s	sys 0.002s
I20260709 13:09:16.462728 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.463722 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.466434 27465 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.447728 25219 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:16.466845 27387 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.464717 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.469314 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.469480 24518 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:16.470114 25211 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
W20260709 13:09:16.481194 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 91510.3us
I20260709 13:09:16.482275 24517 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:16.483913 24517 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:09:16.490963 27587 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.500946 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.501962 25217 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:16.502821 25215 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:16.503839 24594 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:16.504977 24674 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:16.506124 25216 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:16.512238 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:16.514330 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 240038us
I20260709 13:09:16.516845 27440 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.517189 24563 leader_election.cc:400] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7.
I20260709 13:09:16.517649 24563 leader_election.cc:403] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.518278 24596 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:16.520010 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.523944 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 687) took 1486 ms. Trace:
I20260709 13:09:16.525852 24522 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:16.526486 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:16.528729 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.529258 27587 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7.
I20260709 13:09:16.529609 27566 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.524365 25213 rpcz_store.cc:276] 0709 13:09:14.959688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.001095 (+ 41407us) service_pool.cc:224] Handling call
0709 13:09:15.001458 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:15.019192 (+ 17734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.019222 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:15.019669 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:09:15.502434 (+482765us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:15.502666 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.502774 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.291454 (+788680us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b24002fba18. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8cdf9c4 00007f17b8cddacb 00007f17b8e98dc9 00007f17b8e98a55 00007f17b8e9809d 00007f17bbaca10e 00007f17bbae188c 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221
0709 13:09:16.413823 (+122369us) raft_consensus.cc:1685] finished
0709 13:09:16.413846 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.445823 (+ 31977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":603999,"raft.queue_time_us":24962,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":145100544,"thread_start_us":482065,"threads_started":1,"wal-append.queue_time_us":905583}
I20260709 13:09:16.531126 25210 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
W20260709 13:09:16.532339 27599 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.531s	user 0.000s	sys 0.001s
I20260709 13:09:16.517480 27440 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.536080 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.563009 27440 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.565783 24673 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:16.567996 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 620) took 1811 ms. Trace:
I20260709 13:09:16.569234 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.570353 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.571053 27592 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:16.571439 27592 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.571933 27592 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:16.574676 27571 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.708s	user 0.004s	sys 0.037s
I20260709 13:09:16.574932 27440 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:16.576287 27565 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:16.540382 27607 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.577282 27607 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.540287 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.578174 24522 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.541353 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.581701 25218 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:16.582235 25218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 683) took 1623 ms (client timeout 1704 ms). Trace:
W20260709 13:09:16.582674 25218 rpcz_store.cc:269] 0709 13:09:14.958586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.958734 (+   148us) service_pool.cc:224] Handling call
0709 13:09:16.541060 (+1582326us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:16.582166 (+ 41106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7077248}
I20260709 13:09:16.584692 27592 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.541756 24672 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:16.543568 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.589179 25210 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.590088 24672 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:16.591375 27302 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:16.591811 27302 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:16.543740 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 389269us
I20260709 13:09:16.540882 27566 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:16.593302 27566 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:16.594944 27568 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.732s	user 0.002s	sys 0.013s
I20260709 13:09:16.544340 27560 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.544744 27524 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.545485 24668 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:16.599423 27351 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.546132 27596 raft_consensus.cc:476] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:16.546677 27539 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:16.601132 25210 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:16.601559 27539 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.602916 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.604465 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:16.546983 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 363816us
I20260709 13:09:16.605679 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:16.608354 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.609404 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.609967 25216 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:16.610136 25217 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:16.610311 27544 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.610956 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.611476 25214 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.547569 27545 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:16.545516 27525 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.548185 27594 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.617169 27592 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.619601 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.621040 27594 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.622210 25213 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:16.623212 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.623260 27587 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.624008 27587 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.625574 27596 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:16.550379 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.514948 27569 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:09:16.571472 27595 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.626747 27595 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.626938 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.627172 27595 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.627700 24517 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:16.627910 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.628361 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:16.628582 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.577697 27607 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.629161 24517 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.629400 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.629705 27360 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:16.631182 27360 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.631517 27360 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.631831 27360 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.634552 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:16.635769 24517 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:16.636087 27607 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.636650 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.642710 27607 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.613231 24519 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:16.538713 24521 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:16.617007 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.618201 24525 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:16.568387 24673 rpcz_store.cc:276] 0709 13:09:14.756267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.771520 (+ 15253us) service_pool.cc:224] Handling call
0709 13:09:16.565387 (+1793867us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.566360 (+   973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.567787 (+  1427us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54001135d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:16.567932 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4124626688}
I20260709 13:09:16.625634 27545 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:16.588259 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.637677 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:16.648195 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.639940 27581 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.018s	user 0.001s	sys 0.002s
I20260709 13:09:16.640865 27587 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.641237 27387 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.560869 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1443) took 2097 ms. Trace:
I20260709 13:09:16.549027 27409 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:16.629303 27552 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:09:16.662158 25212 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:09:16.663276 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.654254 24665 rpcz_store.cc:276] 0709 13:09:14.463906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.464041 (+   135us) service_pool.cc:224] Handling call
0709 13:09:16.560575 (+2096534us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001135d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:16.560771 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3533391616}
I20260709 13:09:16.635777 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:16.644783 27596 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.645053 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.669749 24523 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:16.650381 25214 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:16.648623 24596 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:16.652138 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.651890 27364 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.652235 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.681423 27552 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:16.668272 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.682322 24519 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.671341 24521 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:16.672482 24516 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:16.673202 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.686748 25218 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:16.673796 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.673880 27566 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.676133 27595 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.678529 24523 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:16.661283 27409 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:16.691335 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55633.4us
I20260709 13:09:16.691715 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.693377 24525 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:16.652012 27545 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:15.463608 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:16.692344 27544 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.695636 27566 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.710587 27435 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:16.724229 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.725250 24598 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:16.718243 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.715462 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.726848 24596 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:16.711640 24597 raft_consensus.cc:2368] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:16.712381 24595 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.718487 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.729904 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.731652 24525 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:16.694061 24522 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:16.732764 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:16.746234 24591 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:16.733968 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.716408 27409 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.717537 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.734890 27525 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:16.735414 27435 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:16.720794 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.736719 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:16.737197 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.747766 27524 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:16.747948 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.748837 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.737468 27469 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:16.753659 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.724164 27544 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.754271 24524 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:09:16.754277 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.755306 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:16.756013 27440 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:16.759634 24593 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:16.762956 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.766098 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:16.770529 24595 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:16.772404 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.775803 25218 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:16.771088 24519 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:16.778556 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.778566 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:16.691489 27596 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.782420 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.784559 24519 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.784833 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.788511 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:16.788383 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.777817 27524 consensus_queue.cc:1243] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:16.777626 27544 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.741276 27552 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.799541 26926 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:16.813889 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.814489 26926 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:16.777210 27564 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:16.815064 27131 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:16.815519 27434 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.815985 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2664) took 1944 ms. Trace:
I20260709 13:09:16.816041 27434 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.814025 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:16.817230 24671 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:16.814013 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.816457 24670 rpcz_store.cc:276] 0709 13:09:14.871802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.871947 (+   145us) service_pool.cc:224] Handling call
0709 13:09:14.872285 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.872601 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.872627 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.873022 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.952074 (+ 79052us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:14.952117 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.952185 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:16.639153 (+1686968us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:16.787676 (+148523us) raft_consensus.cc:1685] finished
0709 13:09:16.787696 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.815811 (+ 28115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1231,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":22718848,"thread_start_us":78762,"threads_started":1,"wal-append.queue_time_us":153532}
I20260709 13:09:16.818764 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.810696 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:16.815629 27564 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.781623 27409 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:09:16.819985 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.820454 27607 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:16.814596 25210 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.821144 27564 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:16.822202 27131 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:16.823223 27131 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.820969 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.824640 27435 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.825556 27224 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.826895 27552 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.800732 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:16.829456 24525 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.804697 27302 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.820818 27607 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:16.832973 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:16.793720 27592 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:16.835824 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 325236us
I20260709 13:09:16.807205 27587 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:16.827523 27595 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:16.815158 27351 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.836581 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:16.814999 26926 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:16.869207 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:16.869684 27250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.910s	user 0.015s	sys 0.027s
W20260709 13:09:16.870095 27250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.968s	user 0.015s	sys 0.027s
I20260709 13:09:16.872002 24593 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:16.873806 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.790493 27525 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:16.876817 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 100791us
I20260709 13:09:16.811944 27188 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:09:16.830142 27419 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:09:16.895298 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:16.895444 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.895773 24525 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:16.884935 24519 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:16.914076 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.915275 27595 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:16.915925 27595 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:16.917029 27595 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.919760 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:16.920728 27409 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:16.921387 27409 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:16.922470 27409 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.855115 27224 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:09:16.866602 27592 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:16.932314 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.934733 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.888744 27569 raft_consensus.cc:2764] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:16.891261 27587 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:16.896041 27302 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.940989 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.942466 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:16.930682 27351 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:16.951049 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 185053us
I20260709 13:09:16.855854 27545 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.927455 27387 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:09:16.957908 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 97081.4us
I20260709 13:09:16.962939 24525 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.964268 27606 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.965716 27594 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:16.966316 27594 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:16.959578 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:16.960263 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:16.942065 27469 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.973016 25218 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:16.878435 27250 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:09:16.956681 27582 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:16.997205 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:17.009400 27566 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:17.010167 27566 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.012614 27566 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:16.968502 27351 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:17.014647 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66926.1us
W20260709 13:09:16.946878 27532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.000s	sys 0.019s
I20260709 13:09:17.033835 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:17.041154 27619 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:16.955703 26926 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:17.041908 27525 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:17.042562 27587 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:16.954468 27607 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:17.044027 25210 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:17.042232 26926 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.045225 27351 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.043030 27596 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:17.047165 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.061208 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.061717 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 121109us
W20260709 13:09:17.068516 27616 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:09:17.058923 27592 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:17.034678 27532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.000s	sys 0.020s
I20260709 13:09:17.070969 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:17.062613 27545 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.079371 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:17.088439 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54676us
I20260709 13:09:17.058445 27594 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:17.094177 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:17.094903 24667 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.092820 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:17.096737 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:17.096954 27250 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:17.097332 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:17.098441 27250 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:17.098826 27250 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:17.099817 27250 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:17.099131 24669 raft_consensus.cc:2955] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:17.102361 27613 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:17.102774 27613 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:17.103578 27613 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.105237 27620 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:17.105448 27250 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.106092 27620 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:17.117214 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 53744.8us
I20260709 13:09:17.109372 27613 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:17.120159 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 168427us
I20260709 13:09:17.121536 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:17.122346 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:17.085260 27621 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.130513 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:17.132135 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:17.134557 25218 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:17.136772 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:17.095378 27619 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:17.142262 24665 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:17.145870 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:17.146710 27435 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:17.147092 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:17.147231 27435 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:17.147799 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:17.148250 27435 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.149870 27525 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:17.150313 27525 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.150624 27628 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:17.151296 27440 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:17.152446 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:17.152568 27619 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.148969 27596 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:17.153596 25218 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:17.154084 27596 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:17.149284 27224 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:09:17.155050 27596 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:17.156621 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.140365 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:17.149442 27364 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:17.150667 27525 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.153213 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 627) took 1210 ms. Trace:
I20260709 13:09:17.160049 24666 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:09:17.161316 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.165578 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43976.4us
I20260709 13:09:17.165103 24674 rpcz_store.cc:276] 0709 13:09:15.942775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.514794 (+572019us) service_pool.cc:224] Handling call
0709 13:09:16.553630 (+ 38836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.716652 (+163022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.716696 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.781429 (+ 64733us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.937172 (+155743us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.937211 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.937319 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.152988 (+215669us) raft_consensus.cc:1685] finished
0709 13:09:17.153008 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.153159 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44603,"raft.queue_time_us":47098,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":15876,"thread_start_us":136728,"threads_started":1,"wal-append.queue_time_us":309529}
W20260709 13:09:17.166917 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.170849 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:17.131381 27582 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:17.190110 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:17.129945 27419 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:09:17.192615 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:17.193305 24598 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
W20260709 13:09:17.203401 27625 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:09:17.203976 24597 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:17.206547 24597 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:17.207340 27561 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:17.207754 27561 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:17.212033 27610 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 13:09:17.220394 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.225896 27632 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.226437 27632 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:17.183648 27595 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.194638 27360 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.553s	user 0.005s	sys 0.006s
I20260709 13:09:17.223783 24667 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:17.171069 27398 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:17.240499 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:17.253418 27440 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.253156 27595 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.185216 27330 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:17.259167 24518 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:17.133028 27620 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.208662 27561 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.226462 27560 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.255429 27582 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:17.339874 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 81029.5us
I20260709 13:09:17.242741 27544 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:17.389376 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.244496 27360 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.260033 27387 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:09:17.258155 27398 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.309134 27330 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:17.434576 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.752290 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 511872us
W20260709 13:09:17.766234 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.485576 24600 raft_consensus.cc:2368] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:09:17.646508 24593 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 10. Ops: []
W20260709 13:09:17.422113 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 66460.6us
W20260709 13:09:17.577322 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.770726 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.771072 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.726435 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.781894 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2608) took 1165 ms. Trace:
I20260709 13:09:17.786490 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:17.731549 26926 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.004s
I20260709 13:09:17.782327 24519 rpcz_store.cc:276] 0709 13:09:16.616873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.934322 (+317449us) service_pool.cc:224] Handling call
0709 13:09:16.934618 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.958942 (+ 24324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.958974 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.979257 (+ 20283us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.094533 (+115276us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:17.094573 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.094642 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.204111 (+109469us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b180035a6a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:09:17.751115 (+547004us) raft_consensus.cc:1685] finished
0709 13:09:17.751141 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.781823 (+ 30682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14835,"raft.queue_time_us":145058,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10715,"spinlock_wait_cycles":45713664,"thread_start_us":72853,"threads_started":1,"wal-append.queue_time_us":77697}
I20260709 13:09:17.787889 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2601) took 1610 ms. Trace:
I20260709 13:09:17.794936 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:17.663422 27613 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.003s
I20260709 13:09:17.354676 27250 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.435s
I20260709 13:09:17.793700 24524 rpcz_store.cc:276] 0709 13:09:16.177666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.210081 (+ 32415us) service_pool.cc:224] Handling call
0709 13:09:16.250607 (+ 40526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:16.773099 (+522492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.787659 (+1014560us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400442854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:17.787834 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157518080}
I20260709 13:09:17.807331 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:17.808084 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:17.435686 27561 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.809417 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:17.809870 24672 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:17.809926 27640 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:17.810570 27636 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:17.899048 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 607) took 1211 ms. Trace:
I20260709 13:09:17.899479 27636 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:17.901888 27636 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:17.609647 27131 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.899619 24516 rpcz_store.cc:276] 0709 13:09:16.687275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.948516 (+261241us) service_pool.cc:224] Handling call
0709 13:09:16.964715 (+ 16199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.089336 (+124621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.089365 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.111041 (+ 21676us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.260413 (+149372us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:17.260457 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.260586 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.898753 (+638167us) raft_consensus.cc:1685] finished
0709 13:09:17.898783 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.898966 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118688,"raft.queue_time_us":137056,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":45,"thread_start_us":86469,"threads_started":1,"wal-append.queue_time_us":688770}
I20260709 13:09:17.902653 26926 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:17.902583 27131 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.812520 27398 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:17.815478 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:17.817426 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:17.415750 27435 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:17.819267 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:17.820137 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:17.355834 27560 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.729306 27360 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:17.827960 24668 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:17.865768 24665 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:17.794502 27638 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.828508 24670 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
W20260709 13:09:17.874378 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 699956us
I20260709 13:09:17.893457 27632 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:17.788268 27539 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:17.905016 25210 raft_consensus.cc:2376] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7. Re-sending same reply.
W20260709 13:09:17.896838 27525 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.709s	user 0.005s	sys 0.004s
W20260709 13:09:17.873031 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.819267 27330 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:17.913677 24524 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:17.920406 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:17.921864 24521 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:17.923961 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:17.924605 24525 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:17.866631 27592 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:17.926852 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:17.934231 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:17.909173 27465 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:17.937824 24520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.043s	sys 0.069s
W20260709 13:09:17.938211 24520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.043s	sys 0.069s
I20260709 13:09:17.865594 27629 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:09:17.915913 27398 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:17.929731 27569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.007s	sys 0.023s
I20260709 13:09:17.972357 27398 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:17.973244 27434 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:17.973922 27569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.007s	sys 0.024s
I20260709 13:09:17.974606 27398 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:17.968720 27131 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:17.911473 27435 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:17.977219 27435 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:17.977260 24673 raft_consensus.cc:1217] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:09:17.939381 27592 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:17.978062 24673 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:17.921054 27525 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:17.981024 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:17.986876 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:17.990466 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:17.991312 24522 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:17.995193 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:17.968164 27613 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:17.987030 27330 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:18.010594 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.012849 24672 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:17.986755 27636 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.012593 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:18.013916 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 79798.7us
I20260709 13:09:17.942314 27465 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:17.942608 27224 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:09:18.016355 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:18.016367 24565 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.005s	sys 0.031s
W20260709 13:09:18.017122 24565 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.005s	sys 0.032s
I20260709 13:09:18.017095 24523 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:18.019354 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 741031us
I20260709 13:09:18.021179 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.016209 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:18.008103 27434 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:18.029431 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:18.035751 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:18.008312 27435 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:18.046833 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:18.068150 24665 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.066370 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.068964 24670 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:18.067672 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:18.027529 27250 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.080025 24592 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:18.083191 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:18.029742 27330 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:18.068189 27569 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.075071 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:18.076267 27545 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.985s	user 0.005s	sys 0.006s
I20260709 13:09:18.097636 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:18.210958 24670 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.087884 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.029418 27434 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.211709 24668 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 3.
W20260709 13:09:18.106657 27552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.014s	sys 0.038s
W20260709 13:09:18.195200 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 127608us
W20260709 13:09:18.216814 24639 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.003s	sys 0.016s
W20260709 13:09:18.217343 24639 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.003s	sys 0.016s
I20260709 13:09:18.203627 27302 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:18.215070 24671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 2675) took 2250 ms (client timeout 1532 ms). Trace:
W20260709 13:09:18.195909 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 121598us
W20260709 13:09:18.173987 27596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.009s	sys 0.020s
I20260709 13:09:18.018908 27131 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:09:18.068044 27398 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
W20260709 13:09:18.214398 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.089357 24669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.003s	sys 0.006s
I20260709 13:09:18.215653 24674 raft_consensus.cc:2410] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:18.075357 27636 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.072860 27435 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.205391 24591 raft_consensus.cc:2376] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7. Re-sending same reply.
I20260709 13:09:18.195013 27360 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:18.218487 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:18.228787 24523 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
W20260709 13:09:18.219385 24669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.006s	sys 0.012s
W20260709 13:09:18.215758 24565 leader_election.cc:336] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.515s (SENT)
W20260709 13:09:18.211839 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 418917us
W20260709 13:09:18.218200 24671 rpcz_store.cc:269] 0709 13:09:15.959907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.055240 (+ 95333us) service_pool.cc:224] Handling call
0709 13:09:18.209913 (+2154673us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400404054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:18.210023 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711558016}
I20260709 13:09:18.232594 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1448) took 1142 ms. Trace:
I20260709 13:09:18.204206 27224 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.242262 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:17.928762 27638 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:18.091720 27613 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.125s
W20260709 13:09:18.238061 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 242919us
I20260709 13:09:17.923075 27640 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:18.217658 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 1.04135e+06us
I20260709 13:09:18.242949 24668 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
W20260709 13:09:18.217106 27552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.014s	sys 0.038s
I20260709 13:09:18.254070 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:18.210173 27607 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.248703 27525 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:18.250036 27398 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:09:18.252019 27648 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
W20260709 13:09:18.222823 27596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.009s	sys 0.021s
I20260709 13:09:18.254405 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:18.255558 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:18.271400 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55166.5us
I20260709 13:09:18.283808 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:18.285952 24671 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
W20260709 13:09:18.289621 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 294484us
I20260709 13:09:18.246894 27620 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.297623 24668 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:18.299399 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 83665.6us
W20260709 13:09:18.300094 24565 leader_election.cc:336] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.573s (SENT)
I20260709 13:09:18.300488 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:18.259552 27632 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:18.255999 27582 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 13:09:18.410667 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 156705us
I20260709 13:09:18.411621 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:18.355214 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.316854 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:18.259377 27360 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.292284 27569 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.390880 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.389228 24598 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:18.316596 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:09:18.414356 24639 connection.cc:256] RPC call timeout handler was delayed by -1.112789869999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 13:09:18.422822 27131 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:18.388417 24591 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:18.470654 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 170585us
I20260709 13:09:18.474712 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:18.476161 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 161835us
I20260709 13:09:18.422785 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.284017 27302 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:18.306797 27633 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.478510 24565 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.619s (SENT)
I20260709 13:09:18.478969 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:09:18.462669 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 51148.8us
W20260709 13:09:18.415982 27648 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:18.495466 27656 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.496031 27656 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.496553 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 609) took 1808 ms. Trace:
I20260709 13:09:18.496963 24517 rpcz_store.cc:276] 0709 13:09:16.687708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.949367 (+261659us) service_pool.cc:224] Handling call
0709 13:09:16.949707 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:17.168179 (+218472us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:17.193357 (+ 25178us) log.cc:844] Serialized 14 byte log entry
0709 13:09:17.448037 (+254680us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:17.565957 (+117920us) log.cc:844] Serialized 52 byte log entry
0709 13:09:17.662138 (+ 96181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:17.662194 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.662295 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.496340 (+834045us) raft_consensus.cc:1685] finished
0709 13:09:18.496359 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.496499 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57434,"prepare.queue_time_us":18951,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5852,"raft.queue_time_us":155301,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":169,"thread_start_us":233448,"threads_started":2,"wal-append.queue_time_us":718657}
I20260709 13:09:18.498634 27656 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:18.499122 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:18.499209 27656 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:18.499670 27659 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.500394 27659 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:18.500743 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.501029 27636 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.480698 24668 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:18.495467 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1474) took 1325 ms. Trace:
I20260709 13:09:18.416450 27560 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.506313 24670 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:18.506482 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:18.298983 27398 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:18.483727 27674 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:18.419348 27592 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.484654 27302 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:18.485841 27561 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.001s
W20260709 13:09:18.485908 27653 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:09:18.487847 27434 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.488921 27250 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:18.489799 27596 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:18.492043 27640 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.492206 27595 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:18.575145 27650 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.810s	user 0.001s	sys 0.001s
I20260709 13:09:18.492779 27673 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:18.577636 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:18.577482 27673 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.578336 24518 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:18.579272 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:18.580281 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:18.580425 27673 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.493126 27669 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:18.581254 27669 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:18.576634 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:18.582011 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.494607 27668 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.423039 27594 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.500360 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:18.493218 27633 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.583798 24517 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:18.584380 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1455) took 1410 ms. Trace:
I20260709 13:09:18.503813 24665 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:18.584776 24674 rpcz_store.cc:276] 0709 13:09:17.181839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.751898 (+570059us) service_pool.cc:224] Handling call
0709 13:09:18.584204 (+832306us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b5400404554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:18.584327 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984862976}
I20260709 13:09:18.585500 27633 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.585839 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.586375 27435 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.586585 24665 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:18.587059 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.294811 27224 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.180s
I20260709 13:09:18.587805 24673 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:18.588428 27224 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:18.501964 24597 rpcz_store.cc:276] 0709 13:09:17.169976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.207197 (+ 37221us) service_pool.cc:224] Handling call
0709 13:09:17.207469 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.207854 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.207882 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.786417 (+578535us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.072530 (+286113us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:18.072569 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.072631 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.495238 (+422607us) raft_consensus.cc:1685] finished
0709 13:09:18.495258 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.495403 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":86,"thread_start_us":275519,"threads_started":1,"wal-append.queue_time_us":508866}
I20260709 13:09:18.589246 24672 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:18.520974 27525 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:18.589967 27525 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.521153 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:18.592271 27525 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.391664 27330 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:18.593035 27652 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 13:09:18.593479 24519 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:18.521726 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:18.594434 24595 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.470715 27131 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:18.478111 27569 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:18.470294 27539 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.524323 27662 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.524964 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:18.525247 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:18.526105 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 54488us
I20260709 13:09:18.531388 27360 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.465274 27540 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:18.533119 27638 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:18.450623 27632 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.533880 27545 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:18.352736 27620 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.539050 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:18.603989 27131 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.583214 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:18.587682 27544 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:18.522101 27660 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.588691 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.580833 24518 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:18.501335 27659 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:18.595990 24517 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:18.585892 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.638325 24674 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:18.638654 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:18.587673 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:18.542631 27674 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:18.606390 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85391.7us
I20260709 13:09:18.609040 24670 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:18.588944 27224 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:18.611407 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:18.616405 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 321744us
I20260709 13:09:18.582160 24521 raft_consensus.cc:2368] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
W20260709 13:09:18.617324 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 78407.7us
I20260709 13:09:18.648804 24597 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:18.628427 24667 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:18.648943 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:18.612277 27435 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.597541 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.650377 24671 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:18.659157 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:18.660287 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 181459us
I20260709 13:09:18.617347 27662 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:18.628069 27638 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.669042 24639 leader_election.cc:400] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:18.672691 24639 leader_election.cc:403] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:18.670115 24665 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:18.670729 24674 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:18.673353 24665 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:18.675660 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 255707us
I20260709 13:09:18.609721 27539 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:18.691273 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 400664us
I20260709 13:09:18.692085 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:18.692991 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:18.633422 27660 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:18.622938 27661 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.637370 27659 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:18.697374 24597 raft_consensus.cc:2410] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:18.701280 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 611) took 1469 ms. Trace:
I20260709 13:09:18.582185 27669 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.616463 27540 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.704125 24667 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:18.674638 27525 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.627838 27545 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:18.705725 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:18.706595 24517 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:18.672339 27561 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.709403 24520 rpcz_store.cc:276] 0709 13:09:17.232058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.233055 (+   997us) service_pool.cc:224] Handling call
0709 13:09:17.253355 (+ 20300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.259426 (+  6071us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:17.259454 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:17.294824 (+ 35370us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.938635 (+643811us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:17.938693 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.938782 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.701006 (+762224us) raft_consensus.cc:1685] finished
0709 13:09:18.701033 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.701207 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2945,"raft.queue_time_us":7282,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":47581,"spinlock_wait_cycles":61824,"thread_start_us":575117,"threads_started":1,"wal-append.queue_time_us":698314}
I20260709 13:09:18.707914 24665 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:18.724246 27678 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:09:18.232952 24669 rpcz_store.cc:276] 0709 13:09:17.090160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.092619 (+  2459us) service_pool.cc:224] Handling call
0709 13:09:17.098669 (+  6050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.098921 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:17.342577 (+243656us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.232257 (+889680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:18.232310 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:18.232362 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.232433 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.232544 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"thread_start_us":746568,"threads_started":1}
I20260709 13:09:18.705164 27660 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:18.763406 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57781.2us
W20260709 13:09:18.726070 27670 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:09:18.694428 27638 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:18.728516 27685 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:18.731038 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:18.780499 24599 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:18.695549 26926 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:09:18.787809 24668 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:18.783936 24639 leader_election.cc:336] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.514s (SENT)
I20260709 13:09:18.713973 27594 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 13:09:18.794795 24639 leader_election.cc:336] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.530s (SENT)
I20260709 13:09:18.795292 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:18.795797 24521 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:09:18.799033 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 102638us
I20260709 13:09:18.773826 27525 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.712898 27683 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:09:18.762410 27552 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:09:18.759639 27561 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.842492 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:18.854480 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:18.855331 24667 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 4: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:18.857285 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:18.861763 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 97775us
I20260709 13:09:18.863656 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:18.872969 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:18.873282 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 78514.2us
I20260709 13:09:18.873737 25214 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
W20260709 13:09:18.873997 24639 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.598s (SENT)
I20260709 13:09:18.874295 27540 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.874658 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:18.874864 27540 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:18.875324 27540 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:18.875259 25214 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:18.875873 27540 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.876602 27595 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:18.877357 27669 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.849890 27662 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:18.885331 27569 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:18.885696 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.886340 24674 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:18.888746 27561 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:18.889631 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:18.890488 25216 raft_consensus.cc:2410] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:18.890709 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:18.893497 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:18.900970 24595 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:18.760414 27224 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.901741 24599 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:18.843647 27398 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:18.910182 25218 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:18.912696 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 708) took 1091 ms. Trace:
I20260709 13:09:18.912779 24666 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:18.913782 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1457) took 1107 ms. Trace:
I20260709 13:09:18.877059 27595 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:18.914395 24666 rpcz_store.cc:276] 0709 13:09:17.806347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.905445 (+1099098us) service_pool.cc:224] Handling call
0709 13:09:18.912429 (+  6984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.913454 (+  1025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.913711 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:18.913278 25213 rpcz_store.cc:276] 0709 13:09:17.821604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.821744 (+   140us) service_pool.cc:224] Handling call
0709 13:09:17.822077 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.183601 (+361524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.202715 (+ 19114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.214532 (+ 11817us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.291762 (+ 77230us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:18.291802 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.291874 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.912398 (+620524us) raft_consensus.cc:1685] finished
0709 13:09:18.912427 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.912630 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55083,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":86,"thread_start_us":305235,"threads_started":2,"wal-append.queue_time_us":338781}
I20260709 13:09:18.918797 24669 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:18.927493 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.787838 27674 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.939013 27360 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.940075 27632 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.941772 24668 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:18.942039 27638 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:18.809854 27659 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.946046 27545 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:18.916639 27684 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.949568 27684 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.873324 27539 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.951710 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:18.955418 24674 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:18.954102 27684 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.852254 27525 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.964748 24671 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
W20260709 13:09:18.951413 27693 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:09:18.973682 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.975481 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 111949us
I20260709 13:09:18.979684 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:18.981017 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:18.984424 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:18.980664 27607 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 13:09:18.985946 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:18.982872 27539 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.984123 27620 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.988260 27662 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.982817 27703 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:18.988628 27654 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.999379 27587 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.000725 27525 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:18.990682 27594 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:18.991514 27687 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.991498 27696 consensus_queue.cc:1175] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "148dc963cec64232ad3b248abad6f36d" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:18.995447 27539 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:18.997298 27703 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:19.015175 26926 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.015648 26926 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:19.016508 27434 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:19.016842 27434 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:18.994030 27592 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:09:19.024355 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.029960 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.030714 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.031343 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.031853 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.030027 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.032529 25214 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:19.031971 25216 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:19.028542 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.014030 27539 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.017949 27434 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:18.994735 27595 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.035360 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.019047 27594 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:19.019694 27703 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.036872 27434 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.037132 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:19.038170 27690 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 13:09:19.041466 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.007704 27654 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.043406 25212 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:19.013559 27587 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.012624 27687 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.047320 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.047904 25212 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:19.052719 25217 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:19.054024 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.036008 27660 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:19.063301 24418 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 343) took 26903 ms (client timeout 15000 ms). Trace:
W20260709 13:09:19.063772 24418 rpcz_store.cc:269] 0709 13:08:52.160241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.165264 (+  5023us) service_pool.cc:224] Handling call
0709 13:09:19.063069 (+26897805us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:12.184707 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:12.354003 (+169296us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:12.356085 (+  2082us) write_op.cc:435] Acquired schema lock
0709 13:09:12.361928 (+  5843us) tablet.cc:662] Decoding operations
0709 13:09:12.531890 (+169962us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:12.531973 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:12.532014 (+    41us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:09:12.532702 (+   688us) tablet.cc:701] Row locks acquired
0709 13:09:12.532722 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:09:12.532871 (+   149us) write_op.cc:270] Start()
0709 13:09:12.533000 (+   129us) write_op.cc:276] Timestamp: P: 1783602552532823 usec, L: 0
0709 13:09:12.533026 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:09:12.586414 (+ 53388us) log.cc:844] Serialized 3126 byte log entry
0709 13:09:13.073345 (+486931us) op_driver.cc:464] REPLICATION: finished
0709 13:09:13.329883 (+256538us) write_op.cc:301] APPLY: starting
0709 13:09:13.329976 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:13.354060 (+ 24084us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:13.354178 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:13.401355 (+ 47177us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:13.401561 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:09:13.401606 (+    45us) write_op.cc:312] APPLY: finished
0709 13:09:13.401846 (+   240us) log.cc:844] Serialized 59 byte log entry
0709 13:09:13.402014 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:13.402140 (+   126us) write_op.cc:454] Released schema lock
0709 13:09:13.402179 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:13.402511 (+   332us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:13.402538 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":402,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":256281,"apply.run_cpu_time_us":3100,"apply.run_wall_time_us":72633,"num_ops":7,"prepare.queue_time_us":377311,"prepare.run_cpu_time_us":104679,"prepare.run_wall_time_us":760143,"raft.queue_time_us":22266,"raft.run_cpu_time_us":54508,"raft.run_wall_time_us":155809,"replication_time_us":540136,"thread_start_us":755088,"threads_started":4,"wal-append.queue_time_us":418668,"wal-append.run_cpu_time_us":17061,"wal-append.run_wall_time_us":1407613}]]}
I20260709 13:09:19.071298 27594 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.072618 25213 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:19.072866 27465 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:19.077864 24600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1301) took 1918 ms (client timeout 1825 ms). Trace:
W20260709 13:09:19.078300 24600 rpcz_store.cc:269] 0709 13:09:17.159830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.159966 (+   136us) service_pool.cc:224] Handling call
0709 13:09:19.077664 (+1917698us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540025e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:19.077781 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643352960}
I20260709 13:09:19.080404 27587 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.082439 24665 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.083298 27660 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:19.087222 27539 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:19.088572 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 214589us
I20260709 13:09:19.088945 27685 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:19.092892 27360 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.093031 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.093694 27360 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.095883 27360 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:19.095954 27539 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.097254 27590 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.097759 27590 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.098337 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.098973 24669 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:19.099758 27590 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.100265 27590 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.101310 24666 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:09:19.102098 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.102818 24667 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:19.103259 24670 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:19.103602 24670 pending_rounds.cc:85] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 7
I20260709 13:09:19.103801 24670 pending_rounds.cc:107] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:19.104053 24670 raft_consensus.cc:2889] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.104432 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:19.105305 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:19.105409 27638 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.105852 27638 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:19.106261 27638 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.108042 27634 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.108466 27634 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.108819 27634 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.110276 27632 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:19.113937 24666 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:19.117655 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:19.117913 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.118535 24668 raft_consensus.cc:2376] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10. Re-sending same reply.
I20260709 13:09:19.118705 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.119096 24673 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.119509 27540 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.119944 27525 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.100677 27590 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.120496 27525 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:19.122090 27590 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.122582 27525 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:19.126191 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:19.115432 27695 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:09:19.115828 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.131438 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:19.139895 24673 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.140223 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:19.093725 24674 raft_consensus.cc:2376] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8. Re-sending same reply.
I20260709 13:09:19.126828 24667 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:19.131029 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.137952 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.142482 25213 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:19.142580 25215 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:19.142902 27131 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.146735 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:19.158989 24670 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:09:19.150559 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 506726us
I20260709 13:09:19.146435 24665 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:19.149140 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:19.162158 24665 pending_rounds.cc:85] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 2
I20260709 13:09:19.163044 24665 pending_rounds.cc:107] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:19.164968 24665 raft_consensus.cc:2889] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.166296 24673 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:19.184275 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.188863 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:19.190228 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1299) took 2441 ms. Trace:
I20260709 13:09:19.116626 27634 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.151073 27566 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.192394 24593 rpcz_store.cc:276] 0709 13:09:16.742429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.879113 (+136684us) service_pool.cc:224] Handling call
0709 13:09:16.910862 (+ 31749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.769285 (+858423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.183635 (+1414350us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540025e4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:19.183811 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566744832}
I20260709 13:09:19.153478 27654 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:19.155272 27544 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.201978 24670 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:19.208493 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.208561 25213 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:19.214151 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.171918 27539 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:09:19.215294 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 126076us
W20260709 13:09:19.219262 24639 leader_election.cc:336] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.784s (SENT)
I20260709 13:09:19.218714 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.198995 27465 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.209992 27544 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.223562 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.237923 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:19.221700 27566 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.244654 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:19.242679 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:19.246209 24598 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:19.246251 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:19.247272 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.248857 25210 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:19.247575 24490 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.248353 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:19.251192 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.004s	sys 0.014s
W20260709 13:09:19.251574 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.004s	sys 0.014s
I20260709 13:09:19.251789 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:19.252547 27694 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.310s	user 0.002s	sys 0.001s
I20260709 13:09:19.252727 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:19.254316 24593 pending_rounds.cc:85] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 5
I20260709 13:09:19.254606 24593 pending_rounds.cc:107] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:19.254863 24593 raft_consensus.cc:2889] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.255198 24593 pending_rounds.cc:107] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:19.255424 24593 raft_consensus.cc:2889] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.222729 27465 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:19.248327 27566 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:19.225231 27544 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:19.264175 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.277271 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:19.251833 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 898186us
I20260709 13:09:19.258831 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:19.279652 24592 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:19.281884 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.282547 24673 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:19.282752 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.285708 24599 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:19.282130 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:19.286437 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:19.232831 27607 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:19.289698 25218 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 4: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:19.280100 27566 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.258776 27398 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:19.249182 27302 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:19.288152 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:19.259742 27465 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.274627 27656 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:19.306267 25210 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:19.276670 27679 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.305749 24637 leader_election.cc:400] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:09:19.311511 24637 leader_election.cc:403] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:19.250157 27587 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:19.304536 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:19.313198 25218 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:19.243256 27594 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:09:19.309803 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:19.315053 24598 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:19.256379 27590 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.313643 27613 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:19.313761 27587 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.307277 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.309661 27698 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:19.316803 27613 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.318202 27620 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
I20260709 13:09:19.318419 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:19.301980 27398 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.320226 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:19.320319 27699 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:19.321861 27545 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.323832 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.350785 24674 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:19.325879 27634 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.328421 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:19.352257 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.352932 24667 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:19.353601 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.290584 27435 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:19.330026 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.357144 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:19.357491 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.357824 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.358309 24594 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:19.290833 27708 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:19.337445 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:19.339833 24639 leader_election.cc:336] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.919s (SENT)
I20260709 13:09:19.275887 27673 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:09:19.343557 24673 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:19.345440 24596 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:19.350412 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.304509 27607 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:19.306932 27302 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.306743 27656 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.318856 27662 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.316746 27685 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:19.359712 24672 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:19.361356 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.346278 27594 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.368969 24674 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:19.362568 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.369827 24673 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:19.363198 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.339558 27188 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:19.364413 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:19.355584 27398 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.347882 27540 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.374661 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.342782 27698 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:19.374254 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:19.378697 25214 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:19.361874 27719 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.364986 27654 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:19.366240 27302 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:19.382421 27539 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:19.383432 27716 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:19.376042 27517 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:19.376003 27634 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:19.390803 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.370862 27656 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.425519 25211 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:19.377556 27708 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:19.426652 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:19.426911 27708 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.339355 27679 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.480878 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.379765 27698 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.482340 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:19.482789 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 142992us
I20260709 13:09:19.483090 25213 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:19.375818 27563 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:09:19.376371 27188 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.373018 27594 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:19.486560 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.427259 25211 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.380942 27654 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:19.527410 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.532426 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.378437 27684 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:19.478875 27715 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:09:19.577122 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.373757 27662 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.584374 25210 raft_consensus.cc:2376] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7. Re-sending same reply.
I20260709 13:09:19.573458 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.374650 27685 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.407006 27525 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:19.479877 27721 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:19.574483 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.445969 27634 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:19.592453 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.424013 27517 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:19.596405 24665 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:19.380774 27719 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:19.632761 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 58294.2us
I20260709 13:09:19.659021 24639 leader_election.cc:400] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5.
W20260709 13:09:19.660645 27707 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.724s	user 0.003s	sys 0.000s
I20260709 13:09:19.661767 27517 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.663296 27517 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:19.598101 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 226327us
I20260709 13:09:19.616976 24516 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:19.584311 27596 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:09:19.667889 27634 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.669413 27634 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.670148 27592 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:19.670668 27592 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:19.671655 27592 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.583461 27330 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.673395 27330 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.665385 24524 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:19.675436 27330 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:19.676663 27722 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
W20260709 13:09:19.678566 27649 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.482s	user 0.000s	sys 0.003s
I20260709 13:09:19.679700 25211 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:19.680092 27566 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:19.680920 27717 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:09:19.682924 27595 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.683786 27685 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:19.685886 27188 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:19.688949 27684 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:19.690141 27706 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.752s	user 0.002s	sys 0.000s
I20260709 13:09:19.691982 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1486) took 1074 ms. Trace:
I20260709 13:09:19.692452 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:19.692474 24597 rpcz_store.cc:276] 0709 13:09:18.617878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.715647 (+ 97769us) service_pool.cc:224] Handling call
0709 13:09:18.715980 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:18.722746 (+  6766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.722776 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:18.765769 (+ 42993us) log.cc:844] Serialized 52 byte log entry
0709 13:09:18.866865 (+101096us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:18.925647 (+ 58782us) log.cc:844] Serialized 14 byte log entry
0709 13:09:18.939962 (+ 14315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.940041 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.689382 (+749341us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:19.691589 (+  2207us) raft_consensus.cc:1685] finished
0709 13:09:19.691707 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.691906 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55759,"prepare.queue_time_us":59974,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":20272,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":25371,"spinlock_wait_cycles":33127680,"thread_start_us":66817,"threads_started":1,"wal-append.queue_time_us":149248}
I20260709 13:09:19.533699 27638 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.698199 27638 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.699383 26926 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.584088 27607 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.588124 27540 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:09:19.618602 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:19.645844 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:19.620134 27714 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:09:19.624958 27679 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:19.628064 27465 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.694641 27662 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.618017 27718 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.159s
W20260709 13:09:19.710201 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49343.8us
I20260709 13:09:19.710927 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.711179 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:19.582283 27654 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:19.738806 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.739405 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:19.711459 27592 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.715129 27725 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:19.715066 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 322193us
I20260709 13:09:19.478096 27689 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.356s
I20260709 13:09:19.721879 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:19.721732 25219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:19.723519 25211 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:19.633905 27720 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:09:19.735553 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.734051 27545 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:19.743062 24667 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:19.709636 26926 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:19.716638 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 423811us
I20260709 13:09:19.750847 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:19.752964 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.746430 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.692569 27613 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.709275 27659 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.651826 27587 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.744561 27596 consensus_queue.cc:1243] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:09:19.738754 27224 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.755416 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:19.753515 24524 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:09:19.798373 24524 pending_rounds.cc:85] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 5
I20260709 13:09:19.798698 24524 pending_rounds.cc:107] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:09:19.798967 24524 raft_consensus.cc:2889] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.762884 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:09:19.763655 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.738530 27718 consensus_queue.cc:1243] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:19.766374 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.767195 27465 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.767748 27540 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:19.767947 24517 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.755872 27679 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.770432 27631 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.771750 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.772151 27719 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:19.818359 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.819502 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.772698 25210 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:19.747046 27674 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.774031 27544 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.774055 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:19.775363 27724 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.776134 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:19.776033 27587 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:19.777576 24521 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:19.777390 27594 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.802963 27250 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.778266 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:19.780154 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:19.761230 27545 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:19.791532 27673 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.800120 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:19.829427 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2623) took 1822 ms. Trace:
I20260709 13:09:19.832257 25214 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.806294 27540 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:19.856463 24524 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:19.849659 24518 rpcz_store.cc:276] 0709 13:09:18.007544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.633989 (+626445us) service_pool.cc:224] Handling call
0709 13:09:18.664416 (+ 30427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.691923 (+ 27507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.691954 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.712366 (+ 20412us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.867186 (+154820us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:18.867227 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.867297 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.659928 (+792631us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:19.810891 (+150963us) raft_consensus.cc:1685] finished
0709 13:09:19.810920 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.829356 (+ 18436us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46583,"raft.queue_time_us":27613,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":9083,"spinlock_wait_cycles":51478912,"thread_start_us":78843,"threads_started":1,"wal-append.queue_time_us":171328}
W20260709 13:09:19.859933 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 97132us
W20260709 13:09:19.838200 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 86491.7us
I20260709 13:09:19.797776 27662 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:19.840047 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 59983.3us
W20260709 13:09:19.868083 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 68067.2us
W20260709 13:09:19.797405 27731 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:19.842136 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.872502 24517 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:19.845149 27465 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.804683 27435 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.863175 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.866408 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:19.867262 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 127923us
I20260709 13:09:19.868798 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:19.760869 27725 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.870162 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:19.866488 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:19.880223 24666 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.880360 25210 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.858189 27540 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.870935 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:19.842770 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:19.818152 27596 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:09:19.818485 27552 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:19.873333 24600 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:19.873219 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.874374 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:19.877933 27566 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.855428 27434 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.899643 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:19.910135 24673 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:19.840467 27724 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.835620 27737 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:09:19.856062 27673 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.889741 27544 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.948416 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.890666 24521 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:19.949069 24523 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:19.949725 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:19.875703 27465 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.894486 27725 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:19.969213 27654 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:19.942332 27703 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.898s	user 0.006s	sys 0.010s
I20260709 13:09:19.910746 27435 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.976629 27703 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.901846 25214 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:19.978117 24595 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:19.881911 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:19.909235 24666 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:19.879732 24674 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:19.910053 27613 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:09:19.916672 27679 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:19.909884 27668 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.918007 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:19.971596 27654 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:19.919359 27525 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:19.920833 25213 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:09:19.990092 25213 pending_rounds.cc:85] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 5
I20260709 13:09:19.990348 25213 pending_rounds.cc:107] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:09:19.990600 25213 raft_consensus.cc:2889] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.897428 27330 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:19.922430 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:19.997587 24671 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.923380 24524 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:19.924368 27569 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:19.924544 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:20.000250 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 75819.5us
I20260709 13:09:19.925410 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:20.000981 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:20.001441 25218 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:19.852694 27250 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.925844 27677 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.004166 27703 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:19.987613 27668 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.004761 27668 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.005566 24670 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:20.005930 24670 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:20.006623 24670 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:20.008404 27687 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:20.009151 27633 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:20.009652 27633 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:20.010035 27633 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.926604 27659 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:19.927496 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:19.928231 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:20.015272 24522 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:19.930902 25212 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:20.017011 25219 raft_consensus.cc:606] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:19.915472 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.999571 27742 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:20.017544 25219 raft_consensus.cc:614] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:19.926098 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:20.020718 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 94694.2us
I20260709 13:09:19.874725 27733 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.944525 24516 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:19.941977 27632 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:19.905356 27545 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:19.947634 27131 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:19.947535 27698 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:19.948143 27673 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:19.953755 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:20.033937 24517 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:19.952571 27302 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 13:09:19.982935 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:20.035175 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 52318.2us
I20260709 13:09:20.035816 24566 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:19.983845 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:19.918586 27727 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:19.990453 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 108673us
I20260709 13:09:19.877245 27638 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:19.978719 27465 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:19.996814 24637 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.645s (SENT) [suppressed 41 similar messages]
I20260709 13:09:20.003924 27677 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:20.002326 27569 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:19.936381 27398 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.000s
I20260709 13:09:19.907218 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:20.037343 27613 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:19.991134 27656 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.009s
I20260709 13:09:20.024608 25210 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:19.951225 27743 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:20.026474 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:20.042529 27539 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.037447 24666 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.038926 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:20.041796 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:09:20.076988 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 169828us
I20260709 13:09:20.043650 24596 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:20.022775 27434 raft_consensus.cc:2764] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:20.080892 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.081537 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.019610 27330 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:20.025696 27387 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.047768 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.023854 27659 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:20.049244 27250 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:20.091475 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.091976 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:20.051597 27698 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:20.052728 27744 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.022414 27733 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:20.070042 27613 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:20.042536 27632 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.139436 27632 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:20.017838 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 102427us
I20260709 13:09:20.072255 25217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28c13259bf74484588e0fb08995091cc"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:20.072849 27656 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.140885 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:20.141839 27699 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:20.142100 27656 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:20.142204 27699 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:20.142464 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:20.142771 27699 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.144168 25217 raft_consensus.cc:606] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:20.144542 25217 raft_consensus.cc:614] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:20.029100 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.147122 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:20.083596 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86808.5us
W20260709 13:09:20.089272 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 62885.4us
I20260709 13:09:20.089509 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.068989 27569 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.094520 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.094624 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.095635 24667 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:20.159564 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:20.096129 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.162503 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:20.163926 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.097390 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.166189 24591 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:20.098202 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.168236 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.098344 24595 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:20.174485 25210 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:20.175573 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.059345 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.177635 25218 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:20.178710 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.101461 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.105396 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.105763 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.182196 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.183153 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.042815 27302 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.107014 24666 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:20.067420 24671 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:20.091187 27659 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.105819 27733 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.109400 24673 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:20.186743 27659 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.187079 27302 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:20.110389 27724 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:20.111578 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.187868 24519 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:09:20.188884 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.115743 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.117044 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:20.190747 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 73782.7us
I20260709 13:09:20.117224 27736 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:09:20.119596 27669 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:20.120324 27634 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:20.216212 27634 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:20.215556 27727 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:20.217145 27634 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.218075 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:20.218369 27634 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:20.219463 24518 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:20.219187 27733 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.092473 26926 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:20.220628 26926 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:20.093034 27673 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.220999 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.190271 27668 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.222234 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.222819 25213 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:20.223111 27668 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:20.222313 27733 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:20.223979 25213 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:20.095268 27387 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:20.225265 24517 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:20.227126 27387 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:20.124740 27677 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:20.127241 27746 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:09:20.075039 27398 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:20.228890 24521 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:20.229372 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:20.230033 27398 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:20.129456 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.231233 24596 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:20.130668 27633 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.233933 27633 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:20.133795 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:20.235651 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:20.238859 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 100639us
I20260709 13:09:20.133469 27330 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.089957 27131 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:20.086077 27719 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.135480 27465 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.099419 27744 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.090130 27561 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.092830 27539 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:20.137171 27613 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:20.155769 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.156884 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:20.158007 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:20.192471 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.205685 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.191111 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:20.176869 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.205134 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:20.207896 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 56873us
I20260709 13:09:20.206835 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.209091 27669 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:20.213275 27724 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.215852 24524 pending_rounds.cc:85] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 4
W20260709 13:09:20.239996 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.212447 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:20.212447 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:20.241353 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:20.210492 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:20.244910 24600 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:20.254803 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.157905 27596 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.156591 27704 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.191977 27698 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.221041 26926 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.262832 25212 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:20.260675 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:20.399145 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.423658 25211 raft_consensus.cc:2376] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6. Re-sending same reply.
I20260709 13:09:20.394764 24670 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.424007 24600 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:20.248936 27131 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.425521 24600 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:20.470480 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 229167us
I20260709 13:09:20.426028 24522 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.472457 24525 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:20.427148 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:20.427978 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 217567us
I20260709 13:09:20.428839 24524 pending_rounds.cc:107] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 13:09:20.429037 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 237995us
I20260709 13:09:20.476994 24524 raft_consensus.cc:2889] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.429939 24594 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.269555 25215 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:20.272722 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:20.430023 25210 raft_consensus.cc:2376] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6. Re-sending same reply.
I20260709 13:09:20.435094 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.316006 24597 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:20.465956 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:20.340363 27592 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.001s
I20260709 13:09:20.489543 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.488943 24595 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:20.500136 24670 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:20.356725 27673 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.354351 27465 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:20.671329 27683 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:09:20.263079 27744 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.502517 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:20.480428 24665 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:20.255175 27732 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.234s
I20260709 13:09:20.468459 27698 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.483505 27566 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.521382 27302 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.521528 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.522709 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.525566 25218 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:20.473327 27633 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.474160 27131 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.473011 27563 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:20.538753 24522 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
W20260709 13:09:20.546391 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 74658.4us
I20260709 13:09:20.293911 27561 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.259238 27540 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:20.551748 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 279091us
W20260709 13:09:20.570217 27753 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:09:20.571131 27752 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:09:20.560616 27743 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.577365 27539 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.553947 27594 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:09:20.501170 27724 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:20.745335 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:20.537479 27525 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:20.486629 27595 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:09:20.473578 27704 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:20.550477 27720 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:20.605443 25212 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:20.751607 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:20.752173 24591 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.656015 24594 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:20.636674 27631 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.663992 27387 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.665949 25219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.000s	sys 0.011s
I20260709 13:09:20.657684 27741 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.677107 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 174660us
I20260709 13:09:20.608842 27669 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:20.697130 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 173625us
W20260709 13:09:20.709246 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 552428us
I20260709 13:09:20.763231 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:20.712163 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.682797 27552 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:20.723227 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.694736 27698 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.666332 27632 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:09:20.732583 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.738844 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:20.740072 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.741473 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:20.749692 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.730702 27732 consensus_queue.cc:1243] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:20.779328 27613 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:20.758673 27631 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.788506 27747 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.788817 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:20.790319 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:20.791324 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:20.792274 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:20.637321 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.721628 27633 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:20.793982 27633 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.794296 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.795817 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.796473 25217 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:20.755837 25219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.000s	sys 0.011s
I20260709 13:09:20.758983 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.746541 27525 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.798589 27525 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.776396 27632 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:20.777592 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.801854 27668 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:20.802047 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.802285 27668 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:20.806820 25214 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:20.808543 25214 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:09:20.811455 27772 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:09:20.817031 27766 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:09:20.817584 27631 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:20.818552 27613 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:20.820446 25216 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:20.821118 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:20.821842 25210 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.737803 27696 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:20.740670 27517 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:09:20.845474 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.826109 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:20.759827 27719 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:20.847395 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.803081 27668 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:20.858736 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 119946us
I20260709 13:09:20.860313 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:20.869911 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 618) took 1107 ms. Trace:
I20260709 13:09:20.848902 27771 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.755251 27563 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:20.858485 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 117959us
I20260709 13:09:20.825423 27747 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:20.885941 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.920233 24521 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:20.865061 27724 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.842726 27673 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.867159 27595 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.849838 27465 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:20.923058 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.923660 24519 rpcz_store.cc:276] 0709 13:09:19.762728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.765274 (+  2546us) service_pool.cc:224] Handling call
0709 13:09:19.765524 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.188411 (+422887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.869551 (+681140us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400440f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:20.869827 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970784000}
W20260709 13:09:20.924573 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 64337.1us
I20260709 13:09:20.970185 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:20.928507 27654 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:20.921030 25214 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 7 LEARNER]: Advancing to term 8
I20260709 13:09:20.848054 25218 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:20.931735 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 140473us
I20260709 13:09:20.990509 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:20.979853 27569 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.754s	user 0.013s	sys 0.001s
I20260709 13:09:20.992367 27569 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.993899 24522 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:20.844120 27669 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.995152 27569 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:20.934350 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:20.999845 24598 raft_consensus.cc:2410] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:20.935179 24591 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:20.946822 27561 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:20.947005 27699 consensus_meta.cc:287] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.804s	user 0.007s	sys 0.004s
I20260709 13:09:20.949326 27540 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:20.950385 27525 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.768347 27741 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:20.764879 27387 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.991791 27718 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:20.951598 27744 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:20.961476 26926 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:20.928531 27736 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.989620 27703 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:09:20.962612 27765 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:09:20.962932 27668 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.942757 27747 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.024818 27633 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:20.932199 27758 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.268s	user 0.002s	sys 0.002s
I20260709 13:09:20.971344 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:20.925186 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 54253.9us
I20260709 13:09:21.009979 25218 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:20.967670 27465 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:21.007982 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86234.4us
I20260709 13:09:21.010429 24591 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:21.014289 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:20.851011 27719 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:21.022794 25214 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 8 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:09:21.024245 25217 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:21.013973 27735 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.109511 24593 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:21.110282 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:21.061462 27387 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.023870 27718 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:20.965799 27698 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.128424 25217 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:21.128639 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 157354us
I20260709 13:09:21.129343 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:21.062847 27633 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:21.081241 27767 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:09:21.094348 25214 pending_rounds.cc:85] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 5
W20260709 13:09:21.059512 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 298869us
I20260709 13:09:21.138266 25214 pending_rounds.cc:107] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:09:21.011807 27699 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.114972 24592 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:21.017432 27131 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.094798 27465 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:21.122042 27770 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:21.061470 27525 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:21.154362 27659 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.967s	user 0.015s	sys 0.008s
I20260709 13:09:21.154888 27659 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:21.156131 27596 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.683s	user 0.007s	sys 0.005s
I20260709 13:09:21.156644 27596 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:21.157675 27777 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:09:21.158407 27699 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.159011 27719 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.160498 27719 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.161767 27704 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:21.162355 27727 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.000s
I20260709 13:09:21.148985 27673 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.140278 25214 raft_consensus.cc:2889] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:21.142967 27634 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.924s	user 0.008s	sys 0.006s
I20260709 13:09:21.139242 27633 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.026839 27563 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.121259 27735 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.168398 25211 raft_consensus.cc:2368] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:21.169200 27540 raft_consensus.cc:2764] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:09:21.127592 27517 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:21.169683 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.170778 27540 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.171109 26926 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.171471 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.115736 27736 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:21.124797 27718 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:21.172767 27744 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.173446 27744 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.137161 27732 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:09:21.174768 27732 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:21.175114 27732 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:21.175880 27732 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:21.163259 27776 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:09:21.179427 27736 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.180228 27698 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:21.180392 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1495) took 1101 ms. Trace:
I20260709 13:09:21.180837 24597 rpcz_store.cc:276] 0709 13:09:20.079480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.079594 (+   114us) service_pool.cc:224] Handling call
0709 13:09:20.079882 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.485116 (+405234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.180148 (+695032us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54001937d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:21.180332 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542557056}
I20260709 13:09:21.181788 27566 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.182253 27566 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.184141 27566 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.184252 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1504) took 1098 ms. Trace:
I20260709 13:09:21.067011 25210 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:21.188918 24593 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:21.172677 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.192399 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.195099 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.189420 27654 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:21.197201 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:21.197978 27566 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:21.197835 27703 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.198141 27718 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.199287 27131 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.204423 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.169270 27735 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.184698 24596 rpcz_store.cc:276] 0709 13:09:20.086209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.418557 (+332348us) service_pool.cc:224] Handling call
0709 13:09:20.485421 (+ 66864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.721623 (+236202us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:20.721824 (+   201us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.920987 (+199163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.921040 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:20.921102 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.183192 (+262090us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b180030e0e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419
0709 13:09:21.184016 (+   824us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54003e8854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:21.184065 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.184194 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79699,"prepare.queue_time_us":466,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":79819,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10627,"spinlock_wait_cycles":560522368,"thread_start_us":119047,"threads_started":1,"wal-append.queue_time_us":144561}
W20260709 13:09:21.216755 24524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.036s	sys 0.072s
I20260709 13:09:21.287503 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 701) took 1018 ms. Trace:
I20260709 13:09:21.190090 27732 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.196265 27708 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.141721 27539 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:21.288002 25213 rpcz_store.cc:276] 0709 13:09:20.269313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.270777 (+  1464us) service_pool.cc:224] Handling call
0709 13:09:20.291434 (+ 20657us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:20.291823 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.291864 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:20.323933 (+ 32069us) log.cc:844] Serialized 52 byte log entry
0709 13:09:20.515733 (+191800us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:20.515770 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.515829 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.287263 (+771434us) raft_consensus.cc:1685] finished
0709 13:09:21.287282 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.287442 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14096,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14107,"thread_start_us":167573,"threads_started":1,"wal-append.queue_time_us":320986}
W20260709 13:09:21.287537 24524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.036s	sys 0.072s
W20260709 13:09:21.278649 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 74282.5us
I20260709 13:09:21.201366 27659 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.201064 27654 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:21.326129 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:21.327762 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:21.304014 27660 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.329445 27539 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:21.363574 27302 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.009s
W20260709 13:09:21.364161 27783 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:09:21.426105 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 302698us
I20260709 13:09:21.349134 27566 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:21.326083 27735 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:09:21.423851 27662 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:21.468178 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.481063 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:21.482040 25210 raft_consensus.cc:2368] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
W20260709 13:09:21.472482 27784 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:09:21.489133 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:21.473364 27785 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:09:21.474887 27654 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.489977 25213 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10.
I20260709 13:09:21.333215 27633 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.536190 24599 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:21.538838 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 737) took 1058 ms. Trace:
I20260709 13:09:21.468752 27302 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.539264 25218 rpcz_store.cc:276] 0709 13:09:20.480620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.064794 (+584174us) service_pool.cc:224] Handling call
0709 13:09:21.065136 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.065870 (+   734us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:21.288221 (+222351us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.538445 (+250224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.538494 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:21.538533 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.538594 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.538764 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":95556,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":27,"thread_start_us":410013,"threads_started":2}
I20260709 13:09:21.542155 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:21.542923 25212 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:21.333498 27747 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:21.558202 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 89518.5us
W20260709 13:09:21.503511 27724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.005s	sys 0.007s
I20260709 13:09:21.566818 24565 leader_election.cc:400] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:21.567201 24565 leader_election.cc:403] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.572983 24523 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.489138 27566 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.574254 24565 leader_election.cc:400] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10.
I20260709 13:09:21.610957 24565 leader_election.cc:403] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.591979 27633 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.595438 27735 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:21.588117 27736 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:21.599339 27747 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.605692 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1320) took 1456 ms. Trace:
I20260709 13:09:21.573550 27654 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:21.567585 27724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.006s	sys 0.008s
W20260709 13:09:21.608095 27763 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.944s	user 0.003s	sys 0.011s
I20260709 13:09:21.622570 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2636) took 1476 ms. Trace:
I20260709 13:09:21.622946 24516 rpcz_store.cc:276] 0709 13:09:20.146567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.189833 (+ 43266us) service_pool.cc:224] Handling call
0709 13:09:20.209618 (+ 19785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.261563 (+ 51945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.261611 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.270143 (+  8532us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.511081 (+240938us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:20.511104 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.511301 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.607533 (+1096232us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:21.622236 (+ 14703us) raft_consensus.cc:1685] finished
0709 13:09:21.622266 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.622506 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16706,"raft.queue_time_us":20731,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":30764,"spinlock_wait_cycles":4023168,"thread_start_us":162042,"threads_started":1,"wal-append.queue_time_us":294473}
I20260709 13:09:21.624372 27629 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:21.615927 24600 rpcz_store.cc:276] 0709 13:09:20.149766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.481561 (+331795us) service_pool.cc:224] Handling call
0709 13:09:20.481892 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:20.553591 (+ 71699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.553637 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:20.554237 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 13:09:21.186548 (+632311us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b18001e6ee0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:09:21.366709 (+180161us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:21.366771 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.366864 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.605406 (+238542us) raft_consensus.cc:1685] finished
0709 13:09:21.605425 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.605630 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73102,"raft.queue_time_us":67689,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6977,"spinlock_wait_cycles":58893696,"thread_start_us":179928,"threads_started":1,"wal-append.queue_time_us":979213}
I20260709 13:09:21.625322 24517 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:21.561386 27660 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:21.614425 27563 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:21.618423 27780 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:09:21.614758 27735 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:21.635521 25212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:21.636169 25212 raft_consensus.cc:606] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:21.636520 25212 raft_consensus.cc:614] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:21.624944 27629 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.639374 27629 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:21.639901 27727 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.630620 27742 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:21.640556 27727 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.640792 27742 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:21.632421 27668 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.001s
I20260709 13:09:21.646137 25219 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:21.609555 27539 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.654480 27465 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.631174 27718 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.658262 27735 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.660012 27566 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.671016 27735 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:21.672821 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.675124 27727 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.675861 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:21.677166 27659 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.677695 27659 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.678481 25213 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:21.679390 25211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1095) took 1403 ms (client timeout 1671 ms). Trace:
W20260709 13:09:21.679764 25211 rpcz_store.cc:269] 0709 13:09:20.276129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.434775 (+158646us) service_pool.cc:224] Handling call
0709 13:09:21.679205 (+1244430us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54005d0f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:21.679336 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1577057664}
I20260709 13:09:21.680071 27659 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.681274 25215 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:21.682754 27719 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.003s
I20260709 13:09:21.683059 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 617) took 1586 ms. Trace:
I20260709 13:09:21.683430 24592 rpcz_store.cc:276] 0709 13:09:20.096691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.474665 (+377974us) service_pool.cc:224] Handling call
0709 13:09:20.510079 (+ 35414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.139846 (+629767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.682852 (+543006us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b540025c954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:21.683006 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390608256}
I20260709 13:09:21.685281 27224 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:21.685659 27224 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:21.686307 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1509) took 1581 ms. Trace:
I20260709 13:09:21.686378 27224 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.686831 24599 rpcz_store.cc:276] 0709 13:09:20.104816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.474876 (+370060us) service_pool.cc:224] Handling call
0709 13:09:20.669234 (+194358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.537647 (+868413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.686080 (+148433us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54001caa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:21.686247 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993344384}
I20260709 13:09:21.687486 27224 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.688215 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:21.688864 25210 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:21.692351 25210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:21.692963 25210 raft_consensus.cc:606] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:21.694545 27731 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.941s	user 0.004s	sys 0.014s
I20260709 13:09:21.697328 27674 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:21.697813 27674 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:21.698225 25210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:21.698868 25210 raft_consensus.cc:606] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:21.699302 25210 raft_consensus.cc:614] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:21.698860 27674 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.700583 27662 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:21.701242 27662 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.701503 27674 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.715728 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:21.716934 27465 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.718202 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:21.722802 27801 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:09:21.728919 26926 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:21.730540 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1101) took 1445 ms. Trace:
I20260709 13:09:21.730953 25215 rpcz_store.cc:276] 0709 13:09:20.284694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.802899 (+518205us) service_pool.cc:224] Handling call
0709 13:09:21.681064 (+878165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.681648 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.730342 (+ 48694us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54005d0f50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:21.730473 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018953984}
W20260709 13:09:21.732919 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.728313 24423 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:21.733381 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.734521 24423 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.736567 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:21.736526 24423 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 3 to 5, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.738539 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.754699 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:21.740048 27613 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.764348 27613 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:21.764937 24593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 620) took 1524 ms (client timeout 1967 ms). Trace:
W20260709 13:09:21.765377 24593 rpcz_store.cc:269] 0709 13:09:20.240993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.249753 (+  8760us) service_pool.cc:224] Handling call
0709 13:09:21.764787 (+1515034us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54001ed7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:21.764883 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556529408}
I20260709 13:09:21.767140 27613 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:21.740955 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 726682us
I20260709 13:09:21.741950 27387 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:21.744264 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.745226 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.746430 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2642) took 1537 ms. Trace:
W20260709 13:09:21.769754 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.770605 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:21.771481 24523 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:21.770025 24524 rpcz_store.cc:276] 0709 13:09:20.208798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.209426 (+   628us) service_pool.cc:224] Handling call
0709 13:09:20.215640 (+  6214us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:20.521322 (+305682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.521354 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:20.606535 (+ 85181us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b2c00000c88. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:09:20.607308 (+   773us) log.cc:844] Serialized 78 byte log entry
0709 13:09:21.306083 (+698775us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:21.491552 (+185469us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.745817 (+254265us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.746020 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.746108 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.746229 (+   121us) raft_consensus.cc:1685] finished
0709 13:09:21.746245 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.746376 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":386827,"prepare.queue_time_us":267664,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":318261,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":8753,"spinlock_wait_cycles":18197248,"thread_start_us":814695,"threads_started":2,"wal-append.queue_time_us":718020}
I20260709 13:09:21.772042 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:21.772825 24520 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:09:21.770510 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.773581 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:21.776223 27387 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.776700 27387 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.776804 27656 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:21.777593 27656 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.780229 24565 leader_election.cc:400] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:21.768939 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:21.781184 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:21.781744 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.782084 27595 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:21.782547 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:21.783648 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:21.784447 25211 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:21.785758 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:21.787356 27718 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:21.787441 27744 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:21.788470 27718 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:21.789005 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:21.789732 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:21.790369 27660 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:21.790769 27660 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:21.791568 27660 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.747730 27435 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:21.749990 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 608375us
I20260709 13:09:21.750495 27525 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.750897 25216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 736) took 1637 ms (client timeout 1554 ms). Trace:
I20260709 13:09:21.751368 27434 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:21.752013 27699 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:21.750946 27596 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:21.797716 27699 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:21.798136 25216 rpcz_store.cc:269] 0709 13:09:20.113136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.115485 (+  2349us) service_pool.cc:224] Handling call
0709 13:09:21.750730 (+1635245us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54005d02d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:21.750823 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449511168}
I20260709 13:09:21.793032 27736 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:21.799345 27736 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:21.800024 27699 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.800140 27736 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.800806 27525 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.801430 27736 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.802642 27662 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.755343 27742 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.757295 27747 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:21.762125 27757 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.128s	user 0.006s	sys 0.006s
W20260709 13:09:21.762989 24637 connection.cc:256] RPC call timeout handler was delayed by -1.0928485870000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2535s for a response
I20260709 13:09:21.763504 27552 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:21.782622 27595 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.805969 27552 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.746476 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2647) took 1505 ms. Trace:
I20260709 13:09:21.806900 24517 rpcz_store.cc:276] 0709 13:09:20.241333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.292571 (+ 51238us) service_pool.cc:224] Handling call
0709 13:09:20.332286 (+ 39715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.629289 (+1297003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.746261 (+116972us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540006d1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:21.746414 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973156096}
I20260709 13:09:21.792718 27387 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.809053 27435 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:21.806535 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.811739 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.811941 27561 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.812410 27545 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.808249 27552 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.813488 27552 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.812458 27561 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.814489 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.813264 27545 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:21.803020 27525 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:21.815490 27561 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:21.804852 24637 connection.cc:256] RPC call timeout handler was delayed by -1.0635561290000624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 13:09:21.821264 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:21.805449 27595 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:21.790361 24522 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:21.822579 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:21.805518 27596 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.819482 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:21.824277 24519 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.824775 27596 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:21.825742 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:21.826309 25219 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:21.792770 27660 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:21.834110 27775 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:21.835153 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 52688.3us
I20260709 13:09:21.819013 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:21.746455 27741 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:21.837536 27775 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:21.837677 27250 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.838086 27775 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:21.838209 27250 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.838958 27775 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.840349 27250 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:21.840905 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 86267.8us
I20260709 13:09:21.841840 27250 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:21.843130 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:21.843333 27250 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:21.843988 27673 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.844322 24491 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:21.846155 27747 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:21.846537 27747 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:21.846899 27747 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.843817 27250 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:21.851017 27781 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.853892 27434 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:21.856801 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:21.857868 24598 raft_consensus.cc:2410] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:21.862330 27387 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:21.863193 27387 consensus_queue.cc:1243] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:21.864063 27613 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:21.864682 27613 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:21.865680 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:21.865281 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:21.866838 24522 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:21.864719 24521 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:21.738456 24423 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 5, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.875304 27741 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:21.875916 27741 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.878569 27741 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:21.879624 27595 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:21.881259 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:21.914682 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:21.884364 24519 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:21.874547 24423 catalog_manager.cc:5697] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 4, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 4 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:21.852473 27250 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.860423 27673 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.850186 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:21.915500 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 130167us
I20260709 13:09:21.915977 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:21.925252 24667 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:21.901849 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:21.915465 24665 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.910441 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:21.929118 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:21.933377 24673 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:21.937779 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:21.940232 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.932247 24423 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 6, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 6 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:21.942662 25219 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:21.944310 24673 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:21.945422 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 43647.7us
I20260709 13:09:21.946219 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:21.948237 24598 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:21.942965 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:21.948810 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 98713.3us
I20260709 13:09:21.951536 24598 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:21.952870 24665 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:21.954334 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:21.955090 24600 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:21.949589 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:21.948261 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:21.913645 27563 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10.
I20260709 13:09:21.962370 24517 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:21.965227 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:21.965827 25217 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:21.913347 27545 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:21.913589 27781 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:21.916129 27569 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.916186 27435 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.970096 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:21.975099 27552 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:09:21.947857 27699 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:21.973534 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 152484us
I20260709 13:09:21.963778 27654 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.963990 27302 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:21.980338 24599 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:21.967044 27596 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.971122 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:21.868381 27613 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:21.989729 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:21.962296 27539 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:22.010391 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:21.973322 24423 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 3, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 3 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:22.002548 24593 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:21.999634 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.995369 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:21.996678 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:21.964564 27771 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.928778 27561 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:21.915946 27741 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:09:21.925861 27724 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:21.970100 27525 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.973976 27673 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:22.025293 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:22.026966 24594 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:21.999532 24491 connection.cc:256] RPC call timeout handler was delayed by -1.897716403000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:09:21.975268 27250 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.999959 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:22.032603 25217 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:21.974867 27660 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:21.973047 27806 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:21.993350 24637 connection.cc:256] RPC call timeout handler was delayed by -1.0091635170000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
I20260709 13:09:22.000633 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:22.026331 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.000603 27654 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:22.018436 24423 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 3 to 4, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 4 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.999347 27302 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.030284 24525 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.037367 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:22.036906 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.005816 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:22.041435 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:22.045670 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:22.061123 25211 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:22.046288 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:22.068059 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62334.7us
I20260709 13:09:22.068228 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:22.068495 24594 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:22.068737 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:21.976333 27545 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.018378 27733 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.053035 25215 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:22.045897 24665 raft_consensus.cc:2410] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:22.040256 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:22.066701 24523 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.074007 24423 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 6, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 6 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.074364 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:21.993546 27781 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.078850 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:22.023027 27744 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:22.079722 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:21.998060 27435 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.067260 24519 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:22.090202 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.010051 27661 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:09:22.033447 27561 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:22.084949 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:22.085119 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.100219 24520 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.100337 24525 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:22.066883 27654 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.075525 27302 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:22.088476 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:22.091262 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.113101 24519 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:22.091841 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.092538 27387 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:22.014285 27732 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:22.045512 27552 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:22.083755 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:22.118287 24523 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:22.099241 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:22.099452 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:22.000583 27699 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.101541 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.016525 27633 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:22.031936 27566 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:22.106420 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:22.001844 27224 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:09:22.125274 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:22.097911 27724 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:22.076375 27698 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:22.012213 27596 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.047286 27434 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:22.112793 24423 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:22.095726 27704 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:22.114579 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:22.118031 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.033699 27525 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.033273 27656 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:22.118786 24595 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:22.118948 24665 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:22.119442 24669 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 13:09:22.121805 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 132180us
I20260709 13:09:22.115921 27744 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:22.089540 27465 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.010736 27539 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.067199 27806 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.130896 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:22.112744 27790 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:22.184659 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53852.5us
I20260709 13:09:22.134078 24671 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.174304 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:22.127847 27724 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.083299 27733 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.195762 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:22.203008 24665 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:22.112135 27638 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:09:22.076789 27747 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:22.187824 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:22.189198 24517 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:22.190026 24674 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:22.134270 27629 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:22.130179 27634 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:09:22.184274 27539 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.182333 27662 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:22.125309 27563 raft_consensus.cc:2764] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:09:22.224054 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 119433us
I20260709 13:09:22.181663 27465 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:22.228065 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:22.126659 27732 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.186657 27790 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:22.188249 27660 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.246984 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:22.243187 24668 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:22.261794 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 82520.3us
I20260709 13:09:22.262161 24521 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:22.243752 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.253520 24671 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10.
I20260709 13:09:22.202490 27818 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.171906 27698 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.201125 27724 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:22.188481 27656 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:22.179307 27434 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.209255 24423 catalog_manager.cc:5697] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 3 to 5, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129), pending config changed. New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:22.262995 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:22.265841 24516 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:22.259903 27811 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:09:22.275799 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:22.227648 27704 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:22.249459 27629 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:22.299095 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.222429 27592 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:22.324271 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.241708 27569 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:09:22.325193 24667 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.349905 24517 raft_consensus.cc:2368] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6.
I20260709 13:09:22.257650 27465 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.332860 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:22.342784 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.275472 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:22.351785 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 98594.3us
I20260709 13:09:22.330119 24668 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
W20260709 13:09:22.324580 27803 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:09:22.266808 27822 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:22.355362 27629 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:22.403463 27822 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.342448 27704 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:22.405723 27704 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.409324 24520 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:22.368983 24596 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:22.353039 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:22.189060 27561 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.356418 24423 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:09:22.362283 27817 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:22.369840 27596 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:22.373647 27435 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:22.275857 27744 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.390002 27806 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:22.392407 24592 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
W20260709 13:09:22.393355 27805 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:09:22.498911 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:22.394871 27816 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.499670 24671 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:22.399632 24524 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:22.400763 27733 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:22.275070 27818 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.401638 27790 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.427804 24667 raft_consensus.cc:2410] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:09:22.491025 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 138110us
W20260709 13:09:22.380335 27807 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:09:22.496706 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:22.521232 24666 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:22.501873 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:22.502997 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:22.504287 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 241369us
W20260709 13:09:22.506021 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 250183us
I20260709 13:09:22.527148 24524 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:22.411619 27656 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:22.354852 27592 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.529212 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:22.405730 27822 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:22.570113 24672 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:22.530380 24423 catalog_manager.cc:5697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 3, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:22.271059 27660 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.538610 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:22.551719 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:22.496318 27821 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:22.523528 27545 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:22.565896 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:22.506852 27673 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:22.505466 27435 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:22.604972 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:22.584134 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.557096 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:22.609308 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52344us
I20260709 13:09:22.602499 24423 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 3 to 4, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:22.612340 24423 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:22.614485 24423 catalog_manager.cc:5697] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 3, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:22.559018 24591 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:22.599561 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 403900us
I20260709 13:09:22.603382 24599 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:22.616405 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.593411 24665 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:22.616938 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.618162 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.623096 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.624490 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.503427 27596 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:09:22.498235 27724 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.629245 24517 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:22.633796 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.575753 27699 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:22.524381 27816 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:22.653347 25217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.014s	sys 0.017s
W20260709 13:09:22.748329 25217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.014s	sys 0.018s
I20260709 13:09:22.590378 27821 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.598785 27668 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:22.606338 27698 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:22.626976 27563 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:22.667682 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:22.674088 27656 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:22.674721 27819 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:09:22.677024 27592 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:22.677642 27613 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:22.678447 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2652) took 1737 ms. Trace:
I20260709 13:09:22.678750 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.678848 27525 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:22.654178 27822 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:22.679813 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:22.681219 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.682718 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.684024 27818 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:22.650138 27781 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:22.689502 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 161004us
I20260709 13:09:22.650543 27435 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:22.701000 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:22.666003 27747 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:22.710654 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.731447 27831 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:22.733100 24670 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:22.617267 24423 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 3, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 3 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:09:22.736393 27250 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.003s
W20260709 13:09:22.796373 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.888904 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:22.889855 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:22.915421 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:22.891247 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 190333us
I20260709 13:09:22.892678 24519 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:22.917865 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 344548us
I20260709 13:09:22.919181 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:22.797843 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:22.709810 27830 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:22.739624 27434 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:22.806874 24671 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:22.860013 27733 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:22.806764 27821 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:22.795307 27552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.012s	sys 0.033s
I20260709 13:09:22.869879 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:22.858103 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:22.871605 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:22.872925 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:22.940028 25210 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:22.940662 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:22.940774 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:22.867125 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:22.941530 24517 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:22.884986 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 627) took 1065 ms. Trace:
I20260709 13:09:22.888844 24520 raft_consensus.cc:1217] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-4.3]   Dedup: 4.3->[]
W20260709 13:09:22.921195 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.894603 24423 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 4, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 4 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:22.895339 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2664) took 1026 ms. Trace:
I20260709 13:09:22.913664 24674 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:22.885264 24518 rpcz_store.cc:276] 0709 13:09:20.941356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.941499 (+   143us) service_pool.cc:224] Handling call
0709 13:09:20.947710 (+  6211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.948094 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.948123 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.750405 (+802282us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b2c00000c88. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:09:21.750798 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.992091 (+241293us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:22.010451 (+ 18360us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.015979 (+  5528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.016054 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.678125 (+662071us) raft_consensus.cc:1685] finished
0709 13:09:22.678226 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.678379 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14707,"prepare.queue_time_us":19785,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":9240,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":9793,"spinlock_wait_cycles":12946816,"thread_start_us":240884,"threads_started":1,"wal-append.queue_time_us":324826}
I20260709 13:09:22.942749 24520 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:22.870497 27704 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:22.885737 24523 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 8: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:22.925016 27683 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:22.937204 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:22.886909 27566 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:22.973464 24519 raft_consensus.cc:2376] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8. Re-sending same reply.
I20260709 13:09:22.945235 25210 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:22.942332 24592 rpcz_store.cc:276] 0709 13:09:21.819629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.821003 (+  1374us) service_pool.cc:224] Handling call
0709 13:09:22.884747 (+1063744us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540021be54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:22.884900 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369763712}
I20260709 13:09:22.893358 27831 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:22.952630 27834 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:09:22.952654 25216 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:22.890625 27435 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:22.897604 27771 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:22.954628 27465 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:09:22.954566 24423 catalog_manager.cc:5697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 3, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 3 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.927750 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:22.956158 24521 rpcz_store.cc:276] 0709 13:09:21.868510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.868632 (+   122us) service_pool.cc:224] Handling call
0709 13:09:21.868898 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.262656 (+393758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.895105 (+632449us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540011dd54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:22.895274 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891722624}
W20260709 13:09:22.956717 27539 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.000s
I20260709 13:09:22.887506 27816 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:22.960517 24525 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:22.920396 27674 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.895637 27302 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.772s	user 0.005s	sys 0.005s
I20260709 13:09:22.893532 27660 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:22.933848 27822 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.892849 27781 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:22.979151 27566 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.877594 27838 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.938783 27552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.012s	sys 0.039s
I20260709 13:09:23.005861 24523 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:23.007614 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 64329us
W20260709 13:09:23.008284 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 80603.1us
I20260709 13:09:23.027269 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.010277 25215 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:22.998535 27629 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.001s
I20260709 13:09:22.931265 27631 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:09:23.019804 24423 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:23.033977 24423 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 5, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.003988 27771 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:22.941063 27733 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.006896 27845 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.029390 27654 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.904s	user 0.012s	sys 0.000s
I20260709 13:09:23.030453 27552 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:23.018949 26926 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.022372 27699 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:23.051853 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.052085 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 711) took 1115 ms. Trace:
I20260709 13:09:23.052978 25211 rpcz_store.cc:276] 0709 13:09:21.937158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.068788 (+131630us) service_pool.cc:224] Handling call
0709 13:09:22.069110 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.088758 (+ 19648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.088807 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.089412 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.581683 (+492271us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.581846 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.581926 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.051884 (+469958us) raft_consensus.cc:1685] finished
0709 13:09:23.051903 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.052030 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9739,"raft.queue_time_us":22939,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"thread_start_us":451775,"threads_started":1,"wal-append.queue_time_us":610982}
I20260709 13:09:23.063162 24637 leader_election.cc:400] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6.
I20260709 13:09:23.066309 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.019512 27465 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.022092 27539 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.042215 27629 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:23.089560 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 479252us
I20260709 13:09:23.090670 27660 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:23.083636 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.032160 27674 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.064877 27781 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.048830 27831 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:23.035434 27302 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.067864 27830 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:23.092110 25182 leader_election.cc:336] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.737s (SENT)
I20260709 13:09:23.047693 27847 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:09:23.063862 24517 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:23.121590 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1576) took 1034 ms. Trace:
I20260709 13:09:23.051118 27838 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:23.092084 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 215265us
I20260709 13:09:23.088021 27699 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.100059 25218 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:23.101367 27465 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.101991 24524 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:23.102478 27659 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:23.102962 27732 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:23.112191 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.112340 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.116634 24522 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:09:23.117859 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.137238 24522 pending_rounds.cc:85] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 5
I20260709 13:09:23.058521 26926 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.076488 27727 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:23.050443 27654 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.121922 24517 rpcz_store.cc:276] 0709 13:09:22.087010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.796732 (+709722us) service_pool.cc:224] Handling call
0709 13:09:23.121513 (+324781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.099162 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.110536 27592 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.125945 24516 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:23.109313 27824 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.050195 27845 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.144145 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.144969 24672 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:23.133556 24666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.013s
I20260709 13:09:23.092844 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.137537 24522 pending_rounds.cc:107] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:09:23.146639 24522 raft_consensus.cc:2889] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:23.138442 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.121491 27724 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:23.146775 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 54003.5us
W20260709 13:09:23.147591 24666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.007s	sys 0.013s
I20260709 13:09:23.152748 27856 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:23.161773 27856 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.164036 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 669) took 1076 ms. Trace:
I20260709 13:09:23.164403 24667 rpcz_store.cc:276] 0709 13:09:22.087999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.088223 (+   224us) service_pool.cc:224] Handling call
0709 13:09:23.163858 (+1075635us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400046fd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:23.163983 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488703360}
I20260709 13:09:23.166307 24598 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.167837 24665 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:23.160585 27733 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.174932 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 753) took 1247 ms. Trace:
I20260709 13:09:23.175354 25219 rpcz_store.cc:276] 0709 13:09:21.927389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.027452 (+100063us) service_pool.cc:224] Handling call
0709 13:09:23.174734 (+1147282us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540066b2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:23.174873 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2321559808}
I20260709 13:09:23.177225 27224 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:23.177757 27224 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:23.178014 27674 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:23.178740 27848 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:09:23.178910 27224 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.133435 27659 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:23.181730 27659 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.182845 27659 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.148231 27781 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.149171 27592 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.136812 27552 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.188170 27845 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.190114 27704 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:23.141734 27727 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:23.191922 27727 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.192560 27302 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.193131 27727 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.197273 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.198139 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.201833 24667 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:23.180871 27224 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.155319 27250 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:23.215747 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2670) took 1082 ms. Trace:
W20260709 13:09:23.216418 27813 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.862s	user 0.002s	sys 0.000s
I20260709 13:09:23.217517 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.203542 27718 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:23.216212 24520 rpcz_store.cc:276] 0709 13:09:22.133266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.951157 (+817891us) service_pool.cc:224] Handling call
0709 13:09:22.951738 (+   581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.021185 (+ 69447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.021239 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.024374 (+  3135us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.135661 (+111287us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.135704 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.135772 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.215539 (+ 79767us) raft_consensus.cc:1685] finished
0709 13:09:23.215564 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.215691 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73619,"raft.queue_time_us":69922,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11447,"spinlock_wait_cycles":337280,"thread_start_us":110694,"threads_started":1,"wal-append.queue_time_us":187721}
I20260709 13:09:23.228504 27744 raft_consensus.cc:1064] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:09:23.229950 27741 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.232332 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 712) took 1294 ms. Trace:
I20260709 13:09:23.246455 25217 rpcz_store.cc:276] 0709 13:09:21.938406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.074135 (+135729us) service_pool.cc:224] Handling call
0709 13:09:22.077798 (+  3663us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:22.078167 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:22.748752 (+670585us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.019833 (+271081us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:23.025955 (+  6122us) log.cc:844] Serialized 52 byte log entry
0709 13:09:23.026129 (+   174us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:23.026575 (+   446us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.026770 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.026858 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.161470 (+134612us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b1800460240. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:09:23.232096 (+ 70626us) raft_consensus.cc:1685] finished
0709 13:09:23.232122 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.232272 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9806,"prepare.queue_time_us":17178,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":2719,"raft.queue_time_us":35956,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":9248,"spinlock_wait_cycles":4264832,"thread_start_us":818673,"threads_started":2,"wal-append.queue_time_us":407985}
I20260709 13:09:23.232777 26926 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.235011 27566 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.245313 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.217757 27629 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.258088 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 710) took 1346 ms. Trace:
I20260709 13:09:23.259865 24674 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:23.211820 27838 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.260736 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.265614 24667 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:23.262744 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.222483 27250 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:23.261845 25214 rpcz_store.cc:276] 0709 13:09:21.911993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.912106 (+   113us) service_pool.cc:224] Handling call
0709 13:09:21.912468 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:21.923436 (+ 10968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.923467 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.928876 (+  5409us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.115679 (+186803us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:22.115736 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.115823 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.407678 (+291855us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b48001b06d8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:09:23.215886 (+808208us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:23.245607 (+ 29721us) raft_consensus.cc:1685] finished
0709 13:09:23.245638 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.258019 (+ 12381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10870,"raft.queue_time_us":7744,"raft.run_cpu_time_us":4234,"raft.run_wall_time_us":483487,"spinlock_wait_cycles":38873216,"thread_start_us":140168,"threads_started":1,"wal-append.queue_time_us":278076}
I20260709 13:09:23.264395 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.268431 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.274943 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.275609 24669 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:23.276197 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:23.276787 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.278750 24596 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:23.260637 27741 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.281896 27741 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.282572 27852 raft_consensus.cc:993] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:09:23.283650 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 667) took 1251 ms. Trace:
I20260709 13:09:23.284016 24673 rpcz_store.cc:276] 0709 13:09:22.031851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.033924 (+  2073us) service_pool.cc:224] Handling call
0709 13:09:22.034186 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.226018 (+191832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.226045 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.226084 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:22.226112 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.283405 (+1057293us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001397d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:23.283454 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.283591 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440731904}
I20260709 13:09:23.285753 24593 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:23.285890 27465 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:23.287999 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2750) took 1104 ms. Trace:
I20260709 13:09:23.236575 27718 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.288686 27465 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:23.288481 24671 rpcz_store.cc:276] 0709 13:09:22.183998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.636155 (+452157us) service_pool.cc:224] Handling call
0709 13:09:22.646784 (+ 10629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.925480 (+278696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.287703 (+362223us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000479d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:23.287904 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367354624}
I20260709 13:09:23.293309 24672 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:23.295660 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.298092 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.300468 27863 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.303138 27863 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.307948 27863 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.311892 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.313062 27869 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.289594 27465 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.313669 27869 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.315968 27869 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.288555 27566 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.327099 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.327728 24668 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.329421 27673 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.311050 27718 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.329874 27673 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.330071 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.310453 27633 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:09:23.330716 24517 raft_consensus.cc:2376] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6. Re-sending same reply.
I20260709 13:09:23.331100 27633 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:23.331467 27633 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:23.331638 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.319648 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.332741 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.333410 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.334088 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.334707 24525 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:23.333619 24521 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:23.335970 27539 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.336143 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:23.337949 24674 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:23.339270 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.340689 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2749) took 1159 ms. Trace:
I20260709 13:09:23.341161 27552 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.341066 24665 rpcz_store.cc:276] 0709 13:09:22.181188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.617611 (+436423us) service_pool.cc:224] Handling call
0709 13:09:23.167614 (+550003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.168378 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.340505 (+172127us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400046fd0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:23.340633 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264124160}
I20260709 13:09:23.341710 27552 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.329674 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.344501 27552 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.346747 27858 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:23.347651 27771 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.348678 27771 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.349624 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.350214 24519 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:23.348618 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.350984 27250 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.352602 27668 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:23.353058 27668 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.354215 27465 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.356465 27595 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.320807 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.358953 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:23.360062 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.364068 24519 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.360695 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.360737 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:23.363142 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.365598 24672 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 6: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:23.367559 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.369695 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.371342 24672 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:23.371270 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.372112 24673 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.373956 24665 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:23.374071 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.374637 24668 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:23.373376 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.374859 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.375420 24671 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:23.376401 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.376902 24671 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.380497 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.382253 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.382886 24523 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:23.383674 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:23.384057 24521 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.366133 27736 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.387423 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1577) took 1183 ms. Trace:
I20260709 13:09:23.387075 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.387910 24516 rpcz_store.cc:276] 0709 13:09:22.203769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.680911 (+477142us) service_pool.cc:224] Handling call
0709 13:09:23.387225 (+706314us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540021dc54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:23.387372 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541165312}
I20260709 13:09:23.389262 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 633) took 1354 ms. Trace:
I20260709 13:09:23.389777 24524 rpcz_store.cc:276] 0709 13:09:22.034591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.624213 (+589622us) service_pool.cc:224] Handling call
0709 13:09:23.388989 (+764776us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54003ddbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:23.389181 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829698816}
I20260709 13:09:23.392433 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.393206 24518 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:23.394692 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.404563 24673 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:23.407577 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.411862 27839 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.412322 27839 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:23.412708 27839 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.414191 27654 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.415932 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1324) took 1390 ms. Trace:
I20260709 13:09:23.416359 24598 rpcz_store.cc:276] 0709 13:09:22.034902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.035030 (+   128us) service_pool.cc:224] Handling call
0709 13:09:22.035278 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.196818 (+1161540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.415706 (+218888us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001932d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:23.415872 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600582528}
I20260709 13:09:23.419037 27727 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:23.420583 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.422770 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.423599 24600 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:23.423190 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.428229 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.428938 24600 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:23.433802 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2665) took 1564 ms. Trace:
I20260709 13:09:23.434326 24522 rpcz_store.cc:276] 0709 13:09:21.869300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.874769 (+  5469us) service_pool.cc:224] Handling call
0709 13:09:21.875048 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.147261 (+1272213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.433518 (+286257us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54003ae8d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:23.433730 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854565248}
I20260709 13:09:23.448441 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.383249 26926 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.449390 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.427155 27633 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.453492 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.386353 27387 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.422955 27847 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.408519 27736 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.454187 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.456182 24525 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:23.456779 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.438206 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.486661 24519 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:23.387928 27435 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.387773 27539 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.492811 24598 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:23.493058 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 70022.4us
I20260709 13:09:23.472092 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.453574 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.494335 24517 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:23.494302 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.473551 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.476676 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.498373 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.499317 24594 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:23.469661 27662 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:23.386986 27718 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:23.480115 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:23.480886 27821 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.004s
I20260709 13:09:23.500496 24671 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:23.477010 24521 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:23.505215 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.460069 27830 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.491809 27595 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:23.483222 27842 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:23.543258 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 181271us
I20260709 13:09:23.502286 27847 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.499850 27434 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.549033 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:23.551518 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 46466us
I20260709 13:09:23.566076 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.502039 27662 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.512051 27822 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.552141 27595 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.577930 27736 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.578442 27847 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.553498 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.554363 27592 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.567607 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.488181 26926 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.565665 24595 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:23.513064 27633 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.501847 27539 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:23.552083 27866 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:09:23.512974 27843 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.513160 27465 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.581534 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.552228 27842 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:23.581656 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:23.582111 27387 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.545257 27821 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.570472 27662 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.501358 27435 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.583694 27847 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.607527 27387 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:23.613392 27435 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:23.613489 27387 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.563488 27790 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.582858 27865 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.568820 27775 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.540555 27718 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.604861 27465 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.604998 27856 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.605540 27842 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.601709 27843 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.616072 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.625401 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:23.644250 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.630752 27870 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:23.660425 27856 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.665401 24598 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:23.667825 27539 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.627282 27744 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:23.669291 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 43984.5us
I20260709 13:09:23.621542 27736 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:09:23.623075 27595 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.675830 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.679555 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.623261 27869 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:09:23.622881 27563 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:09:23.704684 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 120817us
I20260709 13:09:23.706911 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.709951 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:23.719251 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 594129us
I20260709 13:09:23.720283 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:23.721293 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.630455 27654 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:09:23.726437 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 634307us
W20260709 13:09:23.726953 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47548.8us
I20260709 13:09:23.728660 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.642163 27465 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.689316 27868 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:23.690570 27775 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.729287 24491 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:23.755102 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.756886 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:23.725518 27250 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.733029 27595 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.729797 27842 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.751673 27865 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:23.733423 27732 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:23.769945 27865 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.692421 27668 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.769996 27679 raft_consensus.cc:1081] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:09:23.730273 27398 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:23.772713 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61922.5us
W20260709 13:09:23.777511 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56322.5us
I20260709 13:09:23.786094 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.770296 27879 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:23.786576 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.781889 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:23.782581 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54000.2us
I20260709 13:09:23.789099 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.769686 27595 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:23.783483 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.762184 27674 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:23.754207 27741 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:23.769425 27662 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.794039 27741 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:23.794709 27741 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:23.759593 27868 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.795820 27741 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.797019 27868 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.797655 27868 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:23.799687 27679 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:23.800251 27679 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:23.801177 27679 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.801522 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:23.760507 27775 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.806519 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:23.777664 27865 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.805703 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:23.765039 27863 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:09:23.777158 27566 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.817026 27569 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:23.814814 27878 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:09:23.815871 25219 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.816612 27841 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.784530 27561 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.822402 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.837301 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.819648 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.838402 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.790903 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.789872 27828 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.807256 27595 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.844283 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.845165 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:23.840961 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 112154us
I20260709 13:09:23.843266 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:23.844484 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.794728 27662 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.846345 24518 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:23.846629 24523 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:23.849779 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.846362 24519 raft_consensus.cc:2368] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
W20260709 13:09:23.864513 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 73692.5us
I20260709 13:09:23.857384 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.872967 24524 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:23.873705 24517 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:23.858322 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.873939 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.811298 27879 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:23.781625 27885 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:23.821978 27659 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.879577 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:23.898802 24519 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:23.857842 27673 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.001s
I20260709 13:09:23.840626 27842 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.858536 27656 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.840706 27718 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.908594 24597 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:23.909148 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.910478 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.940274 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.940331 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.941164 24667 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:23.839794 26926 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.912091 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.893611 27736 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:23.944351 24518 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:23.912911 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.944995 24673 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:23.945330 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.912117 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.946005 24519 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:23.913460 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:23.947029 24520 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:23.921825 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.922154 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:23.947757 24516 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.855048 27843 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.927608 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.948858 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.950762 25219 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:23.851680 27821 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.953480 25215 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:23.938727 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.906147 27732 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.911141 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.956043 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:23.813433 27674 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.959530 27674 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.942408 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:23.916882 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:23.937783 27660 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.896394 27539 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:23.856423 27771 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
W20260709 13:09:23.961701 27887 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:09:23.906493 27841 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.951150 24668 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.948019 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.903630 27561 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.858743 27629 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:09:23.953166 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.971995 24593 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:23.912670 27673 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:23.940457 24671 raft_consensus.cc:2376] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5. Re-sending same reply.
I20260709 13:09:23.950974 24672 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
W20260709 13:09:23.966568 27839 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.001s
I20260709 13:09:23.955714 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:23.975373 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:23.954793 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:23.957206 27727 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:23.976089 25212 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.957377 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:23.963267 24674 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:23.963428 24669 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.964237 24518 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:23.878208 27888 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:23.943852 24670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:52138
I20260709 13:09:23.980135 24670 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:23.980611 24670 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.939689 27838 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.893589 27668 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:23.968032 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:23.946934 27654 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:23.921133 27224 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:23.954761 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:23.969700 27736 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:23.979324 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:23.985639 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:23.986114 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:23.987732 24668 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
W20260709 13:09:23.974104 27874 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.384s	user 0.000s	sys 0.004s
I20260709 13:09:23.973587 24671 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:23.993287 25216 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:23.983078 27888 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.994444 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:23.996856 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.015949 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:23.971521 27561 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:23.987085 27465 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.012180 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.019208 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:23.995501 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:23.978775 27727 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:24.016588 24517 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.971752 27732 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:24.016804 25215 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.975704 27539 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:23.968812 27660 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:23.999213 27868 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:23.993929 27838 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.026763 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:24.027447 25219 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:24.029104 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.044863 25216 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:24.018770 27561 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.054226 27387 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.014659 27563 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.070462 25215 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:24.036659 27660 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.036873 25212 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:24.072758 24517 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:24.054034 27673 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:23.976688 27839 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.073791 25212 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:24.074232 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 429707us
I20260709 13:09:24.076058 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:24.078811 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.080194 25211 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:24.046554 24670 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.041884 27727 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.083560 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.084442 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.084751 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.083961 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.085529 24674 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:23.998590 27654 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.053365 27595 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.054015 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.086899 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.018301 27888 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.088106 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:24.072257 27563 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.059579 27851 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.059777 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:24.053321 27224 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.060793 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:23.964573 27879 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:24.032306 27539 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.030359 27732 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:24.071429 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:24.042661 27880 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:09:24.090164 27744 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.040748 27841 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.043457 27868 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.051127 24516 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:24.084883 24670 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.085650 24668 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:24.089325 27662 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.071281 27775 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.058943 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.090323 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.103999 24516 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:24.104061 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:24.091310 27563 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.093215 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:24.080225 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:24.094542 27732 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:24.097548 27822 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.047130 24522 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:24.086501 27660 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:09:24.093108 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.105293 24519 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:24.105062 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.105290 24517 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:24.106139 24516 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:24.082000 27698 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:09:24.082451 27889 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:09:24.110523 25210 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:24.073882 27736 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.103186 27868 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.107017 27843 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.127521 25218 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 8 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:09:24.131819 27894 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:09:24.131955 24637 leader_election.cc:400] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:24.113684 27662 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.133329 27662 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:24.133844 27662 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:24.137611 27895 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:09:24.139281 27699 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:24.143162 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.120802 27595 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.094803 27851 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.194280 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.194986 25214 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:24.112910 27744 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:24.193949 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:24.201241 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68206.8us
W20260709 13:09:24.201529 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 58448.5us
I20260709 13:09:24.202207 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.139096 27732 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.208690 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.209263 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.209497 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.210222 24671 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:24.211807 24670 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:24.212110 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.212623 24672 raft_consensus.cc:2376] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6. Re-sending same reply.
I20260709 13:09:24.212847 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.213532 24670 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10.
I20260709 13:09:24.213423 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.214205 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.214326 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.214776 24670 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:24.215641 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.220459 27683 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.232167 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.206609 27830 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:09:24.232824 24668 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:24.234961 25216 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:24.203361 27843 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.194784 27629 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:24.249823 24674 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:24.222177 27744 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:24.229686 27698 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:24.186149 27818 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:09:24.278748 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 76605.8us
I20260709 13:09:24.253786 27843 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:24.279667 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.229317 27858 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:09:24.269930 27838 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.282047 27843 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.233486 27561 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.284623 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.292484 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.293066 24668 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.267786 27387 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.287371 27654 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:24.298026 27906 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:09:24.301934 27865 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.258549 27629 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.304339 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.286020 27698 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.288830 27839 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:24.320621 25212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "182cc63718a84173a76583588f193929"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:24.321715 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.325696 25212 raft_consensus.cc:606] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:24.326077 25212 raft_consensus.cc:614] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:24.324707 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.329835 24665 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.334954 24668 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:24.336884 24665 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:24.339116 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:24.339596 24520 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
W20260709 13:09:24.356593 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 252827us
I20260709 13:09:24.326345 27858 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:24.362064 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:24.359485 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:24.359184 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:24.362967 24517 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.362864 24520 raft_consensus.cc:2368] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13.
I20260709 13:09:24.368741 24517 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:24.370187 24517 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:24.337702 27839 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:24.416402 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 94777us
W20260709 13:09:24.364647 27907 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:09:24.421062 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:24.421375 24563 leader_election.cc:400] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13.
I20260709 13:09:24.421654 24563 leader_election.cc:403] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:24.422281 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.423889 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.335990 27818 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:09:24.414932 27736 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.445767 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:24.419837 27865 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.441514 27839 raft_consensus.cc:2764] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:24.340394 27744 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.445797 27741 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.445982 27851 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:24.465780 27660 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:24.451843 27736 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.470098 27920 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:24.470662 25212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:24.515110 25212 raft_consensus.cc:606] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:24.515625 25212 raft_consensus.cc:614] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:24.486958 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.471530 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:24.441957 27908 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:09:24.575299 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:24.576933 24517 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:24.477916 27911 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:09:24.592589 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.016s	sys 0.067s
W20260709 13:09:24.593171 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.016s	sys 0.067s
W20260709 13:09:24.593896 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 505838us
I20260709 13:09:24.594820 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.596349 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:24.514906 27736 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.604403 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:24.607987 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:24.575924 27660 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:24.577967 27832 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.515069 27888 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.606896 27654 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:24.623386 24672 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:24.610489 27908 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.612161 27890 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.615984 27595 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:24.612505 27561 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.641675 27921 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:09:24.645498 27699 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:24.645980 27699 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:24.646903 27699 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.648331 27699 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.650149 27844 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:24.620512 27832 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.653530 27660 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.631078 27908 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:24.656424 27908 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.657420 25212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:24.658198 25212 raft_consensus.cc:606] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:24.658601 25212 raft_consensus.cc:614] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:24.662629 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.663468 25217 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:24.650595 27844 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:24.664098 27662 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.002s
I20260709 13:09:24.664626 27727 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.668292 27704 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:24.668864 27704 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.670878 27704 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:24.670998 24672 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:24.671789 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:24.674032 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.675347 24517 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:24.676898 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:24.664348 27844 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.624229 27629 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.630223 27890 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:24.679126 27563 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.001s
I20260709 13:09:24.664708 27662 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:24.696995 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 273182us
I20260709 13:09:24.686460 27890 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.698357 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.697017 25218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:24.703841 27662 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.706103 27888 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.720863 25218 raft_consensus.cc:606] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:24.707216 27868 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.003s
I20260709 13:09:24.721346 25218 raft_consensus.cc:614] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:24.721519 27868 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.720506 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.723114 27858 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:24.723237 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.695873 27844 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.723978 27833 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:24.724805 27833 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.685350 27846 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:24.718030 27919 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.690816 27683 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.731492 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.727628 27919 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.729660 27839 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:24.730216 27699 raft_consensus.cc:2764] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:24.692763 27563 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:24.737910 27864 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.056s	user 0.008s	sys 0.003s
I20260709 13:09:24.739176 27563 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.741549 27839 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:24.741951 27839 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:24.742944 27839 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.744279 27839 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.733400 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:24.747334 25218 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:24.747763 25218 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:24.712822 27741 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13.
W20260709 13:09:24.735291 27822 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.001s
I20260709 13:09:24.750324 27822 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:24.726605 27846 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.752053 24523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:09:24.752679 24523 raft_consensus.cc:606] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Received request to transfer leadership
I20260709 13:09:24.752874 27846 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:24.723572 27858 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:24.755977 27858 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.756886 27890 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.757339 27858 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.765846 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:24.748761 25218 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.769276 25218 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.770751 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2748) took 2592 ms. Trace:
I20260709 13:09:24.712922 27908 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.723541 27868 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.771150 24666 rpcz_store.cc:276] 0709 13:09:22.174043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.601464 (+427421us) service_pool.cc:224] Handling call
0709 13:09:22.601841 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.151218 (+549377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.151262 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.151835 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.503064 (+351229us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:23.513580 (+ 10516us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.513790 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.513868 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.715597 (+1201729us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18000a11a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:09:24.737256 (+ 21659us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:24.766257 (+ 29001us) raft_consensus.cc:1685] finished
0709 13:09:24.766276 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.766396 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":565991,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1744,"raft.queue_time_us":193391,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":10450,"spinlock_wait_cycles":22873216,"thread_start_us":899718,"threads_started":2,"wal-append.queue_time_us":471237}
I20260709 13:09:24.756601 27736 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.832945 25218 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:24.835930 25218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:24.835165 24639 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:24.836272 27818 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.849238 25218 raft_consensus.cc:606] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:24.849815 25218 raft_consensus.cc:614] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:24.849890 27595 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:24.848095 27818 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.851105 27595 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.852571 27818 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.832968 27843 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.855283 27833 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:24.856190 27704 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.856724 27704 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.856994 27863 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.858376 27863 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.859148 27704 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.841637 27839 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:24.861096 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:24.861949 27839 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:24.862087 24523 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:24.861297 27929 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.863051 27929 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.863214 27839 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.868043 27718 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:24.868808 27718 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.871536 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.872264 25210 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:24.877539 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:24.878657 27844 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.879118 27844 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.879537 27844 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:24.884693 27905 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.664s	user 0.000s	sys 0.008s
I20260709 13:09:24.885358 27890 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.886425 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.922457 25215 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 4.
I20260709 13:09:24.922902 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1595) took 1078 ms. Trace:
I20260709 13:09:24.899497 27732 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.903172 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2683) took 1453 ms. Trace:
I20260709 13:09:24.923591 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:24.923635 24522 rpcz_store.cc:276] 0709 13:09:23.450100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.479864 (+ 29764us) service_pool.cc:224] Handling call
0709 13:09:24.902902 (+1423038us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54000bccd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:24.903055 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074377088}
I20260709 13:09:24.923290 24525 rpcz_store.cc:276] 0709 13:09:23.844719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.845239 (+   520us) service_pool.cc:224] Handling call
0709 13:09:23.845616 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.858989 (+ 13373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.859034 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.878636 (+ 19602us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.081706 (+203070us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:24.081744 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.081787 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.883953 (+802166us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:24.922635 (+ 38682us) raft_consensus.cc:1685] finished
0709 13:09:24.922657 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.922848 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3831,"raft.queue_time_us":1327,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":24077,"spinlock_wait_cycles":14656384,"thread_start_us":126923,"threads_started":1,"wal-append.queue_time_us":171840}
I20260709 13:09:24.923214 26926 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:24.926745 26926 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:24.927999 24525 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:24.928290 27302 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.910742 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1596) took 1065 ms. Trace:
I20260709 13:09:24.929003 24524 rpcz_store.cc:276] 0709 13:09:23.844964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.846043 (+  1079us) service_pool.cc:224] Handling call
0709 13:09:23.872717 (+ 26674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.873810 (+  1093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.910552 (+1036742us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b54003de0d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:24.910681 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34294656}
I20260709 13:09:24.910640 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.906378 27908 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.932932 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:24.928833 27302 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.934254 27828 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:24.934885 27828 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:24.935139 27302 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.935333 27828 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:24.935602 27674 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:24.935966 27674 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:24.937250 27679 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:24.912588 27833 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.914088 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:24.938237 27833 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.913791 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.938855 25211 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.939806 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.940475 27833 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:24.914379 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.941134 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.941236 24666 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:24.941896 27733 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.942272 27733 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:24.942167 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.942752 27733 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.940492 27841 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:24.943468 27841 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:24.943858 27841 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.915482 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.912842 27847 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:24.917215 27659 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 6 is higher.
I20260709 13:09:24.945560 27659 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.917919 24671 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:24.945894 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.916613 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:24.947886 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.947978 24672 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:24.949263 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:24.950409 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:24.950999 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:24.871570 27718 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.918879 24665 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:24.918169 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:24.919807 25210 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:24.936837 27674 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:24.921111 27896 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.864s	user 0.000s	sys 0.014s
I20260709 13:09:24.923346 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:24.967581 27224 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.915252 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:24.914889 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 632) took 1314 ms. Trace:
I20260709 13:09:24.957054 24599 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:24.968246 27224 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.968715 24674 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:24.969337 27674 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.969457 24595 rpcz_store.cc:276] 0709 13:09:23.600194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.600340 (+   146us) service_pool.cc:224] Handling call
0709 13:09:23.622300 (+ 21960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.676901 (+ 54601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.676944 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.677014 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:23.677059 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.914676 (+1237617us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b540002dfd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:24.914726 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.914839 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125058944}
I20260709 13:09:24.959375 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 713) took 2150 ms. Trace:
I20260709 13:09:24.953207 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:24.971174 25213 rpcz_store.cc:276] 0709 13:09:22.808680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.808836 (+   156us) service_pool.cc:224] Handling call
0709 13:09:22.859003 (+ 50167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.065963 (+206960us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:23.077296 (+ 11333us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.105043 (+ 27747us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.677551 (+572508us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18004602a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:09:23.677707 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.677768 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:23.677825 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.959125 (+1281300us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540060b3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:24.959183 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.959297 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":678585,"prepare.queue_time_us":33606,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":5606,"raft.queue_time_us":585050,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":10112,"spinlock_wait_cycles":481103616,"thread_start_us":24868,"threads_started":1,"wal-append.queue_time_us":56152,"wal-append.run_cpu_time_us":1537,"wal-append.run_wall_time_us":1049961}
I20260709 13:09:24.937417 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:24.973707 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.974503 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:24.974776 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.968271 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:24.956277 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:24.927589 26926 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:24.976864 25214 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:24.924304 25215 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.953722 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:24.965835 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.978164 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:24.936304 27828 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:24.990346 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:24.992301 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:24.993512 24593 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:09:24.952670 27843 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:24.982690 24566 leader_election.cc:400] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10.
I20260709 13:09:25.006606 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:24.987613 25211 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:24.968230 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:25.008112 25210 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.995697 27302 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:24.954950 27863 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:24.971323 27733 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.010061 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:25.011032 25214 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:25.013583 25214 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 8 LEARNER]: Advancing to term 9
I20260709 13:09:24.992193 27679 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:25.023023 25215 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
W20260709 13:09:25.004971 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.024386 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:25.058970 25211 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:25.059314 24674 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.993197 27744 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:09:25.001929 27838 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:24.982137 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:25.001717 27661 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.066700 27661 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.067193 27661 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.052228 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:25.070152 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:25.070849 24673 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:25.072364 24673 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:25.053490 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:25.073534 24665 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:25.054066 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:25.074635 24671 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:25.054448 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:25.075985 24672 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:25.024895 27863 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.076792 27863 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:25.077306 27863 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.064505 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:25.078979 24668 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:25.065666 25213 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:25.093878 27863 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:25.095386 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48470.8us
I20260709 13:09:25.102774 24674 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:25.015923 27679 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.025300 27790 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:25.116757 24598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1548) took 1501 ms (client timeout 1983 ms). Trace:
W20260709 13:09:25.130388 24598 rpcz_store.cc:269] 0709 13:09:23.615698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.615828 (+   130us) service_pool.cc:224] Handling call
0709 13:09:25.116600 (+1500772us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b540013fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:25.116697 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79742208}
I20260709 13:09:25.025424 27851 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:24.995858 27844 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:25.121819 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.126682 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.126739 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1137) took 1109 ms. Trace:
I20260709 13:09:25.136260 25216 rpcz_store.cc:276] 0709 13:09:24.017251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.053725 (+ 36474us) service_pool.cc:224] Handling call
0709 13:09:25.126533 (+1072808us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400680e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:25.126668 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339101056}
I20260709 13:09:25.009179 27638 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:09:25.128409 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1592) took 1284 ms. Trace:
I20260709 13:09:25.128553 24519 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:25.133708 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:25.138381 24520 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.138108 24521 rpcz_store.cc:276] 0709 13:09:23.843880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.844009 (+   129us) service_pool.cc:224] Handling call
0709 13:09:25.127940 (+1283931us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540011dd54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:25.128336 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964381440}
I20260709 13:09:25.017263 27846 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:09:25.146785 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:25.152236 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:25.153151 24525 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.154706 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:25.154862 24520 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:25.155274 24521 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.160100 27661 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.125839 27679 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:25.162529 27908 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.162739 27863 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.163058 27908 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.166177 27661 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:25.170478 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.174304 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:25.176504 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:25.177544 24594 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:25.178241 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:25.178965 24591 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:25.180107 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:25.180900 24666 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:25.182739 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:25.180869 24596 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:25.095626 27843 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:09:25.130167 27790 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:25.198383 24521 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:25.200943 25214 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 9 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:25.202801 24592 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:25.205459 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:25.205751 24595 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:25.206668 25210 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:09:25.178287 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:25.210322 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:25.219522 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:25.224658 24521 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:25.230140 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:25.235193 24525 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
W20260709 13:09:25.237985 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.178768 27868 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:25.241443 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:25.203534 27790 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.205235 27741 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:25.179188 27659 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:09:25.229344 27843 consensus_queue.cc:1243] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:25.224426 27908 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.254832 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:25.250901 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:25.267264 24525 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:25.268170 24669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.033s	sys 0.079s
W20260709 13:09:25.255813 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 253716us
W20260709 13:09:25.262539 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 84357.6us
I20260709 13:09:25.244926 27865 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.246548 27732 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.271775 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:25.204138 27704 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:09:25.225253 27654 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:09:25.246344 27868 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:25.270224 24669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.034s	sys 0.079s
W20260709 13:09:25.305490 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.373903 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 391790us
W20260709 13:09:25.374820 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 309511us
I20260709 13:09:25.387123 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:25.297676 24525 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:25.266656 27889 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:25.362151 27933 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:09:25.394165 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:25.409497 24521 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.270851 27830 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.374392 27865 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.399166 24520 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:25.400789 24516 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:25.401338 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:25.412436 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:25.412565 24518 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:25.413225 24522 raft_consensus.cc:2368] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:25.415143 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:25.418303 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:25.418951 24520 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.410254 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:25.273020 27928 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:25.382547 27929 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.405823 24523 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:25.405712 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:25.341640 27629 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:25.395990 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:25.353753 27741 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:25.390473 27856 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:25.397897 27733 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:25.368023 27224 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.301396 27841 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.397040 27889 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.422564 24521 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:25.424711 24524 raft_consensus.cc:2410] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:25.448868 24522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:09:25.443650 24637 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:25.459933 24522 raft_consensus.cc:606] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Received request to transfer leadership
I20260709 13:09:25.447657 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:25.446277 24520 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:25.444126 27838 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:25.462160 27943 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:09:25.463716 27937 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:25.426239 27830 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.465255 27699 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.466606 27830 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:25.468555 27935 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:09:25.470188 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 350888us
I20260709 13:09:25.476522 24637 leader_election.cc:400] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:25.494683 24637 leader_election.cc:403] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.425230 27661 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.412611 27865 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.428675 27856 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.497529 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:25.476483 27552 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:25.450927 27844 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.502591 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:25.496011 27889 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.470017 27928 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:25.501999 27843 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.426167 27679 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:25.543448 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.435289 27629 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.515758 27638 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:25.514940 27856 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:25.497324 27699 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:09:25.516397 27552 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:25.499064 27830 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:25.469967 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:25.570760 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:25.575263 25217 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:25.511070 27839 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:25.547040 27704 raft_consensus.cc:2764] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:25.516445 27806 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:09:25.551427 27638 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:25.546712 27946 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.585986 27844 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:25.615507 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 360724us
I20260709 13:09:25.617476 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:25.597534 27638 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:25.589030 27629 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:25.604133 27732 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:25.595263 27224 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:25.641884 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:25.643123 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:25.644062 24674 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:25.614889 27844 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:25.646971 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:25.649292 25217 raft_consensus.cc:2368] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:25.648038 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:25.650802 25212 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:25.615964 27699 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:25.653048 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:25.635198 27302 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.639782 27744 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:25.551692 27741 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.661646 27844 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:25.634821 27828 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:25.647410 27868 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.640702 27704 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:25.674430 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:25.675578 27865 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:25.598260 27552 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.605520 27838 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.678622 24639 leader_election.cc:400] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:25.719141 24639 leader_election.cc:403] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:09:25.720245 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.694507 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:25.704706 25212 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:25.706941 27818 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.702211 27948 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.710350 24671 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:25.648524 27839 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.719115 27844 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:25.736608 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 465368us
I20260709 13:09:25.716704 27744 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:25.658535 27674 consensus_meta.cc:287] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.689s	user 0.006s	sys 0.006s
W20260709 13:09:25.750202 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 478492us
I20260709 13:09:25.648415 27928 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.758628 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:25.725356 27921 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:25.659534 27699 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.762557 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:25.744972 25219 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:25.768492 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:25.728996 27830 consensus_queue.cc:1175] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "983693721af6486c97ece1410a90cf30" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:09:25.751449 27552 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.772423 25217 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:25.736009 27806 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:25.762192 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:25.746876 27858 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:25.712289 27828 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.716181 27704 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.799777 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:25.753645 27662 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:25.832062 27905 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:09:25.847437 27977 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:25.847841 27865 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:25.777952 27921 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:25.849888 27958 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:25.837329 27790 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.002s
I20260709 13:09:25.755321 27948 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.750399 27818 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.757757 27839 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.841097 27961 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:25.841298 27662 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:25.866361 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 98366.5us
I20260709 13:09:25.834815 27806 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.860994 27660 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:25.856462 27929 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:09:25.870806 27465 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:25.874907 27724 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.881958 27662 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.884636 27962 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.885025 27958 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:25.911751 27660 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:25.917855 27660 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:25.918474 27921 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:25.871893 27790 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.906972 27970 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.924345 27806 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.910676 27961 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:25.975593 27961 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.977412 27832 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.913534 27724 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:25.914987 27948 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:25.884327 27744 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.979847 27724 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:25.961953 27843 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7.
I20260709 13:09:25.962965 27839 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.965408 27958 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.966662 27919 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:25.921958 27962 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:25.981472 27841 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:25.982899 27986 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:25.941746 27889 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.032755 27925 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:26.033306 27889 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.033429 27925 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:26.034914 27925 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.036456 27925 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.964138 27868 raft_consensus.cc:2955] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:09:26.053328 27974 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:09:26.082856 27986 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.124552 27986 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:26.163625 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:26.167070 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:26.167943 24517 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:09:26.170878 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:26.172459 24520 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:26.172467 24522 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
W20260709 13:09:26.176810 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 340258us
W20260709 13:09:26.178809 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 383593us
I20260709 13:09:26.180327 24517 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:26.181527 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2701) took 2119 ms. Trace:
I20260709 13:09:26.182104 24519 rpcz_store.cc:276] 0709 13:09:24.062390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.115582 (+ 53192us) service_pool.cc:224] Handling call
0709 13:09:25.128315 (+1012733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.141307 (+ 12992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.181013 (+1039706us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b540011dd50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:26.181289 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260672256}
I20260709 13:09:26.183105 24516 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:26.202157 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.202178 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:26.206444 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.207928 24668 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:26.209936 24669 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:26.211316 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 697) took 1292 ms. Trace:
I20260709 13:09:26.211932 24666 rpcz_store.cc:276] 0709 13:09:24.918245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.941928 (+ 23683us) service_pool.cc:224] Handling call
0709 13:09:26.210578 (+1268650us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54002b5554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:26.210970 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546490752}
W20260709 13:09:26.207999 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.215153 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.214955 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2774) took 2001 ms. Trace:
W20260709 13:09:26.227532 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.927927 27638 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:25.927094 27661 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.433341 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1146) took 1557 ms. Trace:
I20260709 13:09:26.437772 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 772) took 1488 ms. Trace:
I20260709 13:09:26.438551 27953 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.439119 27953 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.439689 27953 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.439057 27847 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.445812 27847 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:26.428225 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 249685us
I20260709 13:09:26.438364 25211 rpcz_store.cc:276] 0709 13:09:24.948858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.008240 (+ 59382us) service_pool.cc:224] Handling call
0709 13:09:25.058720 (+ 50480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.059516 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.437226 (+1377710us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54003372d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:26.437509 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115230080}
I20260709 13:09:26.359683 27947 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:26.403680 27741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.010s
I20260709 13:09:26.358814 27827 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:26.508842 26926 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.521890 27704 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:26.525111 27847 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.231791 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:26.459861 27986 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:26.527918 27986 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.460677 27965 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:09:26.531220 27699 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.461477 27946 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:26.462174 27732 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:26.455001 27921 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.215593 24670 rpcz_store.cc:276] 0709 13:09:24.212982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.222629 (+  9647us) service_pool.cc:224] Handling call
0709 13:09:24.222907 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.236470 (+ 13563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.236506 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.237003 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.679314 (+442311us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:24.680942 (+  1628us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.681193 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.213812 (+1532619us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b540026b6d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:26.213935 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.214038 (+   103us) raft_consensus.cc:1685] finished
0709 13:09:26.214221 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.214692 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201,"prepare.queue_time_us":152,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":3075,"raft.queue_time_us":1516,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":9166,"spinlock_wait_cycles":30194560,"thread_start_us":441848,"threads_started":1,"wal-append.queue_time_us":493558,"wal-append.run_cpu_time_us":1938,"wal-append.run_wall_time_us":1014202}
W20260709 13:09:26.466935 24673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.004s
I20260709 13:09:26.469693 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:26.470531 27977 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.471464 27843 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.473938 27806 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:26.534145 27732 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.450028 25213 rpcz_store.cc:276] 0709 13:09:24.875864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.989837 (+113973us) service_pool.cc:224] Handling call
0709 13:09:25.011230 (+ 21393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.079888 (+ 68658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.432357 (+1352469us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b5400532354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:26.432938 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124613888}
I20260709 13:09:26.476888 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:26.479391 27679 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:26.488256 24407 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for e7ec39f0d4e04761ae598f1245692799 already in progress [suppressed 20 similar messages]
I20260709 13:09:26.488610 27698 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:26.489615 27781 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:26.489547 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:26.491133 27736 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:26.498768 27948 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:26.550909 27948 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.499855 24668 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:26.552673 27781 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:26.538098 27843 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.554189 27781 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.555627 27781 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.555721 27843 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.534626 27921 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.533582 27946 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.548774 27698 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:26.559108 27921 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:26.537629 27977 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.559569 27698 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.559588 27946 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:26.556587 27539 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:26.563339 27698 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.563606 27539 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.564821 27960 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:26.565773 27960 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.556710 27928 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:26.566545 24669 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:26.567286 27928 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.569350 27539 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.556620 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:26.570472 27948 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:26.505532 27962 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.358822 27913 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:26.540444 27806 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:26.510599 27741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.001s	sys 0.019s
W20260709 13:09:26.537035 24673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.011s	sys 0.004s
I20260709 13:09:26.369174 27852 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:26.159965 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:26.456125 27947 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:26.230628 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:26.509877 27856 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.933s	user 0.018s	sys 0.017s
I20260709 13:09:26.568678 27960 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.562466 27977 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:26.541721 27827 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.581382 27863 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:26.582540 27828 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:26.582738 27986 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:26.583655 27856 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.563462 27865 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:26.533156 27818 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:26.597828 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.589130 27827 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.595932 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:26.610627 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.603670 24667 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.590262 27965 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.613402 25213 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:26.589238 27863 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:26.607824 24672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.007s	sys 0.010s
I20260709 13:09:26.617762 27984 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:26.633215 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.616813 27847 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.638980 24672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.008s	sys 0.010s
I20260709 13:09:26.626305 27863 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:26.666986 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.596282 27865 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:26.676928 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.602463 27913 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:26.688367 24407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 200631us
I20260709 13:09:26.683995 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:26.687383 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:26.646682 27847 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.720335 27465 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:26.721237 27465 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.722765 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:26.724083 25213 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:26.724588 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:26.638418 27965 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.731248 24666 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.634150 27852 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:26.734869 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44457.8us
I20260709 13:09:26.749786 27679 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:26.750267 27679 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.750629 27679 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.753691 25211 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:26.754571 27966 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:26.754890 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:26.755787 25218 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:26.755369 27966 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.756492 26926 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:26.757051 26926 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:26.757228 27387 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:26.757905 27387 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:26.758363 26926 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.760423 27387 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:26.734800 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:26.761453 24519 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:26.763324 27718 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.097s
W20260709 13:09:26.764276 27976 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.182s	user 0.003s	sys 0.001s
I20260709 13:09:26.765452 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2802) took 1097 ms. Trace:
W20260709 13:09:26.766187 27925 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.016s
I20260709 13:09:26.765897 24672 rpcz_store.cc:276] 0709 13:09:25.667845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.667991 (+   146us) service_pool.cc:224] Handling call
0709 13:09:25.668365 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.668612 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:25.886963 (+218351us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.686832 (+799869us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.697838 (+ 11006us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:26.732223 (+ 34385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.746524 (+ 14301us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.765395 (+ 18871us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166,"prepare.queue_time_us":751,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":4971,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7746,"thread_start_us":971186,"threads_started":2,"wal-append.queue_time_us":586448}
I20260709 13:09:26.768270 25219 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:26.769235 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.769712 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.770608 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:26.771301 27806 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.694408 27928 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:26.728545 27844 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.012s
I20260709 13:09:26.776062 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:26.778380 24522 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:26.746408 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:26.776921 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 546754us
I20260709 13:09:26.737573 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:26.772094 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 847281us
I20260709 13:09:26.794502 24666 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:26.805337 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:26.695676 27946 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:09:26.810571 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:26.728376 27963 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:26.812181 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:26.813604 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:26.772290 27465 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:26.825888 24520 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:26.832747 24522 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:26.811401 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:26.845175 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:26.801931 27953 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:26.862138 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 169748us
I20260709 13:09:26.870167 24523 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:26.803256 27704 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:09:26.870536 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 225076us
I20260709 13:09:26.872404 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:26.797118 27947 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.901161 24520 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:26.895484 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:26.906324 24523 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:26.910049 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:26.918012 24517 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:26.891319 27856 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:26.933159 24674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.083s
W20260709 13:09:26.933588 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 327885us
I20260709 13:09:26.933719 27838 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.934307 27838 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.934701 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:26.936410 27838 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:26.937253 27844 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:26.937680 27844 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:26.937856 27552 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.088s	user 0.003s	sys 0.014s
I20260709 13:09:26.938125 27844 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.937757 27679 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:26.941788 27987 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:09:26.945385 28000 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:26.945466 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:26.946030 28000 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:26.946507 28000 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.947141 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2803) took 1212 ms. Trace:
I20260709 13:09:26.949543 27981 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:26.950456 27981 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:26.954782 27913 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:26.895601 27790 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:26.959213 27679 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:26.933631 24674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.008s	sys 0.083s
W20260709 13:09:26.933046 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 359202us
W20260709 13:09:26.964973 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 73845.4us
I20260709 13:09:26.936733 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:26.915503 27561 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:09:26.921032 27744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.005s	sys 0.022s
I20260709 13:09:26.920897 27949 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.872489 27963 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:26.977341 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81179.5us
W20260709 13:09:26.984887 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 175418us
I20260709 13:09:26.931021 24521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
W20260709 13:09:26.937700 27988 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:09:26.996320 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 185946us
I20260709 13:09:26.947644 24665 rpcz_store.cc:276] 0709 13:09:25.689180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.689401 (+   221us) service_pool.cc:224] Handling call
0709 13:09:25.689873 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.690361 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.690408 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.690984 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.792702 (+101718us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:25.792757 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.792848 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.763473 (+970625us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:26.867284 (+103811us) raft_consensus.cc:1685] finished
0709 13:09:26.867317 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.900913 (+ 33596us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":909,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5058,"spinlock_wait_cycles":7213312,"thread_start_us":63304,"threads_started":1,"wal-append.queue_time_us":861991}
W20260709 13:09:27.006332 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 115509us
W20260709 13:09:27.014561 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 78011.4us
W20260709 13:09:26.993534 27744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.006s	sys 0.022s
I20260709 13:09:27.018729 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:27.009099 24521 raft_consensus.cc:606] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Received request to transfer leadership
I20260709 13:09:26.999481 27732 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:26.985713 27561 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.037182 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:27.037547 27868 consensus_meta.cc:287] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.999s	user 0.006s	sys 0.019s
I20260709 13:09:27.037634 27561 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:27.038358 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 122144us
I20260709 13:09:27.038475 27561 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.032951 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:27.022342 27827 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.040310 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:27.018916 27806 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:27.016227 27465 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.023211 27865 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.051568 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:27.041690 27679 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:27.033812 27949 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.062026 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:27.062578 24520 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.062906 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.063354 27949 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:27.063495 24519 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:27.061384 24524 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:27.044153 27806 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.071415 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.072043 24521 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:27.055450 27465 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.075556 27947 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.076551 24520 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:27.065044 27946 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.088757 27990 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.089404 27990 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.091668 27990 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.044269 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:27.067744 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.069583 27913 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.098029 27913 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.098398 27913 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:27.098513 27989 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.436s	user 0.002s	sys 0.000s
I20260709 13:09:27.067867 24597 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
W20260709 13:09:27.082345 27662 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.161s	user 0.004s	sys 0.018s
I20260709 13:09:27.092316 27806 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.106271 27387 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:27.034279 27965 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:27.093708 27847 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:27.057191 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:27.066138 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:27.110371 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86581.8us
I20260709 13:09:27.120375 27638 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:27.128494 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.130841 24520 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:27.132095 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.124295 24420 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:27.135185 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 69085.7us
I20260709 13:09:27.103623 27981 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.109789 27679 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:27.112459 27965 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.134694 27925 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.147053 27704 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.174939 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 161227us
I20260709 13:09:27.147823 27990 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:27.157480 27925 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.125824 27662 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:27.186268 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 131337us
I20260709 13:09:27.194074 27961 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:27.194482 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.194672 27961 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:27.195159 25218 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:27.195771 27961 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:27.196557 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.181613 27818 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:27.197540 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.197799 27818 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.198879 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:27.199585 24666 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:27.191041 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:27.201921 24668 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
W20260709 13:09:27.211333 27996 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.223s	user 0.005s	sys 0.000s
I20260709 13:09:27.212443 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:27.214099 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:27.215544 24597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1557) took 2261 ms (client timeout 1772 ms). Trace:
W20260709 13:09:27.216078 24597 rpcz_store.cc:269] 0709 13:09:24.953740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.953837 (+    97us) service_pool.cc:224] Handling call
0709 13:09:26.201716 (+1247879us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21eee 0000000000375939 00007f17c0e951e0 00007f17c0f5e0c4 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:27.215249 (+1013533us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b540025e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:27.215405 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060115456}
I20260709 13:09:27.200685 27818 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.219513 24595 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:27.220235 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.220975 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.221550 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.222327 27732 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:27.222785 27732 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.222941 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.223169 27732 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.223752 24591 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:27.226410 27661 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:27.227382 27661 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:27.227847 27661 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:27.229411 28007 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:27.230543 28009 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:27.230885 28009 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:27.231751 28009 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.233484 27851 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.233865 27851 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:27.234753 27851 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.235548 27818 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.236057 27698 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.001s
W20260709 13:09:27.236536 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.236248 27818 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:27.237275 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 126378us
I20260709 13:09:27.238080 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:27.239296 27818 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:27.240103 27946 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.239885 27679 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.240741 27946 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:27.242628 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 221598us
I20260709 13:09:27.242859 27946 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:27.243505 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:27.243587 27704 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:27.232189 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 54636.5us
I20260709 13:09:27.245399 27818 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:27.163861 27965 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.191740 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:27.246691 24665 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.247684 27965 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.186507 27925 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.235980 27659 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:27.239243 27928 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:27.221643 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.255987 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:27.261180 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.246076 27818 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:27.264040 24523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:09:27.264772 24523 raft_consensus.cc:606] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Received request to transfer leadership
I20260709 13:09:27.250969 28009 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.266412 24668 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:27.267925 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.271239 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:27.271787 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.275522 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.276541 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.278070 24525 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:27.280364 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.261798 27781 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:27.262807 27928 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:27.261271 27659 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:27.228742 27661 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.275283 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:27.194115 27844 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.354697 24517 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:27.386955 27844 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.294711 27704 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:27.380690 27963 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:27.385918 28008 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.247s	user 0.003s	sys 0.000s
I20260709 13:09:27.389104 27659 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.306787 27806 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.337859 28000 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.392323 27806 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.393149 27852 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:27.346441 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.394809 27963 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.395381 27963 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.396046 28000 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.356993 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.402271 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:27.338306 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.352582 25217 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:27.307534 27913 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.396199 27851 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.397670 27963 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:27.333679 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.397692 27465 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.337844 27990 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.401487 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.414168 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:27.414413 25213 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:27.401669 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:27.409263 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 103016us
I20260709 13:09:27.253871 27744 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:09:27.279253 27827 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.292486 27781 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:27.397455 27863 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.702s	user 0.003s	sys 0.007s
W20260709 13:09:27.421969 24667 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.006s
I20260709 13:09:27.429944 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:27.411880 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 159767us
I20260709 13:09:27.430460 24667 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:27.346199 27838 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:27.431602 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 2809) took 1202 ms. Trace:
I20260709 13:09:27.432132 24667 rpcz_store.cc:276] 0709 13:09:26.229182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.231003 (+  1821us) service_pool.cc:224] Handling call
0709 13:09:27.431534 (+1200531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.377341 27552 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:27.435807 27966 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:27.437923 24666 raft_consensus.cc:2410] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:27.442792 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.438763 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:27.331833 27818 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.446918 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.447623 25210 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:27.373535 27928 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.449383 27662 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.435190 27838 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:27.451081 27990 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:27.451608 27838 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.453114 27838 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.453586 27990 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:27.454958 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.433494 27781 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.458585 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.460855 24665 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:27.425534 27806 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:27.425544 27704 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:27.462272 27704 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.462057 27806 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:27.462636 27704 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:27.464313 27806 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:27.437346 27863 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.466434 27732 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.466938 27838 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.467295 27863 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.431115 27844 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:27.467470 27838 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.467952 27844 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:27.429711 27947 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.431032 27387 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:27.484287 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:27.485065 25212 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.445770 27953 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.504045 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:27.504916 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.505546 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.503434 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.473140 27732 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:27.525030 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 85975.1us
I20260709 13:09:27.527227 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:27.527892 24520 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.528769 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.535563 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:27.540459 28012 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:27.541491 28012 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.517153 24420 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 2 to 6, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 6 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.546597 28012 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:27.547003 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 71122.3us
W20260709 13:09:27.547844 24423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 346) took 20652 ms (client timeout 15000 ms). Trace:
I20260709 13:09:27.537302 28013 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:27.549435 28013 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:27.549827 27838 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:27.548728 27965 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:27.555519 24525 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:27.516988 27966 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:27.556514 25212 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:27.475776 27552 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.561579 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.500705 27947 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.559834 25214 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:27.566756 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.570783 24521 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:27.564198 25211 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:27.532346 27806 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.573527 24407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 170575us
I20260709 13:09:27.598291 24523 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:27.560380 27732 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.605464 24517 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:27.555501 27965 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:27.555152 27387 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:27.537823 27852 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:09:27.616959 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.618395 24520 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:27.621330 25211 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:27.621671 27659 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.621896 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.622196 27659 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.616685 27806 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.604411 27732 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.568598 27966 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:27.637868 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.649408 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.656036 25217 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.657527 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:27.658252 25216 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:27.659953 28017 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.660758 28017 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:27.663770 28017 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:27.665556 28011 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 13:09:27.668115 27660 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:27.668574 27660 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:27.612335 27981 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.669100 27806 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.669344 27981 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.669615 27660 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.669629 27990 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:27.674811 27387 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.677167 27913 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.692739 27659 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:27.693121 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:27.710338 27552 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.711205 27963 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.693248 27660 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:27.712101 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 184418us
I20260709 13:09:27.698964 25215 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:27.721451 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 173061us
I20260709 13:09:27.643894 27732 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.724382 25218 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:27.729975 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.730156 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:27.730662 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:27.740845 27818 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.744496 24420 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 3 to 5, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 5 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:27.745762 27981 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.745903 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.646152 27925 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.745966 24599 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:27.761865 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50049.9us
I20260709 13:09:27.765951 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.766667 24595 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:27.767424 25216 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:27.548269 24423 rpcz_store.cc:269] 0709 13:09:06.895552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.895854 (+   302us) service_pool.cc:224] Handling call
0709 13:09:27.547600 (+20651746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:23.649754 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:23.669944 (+ 20190us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:23.669998 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:09:23.670019 (+    21us) tablet.cc:662] Decoding operations
0709 13:09:23.671888 (+  1869us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:23.671996 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:23.672021 (+    25us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:09:23.816759 (+144738us) tablet.cc:701] Row locks acquired
0709 13:09:23.816811 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:09:23.816982 (+   171us) write_op.cc:270] Start()
0709 13:09:23.817166 (+   184us) write_op.cc:276] Timestamp: P: 1783602563816916 usec, L: 0
0709 13:09:23.817189 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:23.821308 (+  4119us) log.cc:844] Serialized 8630 byte log entry
0709 13:09:23.986585 (+165277us) op_driver.cc:464] REPLICATION: finished
0709 13:09:24.101727 (+115142us) write_op.cc:301] APPLY: starting
0709 13:09:24.108278 (+  6551us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:24.224246 (+115968us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:24.224380 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:24.226922 (+  2542us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:24.227291 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:09:24.227339 (+    48us) write_op.cc:312] APPLY: finished
0709 13:09:24.227794 (+   455us) log.cc:844] Serialized 145 byte log entry
0709 13:09:24.252942 (+ 25148us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:24.285758 (+ 32816us) write_op.cc:454] Released schema lock
0709 13:09:24.305308 (+ 19550us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:24.313749 (+  8441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:24.313789 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1214437,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":97527,"apply.run_cpu_time_us":6200,"apply.run_wall_time_us":221866,"num_ops":21,"prepare.queue_time_us":270127,"prepare.run_cpu_time_us":22512,"prepare.run_wall_time_us":278886,"raft.queue_time_us":64931,"raft.run_cpu_time_us":19474,"raft.run_wall_time_us":102690,"replication_time_us":158325,"thread_start_us":349153,"threads_started":4,"wal-append.queue_time_us":79101,"wal-append.run_cpu_time_us":36373,"wal-append.run_wall_time_us":1339793}]]}
I20260709 13:09:27.768302 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:27.746562 24519 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
W20260709 13:09:27.774317 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44248.1us
I20260709 13:09:27.774338 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.774657 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.775254 24598 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:27.777475 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.786305 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.787197 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.787774 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.788417 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.769219 27947 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.786331 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.796656 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:27.761960 27844 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:27.802481 24597 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:27.806315 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:27.807621 24600 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:27.807766 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.805546 24420 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.812436 25214 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:09:27.812739 25214 pending_rounds.cc:85] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 7
I20260709 13:09:27.813794 28013 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:27.815939 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.805917 27844 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.816668 24596 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
W20260709 13:09:27.817385 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49225.2us
I20260709 13:09:27.818835 25217 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:27.820416 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.820580 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.770774 27818 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.812885 25214 pending_rounds.cc:107] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:09:27.813692 28028 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.829130 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.835078 25214 raft_consensus.cc:2889] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:27.824920 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:27.834810 24420 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 3 to 5, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 5 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:09:27.817704 28009 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.001s
I20260709 13:09:27.840201 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:27.840734 25218 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.837121 24597 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9.
I20260709 13:09:27.837670 24594 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:27.838477 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.741462 27965 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.847744 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:27.847631 24598 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 4.
I20260709 13:09:27.849400 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:27.806167 27552 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.855057 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.855427 25215 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.856227 25216 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:27.857393 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.858155 24596 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:27.858431 27928 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:27.839711 27806 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.859304 27806 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:27.859813 27806 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.860507 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.858901 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.858875 24523 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:27.862300 27781 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:27.841859 28024 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 13:09:27.859213 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.866529 28013 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.867122 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:27.867431 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:27.865988 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:27.868630 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:27.868655 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:27.869406 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:27.869850 24523 raft_consensus.cc:2368] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11.
I20260709 13:09:27.870180 28013 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:27.870687 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.870748 27662 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.871230 27662 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:27.871594 27662 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.875895 24517 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:27.907382 25217 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.817695 27704 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:27.910851 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 65838.1us
W20260709 13:09:27.905912 28021 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:09:27.911417 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.920864 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:27.925335 24674 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:27.921917 25215 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:27.923722 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:27.928191 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.928625 24668 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.849720 24420 catalog_manager.cc:5697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 2, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added, no longer has a pending config: VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129), VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130), VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131), NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:27.910249 24595 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:27.905851 28013 raft_consensus.cc:2764] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:27.932184 24518 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:27.932258 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.933317 24600 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:27.905249 28028 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.909915 27966 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:27.933998 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 64679.2us
I20260709 13:09:27.923834 28017 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.939152 25217 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 5.
I20260709 13:09:27.938073 24594 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:27.938568 24420 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.943192 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:27.928076 27928 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.951762 27806 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:27.953554 28025 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:09:27.959766 24420 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:09:27.960906 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.961655 24420 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:27.962988 24420 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 4 to 6, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:27.969945 27818 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:27.972854 27806 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:27.974740 28020 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.317s	user 0.003s	sys 0.000s
I20260709 13:09:27.975394 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:09:27.977766 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:27.981899 28029 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.964376 24420 catalog_manager.cc:5697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 1 to 4, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 4 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.978309 27990 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.982975 27990 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:27.983573 24420 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:27.988004 27990 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:27.989811 27732 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:27.993634 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.994518 24597 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:27.994958 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:27.995131 24592 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:27.995693 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:27.996181 24592 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:27.996989 24595 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:27.996063 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:27.998263 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:27.997054 24592 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.004845 25218 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:28.006098 24668 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
W20260709 13:09:28.009241 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 140697us
I20260709 13:09:28.011466 28028 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:28.012034 24516 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:28.023326 24593 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:28.028198 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.028930 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.035141 25217 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.028960 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.036607 25218 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.028786 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.035130 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:28.033970 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.030422 27806 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.041821 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.042692 26926 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:28.043195 26926 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:28.043841 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.044031 26926 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.045250 27744 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:28.045475 27781 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:28.045626 27744 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:28.046131 27744 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.047293 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:28.047868 24518 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.047942 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:28.049476 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.050065 24668 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:28.050200 28012 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:28.051344 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46091.8us
I20260709 13:09:28.052474 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.054251 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.056406 24668 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:28.056619 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.057287 27852 raft_consensus.cc:2764] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:28.058100 27732 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:28.060173 24520 raft_consensus.cc:606] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Received request to transfer leadership
I20260709 13:09:28.062680 24522 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:28.065721 24666 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:28.067935 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:28.069406 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.050863 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:28.071655 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:28.072224 24523 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 5.
I20260709 13:09:28.072726 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.073365 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:28.074940 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:28.076434 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 133381us
I20260709 13:09:28.077795 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.078409 25210 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:28.013592 27990 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:28.079579 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 169403us
I20260709 13:09:28.025339 27981 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.084013 24665 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:28.080968 25211 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:28.053069 28009 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.080710 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.082880 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.087512 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:28.088109 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.088074 24519 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:28.090248 24592 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.070354 28000 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:28.092540 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:28.077905 27732 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.105635 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.110597 25217 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:28.115121 24666 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:28.115288 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:28.115501 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:28.116181 24519 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:28.117461 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:28.118208 24516 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.115648 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:28.119045 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:28.128443 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47801.8us
I20260709 13:09:28.098093 27838 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.129416 24668 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:28.129596 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:28.129976 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.128341 25218 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:28.096349 28000 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:28.134337 28000 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:28.134414 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45602.4us
I20260709 13:09:28.083899 27661 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:09:28.141911 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:28.145460 24520 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:28.105125 27981 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:28.131834 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 76489us
I20260709 13:09:28.133528 24524 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:28.152634 27965 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.154392 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.155179 24665 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:28.155244 24525 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:28.156437 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.157048 24666 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:28.158604 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.160226 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:28.160737 24667 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.162184 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.163816 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.164567 24666 raft_consensus.cc:2368] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7.
I20260709 13:09:28.165414 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:28.165793 24668 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:28.166261 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.167459 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.168074 24673 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:28.169013 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.169790 24669 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:28.172189 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:28.172652 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.173105 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.173761 24670 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:28.174101 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.174765 24669 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:28.173768 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.175782 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.175781 24665 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:28.177673 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:28.172670 24666 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.179154 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:28.178318 27744 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.184237 27662 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.185431 24599 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:28.185603 28027 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.262s	user 0.003s	sys 0.001s
I20260709 13:09:28.186435 27662 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:28.187091 27662 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:28.187765 27744 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:28.191285 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49032.1us
I20260709 13:09:28.125913 27704 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:28.193849 27732 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:28.194320 27732 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:28.194749 27732 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.196409 24516 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:28.130698 27925 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:28.130228 28007 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:28.197919 28007 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:28.197839 27981 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:28.198886 28007 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.199877 24667 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:28.176788 24673 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:28.201508 24666 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:28.201656 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:28.204975 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 116313us
I20260709 13:09:28.091678 28009 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:28.208595 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 116163us
I20260709 13:09:28.209764 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:28.130164 27990 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:28.217819 24592 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:28.141350 27852 raft_consensus.cc:2764] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:28.201694 27659 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:28.234514 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:28.235946 24668 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:28.232360 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:28.241676 24668 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:28.245260 24668 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:09:28.265283 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 126741us
I20260709 13:09:28.265942 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.261123 24668 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:28.269132 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.271584 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:28.272207 24668 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.234930 27659 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:28.225380 27990 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.254276 27704 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:28.279735 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47497.2us
I20260709 13:09:28.272701 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:28.275341 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 104170us
I20260709 13:09:28.280797 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.282925 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.283221 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.283493 25218 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.283787 25217 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.284195 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.284791 25213 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:28.285624 27948 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:28.290493 24667 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:28.291038 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.294785 25217 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:28.296799 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.301582 27838 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:28.309195 27838 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:28.309684 27838 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.310885 27928 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:28.312683 27928 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:28.314775 27928 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:28.315384 27928 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:28.264871 28040 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:09:28.317878 28040 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:28.318248 28040 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:28.318444 25184 leader_election.cc:400] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9.
I20260709 13:09:28.319092 28040 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.319756 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.320286 28040 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.322444 24672 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.323541 27990 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:28.319271 27928 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:28.278205 27659 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.330108 28009 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:28.282003 27704 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:28.330896 27704 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.306327 28030 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:28.333122 28017 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.333312 25211 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:28.333648 28030 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:28.334898 28030 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.302030 27818 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:28.305227 27679 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:09:28.337426 27818 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.337842 27818 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:28.338567 24471 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:09:28.339008 24471 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for e7ec39f0d4e04761ae598f1245692799 already in progress
W20260709 13:09:28.338712 28041 consensus_queue.cc:1175] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "148dc963cec64232ad3b248abad6f36d" responder_term: 6 status { last_received { term: 6 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 6 index: 8 } }
W20260709 13:09:28.339306 24471 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for e7ec39f0d4e04761ae598f1245692799 already in progress
I20260709 13:09:28.325565 27552 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.339810 28042 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.340232 24674 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:28.340503 28044 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.338774 24666 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:28.341918 27948 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:28.344547 28045 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.344678 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.345307 25211 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:28.345045 28045 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.347153 28045 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:28.299614 27925 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:28.279405 27913 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:28.274959 28000 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.347981 27925 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:28.348172 27913 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:28.348925 27925 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.349434 28000 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:28.349188 27913 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.352421 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.355798 24668 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:28.348291 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:28.358265 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54628us
W20260709 13:09:28.358307 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 54090.6us
I20260709 13:09:28.355409 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.359727 24518 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:28.360659 24668 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:09:28.362519 24668 pending_rounds.cc:85] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 5
I20260709 13:09:28.359469 26926 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:09:28.362803 24668 pending_rounds.cc:107] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:09:28.363178 24668 raft_consensus.cc:2889] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.364246 24672 raft_consensus.cc:2410] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:28.365579 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:28.364356 25184 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.366168 24673 raft_consensus.cc:2376] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6. Re-sending same reply.
W20260709 13:09:28.370270 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 71163.9us
I20260709 13:09:28.308534 27806 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:28.413960 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 210357us
I20260709 13:09:28.414909 25218 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:28.415302 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.416163 28042 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.416468 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.417505 28017 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:28.427760 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:09:28.429503 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49304.9us
I20260709 13:09:28.365468 27851 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.449216 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:28.451890 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:28.459389 24491 leader_election.cc:400] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7.
I20260709 13:09:28.459931 24491 leader_election.cc:403] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:28.447671 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:28.380057 27844 raft_consensus.cc:2764] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:28.366034 28000 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:09:28.381436 28045 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.382246 27552 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:28.468888 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:28.367197 27990 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:09:28.483384 27552 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:28.460911 28050 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:09:28.490600 27387 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7.
I20260709 13:09:28.460645 27465 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:28.472147 28046 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:28.473418 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.473814 28041 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.447698 27818 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.478120 27928 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:28.529403 26926 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:28.529875 26926 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.530176 26926 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.451578 27965 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:28.479187 28037 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.312s	user 0.000s	sys 0.006s
I20260709 13:09:28.461282 27966 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:28.430537 28009 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:09:28.447700 28012 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:09:28.523653 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 50312.4us
I20260709 13:09:28.540227 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:28.456341 28013 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:09:28.502642 27465 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:28.554610 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.549721 27660 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:28.557898 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 191285us
I20260709 13:09:28.534284 27966 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:28.470758 28049 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:09:28.534468 27965 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:28.603634 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44794us
I20260709 13:09:28.545020 27852 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:28.545221 27465 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:28.611011 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 148495us
W20260709 13:09:28.606930 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 58548.9us
I20260709 13:09:28.622537 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.547675 27732 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.559442 28050 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:09:28.608825 27965 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.643975 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.644578 25211 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.644662 27732 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:28.635327 27981 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:28.645931 27981 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:28.646821 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:28.646731 27981 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:28.647920 27981 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.558981 27659 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.649871 27744 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.561688 28048 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:09:28.607739 27966 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.664335 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.651585 24563 leader_election.cc:400] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11.
I20260709 13:09:28.650960 27661 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:28.660423 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 293679us
I20260709 13:09:28.667695 24563 leader_election.cc:403] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:09:28.670698 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:28.671526 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.612599 27852 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:28.678972 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 67002.1us
I20260709 13:09:28.664912 26926 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.680096 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.620939 28029 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:28.642699 27818 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:28.682750 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.670711 25211 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:28.589993 27838 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.669869 27661 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:28.624881 27552 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:28.684346 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.685483 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:28.696892 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:28.680114 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:28.673220 27990 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:28.719805 24665 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:28.667385 27660 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:09:28.725580 26926 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:28.699080 27698 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:28.676126 28049 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11.
I20260709 13:09:28.694964 28009 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.684325 27961 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:09:28.679212 27852 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.609484 28042 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:28.743044 28042 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.643152 27704 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.693786 27844 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:28.752628 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 137182us
I20260709 13:09:28.752216 25211 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:28.699860 28041 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.746807 25217 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.719725 28028 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:28.695456 27659 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:28.699317 27781 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.759774 25217 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:28.632558 27928 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
W20260709 13:09:28.755625 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 76971.5us
I20260709 13:09:28.700337 28017 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:28.755486 24672 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:28.724946 27990 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.764268 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:28.761586 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 302385us
I20260709 13:09:28.762643 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.747030 27806 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:28.749049 27552 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:28.766744 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:28.751291 27913 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:28.787515 26926 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:28.757061 28058 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:09:28.789439 27387 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:28.790616 27465 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:28.767764 27990 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:28.793534 28052 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:09:28.797796 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.798594 28029 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:28.798355 27661 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.799500 28028 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:28.800223 27704 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:28.802057 27838 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:28.802659 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.837636 25210 raft_consensus.cc:2410] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:28.768178 27806 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.805370 27781 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:28.807004 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.840585 25211 raft_consensus.cc:2410] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:28.808171 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.841377 25217 raft_consensus.cc:2410] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:28.817612 27961 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:28.763234 28062 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.853161 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 158698us
I20260709 13:09:28.853597 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.815061 25219 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:28.816085 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.788059 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:09:28.855516 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 67533.3us
W20260709 13:09:28.823177 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62441.8us
I20260709 13:09:28.856351 28012 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:28.856426 28062 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.831825 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.808863 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.829941 27387 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:28.839937 27806 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.849769 28000 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:28.849584 27781 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.818414 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:28.770684 27552 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:28.912052 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 54046.8us
I20260709 13:09:28.856818 28012 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:28.816941 28059 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:09:28.832744 28041 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:28.887807 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.903611 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:28.896145 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:28.911293 25212 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:28.825788 27913 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:28.871855 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.914570 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:28.922645 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:28.912451 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:28.914979 25210 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:09:28.923317 24596 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:28.830677 28029 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.917932 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:28.920809 24599 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:28.921587 25211 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:28.917243 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.926829 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.931710 27465 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:28.933372 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:28.934055 27781 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:28.934664 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 116320us
I20260709 13:09:28.937659 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:28.940120 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:28.941318 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:28.942265 26926 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:28.944116 25215 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:28.914958 27965 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:28.856460 27661 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.893046 27961 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:28.915551 27552 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.944053 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:28.917681 28012 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:28.910620 28000 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:28.953230 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:28.936277 28050 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.902426 27928 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:09:29.069427 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:28.950461 28071 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:29.033280 27844 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.036298 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:29.076319 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.076429 24668 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.037469 24672 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:29.038239 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.037484 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:28.948058 27465 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:28.950269 28013 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:09:28.994282 24524 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:29.088908 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:28.957796 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.089689 24516 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.958246 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:28.951869 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.063464 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:29.068113 24667 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:29.071730 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:28.953282 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.036768 27966 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.105286 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:29.070358 27981 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:28.913715 28017 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.079392 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.112180 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.081703 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.085812 27465 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:29.147085 24516 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:29.054525 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.088348 24521 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:29.058951 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:28.994078 28043 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:09:28.946403 28048 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:09:29.104580 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:29.107270 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:29.155628 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 48484.7us
I20260709 13:09:29.157729 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:29.158704 27925 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.159159 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:29.159650 27925 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:29.160180 27698 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:29.099117 24525 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.141637 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:29.107136 28067 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.259s	user 0.000s	sys 0.002s
I20260709 13:09:29.150007 25210 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:28.934092 27913 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.167088 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:29.105486 28050 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:29.141363 28070 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:09:29.064913 28028 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:29.140573 28064 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:09:29.088461 28071 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:29.093356 28068 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:29.111925 27838 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:29.178612 24523 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:29.137018 28063 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.150070 27465 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.137390 27966 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:29.170070 24519 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:29.092790 28009 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:09:29.089958 27844 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.105301 27659 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:09:29.209012 25210 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:09:29.112542 27981 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:29.217846 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.187891 27965 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:29.238981 24525 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:29.232471 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:29.240339 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:29.241295 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 136099us
I20260709 13:09:29.090443 28041 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.109295 27387 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.214756 28068 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:29.249315 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:29.240434 28074 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:09:29.167989 27961 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.252243 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:29.258147 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:29.263546 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.266124 24525 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:29.223572 27852 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.260785 24517 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
W20260709 13:09:29.255813 28065 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 13:09:29.272987 28009 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.251663 28044 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:29.259524 28062 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.284281 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:29.289865 25218 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:29.290343 28043 consensus_queue.cc:1243] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:29.291227 25218 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:29.294939 25218 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:29.280231 28066 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 13:09:29.300822 25213 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:29.299425 27679 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:09:29.283378 28050 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.299757 28044 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.296729 28071 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.432516 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.432638 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.411230 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.363696 25214 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:29.475883 24597 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.436039 25218 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:29.475188 24594 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.410208 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.353698 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.477396 24591 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:29.381873 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.300696 28068 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.320811 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:29.480098 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.483799 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.484432 24591 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:29.488178 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 108550us
I20260709 13:09:29.494065 24598 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:29.496665 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.499506 24519 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:29.500273 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:29.501173 24516 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:29.312028 28043 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.502890 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.493234 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:29.508172 25214 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:29.508996 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:29.425731 27981 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.499557 27966 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:09:29.517921 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.490023 27844 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:29.522650 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.523661 28094 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:29.524575 27660 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:29.502960 28082 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.531585 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.532588 24597 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:29.537379 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.537685 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.538497 24597 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:29.530026 28068 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.557415 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.559758 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.560885 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.562458 28095 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.563513 28095 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:29.563956 28095 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:29.565071 28095 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.569391 28095 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.572855 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.574167 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.578943 28112 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:29.579485 28112 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.584821 24597 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:29.589973 28086 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
W20260709 13:09:29.553890 27661 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.005s
I20260709 13:09:29.581348 27966 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.593834 27966 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:29.594551 27806 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 13:09:29.594960 27806 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:29.596706 27990 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.757s	user 0.003s	sys 0.004s
I20260709 13:09:29.548771 27852 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:29.595224 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.517304 28043 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.601723 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.540428 28082 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.621919 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.626391 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.601969 27981 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:29.631464 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.600001 28112 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:29.642239 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 88842.7us
I20260709 13:09:29.643481 24490 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:29.645349 28087 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:09:29.646535 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:29.548693 28099 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:09:29.602248 27990 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.647867 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.649220 27660 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:09:29.633900 27806 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:29.649422 27552 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.006s
I20260709 13:09:29.624195 27465 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.641151 28095 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:29.647945 28102 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:29.715884 24600 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:29.731171 24670 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:09:29.722150 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.707989 28029 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.755s	user 0.013s	sys 0.008s
I20260709 13:09:29.724948 24591 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:29.726368 24673 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:09:29.726262 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 82902.1us
I20260709 13:09:29.733245 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:29.737807 24600 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:29.737905 28090 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:29.739064 24600 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:29.642788 27981 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.743629 27981 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.750469 24599 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:29.753331 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:29.754695 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.757064 28043 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:29.727620 27387 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.758088 27387 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.760697 24523 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:29.733414 27552 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.763662 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:29.763751 27552 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:29.767005 28009 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.766754 28000 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.770232 24490 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:29.767835 28000 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.774982 24519 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:29.777629 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:29.733434 28095 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.768121 27981 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:29.790110 28082 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.735073 28029 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.729575 28102 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:29.793798 28114 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:29.788846 28012 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.719s	user 0.005s	sys 0.003s
I20260709 13:09:29.760854 27387 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.799606 24665 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:29.648154 28048 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:09:29.802446 28048 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:29.802783 28048 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:29.803340 27465 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:29.803572 28048 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.750478 28109 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.812894 27552 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:29.804874 28048 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.795253 28044 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:29.816759 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:29.798564 28099 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.801510 28000 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.798285 28072 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:29.843175 27990 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:29.799275 28012 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.842036 28028 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.834198 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:29.854839 24592 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:29.846731 27844 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:29.864125 24594 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:09:29.865697 24600 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:29.868675 24516 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:29.845736 28000 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.870424 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:29.880589 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:29.868553 27806 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.881821 24669 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:09:29.847107 28072 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.880020 28110 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.878175 28028 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 13:09:29.883330 28117 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:09:29.884200 24670 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:29.884907 28115 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:09:29.880110 28083 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.290s	user 0.004s	sys 0.000s
I20260709 13:09:29.890043 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.889298 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.892423 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:29.894464 24599 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:29.899073 24671 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.892266 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:29.896199 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:29.841805 28102 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.900365 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:29.900794 24667 raft_consensus.cc:2410] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:29.900911 24672 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.896031 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:29.904278 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:29.905956 24669 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:29.909173 28029 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.911049 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 780) took 1186 ms. Trace:
I20260709 13:09:29.911475 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.912070 24521 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.913565 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.914388 24520 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:29.914531 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:29.915205 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:29.915864 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:29.916270 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:29.917634 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:29.919160 24591 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:29.919720 24518 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:29.920861 24518 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:29.922025 24518 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:29.923338 24518 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:29.881978 27990 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:29.911417 25213 rpcz_store.cc:276] 0709 13:09:28.724905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.725047 (+   142us) service_pool.cc:224] Handling call
0709 13:09:28.750919 (+ 25872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.301615 (+550696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.910852 (+609237us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54006e46d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:29.910995 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264220032}
I20260709 13:09:29.888006 27806 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:29.877745 27844 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.933897 24666 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:29.934273 24666 pending_rounds.cc:85] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 3
I20260709 13:09:29.934504 24666 pending_rounds.cc:107] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:29.934533 27844 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.934834 24666 raft_consensus.cc:2889] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:29.916643 24673 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:29.929409 26926 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.931993 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:29.932665 27806 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.937661 24670 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:29.939491 24598 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:29.943045 28072 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:29.943991 28095 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:29.944496 28102 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.931819 28046 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:09:29.946035 26926 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.946379 26926 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:29.947103 26926 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:29.947866 28080 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.714s	user 0.002s	sys 0.000s
I20260709 13:09:29.948156 26926 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.949676 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1180) took 1060 ms. Trace:
I20260709 13:09:29.950057 25217 rpcz_store.cc:276] 0709 13:09:28.889712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.889886 (+   174us) service_pool.cc:224] Handling call
0709 13:09:28.890276 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.890558 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.890597 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.914487 (+ 23890us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.060403 (+145916us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:29.060438 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.060510 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.947355 (+886845us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:29.949385 (+  2030us) raft_consensus.cc:1685] finished
0709 13:09:29.949411 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.949617 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186773888,"thread_start_us":115147,"threads_started":1,"wal-append.queue_time_us":228856}
I20260709 13:09:29.951756 28043 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:29.954449 28046 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:29.954804 28046 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:29.955526 28046 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:29.956586 28046 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.930765 27990 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:29.957707 27990 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:29.959368 28077 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.685s	user 0.002s	sys 0.000s
W20260709 13:09:29.959972 28119 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:29.972239 28059 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:29.972668 28059 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:29.973455 28059 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:29.974655 28059 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.974921 28000 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:29.978251 28096 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
I20260709 13:09:29.984293 24672 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
W20260709 13:09:29.988091 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 189587us
I20260709 13:09:29.988396 24669 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:29.994869 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:29.994843 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:29.996065 24668 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
W20260709 13:09:30.006524 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.015657 24521 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
W20260709 13:09:30.022236 28079 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.886s	user 0.004s	sys 0.004s
I20260709 13:09:30.028074 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1184) took 1116 ms. Trace:
I20260709 13:09:30.030426 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:30.028476 25212 rpcz_store.cc:276] 0709 13:09:28.911595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.928958 (+ 17363us) service_pool.cc:224] Handling call
0709 13:09:28.929293 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.929718 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.929746 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.930153 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.065147 (+134994us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:29.065198 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.065276 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.021466 (+956190us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:30.027777 (+  6311us) raft_consensus.cc:1685] finished
0709 13:09:30.027797 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.028013 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"spinlock_wait_cycles":418331520,"thread_start_us":127544,"threads_started":1,"wal-append.queue_time_us":181129}
I20260709 13:09:30.056136 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:30.056735 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.058568 24672 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:30.014441 28012 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:30.064252 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:30.065629 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:30.066843 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:30.067723 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:30.069365 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:30.071164 26926 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.071364 24674 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:30.072902 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:30.059777 28013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.020s	sys 0.023s
I20260709 13:09:30.053596 27913 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:30.075151 28043 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.053510 27781 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:30.071861 28041 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.074352 28058 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.074142 28082 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.057331 28029 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:09:30.079102 28017 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:30.081935 28013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.020s	sys 0.023s
I20260709 13:09:30.081051 28049 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.115509 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2841) took 1079 ms. Trace:
I20260709 13:09:30.091028 28073 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.135210 24665 rpcz_store.cc:276] 0709 13:09:29.035921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.106519 (+ 70598us) service_pool.cc:224] Handling call
0709 13:09:29.151514 (+ 44995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.800875 (+649361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.115296 (+314421us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54002b5a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:30.115451 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490006272}
I20260709 13:09:30.095465 28043 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.078706 28068 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:09:30.093271 28081 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:30.158139 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2750) took 1095 ms. Trace:
W20260709 13:09:30.157716 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 69170us
I20260709 13:09:30.135190 28093 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.169178 24671 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:30.136212 28049 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.169970 24667 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:30.153643 28072 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.161619 24524 rpcz_store.cc:276] 0709 13:09:29.062848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.154183 (+ 91335us) service_pool.cc:224] Handling call
0709 13:09:29.215351 (+ 61168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.332367 (+117016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:29.332390 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.352656 (+ 20266us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.530419 (+177763us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:29.530452 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.530515 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.566938 (+ 36423us) raft_consensus.cc:1685] finished
0709 13:09:29.566955 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.155273 (+588318us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b54000bc7d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:30.158080 (+  2807us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65226,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4335,"spinlock_wait_cycles":79999744,"thread_start_us":120397,"threads_started":2,"wal-append.queue_time_us":138643}
W20260709 13:09:30.173231 28127 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:09:30.175400 28041 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:30.156605 27704 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:30.158123 28043 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.155449 28073 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:30.153764 28062 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:30.189220 24597 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:09:30.189320 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:30.189968 24597 pending_rounds.cc:85] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 6
I20260709 13:09:30.189990 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:30.190196 24595 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:30.190510 24597 pending_rounds.cc:107] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:09:30.191002 24597 raft_consensus.cc:2889] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:30.189558 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:30.192334 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:30.192950 24600 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.178542 28049 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.173234 28081 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:30.205497 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:30.207077 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:30.207666 24671 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:30.183885 28058 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:30.209897 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:30.180379 27704 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:30.205475 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:30.205900 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:30.214214 25216 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:30.214839 24593 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:09:30.203608 25217 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:30.197785 28007 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.187112 27838 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.209925 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:30.212325 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:30.205852 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:30.218617 24591 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:30.211274 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:30.219244 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:30.221391 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:30.222198 25215 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:30.223177 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:30.224838 24592 raft_consensus.cc:2410] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:30.225874 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:30.183977 27928 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:30.229852 25216 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:30.178130 28093 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.232048 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:30.234712 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:30.207269 28081 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:30.212121 28045 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:30.209717 28058 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:30.187513 28072 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.240963 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:30.221551 27844 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.251663 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.239275 27852 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.242095 28044 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.253677 27704 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:30.254870 28132 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:09:30.255177 28126 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:30.201310 28101 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
W20260709 13:09:30.255683 28128 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:30.251017 28068 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.256170 27913 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.256615 25210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:30.242815 28009 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.262070 24600 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:30.273653 24665 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:30.275928 28072 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:30.280112 28078 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.038s	user 0.000s	sys 0.012s
W20260709 13:09:30.283375 28116 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.426s	user 0.005s	sys 0.000s
W20260709 13:09:30.286152 28084 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.064s	user 0.001s	sys 0.002s
I20260709 13:09:30.293514 28044 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:30.294230 28104 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.649s	user 0.003s	sys 0.000s
I20260709 13:09:30.294466 27704 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.295042 27965 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:30.255576 28060 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.249212 28045 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.296792 28058 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:30.264632 28098 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:30.299757 28125 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:09:30.246098 28028 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.229403 27838 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.228477 28007 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.359755 28141 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.360316 28141 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.314785 25210 raft_consensus.cc:606] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:30.361182 28058 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:30.319886 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68292.7us
I20260709 13:09:30.362459 28141 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:30.362413 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.364059 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.314445 27661 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.319990 28112 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.318408 28068 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:30.265134 27852 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.321852 27913 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.372897 28045 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:30.374334 27913 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:30.374488 28137 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:30.325498 27990 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.374842 28137 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:30.375681 28137 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:30.376286 27990 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:30.376854 27838 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:30.378557 27838 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.344834 27965 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:30.351177 28072 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:30.243561 28073 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.361258 25210 raft_consensus.cc:614] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:30.317128 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 261043us
I20260709 13:09:30.348649 27806 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:30.344834 28143 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.322352 28009 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.373517 28045 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.383706 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.392443 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1181) took 1500 ms. Trace:
I20260709 13:09:30.392966 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.368778 25211 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:30.385035 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 133644us
I20260709 13:09:30.361220 28098 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:30.394796 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 188710us
I20260709 13:09:30.368505 28112 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:30.376873 28137 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.412938 24666 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:30.413117 24673 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:30.413676 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:30.392796 25219 rpcz_store.cc:276] 0709 13:09:28.891863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.926135 (+ 34272us) service_pool.cc:224] Handling call
0709 13:09:28.926813 (+   678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.927208 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:28.927234 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.927704 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.040970 (+113266us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:29.041024 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.041123 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.279203 (+1238080us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:30.387823 (+108620us) raft_consensus.cc:1685] finished
0709 13:09:30.387843 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.392382 (+  4539us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1096,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":163329024,"thread_start_us":112876,"threads_started":1,"wal-append.queue_time_us":221773}
I20260709 13:09:30.417441 28017 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:30.412910 25215 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:30.365134 28028 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:30.422219 28141 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.338624 28081 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:30.423137 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:30.409762 27990 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:30.424301 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 213115us
W20260709 13:09:30.427199 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.414287 28068 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.388005 28072 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.410039 27913 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.429884 28068 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.428144 28017 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:30.395223 28143 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.429690 27806 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:30.423570 28141 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:30.454600 28072 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:30.456657 28093 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:30.457358 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:30.457857 28112 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:30.458789 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 545899us
I20260709 13:09:30.459295 28110 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:30.459892 28151 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:09:30.460527 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 465734us
I20260709 13:09:30.424656 28044 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:30.492475 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:30.425038 28007 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:30.463565 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:30.467212 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.496380 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.499619 24595 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:30.480170 27465 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.485401 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:30.507642 24665 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
W20260709 13:09:30.490833 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 126862us
I20260709 13:09:30.491712 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:30.493448 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.479916 28141 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.429636 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:30.510003 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.510026 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:30.510601 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 81023.7us
I20260709 13:09:30.511195 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:30.501708 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.483477 28043 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:30.486227 28017 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:30.515697 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:30.577446 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 67517.7us
I20260709 13:09:30.580057 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.496923 28112 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.581858 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:30.582266 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 72326.5us
I20260709 13:09:30.582767 24516 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:30.519102 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:30.597409 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:30.598574 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 91682.8us
I20260709 13:09:30.598927 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:30.497324 28130 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.606586 24594 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:30.611213 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 109611us
I20260709 13:09:30.577878 28102 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.577241 28044 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.583900 28060 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:30.629360 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 49405.1us
I20260709 13:09:30.614917 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.616364 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:30.514549 27913 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.613936 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:30.497704 27662 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:09:30.612758 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:30.671123 26926 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:30.671115 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 56265.8us
I20260709 13:09:30.674510 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:30.599697 27990 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:30.677117 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60820.2us
I20260709 13:09:30.679606 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:30.676743 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 62841.8us
W20260709 13:09:30.668483 28144 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:09:30.612077 28089 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.682020 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:30.621438 28110 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.610515 27852 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:30.612195 27806 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:09:30.700198 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.602169 28099 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.655979 28102 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.668638 28152 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.689769 27465 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:30.723937 24672 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:09:30.699123 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 98983.2us
I20260709 13:09:30.689939 27387 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.674948 28029 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.718113 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:30.677193 27704 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:30.698289 28028 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:30.689571 28012 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.853022 27704 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.853590 28012 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.854049 28012 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.856139 28012 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:30.629884 27966 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:09:30.855338 27704 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:30.860633 27966 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.861274 27966 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.863988 27966 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:30.865388 28102 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:30.836251 28120 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.112s	user 0.008s	sys 0.016s
I20260709 13:09:30.501134 28098 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.674793 28044 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:09:30.745908 28113 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:09:30.699831 28009 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:30.838750 27552 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:30.839805 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 114494us
I20260709 13:09:30.733521 28136 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:09:30.708299 28071 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:30.907259 28071 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:30.907163 27965 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.899508 28113 consensus_queue.cc:1243] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:30.908692 27965 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.908403 28071 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:30.744283 28121 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:30.835054 28089 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.629674 28130 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:30.894929 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.912334 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.833811 27465 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:30.872047 28109 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:30.834235 27913 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:30.905164 27552 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.726377 28153 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:09:30.908982 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:30.907259 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:30.895948 28043 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:30.720633 28099 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.935272 24519 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:30.938671 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:30.726015 28152 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.915050 28143 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:30.949191 28107 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.144s	user 0.000s	sys 0.005s
I20260709 13:09:30.937165 27806 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.951984 27806 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:30.949117 28007 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.953500 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 692) took 1686 ms. Trace:
I20260709 13:09:30.871238 28017 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:30.959034 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51861us
I20260709 13:09:30.959059 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:30.964175 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.953967 24517 rpcz_store.cc:276] 0709 13:09:29.266975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.275247 (+  8272us) service_pool.cc:224] Handling call
0709 13:09:29.296199 (+ 20952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.299387 (+  3188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:29.299427 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.309650 (+ 10223us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.518124 (+208474us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:29.518161 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.518222 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.580506 (+1062284us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:30.953154 (+372648us) raft_consensus.cc:1685] finished
0709 13:09:30.953175 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.953431 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2531,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6448,"spinlock_wait_cycles":11542400,"thread_start_us":208079,"threads_started":1,"wal-append.queue_time_us":338301}
I20260709 13:09:30.931831 27913 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:30.970677 27552 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:30.971751 27913 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:30.973407 27465 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:30.977595 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:30.979378 24598 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:31.000524 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.000993 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.002529 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.004154 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.004974 24525 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:31.006094 24525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:09:31.006763 24525 raft_consensus.cc:606] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:31.007122 24525 raft_consensus.cc:614] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:30.917418 28089 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:31.018496 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 327093us
I20260709 13:09:30.966037 28094 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:30.928313 28109 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:31.048568 28162 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:09:31.050061 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1652) took 1137 ms. Trace:
W20260709 13:09:31.051021 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.053148 28152 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:31.053738 28137 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.634s	user 0.001s	sys 0.014s
I20260709 13:09:31.055757 28089 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:31.059959 28167 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:09:31.050474 24518 rpcz_store.cc:276] 0709 13:09:29.912490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.932396 (+ 19906us) service_pool.cc:224] Handling call
0709 13:09:29.993645 (+ 61249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.460212 (+466567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.460244 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:30.460711 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:09:30.622675 (+161964us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:30.622713 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.622774 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.049813 (+427039us) raft_consensus.cc:1685] finished
0709 13:09:31.049837 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.049992 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":568075,"raft.queue_time_us":471430,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5478,"thread_start_us":161610,"threads_started":1,"wal-append.queue_time_us":258668}
W20260709 13:09:31.061699 28068 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.002s
I20260709 13:09:31.062155 27781 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.062726 28143 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:31.062671 27781 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.063360 28143 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.064666 27806 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.065706 24518 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:31.066308 28058 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.704s	user 0.009s	sys 0.001s
I20260709 13:09:31.024088 28094 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.068758 28094 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.045590 28043 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:31.069928 24524 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:31.071748 24517 raft_consensus.cc:2410] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:31.064915 27781 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:31.075845 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 50141.6us
I20260709 13:09:31.102236 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.104894 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.106187 24592 raft_consensus.cc:2410] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:31.108945 28099 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.110220 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.115662 28109 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:31.118383 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.119563 28049 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.906s	user 0.007s	sys 0.004s
I20260709 13:09:31.120029 28049 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.121526 28130 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.122478 28175 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:31.123169 28175 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.129281 24525 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:09:31.130702 28141 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.531s	user 0.000s	sys 0.009s
I20260709 13:09:31.131362 28141 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:31.132385 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 685647us
I20260709 13:09:31.134166 28141 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.137478 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.130829 28049 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.122509 28143 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.143002 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.145641 28043 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:31.146193 28007 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:31.146741 28007 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.147367 28072 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.148000 28094 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:31.148674 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 464867us
I20260709 13:09:31.149528 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.150297 28130 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:31.155180 28114 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:31.155675 28114 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:31.158430 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.159035 24665 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:31.162832 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.163981 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.164819 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:31.165472 24671 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.164091 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:31.166560 24670 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.169688 28094 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.172833 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:31.173446 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.174403 24668 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:31.175182 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.175339 28062 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:31.175701 28109 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:31.176445 28062 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:31.177670 28099 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:31.178277 28073 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.178356 28175 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.178972 28109 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:31.179368 28109 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:31.156718 28114 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:31.181627 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:31.182219 28114 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.183002 27661 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:31.183715 28183 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.184464 28183 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:31.180263 28109 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.187603 28109 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:31.189764 28157 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.296s	user 0.003s	sys 0.000s
I20260709 13:09:31.176853 28062 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:31.194031 28062 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.199046 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.195627 28091 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:31.199317 28062 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.202915 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.203655 24666 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:31.204638 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.205582 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.206710 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.208664 28091 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.209550 24599 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:31.209961 24599 pending_rounds.cc:85] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 7
I20260709 13:09:31.210196 24599 pending_rounds.cc:107] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:31.210438 24599 raft_consensus.cc:2889] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:31.211066 27852 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.211613 27852 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.212638 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1384) took 1026 ms. Trace:
I20260709 13:09:31.214345 27852 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.215359 27661 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:31.215960 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.219096 27852 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.219050 25210 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:31.219651 27852 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.220366 28174 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:31.220674 24666 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:31.215903 27661 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.221846 28170 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:31.222472 27852 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.222765 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:31.220419 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:31.224299 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44405.6us
W20260709 13:09:31.225239 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 52492.6us
I20260709 13:09:31.229449 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:31.230221 24666 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.231766 24670 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:31.232831 24673 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:09:31.233673 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.224004 25211 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:31.213018 24599 rpcz_store.cc:276] 0709 13:09:30.186482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.193947 (+  7465us) service_pool.cc:224] Handling call
0709 13:09:30.194219 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.210897 (+1016678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.212413 (+  1516us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400193cd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:31.212584 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2333963136}
I20260709 13:09:31.222389 28170 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.240378 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.241570 25211 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:31.243255 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:31.244028 25211 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.239002 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:31.249199 24671 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:31.222689 27661 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:31.220930 28174 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:31.258054 24520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.009s	sys 0.018s
I20260709 13:09:31.265431 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.266582 25213 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:31.265595 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:31.266997 24520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.009s	sys 0.018s
I20260709 13:09:31.267261 25210 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.268466 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:09:31.267086 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:31.236153 27806 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.269132 24519 raft_consensus.cc:606] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:31.248220 27913 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.244853 27852 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.271049 24519 raft_consensus.cc:614] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:31.245399 28175 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:31.255894 28073 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:31.292515 28170 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.293681 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.294332 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:09:31.294920 24519 raft_consensus.cc:606] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:31.295279 24519 raft_consensus.cc:614] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:31.283604 25211 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:31.280100 24666 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:31.298199 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.298862 25211 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:31.299678 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.300254 25211 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:31.301092 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.302130 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.302433 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:31.303135 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.303845 24600 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:31.305102 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.305270 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.305821 24600 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:31.306846 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:31.312318 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.313881 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.314770 24597 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:31.335183 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.246340 28141 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:09:31.337240 26926 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:31.337955 26926 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:31.273749 28050 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:31.342329 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:31.350183 26926 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.270953 28113 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:09:31.355050 24592 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:31.316461 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.373979 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.376910 25211 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
I20260709 13:09:31.378680 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.380589 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:31.381999 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.294930 28174 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.290387 27913 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.317133 28073 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:31.346391 28130 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:31.397459 28130 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.399655 28130 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.402002 28160 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:31.402585 28160 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.403927 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.404320 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.404654 24671 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:31.372926 28098 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.406890 24666 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:31.406706 28007 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.410298 28007 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.411513 28073 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.413195 28095 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:09:31.297320 28175 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.413913 28170 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:31.414871 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.415397 28175 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.415468 28170 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:31.416038 28175 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:31.396872 27913 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:31.297158 27852 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.384088 28017 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.417477 28017 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:31.351410 28050 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:31.419137 28050 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.419845 28017 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:31.421440 28082 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:31.421867 28082 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:31.422067 27852 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.422785 28082 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.404783 28160 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.423825 28082 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.424198 28098 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.427423 28098 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:31.435184 28081 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.435580 25210 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:31.436622 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.437714 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:31.438777 28098 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:31.439579 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 66144.5us
I20260709 13:09:31.439764 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:31.440533 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.441345 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:31.442523 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:31.438621 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:31.443823 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:31.445526 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.446882 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.447664 25210 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:31.448839 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:31.461001 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:31.467983 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.469851 28007 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:31.439313 28098 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:31.515654 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 75214.9us
I20260709 13:09:31.511168 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.516644 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.469514 27913 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:31.523353 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:31.524529 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.470912 27852 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:31.481328 28174 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.477761 27661 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:31.540098 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.542508 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:31.509846 28017 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.508330 27552 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.546011 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:31.523034 28098 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.508529 27704 raft_consensus.cc:2764] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:31.522706 28113 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.473557 27465 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:09:31.531582 27913 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.522850 28141 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:31.560954 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.534992 27852 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.539597 28130 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.543843 28071 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:31.639227 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 78374.6us
I20260709 13:09:31.571528 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:31.614776 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.640341 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:31.549209 28150 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.566916 27913 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.567150 28009 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:31.665727 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.701423 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 690) took 1170 ms. Trace:
I20260709 13:09:31.699893 28150 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.664397 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:31.751559 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 87238us
I20260709 13:09:31.749184 24598 rpcz_store.cc:276] 0709 13:09:30.514993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.516610 (+  1617us) service_pool.cc:224] Handling call
0709 13:09:30.516989 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.982157 (+465168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.684865 (+702708us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540021be54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:31.685095 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062669568}
W20260709 13:09:31.745223 28114 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.005s
I20260709 13:09:31.696453 28017 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:31.709434 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.761093 24524 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
W20260709 13:09:31.712738 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.590492 27852 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.641112 28170 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.547842 27661 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.684540 27781 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:31.729295 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.777844 24516 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
W20260709 13:09:31.733898 28184 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:09:31.738524 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.740805 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.703238 28009 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.698951 28113 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:31.708833 28183 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:31.654894 28130 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.713824 28042 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.720314 28007 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:31.662696 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 91281.4us
I20260709 13:09:31.770095 27465 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:31.754398 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:31.565984 27387 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.640245 28072 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:31.804312 28072 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.794209 28113 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.805982 27966 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:31.806584 28186 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:31.807034 28013 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:31.756327 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.808045 28113 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.763386 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 703) took 1168 ms. Trace:
I20260709 13:09:31.809523 27928 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.810083 27928 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.655628 28187 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.778970 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.780403 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.779955 28153 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.796523 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.797405 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.788071 28009 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.821556 24668 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:31.798558 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.799705 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.823206 24519 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:31.748955 27965 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:09:31.802811 28188 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:09:31.803493 28191 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:31.791742 28183 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:31.806474 27966 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:31.756443 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.832157 24520 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:31.800750 27465 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:31.655016 28141 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.812341 27928 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.818379 24524 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:31.795637 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.840680 24666 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:31.809677 24525 rpcz_store.cc:276] 0709 13:09:30.594838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.008140 (+413302us) service_pool.cc:224] Handling call
0709 13:09:31.128847 (+120707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.129774 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.763152 (+633378us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540006dbd0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:31.763318 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276649216}
I20260709 13:09:31.825574 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:31.827203 24668 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:31.845618 27844 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:31.828063 24516 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:31.846213 27844 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.848387 27844 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:31.832680 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:31.834991 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:09:31.850085 24519 raft_consensus.cc:606] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:31.850420 24519 raft_consensus.cc:614] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:31.821038 28102 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:31.852717 28009 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.801451 27806 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.854302 28189 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:09:31.854142 27806 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.855398 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1653) took 1260 ms. Trace:
I20260709 13:09:31.855790 24522 rpcz_store.cc:276] 0709 13:09:30.595141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.010247 (+415106us) service_pool.cc:224] Handling call
0709 13:09:31.055196 (+ 44949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.055611 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.055645 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.056150 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.477895 (+421745us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:31.477941 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.478015 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.855179 (+377164us) raft_consensus.cc:1685] finished
0709 13:09:31.855196 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:31.855335 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":414061,"threads_started":1,"wal-append.queue_time_us":664713}
I20260709 13:09:31.848670 24593 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:31.856788 27806 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:31.783596 28170 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:31.813239 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60265.2us
I20260709 13:09:31.864251 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:31.865512 28170 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.865739 24490 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:31.866757 28062 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.853499 28102 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.867803 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:31.829602 27661 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.876013 24592 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:31.872056 28071 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:31.873064 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.831875 28183 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.878980 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.883347 24591 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:31.875726 28102 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.838361 27465 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.813534 28007 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.977607 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.824869 28153 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.875109 28114 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:31.931994 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:31.987053 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.859782 28009 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:31.926069 27552 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.997440 27552 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:31.999941 27552 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:31.952035 24592 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:32.000542 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.001200 24516 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:32.001292 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:32.001384 27781 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.001928 27781 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.003168 28150 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.966233 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.967471 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:31.960250 28073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.016s	sys 0.029s
I20260709 13:09:31.940979 28143 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.989955 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:31.934314 27966 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:31.990335 24517 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:31.994256 28141 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:31.935081 27387 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:09:31.997766 28130 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:31.965543 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:31.934593 28071 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:31.964884 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:31.990139 28196 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:09:32.006868 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.085299 24597 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:32.007822 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:32.015085 25217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.020s	sys 0.028s
W20260709 13:09:32.086706 25217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.020s	sys 0.028s
I20260709 13:09:32.080539 24517 pending_rounds.cc:85] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 3
I20260709 13:09:32.073711 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.087352 24517 pending_rounds.cc:107] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:32.087738 24517 raft_consensus.cc:2889] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:32.069061 24592 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:32.061403 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.062610 24522 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:32.088886 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.086236 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.080909 24594 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:32.095700 24597 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:31.988943 28114 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.003849 28007 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.112574 24597 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:09:32.015436 28050 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.020s	sys 0.018s
I20260709 13:09:32.136695 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.137579 24521 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:31.999960 27806 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.026129 27928 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:09:32.005940 28073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.016s	sys 0.029s
I20260709 13:09:32.163756 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:32.214843 25214 raft_consensus.cc:2410] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:09:32.134864 28050 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.021s	sys 0.019s
I20260709 13:09:32.109496 27966 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.171742 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.175179 27913 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.175912 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1399) took 1073 ms. Trace:
I20260709 13:09:32.177105 28109 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:32.177716 27465 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.179960 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:32.185889 28153 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.187378 28082 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.188553 28170 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.189725 28072 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.189915 25218 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:32.192191 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:32.251901 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 59781.9us
I20260709 13:09:32.103091 28081 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.102355 28150 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.196045 27660 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.198573 27852 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.200065 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 745) took 1029 ms. Trace:
I20260709 13:09:32.240423 28141 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.217653 27928 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:32.200237 28174 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.003s
I20260709 13:09:32.202039 27806 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:32.260830 25211 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.019s	sys 0.008s
I20260709 13:09:32.164557 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:32.240260 28109 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:32.100266 28114 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.134637 28091 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.224489 24600 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:09:32.262925 24672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.029s	sys 0.032s
I20260709 13:09:32.225004 24593 rpcz_store.cc:276] 0709 13:09:31.102449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.103606 (+  1157us) service_pool.cc:224] Handling call
0709 13:09:32.175712 (+1072106us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54001ec8d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:32.175823 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696633600}
W20260709 13:09:32.263239 24672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.030s	sys 0.032s
I20260709 13:09:32.243562 25215 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:32.017951 28143 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.246443 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1200) took 1027 ms. Trace:
I20260709 13:09:32.255362 25218 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:32.256749 27387 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:32.215237 24669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.027s	sys 0.033s
W20260709 13:09:32.266577 24669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.028s	sys 0.033s
I20260709 13:09:32.267313 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2864) took 1121 ms. Trace:
I20260709 13:09:32.267184 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2866) took 1106 ms. Trace:
I20260709 13:09:32.273456 25210 raft_consensus.cc:2368] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:32.274590 24595 raft_consensus.cc:2410] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:32.275017 25218 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:32.268461 25216 rpcz_store.cc:276] 0709 13:09:31.218926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.236001 (+ 17075us) service_pool.cc:224] Handling call
0709 13:09:31.246903 (+ 10902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.247191 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:31.747822 (+500631us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.245832 (+498010us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.246088 (+   256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.246134 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:32.246183 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.246257 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.246386 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":559181,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":175,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":7183,"spinlock_wait_cycles":23318400,"thread_start_us":995029,"threads_started":2}
W20260709 13:09:32.261649 25211 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.020s	sys 0.008s
W20260709 13:09:32.261180 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.016s	sys 0.045s
I20260709 13:09:32.258070 24674 rpcz_store.cc:276] 0709 13:09:31.170666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.171068 (+   402us) service_pool.cc:224] Handling call
0709 13:09:31.171358 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.171708 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.171740 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.172170 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.541727 (+369557us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:31.541768 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.541848 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:31.845352 (+303504us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b48001b1758. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:09:32.199689 (+354337us) raft_consensus.cc:1685] finished
0709 13:09:32.199724 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.199991 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":900,"raft.run_cpu_time_us":8421,"raft.run_wall_time_us":672884,"spinlock_wait_cycles":41872256,"thread_start_us":369219,"threads_started":1,"wal-append.queue_time_us":658046}
W20260709 13:09:32.240916 25219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.016s	sys 0.025s
W20260709 13:09:32.279260 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.017s	sys 0.045s
W20260709 13:09:32.279491 25219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.017s	sys 0.025s
I20260709 13:09:32.271266 24669 rpcz_store.cc:276] 0709 13:09:31.160380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.162363 (+  1983us) service_pool.cc:224] Handling call
0709 13:09:31.162667 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.162886 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:31.548871 (+385985us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.266918 (+718047us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.266961 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:32.267000 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.267053 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.267140 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":795799,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":1101559,"threads_started":2}
W20260709 13:09:32.280046 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 708419us
I20260709 13:09:32.252385 28082 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.254550 28170 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.261008 28072 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:09:32.270700 27387 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.297883 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1199) took 1079 ms. Trace:
I20260709 13:09:32.298446 25219 rpcz_store.cc:276] 0709 13:09:31.218640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.221175 (+  2535us) service_pool.cc:224] Handling call
0709 13:09:31.221452 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.221647 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:31.547490 (+325843us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.297411 (+749921us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.297482 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:32.297554 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.297642 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.297808 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":583777,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"thread_start_us":1057558,"threads_started":2}
W20260709 13:09:32.289499 25212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.014s	sys 0.009s
W20260709 13:09:32.301488 25212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.015s	sys 0.009s
I20260709 13:09:32.260080 28081 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.263898 27660 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.264588 28141 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:32.293993 28195 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:09:32.261207 28150 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.270593 28091 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.290645 28062 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:32.315912 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1197) took 1098 ms. Trace:
I20260709 13:09:32.300881 27387 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.272339 28102 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.331032 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:32.333521 27704 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.334165 27704 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.337316 28113 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.305878 28044 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:32.338002 28113 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.338184 28044 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.340672 28044 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.342979 27660 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.267856 24672 rpcz_store.cc:276] 0709 13:09:31.144354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.151739 (+  7385us) service_pool.cc:224] Handling call
0709 13:09:31.152047 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.152236 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:31.547704 (+395468us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.265762 (+718058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.265821 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:32.265879 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.265972 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.266122 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":781470,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":5478,"raft.queue_time_us":87,"thread_start_us":1109843,"threads_started":2}
I20260709 13:09:32.264060 28071 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:32.343631 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.008s	sys 0.016s
I20260709 13:09:32.332913 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:32.347934 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.008s	sys 0.016s
I20260709 13:09:32.349584 24597 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:32.347131 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:32.353708 28212 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:09:32.357590 28210 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:32.359814 28143 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.362425 27806 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:32.364809 28183 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:32.367301 28098 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.798s	user 0.006s	sys 0.005s
I20260709 13:09:32.367763 28098 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.368582 27852 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.369369 25214 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:32.371475 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 808) took 1059 ms. Trace:
I20260709 13:09:32.369166 25212 rpcz_store.cc:276] 0709 13:09:31.217009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.217199 (+   190us) service_pool.cc:224] Handling call
0709 13:09:31.217496 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.217707 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:31.566127 (+348420us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.315443 (+749316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.315525 (+    82us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:32.315590 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.315685 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.315833 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7133,"prepare.queue_time_us":587506,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":31204,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":1081069,"threads_started":2}
I20260709 13:09:32.371798 25214 rpcz_store.cc:276] 0709 13:09:31.311804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.215664 (+903860us) service_pool.cc:224] Handling call
0709 13:09:32.216027 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.369863 (+153836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.371257 (+  1394us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54006801d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:32.371417 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352195328}
W20260709 13:09:32.376631 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.378367 28099 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:32.379328 28099 consensus_queue.cc:1243] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:32.379876 28099 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:32.380259 28099 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:32.381562 28099 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.383054 28099 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.318441 28130 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:09:32.386864 28130 consensus_queue.cc:1243] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:32.387640 28113 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.391554 28187 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:32.392050 28187 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:32.392983 28187 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.394520 28187 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.296375 28109 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.396739 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2873) took 1227 ms. Trace:
W20260709 13:09:32.410714 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 77903.1us
I20260709 13:09:32.412061 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:32.404197 24667 rpcz_store.cc:276] 0709 13:09:31.169821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.169944 (+   123us) service_pool.cc:224] Handling call
0709 13:09:31.170253 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.170668 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.170703 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.171185 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.431396 (+260211us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b48001b1758. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:09:31.660605 (+229209us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:31.660669 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.660765 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.396368 (+735603us) raft_consensus.cc:1685] finished
0709 13:09:32.396394 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.396665 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":323,"raft.run_cpu_time_us":3060,"raft.run_wall_time_us":260649,"spinlock_wait_cycles":45390720,"thread_start_us":488982,"threads_started":1,"wal-append.queue_time_us":977034}
I20260709 13:09:32.337993 27661 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:32.348307 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 806036us
I20260709 13:09:32.345427 28141 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:32.422164 28206 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:09:32.420554 28044 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:32.432010 24518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.009s	sys 0.036s
I20260709 13:09:32.331741 28062 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.424285 28109 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:32.431609 24489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.010s	sys 0.031s
W20260709 13:09:32.436725 24489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.010s	sys 0.031s
I20260709 13:09:32.436781 28130 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.437201 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.437755 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.437639 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:32.438093 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.010s	sys 0.036s
I20260709 13:09:32.344988 27781 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.424125 27928 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:32.438359 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.010s	sys 0.036s
I20260709 13:09:32.440230 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:32.442487 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 701873us
I20260709 13:09:32.443154 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:32.443646 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:32.445971 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:32.431155 28044 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.448572 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:32.449426 24672 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:32.434347 24518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.009s	sys 0.036s
I20260709 13:09:32.456727 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1205) took 1200 ms. Trace:
I20260709 13:09:32.432590 28113 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.457293 25217 rpcz_store.cc:276] 0709 13:09:31.256266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.256604 (+   338us) service_pool.cc:224] Handling call
0709 13:09:31.256965 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:31.257342 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.257367 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:31.268630 (+ 11263us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.087077 (+818447us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:32.139704 (+ 52627us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.140148 (+   444us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.198801 (+ 58653us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b18002c3b60. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:09:32.198981 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.199048 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.351875 (+152827us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18002c3b60. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:09:32.456463 (+104588us) raft_consensus.cc:1685] finished
0709 13:09:32.456492 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.456658 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55389,"prepare.queue_time_us":113288,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":59326,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":4527,"spinlock_wait_cycles":37116032,"thread_start_us":742403,"threads_started":1,"wal-append.queue_time_us":999583}
I20260709 13:09:32.435288 27913 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.458998 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:32.424794 28042 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:09:32.431946 27704 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.472214 25182 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:32.473126 27704 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.473688 27704 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.474170 27704 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.462854 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:32.477834 28102 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.479976 27781 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.480854 28098 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.481688 25182 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:32.482761 28062 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.482894 28098 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:32.483512 28098 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:32.484001 28098 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.448660 27465 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:32.486243 24670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.022s	sys 0.043s
I20260709 13:09:32.462180 24521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50160
I20260709 13:09:32.487156 24521 raft_consensus.cc:606] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:09:32.487573 24521 raft_consensus.cc:614] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:32.438629 28082 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.460879 27981 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.433701 27852 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:09:32.468583 28170 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.505527 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.469803 28150 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.514232 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:32.442076 28130 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.529176 27852 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:32.529424 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.529673 27852 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:32.530443 28091 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.467744 28009 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.531374 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:32.401022 28095 consensus_queue.cc:1175] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "983693721af6486c97ece1410a90cf30" responder_term: 8 status { last_received { term: 7 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:09:32.486696 24670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.022s	sys 0.043s
I20260709 13:09:32.530637 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:32.461279 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 708) took 1602 ms. Trace:
I20260709 13:09:32.535324 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 752) took 1133 ms. Trace:
I20260709 13:09:32.489723 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:32.492717 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:32.498857 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:32.535755 24670 rpcz_store.cc:276] 0709 13:09:31.402075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.405160 (+  3085us) service_pool.cc:224] Handling call
0709 13:09:31.405465 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.405694 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:31.818712 (+413018us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.534988 (+716276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.535058 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:32.535104 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.535166 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.535268 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":580117,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":1127264,"threads_started":2}
I20260709 13:09:32.536867 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:32.456022 28044 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:32.461056 28141 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:32.508373 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:32.516532 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:32.520552 24595 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:32.520754 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:32.465103 28081 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.537588 24517 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:32.576220 24637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.017s	sys 0.025s
W20260709 13:09:32.576552 24637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.017s	sys 0.025s
I20260709 13:09:32.579406 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:32.496053 28062 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:32.465879 28113 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:32.576920 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 782116us
I20260709 13:09:32.500584 28143 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:09:32.534747 24518 rpcz_store.cc:276] 0709 13:09:30.858827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.066495 (+207668us) service_pool.cc:224] Handling call
0709 13:09:31.066813 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.067015 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:31.072103 (+  5088us) log.cc:844] Serialized 14 byte log entry
0709 13:09:31.787944 (+715841us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b18003636a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a 00007f17bbf50a2a
0709 13:09:32.460831 (+672887us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.460898 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:32.460961 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.461042 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.461212 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9735,"prepare.queue_time_us":4824,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":956,"raft.queue_time_us":9861,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":7499648,"thread_start_us":662807,"threads_started":1}
I20260709 13:09:32.601871 24516 raft_consensus.cc:2410] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:32.572255 28141 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.575947 28102 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:32.577857 27913 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.583033 28183 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:32.607344 24471 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0131806e3b9647128f32db1ab8d314fc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:09:32.608026 24420 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 344) took 21283 ms (client timeout 15000 ms). Trace:
W20260709 13:09:32.612989 24471 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:09:32.613668 24471 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:09:32.615658 24524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.009s	sys 0.020s
W20260709 13:09:32.616080 24524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.009s	sys 0.021s
I20260709 13:09:32.628192 24518 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:32.612142 28102 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.633891 24597 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:32.625017 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:32.643548 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:32.645854 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:32.606886 28141 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.657709 24521 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:09:32.530555 27852 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.658185 24521 pending_rounds.cc:85] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 10
I20260709 13:09:32.658586 24521 pending_rounds.cc:107] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:09:32.658834 24521 raft_consensus.cc:2889] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:32.585150 27552 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:09:32.635946 28102 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.667351 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.668097 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:32.668813 24672 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:32.672264 24599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.014s	sys 0.060s
I20260709 13:09:32.672533 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:32.675447 24599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.014s	sys 0.060s
I20260709 13:09:32.587714 28062 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:32.614056 24420 rpcz_store.cc:269] 0709 13:09:11.331266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.338399 (+  7133us) service_pool.cc:224] Handling call
0709 13:09:32.607958 (+21269559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:28.495935 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:28.608857 (+112922us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:28.623534 (+ 14677us) write_op.cc:435] Acquired schema lock
0709 13:09:28.623553 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:28.634595 (+ 11042us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:28.634685 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:28.634729 (+    44us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:09:28.636304 (+  1575us) tablet.cc:701] Row locks acquired
0709 13:09:28.636366 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:09:28.636574 (+   208us) write_op.cc:270] Start()
0709 13:09:28.636768 (+   194us) write_op.cc:276] Timestamp: P: 1783602568636497 usec, L: 0
0709 13:09:28.636801 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:09:28.755849 (+119048us) log.cc:844] Serialized 4860 byte log entry
0709 13:09:29.958001 (+1202152us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:30.209676 (+251675us) op_driver.cc:464] REPLICATION: finished
0709 13:09:30.426093 (+216417us) write_op.cc:301] APPLY: starting
0709 13:09:30.443454 (+ 17361us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:30.443766 (+   312us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:30.443805 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:30.833356 (+389551us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:30.962163 (+128807us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:09:30.969130 (+  6967us) write_op.cc:312] APPLY: finished
0709 13:09:31.076423 (+107293us) log.cc:844] Serialized 89 byte log entry
0709 13:09:31.076609 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:31.076761 (+   152us) write_op.cc:454] Released schema lock
0709 13:09:31.076843 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:31.080513 (+  3670us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:31.080550 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":397597,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":160707,"apply.run_cpu_time_us":5897,"apply.run_wall_time_us":665241,"num_ops":12,"prepare.queue_time_us":317144,"prepare.run_cpu_time_us":83302,"prepare.run_wall_time_us":610525,"raft.queue_time_us":204700,"raft.run_cpu_time_us":14340,"raft.run_wall_time_us":180503,"replication_time_us":1545586,"spinlock_wait_cycles":108970240,"thread_start_us":587356,"threads_started":4,"wal-append.queue_time_us":434659,"wal-append.run_cpu_time_us":18472,"wal-append.run_wall_time_us":2908548}]]}
I20260709 13:09:32.678669 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:32.681412 24674 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:32.660574 27465 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:32.691244 25184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.530s (SENT) [suppressed 17 similar messages]
I20260709 13:09:32.666213 28187 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.700536 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:32.662649 27981 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:32.701799 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:32.612998 24421 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 5 to 6, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.719055 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.720422 24597 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
W20260709 13:09:32.720954 24665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.024s	sys 0.052s
W20260709 13:09:32.721280 24665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.024s	sys 0.052s
W20260709 13:09:32.725045 24592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.024s	sys 0.037s
W20260709 13:09:32.726167 24592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.024s	sys 0.037s
W20260709 13:09:32.730258 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.026s	sys 0.036s
I20260709 13:09:32.704802 28183 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.676779 27966 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:09:32.667843 28098 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.738037 24672 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
W20260709 13:09:32.736590 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.027s	sys 0.036s
I20260709 13:09:32.707944 28102 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:32.740724 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:32.722602 27981 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:32.776932 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.784993 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.784785 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.786513 24595 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:32.787698 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.787302 24421 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 4 to 7, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 7 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.788793 24591 raft_consensus.cc:2410] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:32.793661 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.775843 28095 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.796627 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.796937 28095 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.798918 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:32.799264 28219 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:32.797320 24593 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:32.799657 28219 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.799999 28219 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.769768 28183 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:32.802508 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.803333 24597 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:32.805497 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.806221 24596 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:32.806429 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.807786 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.808722 24518 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:09:32.810189 24525 raft_consensus.cc:2410] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:32.811574 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.812103 24525 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
W20260709 13:09:32.815534 28114 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.002s
I20260709 13:09:32.815861 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:32.815941 28114 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.821907 27928 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.822345 27928 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:32.822721 27928 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.825922 28113 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.826683 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.827304 24522 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:32.827770 28102 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.828240 28098 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.828264 28102 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.829653 27965 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:32.830186 27965 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.830569 27928 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.831187 28102 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.779608 27552 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.832144 27965 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.832775 27928 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.714579 28187 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.834360 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.834672 28187 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:32.834959 24597 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:32.836380 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.836908 24597 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:32.837181 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:32.735970 28130 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.838974 28042 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.839473 28042 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.841156 27661 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:32.841733 28042 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:32.846187 28216 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:09:32.834610 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:32.849061 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 785) took 1577 ms. Trace:
W20260709 13:09:32.850093 28218 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:32.849870 25213 rpcz_store.cc:276] 0709 13:09:31.271716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.271855 (+   139us) service_pool.cc:224] Handling call
0709 13:09:31.282837 (+ 10982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.308644 (+ 25807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.308695 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.336089 (+ 27394us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.835644 (+499555us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:31.835698 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.835781 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.848812 (+1013031us) raft_consensus.cc:1685] finished
0709 13:09:32.848841 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.848999 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6718,"raft.queue_time_us":53630,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":7525,"thread_start_us":462975,"threads_started":1,"wal-append.queue_time_us":1505136}
I20260709 13:09:32.832651 27552 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.838251 24596 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:32.812986 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.857923 24525 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:32.850212 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:32.859658 24517 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:32.860659 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:32.860989 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:32.862125 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:32.865200 24520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.003s	sys 0.023s
W20260709 13:09:32.865561 24520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.003s	sys 0.023s
I20260709 13:09:32.771461 28050 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:32.871748 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:32.879918 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:32.887245 27552 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:32.888056 27552 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:32.889366 28050 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.890023 28150 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.890554 28150 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.890970 28150 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.892804 28050 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:32.892988 27661 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:32.877144 28081 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.893708 28170 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:09:32.864578 24421 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.888123 27981 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:32.913982 27852 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.919531 28044 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.824774 27704 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.926335 28042 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.929450 28223 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:32.930078 24594 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.011s	sys 0.020s
W20260709 13:09:32.997709 24594 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.011s	sys 0.020s
I20260709 13:09:32.775544 28211 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
W20260709 13:09:32.943787 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.871136 28222 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.871073 28099 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.990660 24421 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 6, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 6 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:33.006318 27704 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:33.007570 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:33.015820 24517 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.016165 25214 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:33.002202 28042 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.013521 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1662) took 1348 ms. Trace:
I20260709 13:09:32.888736 27552 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:32.957898 27661 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:33.016938 24524 rpcz_store.cc:276] 0709 13:09:31.664936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.840352 (+175416us) service_pool.cc:224] Handling call
0709 13:09:31.843207 (+  2855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.843584 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:31.843884 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.616703 (+772819us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.637727 (+ 21024us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.637868 (+   141us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:32.637913 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.637995 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.013311 (+375316us) raft_consensus.cc:1685] finished
0709 13:09:33.013331 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.013467 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":586,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":5568,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":6547,"thread_start_us":772307,"threads_started":1,"wal-append.queue_time_us":1158497}
I20260709 13:09:33.033701 24517 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:33.001605 28081 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.034736 24421 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.027390 28062 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:33.038123 25211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.001s	sys 0.044s
W20260709 13:09:33.038516 25211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.001s	sys 0.044s
I20260709 13:09:33.039506 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 786) took 1766 ms. Trace:
I20260709 13:09:33.015336 28099 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.014130 28222 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:33.039933 25211 rpcz_store.cc:276] 0709 13:09:31.273018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.558701 (+285683us) service_pool.cc:224] Handling call
0709 13:09:31.559048 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.559343 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:32.279236 (+719893us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.039057 (+759821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.039127 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.039185 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.039300 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.039442 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":246424,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":97,"thread_start_us":1447750,"threads_started":2}
W20260709 13:09:33.019009 28071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.010s	sys 0.019s
I20260709 13:09:33.070523 24421 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:33.041898 27844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.023s	sys 0.040s
I20260709 13:09:33.014366 28223 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.040742 28007 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.085176 24421 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 4 to 5, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 5 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:33.068339 28071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.010s	sys 0.019s
I20260709 13:09:33.066993 28222 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:33.042234 24598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.013s	sys 0.015s
I20260709 13:09:33.041800 28099 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:33.122020 24598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.014s	sys 0.015s
W20260709 13:09:33.104489 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.005s	sys 0.011s
I20260709 13:09:33.123106 25182 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:33.123090 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.012s
W20260709 13:09:33.124130 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 547834us
W20260709 13:09:33.087553 27844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.023s	sys 0.040s
I20260709 13:09:33.124893 24639 leader_election.cc:400] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:33.138476 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:33.143707 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 698) took 1175 ms. Trace:
I20260709 13:09:33.143887 24639 leader_election.cc:403] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:33.040843 28081 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.144153 24592 rpcz_store.cc:276] 0709 13:09:31.968328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.089945 (+121617us) service_pool.cc:224] Handling call
0709 13:09:32.090305 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.153060 (+ 62755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.157732 (+  4672us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.170099 (+ 12367us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.728332 (+558233us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:32.734981 (+  6649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.735076 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.143499 (+408423us) raft_consensus.cc:1685] finished
0709 13:09:33.143519 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.143653 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44531,"raft.queue_time_us":68891,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87,"thread_start_us":557320,"threads_started":1,"wal-append.queue_time_us":853909}
W20260709 13:09:33.113895 27387 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.001s
I20260709 13:09:33.178174 27387 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.151896 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:33.182320 24596 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:33.151870 27704 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:33.143042 27661 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:33.154950 28226 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:33.161916 28044 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:33.166770 28143 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:33.087000 28183 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:33.161757 28223 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:33.169988 28042 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:33.171303 27552 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:33.171591 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:33.173365 28081 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:33.176559 27844 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.177147 28095 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:33.083123 28141 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.201159 24421 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.185177 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:33.186728 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:33.221325 24524 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
W20260709 13:09:33.187155 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.014s
I20260709 13:09:33.180774 27387 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:33.194954 24600 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:33.196483 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:33.147455 28114 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:33.212147 24517 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 6: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:33.221921 24637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.000s	sys 0.020s
W20260709 13:09:33.222306 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.011s	sys 0.014s
W20260709 13:09:33.188347 28160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.012s	sys 0.019s
I20260709 13:09:33.297843 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.298671 25211 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:33.299377 28017 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.246259 28095 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:33.300205 28095 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.300796 28095 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.201525 27704 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:33.276046 24519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.017s	sys 0.000s
W20260709 13:09:33.294066 24665 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.043s	sys 0.055s
W20260709 13:09:33.314155 24519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.017s	sys 0.000s
W20260709 13:09:33.231060 24637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.000s	sys 0.021s
I20260709 13:09:33.294463 24669 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:33.314172 24665 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.044s	sys 0.055s
I20260709 13:09:33.222610 27552 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:33.227913 24421 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 5 to 6, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.294463 28044 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.320695 28044 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.323244 28044 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:33.324892 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2867) took 2156 ms. Trace:
I20260709 13:09:33.325120 24490 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:33.316298 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 728695us
W20260709 13:09:33.317109 25184 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.031s	sys 0.079s
I20260709 13:09:33.223116 28143 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:33.327029 25184 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.031s	sys 0.079s
W20260709 13:09:33.327893 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 636641us
I20260709 13:09:33.328286 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1599) took 1454 ms. Trace:
W20260709 13:09:33.313426 28160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.013s	sys 0.020s
I20260709 13:09:33.329613 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:33.244976 28009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.017s	sys 0.012s
I20260709 13:09:33.323855 28223 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.222282 27844 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.325336 24665 rpcz_store.cc:276] 0709 13:09:31.160694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.163424 (+  2730us) service_pool.cc:224] Handling call
0709 13:09:31.163765 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.163971 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:31.573608 (+409637us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.316592 (+1742984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.316658 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:33.316715 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.316804 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.316961 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":821544,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":404465,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8324,"thread_start_us":2151793,"threads_started":3,"wal-append.queue_time_us":1498406}
I20260709 13:09:33.332000 28183 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.334575 28044 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:33.295179 28098 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.326820 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:33.342144 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 699) took 1373 ms. Trace:
I20260709 13:09:33.343392 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:33.347282 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:33.347962 25211 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.330864 24421 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.318670 27781 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:33.328672 24599 rpcz_store.cc:276] 0709 13:09:31.873610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.873799 (+   189us) service_pool.cc:224] Handling call
0709 13:09:31.874180 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.874549 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.874575 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.874978 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.682180 (+807202us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:32.682238 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.682330 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.328077 (+645747us) raft_consensus.cc:1685] finished
0709 13:09:33.328105 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.328226 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11099,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":17000,"thread_start_us":745785,"threads_started":1,"wal-append.queue_time_us":1071035}
I20260709 13:09:33.347621 24594 rpcz_store.cc:276] 0709 13:09:31.968651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.099566 (+130915us) service_pool.cc:224] Handling call
0709 13:09:32.101212 (+  1646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.101456 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:32.998127 (+896671us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.341713 (+343586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:33.341782 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:33.341842 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.341924 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.342073 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1109453,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2296,"raft.queue_time_us":104,"thread_start_us":1188377,"threads_started":2}
I20260709 13:09:33.300259 28017 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.294070 28211 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.351257 24521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.027s
I20260709 13:09:33.351819 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.351819 25210 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:33.358155 25216 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:33.358618 24521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.006s	sys 0.027s
I20260709 13:09:33.358852 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.359680 25210 raft_consensus.cc:2410] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:09:33.331969 28009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.020s	sys 0.014s
I20260709 13:09:33.329715 27387 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:33.344508 24592 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
W20260709 13:09:33.372306 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45544.4us
I20260709 13:09:33.380740 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:33.372786 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.385613 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:33.346189 28082 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.018s
W20260709 13:09:33.373208 24595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.007s	sys 0.012s
I20260709 13:09:33.380838 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.388833 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:33.373929 24591 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.007s	sys 0.011s
I20260709 13:09:33.389420 25215 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:33.381045 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:33.394991 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:33.397040 24595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.012s
I20260709 13:09:33.361626 25211 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:33.378449 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.397883 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:33.398276 25216 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:33.399247 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:33.399968 25216 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:33.362885 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:33.357630 27781 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.412066 25215 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 9 LEARNER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:09:33.390617 24591 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.007s	sys 0.012s
W20260709 13:09:33.422102 24597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.014s
W20260709 13:09:33.388018 28082 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.000s	sys 0.019s
I20260709 13:09:33.379495 28081 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.391372 27913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.010s	sys 0.027s
I20260709 13:09:33.347812 28223 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.387627 27552 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:33.422658 24597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.007s	sys 0.014s
I20260709 13:09:33.429189 25215 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:33.379974 28007 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.443612 28007 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.425555 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.424029 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.352782 28098 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.357147 28044 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:33.451538 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.005s	sys 0.021s
I20260709 13:09:33.452316 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:33.430799 27913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.010s	sys 0.027s
I20260709 13:09:33.396273 27806 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.392453 27387 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:33.457216 24520 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.029s	sys 0.047s
W20260709 13:09:33.469026 24520 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.030s	sys 0.048s
I20260709 13:09:33.372327 28211 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.456512 24421 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.422439 28109 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:33.452419 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.475695 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1661) took 1811 ms. Trace:
I20260709 13:09:33.440208 27552 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:33.465344 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.005s	sys 0.021s
I20260709 13:09:33.439424 28042 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.474462 25210 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:33.395543 28071 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:33.426177 28072 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:33.465606 28219 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.003s
I20260709 13:09:33.448042 28081 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.476099 24520 rpcz_store.cc:276] 0709 13:09:31.664686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.837292 (+172606us) service_pool.cc:224] Handling call
0709 13:09:31.837677 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:31.838022 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.838049 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:31.841294 (+  3245us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.182326 (+341032us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18003d3360. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:09:32.865927 (+683601us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.469473 (+603546us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.469771 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.469849 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.469889 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:33.475456 (+  5567us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.475636 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":124056,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":1758,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":4404608,"thread_start_us":1197765,"threads_started":2,"wal-append.queue_time_us":1242273}
W20260709 13:09:33.480412 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 608718us
I20260709 13:09:33.495961 24421 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 6, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 6 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:33.495283 24516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.043s	sys 0.052s
I20260709 13:09:33.417582 27704 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.484022 27552 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:33.506347 24516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.043s	sys 0.052s
I20260709 13:09:33.494531 28141 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:33.493436 28071 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:33.538512 28233 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:09:33.538784 28098 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:33.539935 28235 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:33.540004 28071 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:33.541270 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1605) took 1288 ms. Trace:
I20260709 13:09:33.541615 24598 rpcz_store.cc:276] 0709 13:09:32.253343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.253480 (+   137us) service_pool.cc:224] Handling call
0709 13:09:32.253773 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.310485 (+ 56712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.310545 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.311113 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.122718 (+811605us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:33.122761 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.321519 (+198758us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b54001ed2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:33.321600 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.540924 (+219324us) raft_consensus.cc:1685] finished
0709 13:09:33.540944 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.541205 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1062,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5154,"spinlock_wait_cycles":129355136,"thread_start_us":771784,"threads_started":1,"wal-append.queue_time_us":1065902}
I20260709 13:09:33.545311 28081 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:33.545614 27387 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.548274 28211 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:33.552062 28244 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.526269 28072 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.553134 28072 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.555048 28072 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:33.529784 27852 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.005s
I20260709 13:09:33.530380 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:33.426586 28143 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.527463 27806 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.580655 27806 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.582896 27806 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:33.585392 28222 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.586858 28095 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:33.588069 28222 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:33.493496 28219 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.590565 28219 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:33.591452 28239 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:09:33.551421 28099 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.592716 28007 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:33.593367 24523 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:33.593634 28099 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:33.552580 28244 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.530130 24421 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 3 to 4, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.590802 28044 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:33.603062 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 72759.4us
I20260709 13:09:33.608750 24421 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.604120 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:33.610594 24421 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:33.574836 28183 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:33.642131 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:33.600356 28095 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:33.604539 27806 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:33.608387 27913 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.677467 24421 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 2 to 3, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.679077 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:33.627346 28143 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.641714 28237 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.716658 24491 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.013s	sys 0.017s
I20260709 13:09:33.643128 27844 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:33.728544 24491 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.013s	sys 0.017s
W20260709 13:09:33.728910 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 534925us
W20260709 13:09:33.724632 28245 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:09:33.729130 28252 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:33.725227 28232 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 13:09:33.676488 27981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.013s	sys 0.022s
I20260709 13:09:33.729807 28170 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:33.727108 27781 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:33.729655 28252 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.666636 28183 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.730893 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:33.734530 28042 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:33.735019 28042 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.666211 28017 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:33.730114 27981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.013s	sys 0.023s
I20260709 13:09:33.731519 28252 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.732790 28170 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.735407 28042 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.728152 28237 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.736351 28223 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:33.770557 24520 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:33.739666 28095 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:33.739890 28071 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:09:33.774251 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 430921us
I20260709 13:09:33.779695 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:33.779963 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:33.770789 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 389786us
I20260709 13:09:33.722723 27806 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.730724 27913 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:33.768065 28170 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.785647 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:33.792651 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:33.770848 28244 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:33.800984 28007 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.803361 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:33.803936 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 369025us
I20260709 13:09:33.804214 28211 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:33.804396 28007 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:33.804723 28211 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.805140 28007 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:33.810297 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 366021us
I20260709 13:09:33.811054 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:33.816463 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 367890us
I20260709 13:09:33.784817 28095 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.785907 28071 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.825436 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.827108 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:33.828912 24672 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:33.828598 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:33.829434 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:33.832479 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:33.838007 24672 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:33.843760 25185 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:33.844944 28260 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.845440 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.845559 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:33.846287 24672 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:33.846553 28260 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:33.846925 28260 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:33.847321 28260 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.847663 28223 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:33.851389 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.851975 24670 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:33.857326 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:33.859278 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.861418 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.862924 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.863860 25211 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:33.866086 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.866849 24672 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:33.870827 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:33.871551 24520 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:33.858625 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73520.2us
I20260709 13:09:33.887209 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:33.889520 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.889819 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.890363 24672 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:33.895998 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.896862 25213 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:33.899415 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.901621 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.902117 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.903126 24674 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:33.902164 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.904183 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:33.868722 28236 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:33.910840 24667 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:33.904275 24672 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:33.907088 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:33.843266 28244 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:33.867658 28099 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:33.882632 28222 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:33.907588 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:33.918102 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.919433 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:33.923811 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.869213 27852 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.930202 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:33.934672 25211 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:33.853940 28240 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 13:09:33.914289 28254 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:09:33.898303 28007 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:33.968109 25210 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:33.951292 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:33.968976 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:33.956655 24674 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:34.336036 25213 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:34.329592 24670 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:33.952148 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:33.969496 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:34.328684 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 800) took 1032 ms. Trace:
I20260709 13:09:34.336243 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:34.009364 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:34.337924 24598 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.940332 24672 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:34.336081 24668 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:34.158039 24520 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
W20260709 13:09:34.049429 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 432142us
I20260709 13:09:34.341365 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:34.334625 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:34.335094 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.015s	sys 0.019s
W20260709 13:09:34.343742 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.015s	sys 0.019s
I20260709 13:09:34.232899 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:34.345525 24666 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:34.292196 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:34.346540 24592 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.910506 28098 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.337286 24519 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:34.019395 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:34.362046 25215 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:34.138542 27552 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.005s
I20260709 13:09:34.022396 27806 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:33.931143 28249 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:09:34.600432 28265 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.543205 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 730) took 1690 ms. Trace:
I20260709 13:09:34.337610 25214 rpcz_store.cc:276] 0709 13:09:33.296062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.296195 (+   133us) service_pool.cc:224] Handling call
0709 13:09:33.296552 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.296955 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.296992 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.344469 (+ 47477us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b2c00047778. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:09:33.348161 (+  3692us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.784542 (+436381us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.784579 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.784651 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.328253 (+543602us) raft_consensus.cc:1685] finished
0709 13:09:34.328283 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.328602 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26884,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"spinlock_wait_cycles":5955456,"thread_start_us":400663,"threads_started":1,"wal-append.queue_time_us":972522}
I20260709 13:09:34.391587 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:34.545856 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:34.390192 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 59314.3us
I20260709 13:09:34.392619 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:34.611958 24666 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.572007 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2794) took 1796 ms. Trace:
W20260709 13:09:34.513734 25212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.017s	sys 0.034s
I20260709 13:09:34.606936 24525 rpcz_store.cc:276] 0709 13:09:32.852349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.919633 (+ 67284us) service_pool.cc:224] Handling call
0709 13:09:32.919973 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.920422 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.920459 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.920985 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.395731 (+474746us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:33.395787 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.395873 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.542925 (+1147052us) raft_consensus.cc:1685] finished
0709 13:09:34.542951 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.543133 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13404,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9634,"thread_start_us":450970,"threads_started":1,"wal-append.queue_time_us":704291}
W20260709 13:09:34.615073 25212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.019s	sys 0.036s
I20260709 13:09:33.915431 28082 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.613648 24523 rpcz_store.cc:276] 0709 13:09:32.775558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.776713 (+  1155us) service_pool.cc:224] Handling call
0709 13:09:34.571787 (+1795074us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54003dd1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:34.571919 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875746688}
W20260709 13:09:33.966137 28257 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:09:34.616019 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 805) took 1265 ms. Trace:
W20260709 13:09:34.423544 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67042.4us
I20260709 13:09:34.512650 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:34.640202 25212 rpcz_store.cc:276] 0709 13:09:33.350360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.350587 (+   227us) service_pool.cc:224] Handling call
0709 13:09:33.375572 (+ 24985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.375821 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:33.784831 (+409010us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.615595 (+830764us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.615670 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:34.615729 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.615814 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.615955 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11286,"prepare.queue_time_us":648756,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":8884,"raft.queue_time_us":2557,"thread_start_us":1215272,"threads_started":2}
I20260709 13:09:34.641569 24670 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:34.501286 24421 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.018s	sys 0.025s
I20260709 13:09:34.606050 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:34.642234 24421 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.020s	sys 0.030s
W20260709 13:09:34.615854 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 669515us
W20260709 13:09:34.417351 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65708.5us
I20260709 13:09:34.392038 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:34.605844 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:34.631906 24592 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:34.632580 24593 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:34.637621 25215 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:34.460003 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:33.931141 27704 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:34.611871 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:34.647410 24597 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.647856 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:34.563860 28150 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.672s	user 0.013s	sys 0.002s
I20260709 13:09:34.649039 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:34.651684 24671 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:34.028016 28160 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:34.509743 28226 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:09:34.653890 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:33.953985 28050 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:34.666592 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:34.605626 28211 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:34.654700 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:34.659003 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:34.348907 28095 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:34.541795 28228 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:34.009725 28256 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:09:34.567277 28269 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:34.681497 24674 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:34.680640 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:34.682631 24670 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:33.950680 28262 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.655710 24671 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.921367 27387 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:34.667533 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1412) took 1875 ms. Trace:
I20260709 13:09:33.939026 28099 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:34.694888 25219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.011s	sys 0.019s
I20260709 13:09:34.618391 28071 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:34.675899 24591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.012s	sys 0.054s
I20260709 13:09:34.650424 27704 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:34.659789 28260 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.812s	user 0.008s	sys 0.002s
I20260709 13:09:34.654641 28244 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.661605 28283 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.657893 28240 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.967851 28222 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:34.695502 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52066.3us
I20260709 13:09:34.685598 28160 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:34.023418 28237 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:34.681349 28228 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.697830 24597 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
W20260709 13:09:34.735936 24591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.016s	sys 0.058s
I20260709 13:09:34.712715 27806 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:34.775703 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1411) took 1985 ms. Trace:
I20260709 13:09:34.716182 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:34.713840 25219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.011s	sys 0.019s
W20260709 13:09:34.712311 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 380060us
I20260709 13:09:34.712067 24595 rpcz_store.cc:276] 0709 13:09:32.791644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.792207 (+   563us) service_pool.cc:224] Handling call
0709 13:09:32.792566 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.804317 (+ 11751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.804352 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.804837 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.397731 (+592894us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.397769 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.397833 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.667251 (+1269418us) raft_consensus.cc:1685] finished
0709 13:09:34.667279 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.667446 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12685,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":592581,"threads_started":1,"wal-append.queue_time_us":869299}
I20260709 13:09:34.757711 24666 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:34.659432 28150 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.651875 28082 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.792176 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:34.793150 24516 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:34.738276 27704 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:34.709065 28281 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:09:34.761683 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:34.693365 28219 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.692240 28292 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:34.651288 27552 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.778121 24670 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
W20260709 13:09:34.738143 28170 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.940s	user 0.010s	sys 0.000s
I20260709 13:09:34.780354 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 806) took 1429 ms. Trace:
W20260709 13:09:34.695618 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51038.4us
I20260709 13:09:34.804193 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.805197 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:34.805455 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.806124 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.806630 24600 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:34.806553 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:34.807538 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:34.776072 24591 rpcz_store.cc:276] 0709 13:09:32.790116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.790625 (+   509us) service_pool.cc:224] Handling call
0709 13:09:32.790948 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.791172 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:33.419145 (+627973us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.775390 (+1356245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.775440 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:34.775480 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.775540 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.775649 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":811,"prepare.queue_time_us":435931,"prepare.run_cpu_time_us":10273,"prepare.run_wall_time_us":48124,"raft.queue_time_us":93117,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1969856,"threads_started":3,"wal-append.queue_time_us":1238316}
I20260709 13:09:34.738426 28244 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:34.797610 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:34.677874 28050 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.809872 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.838472 24595 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:34.931468 24597 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:34.931949 24525 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:34.902347 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:34.822232 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 174428us
I20260709 13:09:34.714586 28268 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:09:34.801353 28219 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.853034 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.947764 24594 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:34.835541 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:34.948369 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:34.948906 24516 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:34.866833 24593 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.949044 24668 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:34.951553 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.954021 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.946636 28091 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:34.954833 24600 raft_consensus.cc:2410] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:34.954870 28091 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.955719 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:34.956270 28246 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.239s	user 0.002s	sys 0.010s
I20260709 13:09:34.956308 24600 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:34.957031 28091 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:34.957377 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.962514 27552 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:34.965497 28150 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:34.758134 28260 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:34.890750 28282 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:09:34.946990 28285 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:34.780166 28044 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:34.891552 28286 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:09:34.946998 28303 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.853878 24669 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:34.838994 28244 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.975910 28303 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.978220 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:34.978348 28303 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:34.979066 28098 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.979472 28098 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.979843 28098 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.983311 28244 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.846086 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.985327 24665 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.851293 28160 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.798813 27806 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:34.872548 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:34.768873 28283 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.811693 28292 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:34.692587 28269 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.812498 28288 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.721341 27387 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:34.868340 24488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.008s	sys 0.021s
I20260709 13:09:34.923719 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 804) took 1574 ms. Trace:
W20260709 13:09:35.004913 24488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.009s	sys 0.022s
W20260709 13:09:34.910537 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.856084 24489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.020s	sys 0.020s
W20260709 13:09:35.008111 24489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.028s	sys 0.024s
I20260709 13:09:34.835978 28170 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:34.928948 24598 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
W20260709 13:09:34.942271 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 144733us
I20260709 13:09:34.943969 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.944166 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.046703 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.047065 28150 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:35.047516 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:35.047945 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.048341 28091 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:35.046720 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.049001 24598 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:34.878484 28297 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:34.971982 24593 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:34.922528 28262 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:34.922139 28211 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.049697 28297 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.050081 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.050339 28211 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.051560 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.051899 28297 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.052330 28211 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:34.957252 28304 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.779517 28228 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.049701 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.054194 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.994529 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:34.930867 28240 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:35.053190 28304 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.056387 28240 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:34.991551 24673 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:34.938081 28289 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:35.057592 24525 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:35.057788 28289 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:34.950886 28109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.446s	user 0.010s	sys 0.011s
W20260709 13:09:35.059719 28109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.562s	user 0.010s	sys 0.011s
I20260709 13:09:35.060063 28109 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:35.005049 25217 rpcz_store.cc:276] 0709 13:09:33.349020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.349172 (+   152us) service_pool.cc:224] Handling call
0709 13:09:33.349511 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.349795 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:33.785486 (+435691us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.913678 (+1128192us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b18003cbda0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a
0709 13:09:34.923386 (+  9708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.923435 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:34.923477 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.923542 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.923664 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9459,"prepare.queue_time_us":586167,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":16943,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":12499,"spinlock_wait_cycles":69440768,"thread_start_us":752776,"threads_started":2,"wal-append.queue_time_us":785791}
I20260709 13:09:35.048727 24597 raft_consensus.cc:2410] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:09:35.035853 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:35.038503 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:34.957593 28082 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:34.944835 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.066812 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:35.067127 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 116231us
I20260709 13:09:35.052459 28297 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.048684 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:34.994272 24665 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:35.077416 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 770) took 1470 ms. Trace:
I20260709 13:09:35.077749 24665 rpcz_store.cc:276] 0709 13:09:33.606944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.607082 (+   138us) service_pool.cc:224] Handling call
0709 13:09:34.985171 (+1378089us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5400048228. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d23924 00007f17c0f0c227 00007f17c0f0bab8 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:35.077358 (+ 92187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51928448}
I20260709 13:09:35.052491 24598 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:35.072687 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 121387us
I20260709 13:09:35.001710 28288 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.085044 24518 pending_rounds.cc:85] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 3
I20260709 13:09:35.089782 24600 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:35.090137 24518 pending_rounds.cc:107] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:35.083539 24516 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:35.090412 24518 raft_consensus.cc:2889] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:35.082018 25184 connection.cc:256] RPC call timeout handler was delayed by -1.0405523330000506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 13:09:35.038223 28295 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.991382 28098 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:35.087544 28143 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.356s	user 0.010s	sys 0.003s
I20260709 13:09:35.094873 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:35.101369 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.062331 28114 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.094583 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:35.106606 24524 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:35.099201 24639 connection.cc:256] RPC call timeout handler was delayed by -1.0481342309999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
I20260709 13:09:35.099159 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.108198 25217 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:35.085016 28082 raft_consensus.cc:2764] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:35.102128 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.111573 25211 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:35.112748 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.103694 25216 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.105576 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.100409 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.079084 28308 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.108987 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.110321 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1573) took 1103 ms. Trace:
I20260709 13:09:35.114300 25215 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:35.107393 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.092718 28288 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.110692 28114 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.119719 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.092414 28311 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.117343 25217 raft_consensus.cc:2410] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:35.118059 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.117522 24671 rpcz_store.cc:276] 0709 13:09:34.006923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.655233 (+648310us) service_pool.cc:224] Handling call
0709 13:09:34.655557 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.110018 (+454461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.110048 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:35.110088 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:35.110121 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.110178 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.110272 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6696,"raft.queue_time_us":20363,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":159125,"threads_started":1}
I20260709 13:09:35.131481 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.133332 25215 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:35.122459 25213 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:35.135422 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.116731 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:35.096239 28274 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.141294 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.092208 28305 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:35.148281 24671 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:35.108619 27852 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.118903 28042 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.346s	user 0.015s	sys 0.000s
I20260709 13:09:35.150403 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:35.150914 28312 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:35.150442 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.144701 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.143452 25215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:35.155747 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:35.160084 25215 raft_consensus.cc:606] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:35.159206 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.087791 28297 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.159422 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.119206 28265 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.160483 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43831.5us
I20260709 13:09:35.050112 28262 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.116991 28296 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.142803 28260 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:35.167856 28098 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:35.143257 28311 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.170328 28114 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.171288 28303 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.171657 28143 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:35.172116 28306 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:09:35.172295 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:35.172526 27928 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:35.174006 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.212385 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.174935 28276 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:35.165601 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:35.152299 28244 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.214908 24593 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:09:35.200176 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 108543us
W20260709 13:09:35.217796 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45585.8us
I20260709 13:09:35.104655 28295 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.201540 28271 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.163475 28042 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:35.215334 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49840.3us
I20260709 13:09:35.111235 28109 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.156443 27852 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.200812 25217 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:35.166405 28312 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.226809 28170 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.226765 28317 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:35.227921 28312 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.228025 28295 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.229456 28283 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.214769 28114 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.204643 28303 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.222559 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:35.211613 28304 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.133795 28308 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.209996 28143 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.154348 28274 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.147996 27806 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.230170 28114 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.224822 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:35.232740 28318 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:35.242895 28318 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:35.243458 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:35.243777 28318 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.244566 28297 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.245959 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:35.154474 28305 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.250418 28305 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.218737 28071 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:35.236650 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.191711 28265 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.251991 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.252665 28265 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.220584 28276 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:35.252959 25216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:35.239442 25214 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:35.253520 25216 raft_consensus.cc:606] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:35.253756 28276 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:35.211498 27928 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:35.221199 28271 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.255298 28271 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.255574 27928 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.256765 27928 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.258482 28183 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.221002 28050 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.237985 28292 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.260495 28274 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.261025 28304 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:35.261576 28304 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:35.241547 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:35.242288 28269 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.262434 28304 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.263396 28274 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:35.263916 28274 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:35.264694 28274 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.237092 28283 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.234611 28303 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.272035 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.279810 24521 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:35.238153 28143 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.281266 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:09:35.271179 28311 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:35.265408 28071 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:35.199681 28296 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.281785 28307 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.253644 27704 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.318409 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:35.318873 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 168517us
I20260709 13:09:35.324236 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:35.325565 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:35.288781 28265 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:09:35.322552 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet de2b0253cbb445a4bb49f874e70ea972: Illegal state: Replica 0131806e3b9647128f32db1ab8d314fc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:35.331017 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:35.327139 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:35.333567 27704 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.334408 25211 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:35.335781 28297 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:35.311908 27387 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:35.325353 28252 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.561s	user 0.014s	sys 0.000s
I20260709 13:09:35.337661 28252 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.311712 28307 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:35.324892 28269 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.341506 28307 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.342049 28308 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.346974 24594 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:35.349740 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:35.350344 24671 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.351287 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.352130 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.353551 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:35.354255 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.354986 24591 raft_consensus.cc:2410] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:35.355743 28260 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.355877 27704 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:35.356223 28260 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.356618 28260 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.358515 28296 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.361753 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.364125 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.360926 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:35.367074 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.369410 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.352864 28311 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.371167 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:35.374900 24671 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:35.377018 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.373793 28071 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.381450 28329 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:35.382035 28329 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:35.382954 28329 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.376739 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.389866 28314 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:35.392241 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:35.375847 27661 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.360034 28330 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:35.375988 28311 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.388479 28244 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.416599 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.393959 28312 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.436681 24520 raft_consensus.cc:606] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:35.416674 28311 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.441334 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.444195 24598 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:35.445106 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.445376 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:35.447046 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:35.447149 28295 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:35.447943 28295 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.448608 28295 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.454079 28311 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.428295 28244 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.429381 28312 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.466720 28341 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:35.469641 28341 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.439906 28042 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:35.412464 28228 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.495043 28228 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.416201 28303 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.495790 28288 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.497174 24592 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:35.464241 28244 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.497627 28303 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:35.498095 24596 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:35.497749 28271 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.469120 28340 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.499058 28340 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.499441 28340 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.499991 28271 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:35.500644 28332 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:09:35.500731 25216 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:35.497133 28341 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:35.499441 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 500097us
I20260709 13:09:35.466387 28312 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.533617 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:35.532862 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.536707 25216 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:35.537103 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:35.537739 24517 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:35.538650 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:35.539021 24517 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.541913 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:35.542508 24524 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:35.542586 24518 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:35.543571 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:35.544096 24524 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.492250 28143 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.466173 28260 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:35.551288 28283 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.569411 24517 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:35.563266 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.571368 25211 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:35.571055 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.572166 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.573222 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.535465 28275 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.575867 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.576017 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:35.578424 25215 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:09:35.580536 24591 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:35.581331 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.581631 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:35.581948 25211 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:35.581666 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.582814 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.583211 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.586414 25211 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:35.586824 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.587489 25216 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:35.587532 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.588136 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.588353 25211 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:35.588609 25216 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:35.589555 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.534144 28228 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:09:35.590411 25216 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:35.583398 28071 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.591835 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:35.593796 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.594375 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:35.577229 28215 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.598889 25216 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:35.598842 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:35.599682 28143 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.599699 28308 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.634280 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.647858 28308 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.638682 28170 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:09:35.648309 28308 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.648645 28170 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:35.649025 28170 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:35.649893 28170 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.599128 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:35.651538 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52468.7us
I20260709 13:09:35.652112 27661 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:35.652182 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.601338 28260 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:35.653535 28265 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.653406 28341 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.653945 28265 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.654340 28265 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.655714 28308 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.593719 28296 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.657256 28296 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:35.657691 28296 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.660344 28244 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.661522 24671 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:35.664149 28259 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.664569 28259 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.664888 28244 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.665028 28259 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:35.665665 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66899.9us
I20260709 13:09:35.666620 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.667261 28009 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:35.667533 28308 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.668154 28308 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.668468 28308 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:35.668640 28009 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.668854 28308 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.669116 28009 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.669580 28009 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.672096 28262 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.601541 28307 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.608139 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:35.673431 24667 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:35.674917 28294 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.822s	user 0.000s	sys 0.001s
I20260709 13:09:35.615068 28219 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:35.616557 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet 869c3dc61dc04d64adba5e6ab84e5d83: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:35.676995 28312 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.678087 28289 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.617399 28222 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.617614 28114 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.617769 28311 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:35.620869 28283 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:35.679934 28283 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:35.680778 28283 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.681982 28283 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.682337 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 769) took 2076 ms. Trace:
I20260709 13:09:35.682797 24669 rpcz_store.cc:276] 0709 13:09:33.605821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.606018 (+   197us) service_pool.cc:224] Handling call
0709 13:09:33.606446 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.975947 (+1369501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.682058 (+706111us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001135d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:35.682259 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868207872}
I20260709 13:09:35.621753 28330 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.596462 28215 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.685369 28330 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:35.686260 28330 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.580276 28109 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.598017 27704 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:09:35.622218 28288 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:35.627235 28336 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:09:35.641515 28290 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.775s	user 0.000s	sys 0.003s
I20260709 13:09:35.641031 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.701123 25215 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.643802 28295 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.628795 24524 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:35.645288 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.632946 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1208) took 2279 ms. Trace:
W20260709 13:09:35.639161 25210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 818) took 1778 ms (client timeout 2187 ms). Trace:
I20260709 13:09:35.667394 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.702764 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:35.714325 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:35.715224 24516 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:35.715242 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:35.716180 24521 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:35.718060 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:35.718798 24521 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:35.678930 28312 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.602262 27387 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.693549 24667 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:35.698684 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:35.702765 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:35.706671 25210 rpcz_store.cc:269] 0709 13:09:33.860981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.861145 (+   164us) service_pool.cc:224] Handling call
0709 13:09:35.638987 (+1777842us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54004272d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:35.639079 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243597056}
I20260709 13:09:35.706485 25218 rpcz_store.cc:276] 0709 13:09:33.353145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.353254 (+   109us) service_pool.cc:224] Handling call
0709 13:09:33.353523 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.525471 (+171948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.525518 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.531966 (+  6448us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.930513 (+398547us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.930576 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.632544 (+1701968us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540060b3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:35.632598 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:35.632649 (+    51us) raft_consensus.cc:1685] finished
0709 13:09:35.632665 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.632864 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29772,"raft.queue_time_us":60076,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":20479,"spinlock_wait_cycles":328211840,"thread_start_us":321460,"threads_started":1,"wal-append.queue_time_us":844235}
I20260709 13:09:35.764357 25215 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:35.782001 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.675163 28307 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.762835 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.655515 28341 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:35.785907 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 54868.8us
I20260709 13:09:35.790143 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.791091 25216 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.788782 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.720301 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.795583 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:35.798297 24591 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.705261 28330 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.805617 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.807106 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.808331 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.787478 27661 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:35.810029 27661 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:34.801939 25219 rpcz_store.cc:276] 0709 13:09:33.350870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.350974 (+   104us) service_pool.cc:224] Handling call
0709 13:09:33.374575 (+ 23601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.374946 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.374986 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.389463 (+ 14477us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.818227 (+428764us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:34.779657 (+961430us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.779942 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.780047 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.780102 (+    55us) raft_consensus.cc:1685] finished
0709 13:09:34.780119 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.780285 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17071,"prepare.queue_time_us":368494,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":89238,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":12648,"thread_start_us":1206157,"threads_started":2,"wal-append.queue_time_us":1107826}
I20260709 13:09:35.812505 28252 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.704493 27852 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:35.729538 28170 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.820001 24591 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:35.821761 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:35.686815 28215 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.826720 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:35.845623 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:35.828817 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet e4b8c8f0e3de4df592f498349e097d44: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:09:35.799919 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 79720.8us
I20260709 13:09:35.706084 28340 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.849107 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.850292 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.851306 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:35.874281 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:35.825053 28044 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:35.825248 28253 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:35.702883 28317 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.130s
W20260709 13:09:35.885212 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.873349 28042 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.874291 28269 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.873670 28307 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:35.877378 28297 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.876717 28295 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:35.817371 28308 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:35.898875 28042 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:35.903966 28297 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.787168 27387 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:35.884853 28253 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:35.884621 28044 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:35.899798 28269 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.935634 28240 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:35.939411 28042 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.971558 28283 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:35.945228 28297 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.945999 27387 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:35.984668 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet 5f10dd13cd784e8cb8b1dba5b1d1892a: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:35.977753 28143 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.957296 28269 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.017638 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1419) took 1072 ms. Trace:
I20260709 13:09:36.021225 24592 rpcz_store.cc:276] 0709 13:09:34.944708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.951282 (+  6574us) service_pool.cc:224] Handling call
0709 13:09:36.017306 (+1066024us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54001caf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:36.017543 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252534144}
I20260709 13:09:35.925864 27661 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.027789 28308 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.029479 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:36.030238 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:35.990012 28265 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.053192 24591 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:35.948088 28009 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.038537 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:36.041616 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:36.054872 24599 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:36.057055 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:36.060184 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:36.061038 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:36.058247 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:36.064903 25216 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:36.059074 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:36.065393 24595 raft_consensus.cc:2368] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
W20260709 13:09:36.039099 28334 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:36.067598 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:36.065968 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:36.069178 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:36.069811 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:36.057968 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:36.070367 24516 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.070808 24591 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:36.038154 27913 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:36.071440 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:36.070367 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:36.073807 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:36.074532 24525 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.072835 24517 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:36.067601 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:36.021099 28050 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:36.072490 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:36.078450 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:36.079069 24594 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.080312 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:36.081216 28262 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.081984 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:36.083796 28345 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:09:36.084609 28345 consensus_queue.cc:1243] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:36.020279 28170 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:09:36.089738 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:36.092303 24639 leader_election.cc:400] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:36.093219 24639 leader_election.cc:403] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:09:36.095036 24594 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:36.094908 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:36.105286 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:36.105849 25216 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.106091 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:36.107961 24597 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:36.110608 24516 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:36.111668 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:36.113598 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46076.5us
I20260709 13:09:36.114092 25216 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:36.114313 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:36.115550 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:36.116735 25217 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:36.124518 24525 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:36.131119 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:36.128412 24566 leader_election.cc:336] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.557s (SENT)
I20260709 13:09:36.137542 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:36.138574 24524 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:36.145318 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:36.146008 25211 raft_consensus.cc:2376] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9. Re-sending same reply.
I20260709 13:09:36.130287 28114 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.103186 27913 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:36.124495 28238 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.099375 27552 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.123334 28274 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:36.122961 28311 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.124109 28275 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.095768 28044 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.125249 28219 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.095453 28312 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:36.058840 28253 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.147292 28009 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:36.081000 28259 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.153640 27913 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.170985 24597 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:09:36.174714 24566 leader_election.cc:336] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.604s (SENT)
W20260709 13:09:36.147786 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.169025 28238 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.174510 28274 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:36.170275 28244 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.180181 25218 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:36.194075 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:36.206439 24566 leader_election.cc:336] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.630s (SENT)
I20260709 13:09:36.206709 24598 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.199379 27913 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.201565 28259 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.206930 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:36.194900 28344 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.626s	user 0.000s	sys 0.005s
I20260709 13:09:36.229633 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1230) took 1119 ms. Trace:
I20260709 13:09:36.230171 25214 rpcz_store.cc:276] 0709 13:09:35.110314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.119485 (+  9171us) service_pool.cc:224] Handling call
0709 13:09:36.229367 (+1109882us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003903d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:36.229525 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269901568}
I20260709 13:09:36.235947 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:36.236416 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:36.237274 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:36.238395 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 116636us
I20260709 13:09:36.242606 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:36.232977 28274 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.246869 25214 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 9: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:36.247340 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 131816us
I20260709 13:09:36.227639 28050 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.231846 28170 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:36.266659 24598 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:36.265772 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:36.271251 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:36.234097 28265 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:36.264696 28296 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
I20260709 13:09:36.247255 27552 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:36.281623 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44460.7us
I20260709 13:09:36.219528 28244 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.288638 28292 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.292568 28269 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.299556 28283 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:36.244704 28288 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:09:36.303442 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67145.9us
I20260709 13:09:36.304796 28292 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:36.231393 28276 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:09:36.310458 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:36.319862 24566 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.748s (SENT)
I20260709 13:09:36.327826 25215 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:36.328382 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:36.278563 28050 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.333489 24598 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:36.277619 28170 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.304618 28360 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.311854 28283 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:36.309798 28292 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.325874 28219 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:36.311708 28359 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.301941 28296 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.345924 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.346789 24667 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:36.350009 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 63883us
I20260709 13:09:36.420691 24669 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:36.338497 28308 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:36.330397 27552 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:36.330271 28238 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:36.424670 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.334360 28361 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:36.429245 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:36.430081 28355 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:09:36.430285 24666 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:36.431504 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.432263 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:36.426211 28353 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:36.445843 28364 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.451134 28364 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.452116 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.452802 24670 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:36.434968 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.436136 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:36.454213 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 134388us
I20260709 13:09:36.454830 24669 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:36.436312 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.438292 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.349743 28359 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:36.441239 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.420109 28259 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:36.428156 28219 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:36.458904 24672 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:36.459730 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.464423 24667 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
W20260709 13:09:36.456254 28330 consensus_meta.cc:287] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.004s
I20260709 13:09:36.470268 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:36.474900 24671 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:36.477488 28219 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.479220 28311 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:36.477681 27913 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:36.484337 24566 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.834s (SENT)
I20260709 13:09:36.490595 24670 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:36.460150 28289 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:36.493157 28042 consensus_meta.cc:287] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.500s	user 0.005s	sys 0.005s
I20260709 13:09:36.460320 28359 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.440202 27387 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.452772 28238 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:36.502147 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.504063 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.510633 24669 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:36.510967 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.511554 24672 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:36.512619 24521 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:36.514098 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.515019 24672 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:36.513423 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.517226 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.518167 24667 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:36.499614 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51641.4us
I20260709 13:09:36.580410 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.456115 28361 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.586127 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.595964 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.597160 24667 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:36.500536 28244 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.604897 24672 raft_consensus.cc:2368] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9.
I20260709 13:09:36.610819 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.611634 24670 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
W20260709 13:09:36.615531 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 96238.8us
I20260709 13:09:36.509927 27913 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.620242 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:36.621021 24670 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.623587 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.624437 24669 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:36.625509 28366 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 13:09:36.626331 28357 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:09:36.627635 28374 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:36.628197 28374 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.637364 28170 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.638950 28238 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.577903 28009 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:36.641779 28009 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:36.642926 28297 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.001s
I20260709 13:09:36.643373 28297 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.643944 28009 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:36.587796 28330 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.645421 28050 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.645865 28330 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:36.607681 28269 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:36.501006 27552 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.648213 28330 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:36.472638 28259 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:36.497944 28042 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.650287 28259 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:36.650674 28042 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:36.471787 28283 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.652529 27387 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.622325 24674 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:36.657480 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:36.663336 24566 leader_election.cc:336] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.077s (SENT)
I20260709 13:09:36.663956 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:36.665293 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46530.4us
I20260709 13:09:36.667212 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:36.668272 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:36.669730 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:36.606766 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.703826 24667 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:36.735668 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.736343 24672 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:36.774020 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:36.778493 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:36.779659 24667 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:36.860301 24670 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:36.768945 28170 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:36.769332 28050 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:36.768409 28259 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:36.791357 28371 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:09:36.869335 28296 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:36.940167 28292 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.000s
I20260709 13:09:36.965560 28292 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.884719 28297 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:36.954586 28361 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.955677 28371 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.956916 28370 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:36.968910 28370 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:36.970029 28370 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.971560 28370 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.899498 28259 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:36.975095 28259 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:36.959806 28359 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:36.977758 28359 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:36.941247 28375 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:09:36.911099 28288 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:36.990679 28363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.005s	sys 0.019s
W20260709 13:09:36.991117 28363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.005s	sys 0.019s
W20260709 13:09:36.996882 25184 leader_election.cc:336] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.566s (SENT)
I20260709 13:09:36.979970 28292 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:37.052078 28253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.016s	sys 0.017s
W20260709 13:09:37.091204 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 65963us
I20260709 13:09:37.091284 28050 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:37.091977 25184 leader_election.cc:336] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.634s (SENT)
I20260709 13:09:37.092384 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:37.093145 28042 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:37.092487 28050 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:37.096313 28170 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:37.097566 28170 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:37.225508 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54954 (request call id 13) took 1944 ms. Trace:
W20260709 13:09:37.226192 24523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 738) took 2413 ms (client timeout 1815 ms). Trace:
I20260709 13:09:37.226475 24520 rpcz_store.cc:276] 0709 13:09:35.280863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.281058 (+   195us) service_pool.cc:224] Handling call
0709 13:09:37.224897 (+1943839us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400442354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf40853 00007f17c0f0e60a 00007f17ba4947d4 00007f17ba494762 00007f17ba494691 00007f17ba49460c 00007f17ba4938c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:37.225218 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337467648}
W20260709 13:09:37.226765 24523 rpcz_store.cc:269] 0709 13:09:34.812689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.872189 (+ 59500us) service_pool.cc:224] Handling call
0709 13:09:37.225586 (+2353397us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400442354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:37.225902 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021417344}
I20260709 13:09:37.239172 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 747) took 1703 ms. Trace:
W20260709 13:09:37.239507 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.244102 24639 leader_election.cc:336] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.580s (SENT)
W20260709 13:09:37.244891 24673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1572) took 3237 ms (client timeout 2226 ms). Trace:
W20260709 13:09:37.245550 24673 rpcz_store.cc:269] 0709 13:09:34.006665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.485266 (+478601us) service_pool.cc:224] Handling call
0709 13:09:37.244244 (+2758978us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400048dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:37.244498 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874472704}
I20260709 13:09:37.246390 24518 rpcz_store.cc:276] 0709 13:09:35.537843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.543366 (+  5523us) service_pool.cc:224] Handling call
0709 13:09:37.231447 (+1688081us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:09:37.232069 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.232697 (+   628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.232767 (+    70us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:37.232868 (+   101us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:37.232936 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.233062 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.238857 (+  5795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8696192}
I20260709 13:09:37.253151 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:37.254789 24670 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:37.256930 24672 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:36.884547 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:37.258955 24667 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:37.251734 24668 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.268595 24667 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:37.269673 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2812) took 1200 ms. Trace:
I20260709 13:09:37.270182 24521 rpcz_store.cc:276] 0709 13:09:36.068783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.070771 (+  1988us) service_pool.cc:224] Handling call
0709 13:09:36.071026 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.513235 (+442209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.269164 (+755929us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54003ae3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:37.269489 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015061888}
I20260709 13:09:37.271292 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:37.273943 24668 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:37.274626 24674 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:37.276149 24670 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:37.278189 24672 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:37.286942 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 714) took 2480 ms. Trace:
I20260709 13:09:37.287515 24596 rpcz_store.cc:276] 0709 13:09:34.806098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.806235 (+   137us) service_pool.cc:224] Handling call
0709 13:09:37.286248 (+2480013us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540033d954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:37.286570 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179288448}
I20260709 13:09:37.299877 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.342880 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:37.343431 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:37.344419 25210 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.342610 25214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:37.350941 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:37.351274 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:37.353034 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:37.399531 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.007s	sys 0.012s
I20260709 13:09:37.400709 28099 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:37.402704 28370 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:37.405525 25214 raft_consensus.cc:606] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:37.400004 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.012s	sys 0.033s
W20260709 13:09:37.411896 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.007s	sys 0.012s
W20260709 13:09:37.414232 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.013s	sys 0.033s
W20260709 13:09:37.420222 24491 connection.cc:256] RPC call timeout handler was delayed by -1.5146617630000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2258s for a response
I20260709 13:09:37.412874 28398 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:37.429922 27552 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:37.433899 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 809) took 2333 ms. Trace:
I20260709 13:09:37.432672 28211 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:37.448966 24521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:09:37.443948 25212 rpcz_store.cc:276] 0709 13:09:35.100366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.100477 (+   111us) service_pool.cc:224] Handling call
0709 13:09:35.645378 (+544901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.645575 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.645608 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:35.645658 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:35.645701 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.645767 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.412640 (+1766873us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54004272d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:37.433575 (+ 20935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252546944}
W20260709 13:09:37.451359 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 64034.3us
I20260709 13:09:37.454423 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:37.441779 28219 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:37.466102 27806 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.467101 27806 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.469403 24521 raft_consensus.cc:606] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:37.472828 25214 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 9 LEARNER]: Advancing to term 11
I20260709 13:09:37.474826 28370 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:37.472831 28398 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.485276 28397 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:37.485996 28397 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.486657 28398 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:37.488258 28397 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:37.489415 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:37.490386 28370 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:37.493328 28219 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.472941 27552 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.495949 28219 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.496345 27552 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:37.497912 28350 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.321s	user 0.016s	sys 0.023s
I20260709 13:09:37.498857 27806 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.487385 28398 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:37.500602 28398 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:37.501770 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1646) took 2091 ms. Trace:
I20260709 13:09:37.501932 28398 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.502278 24600 rpcz_store.cc:276] 0709 13:09:35.410038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.544803 (+134765us) service_pool.cc:224] Handling call
0709 13:09:35.567575 (+ 22772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.568040 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:35.568080 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.568652 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.957032 (+388380us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:35.957109 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.957177 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.492433 (+1535256us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:37.501230 (+  8797us) raft_consensus.cc:1685] finished
0709 13:09:37.501253 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.501526 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2601,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":2629,"spinlock_wait_cycles":6812928,"thread_start_us":388058,"threads_started":1,"wal-append.queue_time_us":588588}
I20260709 13:09:37.450719 28211 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:37.511376 25210 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:37.520217 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.521342 24600 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:09:37.533247 24597 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:37.541904 25212 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:37.565032 24597 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:37.565228 25184 leader_election.cc:336] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.857s (SENT)
W20260709 13:09:37.568075 25184 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.019s (SENT)
I20260709 13:09:37.572291 25214 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 11 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:09:37.574433 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 904720us
W20260709 13:09:37.592036 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 174282us
I20260709 13:09:37.598315 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:37.600476 28099 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:37.622320 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:37.623450 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 960088us
I20260709 13:09:37.623525 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:37.623656 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.621563 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:37.615216 28062 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:37.632035 24639 leader_election.cc:336] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.788s (SENT)
I20260709 13:09:37.633527 28062 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:37.634616 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 829) took 1703 ms. Trace:
I20260709 13:09:37.635036 25215 rpcz_store.cc:276] 0709 13:09:35.931166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.931416 (+   250us) service_pool.cc:224] Handling call
0709 13:09:35.931808 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.328491 (+396683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.634118 (+1305627us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54002e7054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:37.634436 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910190976}
I20260709 13:09:37.625880 25212 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:37.626778 28403 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:37.626663 28099 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:37.623932 28222 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:09:37.628476 28373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.025s	sys 0.018s
I20260709 13:09:37.626686 28401 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.637778 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 183706us
I20260709 13:09:37.636166 28062 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:37.642581 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.642884 28099 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:37.636143 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.644083 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:37.643940 28403 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:37.646306 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 88464.5us
I20260709 13:09:37.648850 24600 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
W20260709 13:09:37.645860 28373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.026s	sys 0.018s
I20260709 13:09:37.651314 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.652146 24595 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:37.653975 24521 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:37.648861 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:37.657752 28401 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.658389 24591 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:37.659165 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 63066.4us
I20260709 13:09:37.660187 28401 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.660362 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:37.660825 24525 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:37.663043 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.650554 28222 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.667289 24524 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.671799 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:37.672871 24521 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.674835 24598 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:37.662627 28062 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:37.677605 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46122.5us
I20260709 13:09:37.678967 28222 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.681378 27928 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:37.681802 27928 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:37.682895 27928 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.683427 28222 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.689440 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:37.690397 28412 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:09:37.693110 24600 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:37.666328 28099 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:09:37.700675 28062 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:37.707984 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:37.708729 24523 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.708752 28062 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.714320 24595 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:37.718783 24521 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:37.720417 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.720883 24594 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:37.722646 24594 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:37.723730 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.723923 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.724189 24599 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:37.724929 24594 raft_consensus.cc:2410] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:37.724926 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.725402 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.725621 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.725961 24596 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:37.726358 24592 raft_consensus.cc:2376] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8. Re-sending same reply.
I20260709 13:09:37.726943 24597 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:37.726944 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.728292 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.729051 24600 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
W20260709 13:09:37.731110 25184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.263s (SENT) [suppressed 47 similar messages]
I20260709 13:09:37.735399 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:37.736210 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.670207 28401 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:09:37.828573 24523 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:37.734802 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.836742 27928 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.838997 24599 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:37.839270 24524 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
W20260709 13:09:37.841348 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 145844us
I20260709 13:09:37.707137 28403 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.847113 24524 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:37.838708 28099 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.696259 28408 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 13:09:37.728029 28374 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.852478 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.858105 28411 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.139s
W20260709 13:09:37.858647 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.860440 24593 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:37.861372 28289 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.861588 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.862241 24596 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:37.861934 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.861546 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.863878 24595 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:37.862672 24596 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:37.864768 24593 raft_consensus.cc:2410] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:37.862628 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.866115 28326 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.866612 28312 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.866662 24596 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:37.866310 28414 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:09:37.867368 28312 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.868052 24596 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.866874 28326 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.868616 28329 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 13:09:37.868707 28416 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:37.863161 24594 raft_consensus.cc:2376] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12. Re-sending same reply.
I20260709 13:09:37.861981 28289 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.869628 28370 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.911218 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.871315 24566 leader_election.cc:400] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9.
I20260709 13:09:37.911778 24566 leader_election.cc:403] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:37.871731 28143 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.877595 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.881378 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:37.881651 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:37.891196 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:37.892745 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:37.898855 24599 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:37.899577 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:37.900784 25182 leader_election.cc:336] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.815s (SENT)
I20260709 13:09:37.902752 28317 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.902652 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:37.906042 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:37.924372 28143 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.919613 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:37.920398 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:37.921228 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:37.894196 28099 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.926608 24516 raft_consensus.cc:2368] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:37.914439 24592 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:37.928903 24597 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:37.930073 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.930243 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:37.932371 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:37.933426 28312 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.925961 28370 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.934492 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:37.935523 28099 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.936337 28370 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.937393 28317 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.938498 28326 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:37.939869 28317 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:37.941171 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:37.941301 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:37.941948 24592 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:37.941340 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:37.945937 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45176.8us
I20260709 13:09:37.947789 24599 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:37.948127 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1233) took 2819 ms. Trace:
I20260709 13:09:37.949515 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:37.943436 25219 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:37.963874 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:37.967037 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85550.4us
I20260709 13:09:37.897343 28374 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:09:37.977373 25212 raft_consensus.cc:2368] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:37.966060 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:37.979105 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 108048us
I20260709 13:09:37.979537 28275 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:37.979995 28275 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:37.980032 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:37.980429 28312 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:37.980764 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:37.981439 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:37.969810 28405 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:37.982151 24517 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:37.982226 28405 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:37.983460 28405 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:37.970410 24520 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:37.984838 28401 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:37.971189 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:37.965794 28373 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.986398 28271 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:37.986615 28373 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:37.987252 24518 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:09:37.987598 24518 pending_rounds.cc:85] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 6
I20260709 13:09:37.987846 24518 pending_rounds.cc:107] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:37.969236 28099 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.988114 24518 raft_consensus.cc:2889] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:37.972298 28348 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.800s	user 0.003s	sys 0.042s
I20260709 13:09:37.973977 28289 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.974120 25210 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:37.991691 28275 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:37.992398 24597 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:37.992686 28373 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.993798 25215 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:37.969369 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54552us
W20260709 13:09:37.985900 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 94785.8us
I20260709 13:09:37.987037 28340 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:37.992843 28275 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.981166 28312 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:37.973222 28370 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.987914 28390 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.986438 28401 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:38.009205 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.011656 24596 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:09:38.011808 28367 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:38.012193 24596 pending_rounds.cc:85] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 7
I20260709 13:09:38.012336 28367 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:38.012496 24596 pending_rounds.cc:107] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:09:38.012879 28367 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.012912 24596 raft_consensus.cc:2889] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:38.014076 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:38.014848 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 49843.7us
I20260709 13:09:38.017227 24516 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:38.018126 28050 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.948509 25213 rpcz_store.cc:276] 0709 13:09:35.128526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.200704 (+ 72178us) service_pool.cc:224] Handling call
0709 13:09:35.644853 (+444149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.645228 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:35.649903 (+  4675us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.958073 (+308170us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.982852 (+ 24779us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.983018 (+   166us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:35.983052 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.983116 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.186413 (+203297us) raft_consensus.cc:1685] finished
0709 13:09:36.186439 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.947796 (+1761357us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400532350. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:37.947945 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4391,"prepare.queue_time_us":5003,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":3831,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":23721,"spinlock_wait_cycles":1020338432,"thread_start_us":307794,"threads_started":1,"wal-append.queue_time_us":501232,"wal-append.run_cpu_time_us":2386,"wal-append.run_wall_time_us":1032390}
I20260709 13:09:38.031164 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.031828 24671 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:38.051970 28402 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:38.052541 28402 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:38.052968 28402 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.058161 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:38.058563 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.058911 24596 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:38.026890 24673 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
W20260709 13:09:38.078177 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 49603.8us
I20260709 13:09:38.025393 28099 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:09:38.107203 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 142389us
W20260709 13:09:38.109728 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 92396.9us
I20260709 13:09:38.066303 28050 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.104933 28374 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:09:38.140908 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 160987us
I20260709 13:09:38.150117 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:38.156291 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 97856.9us
I20260709 13:09:38.128173 28099 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:09:38.169441 28345 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:09:38.169925 28395 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:38.170914 28423 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:38.137091 28329 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:09:38.183079 28050 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:38.169293 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:38.184892 28418 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.215s	user 0.002s	sys 0.000s
I20260709 13:09:38.142086 28317 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:09:38.195794 28143 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.185575 28428 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:38.185858 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.197372 28428 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:38.197595 24524 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:38.198328 28428 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:38.202158 28395 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:38.202709 28395 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:38.178759 28312 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:38.203204 28395 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.211781 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:38.313151 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 108888us
I20260709 13:09:38.147426 28411 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:09:38.386121 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 62161.5us
W20260709 13:09:38.389338 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.296149 28345 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:38.391147 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 239581us
I20260709 13:09:38.385808 28050 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.295764 28412 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.192s
W20260709 13:09:38.413352 28425 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:38.188928 28211 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.436148 28050 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:38.397295 28345 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:38.453305 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 290070us
W20260709 13:09:38.465132 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.510571 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 214942us
I20260709 13:09:38.435199 28042 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.435655 28082 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.463865 28407 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.252s
I20260709 13:09:38.464520 28432 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.301s
W20260709 13:09:38.520021 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 112108us
I20260709 13:09:38.391129 28397 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:09:38.406399 28312 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.523582 28050 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:38.522171 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.522362 28275 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.014s
W20260709 13:09:38.523185 28426 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 13:09:38.528931 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.542503 28143 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:38.542389 28042 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.543740 28441 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:38.545192 28367 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.528s	user 0.013s	sys 0.000s
I20260709 13:09:38.545514 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.464778 27387 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:09:38.569653 24563 leader_election.cc:400] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:38.569989 24563 leader_election.cc:403] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:38.573037 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:38.552855 28395 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.569213 27387 consensus_queue.cc:1243] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:38.589915 28345 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.590700 28373 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:38.591464 28416 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:38.613603 28416 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:38.614694 28416 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.615423 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:38.615957 28416 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.616187 24598 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:38.617251 28374 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.620777 28211 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.597249 28434 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:38.597455 28412 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.598563 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:38.599092 28449 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:38.599635 28370 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.001s
I20260709 13:09:38.599951 28439 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:38.604498 28042 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:38.579553 28372 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.613159 28373 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:38.640483 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.621995 28430 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:38.626060 28447 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:38.569106 28312 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:38.569281 28367 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:38.623802 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 78412.6us
I20260709 13:09:38.595425 28395 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:38.580345 28441 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:38.638401 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 445386us
I20260709 13:09:38.634738 28412 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.672983 28412 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.673269 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:38.673442 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:38.663954 28114 raft_consensus.cc:2764] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:38.674944 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.674424 24423 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.676272 28312 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:38.676445 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.677735 24566 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:38.678128 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.679181 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.680159 28427 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:38.680557 28427 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:38.680981 28427 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:38.681347 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:38.682374 28345 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.682792 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.681386 28228 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.685626 28228 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.686088 28228 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.665540 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:38.689824 28402 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.001s
I20260709 13:09:38.690320 28402 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:38.692394 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.692605 28402 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:38.694530 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.695638 28367 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:38.696698 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:38.697602 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.697741 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.698024 25217 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 10. Ops: []
I20260709 13:09:38.698994 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.699606 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.666786 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.700436 24672 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:38.697194 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.696806 25210 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:38.667500 28274 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:38.701030 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:38.701333 25214 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:38.666422 28373 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.701854 24666 raft_consensus.cc:2368] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9.
I20260709 13:09:38.667917 28442 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.669800 28240 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.702502 25214 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:38.670567 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:38.702732 28442 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.703804 28427 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:38.671442 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.669624 25211 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:38.672381 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.699859 24674 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 7: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:38.700511 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.667732 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.704072 28274 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:38.676414 24423 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 5, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.672210 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:38.704066 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:38.718616 25213 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.719439 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:38.720337 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.721719 28274 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:38.702502 28373 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.666338 28441 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:38.715359 28407 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.722141 28274 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.723472 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:38.723160 28407 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.702838 28240 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.715910 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.724448 28326 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:38.724905 28326 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.670804 24673 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:38.725266 28326 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.644872 28370 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9.
I20260709 13:09:38.725970 28442 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:38.643750 28401 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.726214 28240 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:38.726614 28401 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.727149 25219 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:38.719554 28114 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:38.727615 28114 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:38.722124 28450 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.714965 28082 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.717953 28427 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:38.673094 24421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 245) took 19746 ms (client timeout 15000 ms). Trace:
I20260709 13:09:38.728199 28114 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.725267 28374 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:38.733336 28450 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.727056 28401 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.733879 28450 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.734918 28412 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.728327 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.723161 28274 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.740522 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.738530 28441 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:38.741777 28441 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:38.742201 28441 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:38.742208 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.742691 28441 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.743016 24673 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:38.742339 28397 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:38.744379 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:38.745201 24668 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:38.745524 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.746711 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.747862 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.748147 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:38.748301 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.748481 24668 raft_consensus.cc:2376] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11. Re-sending same reply.
I20260709 13:09:38.749256 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:38.642099 28430 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:38.749615 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.684783 28431 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:38.751905 28431 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:38.751991 24674 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:38.752470 28431 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.753245 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.753402 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.753947 24523 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:38.755049 28412 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:38.759708 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.761132 25217 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:38.761515 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.762209 24523 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:38.750566 24673 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:38.764344 24523 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:38.751477 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 70377.7us
I20260709 13:09:38.765661 28340 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:38.766911 28340 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:38.769109 28340 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:38.750514 28430 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.771087 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.771422 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.766911 24523 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:38.768488 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.771066 28430 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.774375 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.774669 28312 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:38.775656 28312 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:38.776008 28312 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:38.733579 24421 rpcz_store.cc:269] 0709 13:09:18.926636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.926921 (+   285us) service_pool.cc:224] Handling call
0709 13:09:19.323228 (+396307us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:09:38.672824 (+19349596us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:34.801614 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:35.106937 (+305323us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:35.109852 (+  2915us) write_op.cc:435] Acquired schema lock
0709 13:09:35.111348 (+  1496us) tablet.cc:662] Decoding operations
0709 13:09:35.301588 (+190240us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:35.301666 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:35.301707 (+    41us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:09:35.303341 (+  1634us) tablet.cc:701] Row locks acquired
0709 13:09:35.303367 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:09:35.303563 (+   196us) write_op.cc:270] Start()
0709 13:09:35.303713 (+   150us) write_op.cc:276] Timestamp: P: 1783602575303508 usec, L: 0
0709 13:09:35.303755 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:09:35.304560 (+   805us) log.cc:844] Serialized 6326 byte log entry
0709 13:09:36.151639 (+847079us) op_driver.cc:464] REPLICATION: finished
0709 13:09:36.334608 (+182969us) write_op.cc:301] APPLY: starting
0709 13:09:36.339391 (+  4783us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:36.432328 (+ 92937us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:36.445222 (+ 12894us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:36.603854 (+158632us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:36.644785 (+ 40931us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:09:36.644838 (+    53us) write_op.cc:312] APPLY: finished
0709 13:09:36.645206 (+   368us) log.cc:844] Serialized 113 byte log entry
0709 13:09:36.645380 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.645559 (+   179us) write_op.cc:454] Released schema lock
0709 13:09:36.645621 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:36.645998 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:36.646030 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":39,"spinlock_wait_cycles":7499648,"child_traces":[["op",{"apply.queue_time_us":158755,"apply.run_cpu_time_us":5174,"apply.run_wall_time_us":330136,"num_ops":16,"prepare.queue_time_us":895186,"prepare.run_cpu_time_us":21152,"prepare.run_wall_time_us":546278,"raft.queue_time_us":597396,"raft.run_cpu_time_us":17540,"raft.run_wall_time_us":185528,"replication_time_us":812557,"thread_start_us":1304914,"threads_started":4,"wal-append.queue_time_us":55275,"wal-append.run_cpu_time_us":54510,"wal-append.run_wall_time_us":2289585}]]}
I20260709 13:09:38.776814 28312 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.778844 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.779210 28312 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.779402 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.780416 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.780859 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:38.722215 24423 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.766835 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.784173 27806 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:38.785008 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.785918 24523 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.786264 28373 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:38.786630 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.786813 27806 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:38.786274 24423 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 3 to 4, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 4 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.788115 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:38.789219 28427 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:38.789943 28373 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.790120 28427 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:38.790405 28373 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:38.790531 28427 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:38.790853 28373 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:38.791365 28427 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.793191 27806 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:38.792946 28427 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.794818 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.795150 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.794517 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.788806 24423 catalog_manager.cc:5697] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:38.770341 28340 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.805847 24523 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
W20260709 13:09:38.807015 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 219887us
W20260709 13:09:38.810068 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.817750 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:38.819169 24673 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:38.821043 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.823764 24521 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:38.822080 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.820237 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:38.835633 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.836261 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:38.837867 24523 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:38.838142 25213 raft_consensus.cc:2410] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:38.649138 28447 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:38.839854 24423 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 7, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 7 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.844973 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:38.850126 28237 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:09:38.851150 28395 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:38.853401 28340 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.853525 28442 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.854169 28442 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.856209 28442 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:38.850333 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.847579 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:38.861238 25212 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:38.865594 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:38.865830 24521 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:38.869019 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:38.871778 24423 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 5 to 7, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 7 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.839453 27806 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.878918 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:38.879452 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:38.874703 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:38.889102 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 101125us
I20260709 13:09:38.869288 28430 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:38.892271 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.890461 24423 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 6 to 7, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 7 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.832176 28326 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:38.897185 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 49988.6us
W20260709 13:09:38.898501 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.846095 28042 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:09:38.881827 27806 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.909794 24523 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:38.889385 28211 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:38.882400 28450 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.915681 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.917271 28453 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:38.917578 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.917793 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.918498 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.921154 24670 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8.
I20260709 13:09:38.922848 28326 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:38.923331 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.924705 24665 raft_consensus.cc:2368] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10.
I20260709 13:09:38.901274 28399 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.925825 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.936437 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:38.937794 24669 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:38.950740 28228 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.954178 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.955367 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.955921 24524 raft_consensus.cc:2376] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8. Re-sending same reply.
I20260709 13:09:38.956876 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.957752 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.958101 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.958521 28114 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:38.958912 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.956820 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:38.959213 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.998885 28441 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:38.997517 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.997468 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.960775 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:39.007069 24524 raft_consensus.cc:2376] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10. Re-sending same reply.
W20260709 13:09:39.009342 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.008791 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 94425.9us
I20260709 13:09:38.961480 24423 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:39.011860 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:39.018181 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 108955us
I20260709 13:09:38.913902 27806 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.022521 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:38.912231 28454 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:39.026196 24565 leader_election.cc:400] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8.
I20260709 13:09:38.952986 28228 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.001062 28441 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.027912 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.032392 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.031260 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.003201 28042 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.024089 24520 raft_consensus.cc:2376] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10. Re-sending same reply.
I20260709 13:09:39.029479 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.006403 28453 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:39.035567 24524 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:38.959740 28399 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.024590 24423 catalog_manager.cc:5697] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 6, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 6 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:39.022886 28240 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.027209 28454 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:38.959612 28211 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:39.062704 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.955940 28274 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.081669 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.077463 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.103782 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.104542 24594 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:39.082615 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.105690 24599 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 12 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:39.106567 28211 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:39.077208 28454 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.112049 28274 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.084583 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.086675 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.117889 24596 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:39.083297 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.087423 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.092235 28443 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:09:39.006844 28447 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:39.093657 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 191853us
I20260709 13:09:39.094238 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.095010 28450 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.097499 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:39.047013 28453 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.098148 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:39.098869 28114 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.099426 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.047415 28367 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:39.101464 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:39.112928 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.091454 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:39.120210 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.126596 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.142728 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.051159 24423 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 6 to 7, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:39.143508 24600 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:39.128465 24523 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:09:39.076968 28240 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:39.048020 28372 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:39.038407 28399 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:39.151471 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 53397.2us
W20260709 13:09:39.138963 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.140316 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.141366 24591 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:39.146164 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.148267 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.155267 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:39.155678 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 58237.1us
I20260709 13:09:39.155874 24671 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:39.156826 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:39.157491 24671 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.153198 24592 raft_consensus.cc:2376] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10. Re-sending same reply.
I20260709 13:09:39.137315 24597 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:39.141383 24669 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:39.153260 24518 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:39.162590 24517 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:39.045463 28042 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.162103 28228 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.177812 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:39.178313 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:39.178501 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:39.179078 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.201488 24596 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:39.198671 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.202684 24597 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:39.208588 28228 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.208890 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.209231 28228 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.212163 28407 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:39.213691 28042 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.217427 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:39.218000 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.218614 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:39.219895 24669 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:39.222540 24599 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:39.150761 28240 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:39.223668 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67172.3us
I20260709 13:09:39.215626 28431 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:39.164242 28050 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.134214 28401 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.227303 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:39.229521 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.240034 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.241319 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.246127 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.248132 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:39.246865 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 82085us
I20260709 13:09:39.250027 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:39.235455 28424 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:39.252856 24593 raft_consensus.cc:2410] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:39.220821 28373 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:39.253131 24423 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 6 to 10, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 10 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:39.254381 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.255293 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.255931 24516 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:09:39.262118 28462 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:09:39.263422 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.264004 24516 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:39.264727 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.265141 28428 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.247558 28370 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.265838 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.266364 28431 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.236712 28050 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:39.267132 28050 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.225241 28372 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:39.269687 28372 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:39.271633 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 93427.6us
I20260709 13:09:39.266678 28454 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.273171 28326 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:39.273788 28326 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:39.274513 28430 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:39.274962 28430 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:39.275183 28454 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.275791 28430 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:39.278851 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.236828 28447 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.280893 28427 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.283860 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.280308 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.262236 28441 raft_consensus.cc:1064] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:09:39.283761 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.329730 24591 pending_rounds.cc:85] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 6
I20260709 13:09:39.329753 24665 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:09:39.332087 24665 pending_rounds.cc:85] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 5
I20260709 13:09:39.332472 24665 pending_rounds.cc:107] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:09:39.332717 24665 raft_consensus.cc:2889] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.289618 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.320475 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.334833 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:39.335546 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.335848 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52210.6us
W20260709 13:09:39.285748 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.337289 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.338097 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.285912 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:39.339237 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54199.7us
I20260709 13:09:39.339426 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:39.340445 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:39.340535 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.295894 24423 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.341907 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.341960 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:39.342716 24523 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
W20260709 13:09:39.350556 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 100602us
I20260709 13:09:39.352227 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.353482 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:39.354270 24665 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:39.355669 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:39.334477 28430 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.358028 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.358790 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.359287 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.359583 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.274652 28326 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.332024 24591 pending_rounds.cc:107] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 13:09:39.361166 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.367877 24521 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.360105 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.363448 24518 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:39.258900 28443 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.097s
I20260709 13:09:39.371483 24591 raft_consensus.cc:2917] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 13:09:39.345811 28454 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.351498 24423 catalog_manager.cc:5697] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 2 to 5, term changed from 5 to 7, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130), 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:39.367233 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.368403 24516 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:39.342124 28431 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:39.339797 28372 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.361821 24665 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:39.364272 24523 raft_consensus.cc:2376] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8. Re-sending same reply.
I20260709 13:09:39.374277 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:39.359658 28441 raft_consensus.cc:1068] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Unable to promote non-voter 983693721af6486c97ece1410a90cf30: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:39.358515 28114 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.366858 28082 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.363014 28143 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.389497 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.396842 24521 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:39.399027 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.366338 28271 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.407169 24423 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 6 to 7, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 7 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:39.410989 24520 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:39.416735 24423 catalog_manager.cc:5697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 5, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 5 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:39.418131 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60324.5us
I20260709 13:09:39.417104 24591 raft_consensus.cc:2889] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.426276 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.412297 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:39.427372 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:39.398293 27387 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.437879 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.438676 24593 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:39.441655 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 121287us
I20260709 13:09:39.413923 28271 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.404016 28143 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:39.382602 28454 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.457376 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.462859 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.454370 24423 catalog_manager.cc:5697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 3 to 5, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 5 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:39.390340 28372 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.458341 28271 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:39.487805 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45300.2us
I20260709 13:09:39.422686 28405 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:09:39.450738 28114 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:39.465374 24423 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 5 to 8, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 8 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:39.463012 28143 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.497313 24491 leader_election.cc:400] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9.
I20260709 13:09:39.498049 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:39.485112 28312 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:39.484133 28450 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:39.515950 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 96883.2us
I20260709 13:09:39.488905 28407 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:39.511776 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48973.2us
I20260709 13:09:39.510553 24671 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:39.514523 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.517969 24600 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:39.518047 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.515043 28401 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:39.522751 28464 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:09:39.525223 28466 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
W20260709 13:09:39.541929 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44747.3us
I20260709 13:09:39.507210 24423 catalog_manager.cc:5697] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 3 to 5, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 5 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:39.550805 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.564388 24600 raft_consensus.cc:2410] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:39.513545 27387 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:39.574630 27387 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.526929 28373 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.503223 28329 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:09:39.573879 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.566848 24423 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 1 to 4, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 4 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:39.590255 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.549912 28312 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:39.613605 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.615123 24593 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
W20260709 13:09:39.618996 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 102310us
I20260709 13:09:39.619488 24521 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:39.578493 28297 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.571343 28211 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:39.624791 24520 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:39.626917 24521 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:09:39.612959 28468 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:09:39.525960 28114 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.621759 28050 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:39.630477 28211 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.613286 28401 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.634189 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.617314 28412 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.644224 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.644831 24600 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.618141 27387 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.641921 24521 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.591439 28326 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:09:39.625221 28297 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:39.641147 24593 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:39.653791 24592 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:39.653589 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 135613us
I20260709 13:09:39.641770 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.650662 24423 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 7, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 7 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:39.658294 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 153806us
I20260709 13:09:39.660202 28481 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:39.663719 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:39.665001 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.664354 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:39.664408 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:39.668810 24596 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.670523 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.670886 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.674404 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.651881 28480 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.679322 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.685825 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:39.686621 24593 raft_consensus.cc:2368] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10.
I20260709 13:09:39.675531 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.689953 24521 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:39.671797 28467 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:09:39.667057 28297 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.681154 28412 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.671114 28407 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:39.694906 24599 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:39.673207 28373 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:39.681384 28443 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.714802 24593 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:39.676213 28082 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.690979 28477 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:39.728433 24596 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:39.721657 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:39.734958 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 60813.1us
W20260709 13:09:39.737547 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 103763us
I20260709 13:09:39.738322 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:39.739705 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 112692us
W20260709 13:09:39.751596 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 72373.9us
I20260709 13:09:39.727669 28372 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.753453 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:39.742641 27806 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
I20260709 13:09:39.693943 28480 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:39.758242 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.757385 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.759718 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.691964 28312 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:39.762832 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 99765.3us
I20260709 13:09:39.763566 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.747988 28082 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.766276 24593 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:09:39.722424 28399 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.760546 27806 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.768549 28374 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:39.771684 28480 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:39.761776 28490 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:39.733814 28373 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:39.755415 28329 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.781634 28372 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:39.756438 28481 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:39.807229 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:39.809808 28486 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:39.786338 28482 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.787223 28367 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:09:39.775782 28050 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.790392 28487 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.792503 28374 consensus_queue.cc:1243] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:09:39.830415 28240 consensus_meta.cc:287] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 13:09:39.831005 28240 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.771224 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.806219 28399 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.793162 28082 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:39.832325 25214 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:39.787616 28473 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:09:39.832388 28483 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.832649 28082 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:39.825829 28412 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.834005 28082 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:39.834537 28211 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:39.835340 28453 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
I20260709 13:09:39.835738 28453 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.808952 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.792959 28485 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.837746 24594 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:39.837911 28453 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.838618 28412 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.838972 24594 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:39.839861 24491 leader_election.cc:400] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10.
I20260709 13:09:39.840379 24594 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:09:39.840739 24594 pending_rounds.cc:85] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 8
I20260709 13:09:39.841204 24594 pending_rounds.cc:107] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:09:39.796842 24673 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:39.841465 24594 raft_consensus.cc:2889] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.834829 28082 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:39.842027 28428 consensus_meta.cc:287] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 13:09:39.842799 24594 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:39.842783 24519 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:39.842365 28082 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.846403 28373 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:39.848750 28447 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.000s
I20260709 13:09:39.803079 28329 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:39.855010 28329 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.855957 27806 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:39.857227 24491 leader_election.cc:336] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.564s (SENT)
I20260709 13:09:39.857645 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.825534 28271 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:39.859150 28228 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.002s
I20260709 13:09:39.859511 28271 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.791896 28407 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.859582 28228 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.860807 24595 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:39.852169 24597 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:39.853657 28474 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:09:39.832556 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 61552.9us
W20260709 13:09:39.822561 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59030.8us
W20260709 13:09:39.831422 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 71738us
I20260709 13:09:39.802672 28275 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.866039 24600 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:39.792346 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.863489 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.823107 28490 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.869870 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.871912 28490 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.873495 28412 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.873744 28114 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.875188 24525 raft_consensus.cc:2410] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:39.877996 24600 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:39.879040 28367 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.885414 24637 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.886673 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:39.886909 28228 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.887390 28405 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.887562 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.888052 28405 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:39.888456 28405 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:39.888943 28491 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.889359 28482 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.889523 28491 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:39.889675 28471 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.298s	user 0.003s	sys 0.000s
I20260709 13:09:39.890734 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.890445 28491 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.891445 28482 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.892549 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.888758 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.893450 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:39.877251 28275 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.893296 28482 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.893647 28443 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.874228 28412 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:39.897405 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:39.898061 24674 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:39.896623 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:39.899631 24671 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.906497 24671 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
W20260709 13:09:39.879736 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 87577.3us
I20260709 13:09:39.912819 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:39.935326 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.936932 24598 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:39.936830 28228 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:39.888794 28405 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.937877 28401 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.938071 28228 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:39.938565 28228 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:39.939392 28228 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:39.941198 28275 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.942086 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:39.942747 24518 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:39.943918 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.944474 24521 raft_consensus.cc:2376] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8. Re-sending same reply.
I20260709 13:09:39.896610 28240 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:39.940814 28228 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:39.953948 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61456.4us
I20260709 13:09:39.953832 24520 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:39.945922 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.955090 25184 leader_election.cc:400] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10.
I20260709 13:09:39.956295 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:39.958199 24521 pending_rounds.cc:85] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 4
I20260709 13:09:39.958510 24521 pending_rounds.cc:107] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:09:39.958750 24521 raft_consensus.cc:2889] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.894728 28297 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.897425 28412 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:39.968459 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57674.7us
I20260709 13:09:39.979027 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:39.983330 28412 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.968590 28240 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.985574 28240 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:39.986143 28340 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:39.986572 28340 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:39.987134 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.987417 28340 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.988596 28340 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.986572 28240 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.991058 28042 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:39.991554 28042 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.959887 28494 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.997414 28329 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:39.998795 28454 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:39.999521 28329 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:40.000624 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:40.001757 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.003436 28483 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.004447 25217 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:40.004681 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:40.001781 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:40.005703 25219 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:39.995079 28479 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.995599 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:40.005002 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:39.972388 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:39.995534 28271 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:40.008826 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:39.996800 28494 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:40.011605 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:39.967475 27806 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:40.022759 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.016270 28329 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:40.032061 28329 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:40.032203 28482 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.032568 28329 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.960949 28405 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.033370 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:40.025748 28399 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:40.026631 28143 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:09:40.016039 28312 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.024806 28275 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:40.046752 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51226.5us
I20260709 13:09:40.050778 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:40.043627 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.052685 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.041503 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.016908 28494 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.036362 28399 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.048580 27806 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:40.052186 28275 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:40.066517 28482 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.068670 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:40.059701 28271 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.078672 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:40.079181 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:40.079777 24523 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.082379 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:40.083521 28082 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:40.084043 28082 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.084481 28082 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.086069 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.078739 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:40.088481 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:40.079041 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.090008 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.096019 24523 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:40.098927 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:40.098851 28082 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:40.103454 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 70733.3us
I20260709 13:09:40.103780 28493 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:40.104305 28493 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:40.105329 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:40.109427 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68029.4us
I20260709 13:09:40.109840 28480 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.110102 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.111325 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.111581 28480 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.112396 28480 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.073417 28275 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:40.113698 24518 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:09:40.113947 28405 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:40.115144 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet 5f10dd13cd784e8cb8b1dba5b1d1892a: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
W20260709 13:09:40.116225 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.112716 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:40.118896 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.119052 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:40.119939 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.120885 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.121912 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:40.122195 24599 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:40.050339 28143 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:40.115199 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46639.4us
I20260709 13:09:40.117033 28479 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:40.065389 28345 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.127723 25215 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:40.129689 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:40.132745 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.128685 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:40.135769 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.145834 25212 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:40.146253 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:40.148916 24600 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:40.153983 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.148327 28491 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.160341 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:40.160728 27806 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.109850 28237 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:09:40.158010 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:40.164629 25213 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.164826 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:40.165373 28237 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:40.165781 28491 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.165848 28237 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:40.166368 28237 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.167322 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.168030 24669 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:40.168780 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.148233 28485 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:09:40.169392 24665 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 6.
I20260709 13:09:40.146986 28211 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.170651 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.171263 24671 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.174067 28494 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.174968 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.175551 24667 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.176573 28345 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:40.174326 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.177528 28345 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.178166 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:40.179365 28499 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:09:40.179270 28411 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.181944 25219 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:40.183074 25213 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:40.185761 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.184885 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.133376 28312 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.195572 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.186733 24669 raft_consensus.cc:2376] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11. Re-sending same reply.
I20260709 13:09:40.203307 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:40.203851 24669 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:40.205304 24669 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:40.201905 25216 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:40.207124 24669 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:40.207680 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.152681 28447 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.214398 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:40.133764 28492 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.152225 27387 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.216919 24600 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:40.217422 24670 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:40.220662 24671 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:40.129876 28481 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:09:40.227339 24665 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: [9.6-10.7]
W20260709 13:09:40.244859 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90979.6us
W20260709 13:09:40.267920 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.197050 28082 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:40.305337 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:40.232496 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:40.201299 28430 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:40.147145 28495 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:09:40.133791 28450 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:09:40.303069 25218 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:40.340842 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:40.134454 28487 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:09:40.207722 28407 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.305898 24671 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:40.333949 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 131282us
I20260709 13:09:40.302897 28412 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:40.129814 28493 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.344482 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:40.237639 28479 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.339018 24666 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:40.351476 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.302628 27387 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.350230 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.348960 28211 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.385849 28211 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.386426 27387 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:40.376612 28501 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:09:40.379220 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 73954.9us
I20260709 13:09:40.393168 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1715) took 1402 ms. Trace:
I20260709 13:09:40.393603 24525 rpcz_store.cc:276] 0709 13:09:38.951244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.958969 (+  7725us) service_pool.cc:224] Handling call
0709 13:09:40.353392 (+1394423us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54000bc7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:40.353572 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015782784}
I20260709 13:09:40.394693 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.395967 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:40.398062 28412 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:40.398797 28490 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.399531 28490 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:40.399099 28412 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.400008 28490 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.351708 28042 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:40.401542 28487 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:40.402037 28487 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.403108 28487 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.384379 28237 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.404343 28487 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.225898 28447 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.405588 28237 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:40.405859 28326 consensus_queue.cc:1175] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0131806e3b9647128f32db1ab8d314fc" responder_term: 10 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: [9.9-9.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:40.405582 28495 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:40.406991 28447 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:40.407387 28495 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.407703 28447 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:40.408217 28447 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.408281 28495 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.409705 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.410924 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.411440 24670 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:40.412181 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.415525 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:40.416965 24524 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:40.416893 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:40.378585 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.400875 28490 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.419646 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:40.421339 28228 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.421794 24566 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:40.422032 28228 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:40.423023 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 822) took 1326 ms. Trace:
I20260709 13:09:40.423403 24673 rpcz_store.cc:276] 0709 13:09:39.101014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.101184 (+   170us) service_pool.cc:224] Handling call
0709 13:09:40.422800 (+1321616us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400405954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:40.422942 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504901504}
I20260709 13:09:40.424561 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.425590 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.394742 24522 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:09:40.426659 24522 pending_rounds.cc:85] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 5
I20260709 13:09:40.426594 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.427083 24522 pending_rounds.cc:107] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:09:40.427399 24522 raft_consensus.cc:2889] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.427693 24671 raft_consensus.cc:2368] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8.
I20260709 13:09:40.403430 28240 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:40.387347 27387 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:09:40.430763 24667 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:40.435602 24674 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:40.439421 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.415437 28297 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:40.437822 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:40.443603 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:40.444104 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.445140 24667 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
W20260709 13:09:40.438145 28478 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.778s	user 0.001s	sys 0.003s
I20260709 13:09:40.447419 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:40.437541 28237 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.437673 28228 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:40.440332 28491 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.438387 28481 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:40.458853 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.448027 28443 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.435787 28367 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:40.461297 28514 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:40.461963 28514 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.464828 28512 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:09:40.467264 28515 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:40.467741 28515 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:40.469975 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 121677us
I20260709 13:09:40.471038 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:40.449982 28240 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.476028 28512 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:40.476455 28512 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.477324 28512 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.464468 28514 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:40.460444 28493 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.483173 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1681) took 1242 ms. Trace:
I20260709 13:09:40.483726 24591 rpcz_store.cc:276] 0709 13:09:39.240956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.242015 (+  1059us) service_pool.cc:224] Handling call
0709 13:09:39.258395 (+ 16380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:39.467311 (+208916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.467344 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:39.474578 (+  7234us) log.cc:844] Serialized 52 byte log entry
0709 13:09:39.642057 (+167479us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:39.642106 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.642166 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.416059 (+773893us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:40.478302 (+ 62243us) raft_consensus.cc:1685] finished
0709 13:09:40.478330 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.483091 (+  4761us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1077,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9136,"spinlock_wait_cycles":4458240,"thread_start_us":138712,"threads_started":1,"wal-append.queue_time_us":179564}
I20260709 13:09:40.455235 28237 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.459411 28491 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.468665 28515 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.514923 28515 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.515249 28447 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:40.516328 28240 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.521739 28271 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.522696 28491 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:40.514268 24519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1694) took 1728 ms (client timeout 1765 ms). Trace:
W20260709 13:09:40.525595 24519 rpcz_store.cc:269] 0709 13:09:38.794101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.794250 (+   149us) service_pool.cc:224] Handling call
0709 13:09:40.514048 (+1719798us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400442854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:40.514214 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405602560}
I20260709 13:09:40.531523 28495 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:40.514045 28476 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.819s	user 0.003s	sys 0.000s
I20260709 13:09:40.475647 28329 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.514144 28498 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:40.535498 28498 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:40.535959 28498 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.536554 28329 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:40.537279 25210 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:40.493839 28479 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.540023 28237 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:40.544118 28427 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.544677 28427 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.509829 28512 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.544860 28399 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.546482 28399 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.546839 28427 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:40.548921 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:40.549638 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:40.550462 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet eb1f10582ce7411b8b3187da8ec646c8: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:40.550944 28345 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.552721 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.550483 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 853) took 1260 ms. Trace:
I20260709 13:09:40.553340 28518 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:40.553881 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.554754 28447 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.555289 28447 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:40.556233 28447 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.555306 28477 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.557955 28477 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.560413 28494 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:40.532882 28275 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.553295 25214 rpcz_store.cc:276] 0709 13:09:39.290525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.290624 (+    99us) service_pool.cc:224] Handling call
0709 13:09:39.290889 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.832812 (+541923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.550273 (+717461us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b5400570dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:40.550425 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244759936}
I20260709 13:09:40.563454 28275 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:40.557991 24591 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:40.565634 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 124651us
I20260709 13:09:40.565968 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:40.564284 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:40.617322 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.621941 28491 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:40.623230 28491 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:40.623667 28491 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:40.645686 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.646745 24593 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:40.647006 24594 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:09:40.652540 24471 auto_rebalancer.cc:629] Failed to schedule move for tablet 4430292826c34b99a8f9413e570e0ff3: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:40.653390 24593 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:40.656904 28498 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.639415 28443 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.661338 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.662102 24592 raft_consensus.cc:2368] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:40.664412 28479 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:40.654918 28329 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.664929 28479 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.665534 28329 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.667026 28479 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:40.667415 28329 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:40.630534 28442 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.624804 28491 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.677106 28275 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.696070 25184 leader_election.cc:400] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:40.698583 25184 leader_election.cc:403] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:40.677595 28326 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:09:40.736351 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 170001us
I20260709 13:09:40.730309 24592 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:09:40.737408 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 290076us
I20260709 13:09:40.737699 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.737658 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.679427 28442 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.739252 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:40.741518 24594 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:40.742372 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:09:40.740832 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 265240us
I20260709 13:09:40.733353 28399 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:40.738582 28491 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.747125 28143 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:40.749809 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.751010 24673 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:40.770939 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.763991 24598 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:40.699056 28520 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:09:40.700294 28297 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:09:40.733682 28228 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:40.773128 24670 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:40.771440 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.773619 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.702987 28275 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.744637 28082 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.784432 24672 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:40.787705 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:40.794836 24594 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
W20260709 13:09:40.789254 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44914.4us
I20260709 13:09:40.805009 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:40.806485 24671 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:40.772271 28367 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:40.808233 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:40.741263 28518 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:09:40.811733 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.810353 25216 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
W20260709 13:09:40.812755 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74882us
I20260709 13:09:40.813750 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.816991 25216 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:40.818178 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:40.818962 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:40.819521 25210 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.773681 28237 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:40.823050 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:40.828186 25214 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:40.829519 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:40.802608 28535 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:40.827389 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:40.778182 28484 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:09:40.835284 25213 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:09:40.786995 28443 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:40.815614 28082 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:40.837435 25213 pending_rounds.cc:85] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 8
I20260709 13:09:40.842492 25213 pending_rounds.cc:107] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:09:40.842978 25213 raft_consensus.cc:2889] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.840222 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:40.786810 28482 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:09:40.846124 28082 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.822688 28477 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:09:40.836299 28534 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:40.811564 28340 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:09:40.820619 28524 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.836578 28275 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:40.836311 28540 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.854782 28498 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:40.821017 28532 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:09:40.863936 28539 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:09:40.891426 28527 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:09:40.892809 28528 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:09:40.886196 28525 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:09:40.899880 28506 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.516s	user 0.002s	sys 0.000s
W20260709 13:09:40.934139 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 113586us
I20260709 13:09:40.937500 28367 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:40.938985 28367 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.884754 28484 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:09:40.951629 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 88433.3us
I20260709 13:09:40.839756 28535 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:40.955122 25210 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:40.972321 25219 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:40.963425 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:40.971608 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1682) took 1730 ms. Trace:
I20260709 13:09:40.950649 28544 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:09:40.972934 24595 rpcz_store.cc:276] 0709 13:09:39.241316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.242033 (+   717us) service_pool.cc:224] Handling call
0709 13:09:39.262984 (+ 20951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.861157 (+598173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.971337 (+1110180us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54001ebed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:40.971549 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374361856}
I20260709 13:09:40.989959 28492 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:40.990461 28492 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:40.991441 28492 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:40.992175 28547 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:40.996086 28553 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:40.947854 28443 consensus_queue.cc:1243] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:40.888449 28541 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.927915 28442 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:41.022600 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 214775us
I20260709 13:09:40.856856 28228 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.026325 24674 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:41.030857 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 58570.1us
I20260709 13:09:40.962311 28484 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:41.003561 28492 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.036863 24666 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:09:41.037104 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 73751us
I20260709 13:09:41.038645 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:41.039186 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:41.044545 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:41.033509 24674 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:41.026908 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:41.044966 24673 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:41.040586 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.044365 25215 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:41.046314 25216 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:41.046581 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:41.048629 24674 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:41.040817 28412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.009s	sys 0.019s
I20260709 13:09:41.048105 28539 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:41.072813 24674 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:41.073365 28412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.009s	sys 0.019s
I20260709 13:09:41.029554 28520 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:41.025880 28531 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:09:41.080870 28520 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:41.103839 24673 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:41.083777 28553 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.110158 28535 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:41.110970 28511 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.727s	user 0.002s	sys 0.000s
W20260709 13:09:41.111937 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.112030 28530 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:41.112543 28530 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:41.113034 28512 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.004s
I20260709 13:09:41.113396 28530 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.114447 28530 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.116447 28345 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:41.116863 28345 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:41.117161 28538 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:09:41.117738 28345 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:41.118711 28500 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.985s	user 0.000s	sys 0.003s
I20260709 13:09:41.119060 28345 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.121742 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1724) took 2097 ms. Trace:
I20260709 13:09:41.122211 24522 rpcz_store.cc:276] 0709 13:09:39.023914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.033881 (+  9967us) service_pool.cc:224] Handling call
0709 13:09:40.353686 (+1319805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.435538 (+ 81852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.121496 (+685958us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000bc7d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:41.121672 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2954238208}
I20260709 13:09:41.103111 28539 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.131393 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:41.138311 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:41.143594 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.145696 24599 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:41.146819 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.148886 24599 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:41.152526 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:41.152509 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.152290 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 107835us
I20260709 13:09:41.154474 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:41.157734 24597 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:41.158296 28430 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:41.158900 28430 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.158985 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:41.160073 28483 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:41.160444 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:41.161311 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 305281us
I20260709 13:09:41.162137 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:41.163079 28442 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:41.163547 28442 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.163935 28442 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.169721 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:41.171437 28493 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:41.172005 28493 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:41.173105 28493 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.187654 24598 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:41.188156 24598 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:41.193172 24491 leader_election.cc:400] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8.
I20260709 13:09:41.193516 24491 leader_election.cc:403] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:41.197890 27387 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:41.198402 27387 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.191913 24598 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.150683 28531 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.201304 25211 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:41.155393 28490 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:41.206110 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:41.206364 25212 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:41.206419 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 159884us
I20260709 13:09:41.206863 28557 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8.
I20260709 13:09:41.209497 27387 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:41.212466 27387 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.082357 28484 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.187803 28494 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:41.209915 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:41.190456 28483 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:41.209623 25210 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:41.212875 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:41.214912 24595 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:41.213647 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:41.200428 28082 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.188235 28554 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.230360 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:41.214587 28494 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.215724 28484 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.233047 27387 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:41.238740 27387 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.239239 27387 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.233955 24671 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:09:41.239873 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.210466 28479 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:09:41.215857 28483 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.219137 28557 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.226598 28490 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:41.243489 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:41.247022 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:41.238300 28494 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.250097 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:41.251609 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:41.252223 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:41.257289 24520 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:41.258016 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:41.257792 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:41.253441 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:41.188880 28520 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.255429 24671 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:41.258761 24525 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:41.258893 24671 pending_rounds.cc:85] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 7
I20260709 13:09:41.259296 24671 pending_rounds.cc:107] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:41.259608 24671 raft_consensus.cc:2889] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:41.259613 24525 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:41.260931 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:41.261556 24516 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.262002 28523 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:41.262439 28523 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.262884 28523 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.263468 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:41.245464 28540 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.265592 28540 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.267650 28540 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:41.267843 28554 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.268376 28554 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.265899 28520 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:41.274101 28532 consensus_queue.cc:1175] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "983693721af6486c97ece1410a90cf30" responder_term: 10 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:41.213124 28531 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:41.278439 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.279089 24674 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:09:41.280166 24674 pending_rounds.cc:85] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 7
I20260709 13:09:41.279440 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:41.280459 24674 pending_rounds.cc:107] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:09:41.281380 24674 raft_consensus.cc:2889] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:41.245405 28553 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:09:41.283238 28555 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.225584 28082 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.245256 28483 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.285399 24516 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:41.245105 28544 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.293712 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:41.295360 24522 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:41.296113 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:41.248979 28560 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 13:09:41.300760 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 58076.8us
I20260709 13:09:41.285732 28540 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:09:41.300371 28367 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.318396 28571 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:09:41.318562 28573 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:41.320112 28430 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.322014 28082 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:41.322187 28554 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:41.341929 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:41.300984 28345 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:09:41.324200 28447 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:41.290776 28570 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:09:41.344671 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.354550 24525 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:41.355520 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:41.355806 24516 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:41.360930 24520 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:41.362206 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:41.367027 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:41.368326 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:41.349511 28447 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:41.370151 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.364964 28579 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.371029 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:41.374076 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:41.378814 28505 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.041s	user 0.002s	sys 0.001s
I20260709 13:09:41.380115 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2851) took 1422 ms. Trace:
I20260709 13:09:41.381188 28565 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:09:41.382525 28580 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.383096 28580 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.380483 24521 rpcz_store.cc:276] 0709 13:09:39.957529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.957675 (+   146us) service_pool.cc:224] Handling call
0709 13:09:39.957998 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:39.967236 (+  9238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.967268 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:39.967810 (+   542us) log.cc:844] Serialized 52 byte log entry
0709 13:09:40.073572 (+105762us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:40.490189 (+416617us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.511910 (+ 21721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.512028 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.356348 (+844320us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:41.379803 (+ 23455us) raft_consensus.cc:1685] finished
0709 13:09:41.379911 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.380056 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5608,"prepare.queue_time_us":517689,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":887,"raft.queue_time_us":193904,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":35922,"spinlock_wait_cycles":5904128,"thread_start_us":410252,"threads_started":3,"wal-append.queue_time_us":187682}
I20260709 13:09:41.365906 28237 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:41.395272 24520 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:41.313418 28490 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.488297 27387 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.369388 28345 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.533308 24520 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:41.488531 28427 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.540268 27387 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:41.529111 28491 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.001s
I20260709 13:09:41.488242 28515 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:41.552277 25210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:41.554253 25210 raft_consensus.cc:606] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:41.490435 28237 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:41.528990 28571 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:41.529383 28082 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.576685 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.564117 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:41.548970 28574 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:09:41.579984 24522 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:41.584834 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:41.553068 28573 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.553829 28515 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:41.590077 28329 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.591693 28498 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.613668 28498 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:41.614373 28568 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:09:41.546483 28345 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.628870 25213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:41.629748 25213 raft_consensus.cc:606] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:41.630167 25213 raft_consensus.cc:614] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:41.632175 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.551792 28427 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.593920 28411 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.638706 25210 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:41.393321 28579 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.574635 28297 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:09:41.645624 28367 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:41.652976 28367 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:41.644170 25210 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:09:41.660733 25210 pending_rounds.cc:85] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 8
I20260709 13:09:41.661000 25210 pending_rounds.cc:107] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:41.661247 25210 raft_consensus.cc:2889] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:41.578253 28495 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:09:41.581284 28512 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:09:41.627625 28531 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:41.666541 25211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:41.642401 28518 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:41.671329 25211 raft_consensus.cc:606] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:41.581416 28571 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.571015 28447 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.677467 28479 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:41.679647 25211 raft_consensus.cc:614] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:41.678877 28329 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.692590 28531 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:41.693169 28531 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.696043 25211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:41.696610 25211 raft_consensus.cc:606] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:41.696578 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:41.697882 24591 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
W20260709 13:09:41.677877 28578 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:09:41.702240 28479 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.705765 28312 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:41.706177 28312 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:41.706463 28487 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:41.706807 28487 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:41.707010 28312 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.707583 28487 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.616009 28573 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.723661 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:41.708060 28312 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.728650 28495 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:41.733783 27387 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.734391 27387 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.770283 28561 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.687422 28515 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.770972 28561 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.771767 28515 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:41.774439 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.732547 28297 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.857292 28370 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.863927 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.864373 28370 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:41.680722 28518 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:41.945752 28584 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.264s	user 0.005s	sys 0.003s
I20260709 13:09:41.951628 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 865) took 1134 ms. Trace:
I20260709 13:09:41.965040 28534 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:41.965592 28534 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:41.966358 28512 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:41.966991 28512 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:41.966517 28534 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:41.967995 28512 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:41.974048 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.952242 25219 rpcz_store.cc:276] 0709 13:09:40.817275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.817396 (+   121us) service_pool.cc:224] Handling call
0709 13:09:40.972155 (+154759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.972809 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.951392 (+978583us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54005d0f50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:41.951564 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322250112}
I20260709 13:09:42.042654 28430 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:42.057374 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 333764us
I20260709 13:09:42.060254 24593 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:42.062414 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.062558 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:42.063225 24598 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:42.064671 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.065299 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.066692 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.070737 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.070554 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.080303 24665 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:42.082298 24592 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:42.083987 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.085218 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:42.087173 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.089515 24522 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:42.092301 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:42.093042 24592 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:42.057518 28512 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:41.589421 28082 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:42.099417 24598 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:09:41.692883 28329 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:42.101883 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.010s
I20260709 13:09:42.101716 24598 pending_rounds.cc:85] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 8
I20260709 13:09:42.070065 27806 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.109046 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:42.103255 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.011s	sys 0.010s
I20260709 13:09:42.103231 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:42.110496 24670 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:42.110620 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.074198 28546 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.109808 24672 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:42.073752 28539 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.075416 28370 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:42.112102 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 527315us
I20260709 13:09:42.104079 24598 pending_rounds.cc:107] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 9.9
W20260709 13:09:42.113372 24594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.004s	sys 0.023s
I20260709 13:09:42.111446 24519 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:42.130913 24598 raft_consensus.cc:2889] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:42.099503 28340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.009s	sys 0.016s
W20260709 13:09:42.114653 25212 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.002s	sys 0.028s
I20260709 13:09:42.126832 24592 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:42.100576 28143 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:42.131043 24594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.005s	sys 0.023s
W20260709 13:09:42.103044 28572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.014s	sys 0.028s
I20260709 13:09:42.133780 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:42.139061 24598 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:42.139336 24592 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:42.074482 28297 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:09:42.134516 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:42.096971 28345 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.080472 28560 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:42.135715 25212 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.002s	sys 0.028s
I20260709 13:09:42.081436 28530 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:09:42.140769 24600 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:42.158710 24598 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
W20260709 13:09:42.135390 28340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.009s	sys 0.016s
I20260709 13:09:42.163729 24592 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:42.138118 28454 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:09:42.138877 28572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.014s	sys 0.028s
I20260709 13:09:42.125994 27806 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.165781 28547 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:42.130355 28546 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:42.157814 28477 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.165704 28479 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.166563 28498 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.131414 28539 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.168264 28143 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.166891 28573 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:42.199091 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.112489 28237 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.172648 28579 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.167302 28560 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:42.200414 28520 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.930s	user 0.008s	sys 0.013s
I20260709 13:09:42.199608 28531 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.209048 24518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c35412a4ad4729862392b77295639d"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:09:42.211365 24524 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:42.211750 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:42.217657 24518 raft_consensus.cc:606] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:42.218109 24518 raft_consensus.cc:614] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:42.205523 28518 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.212687 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.199558 28495 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.197938 28561 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.193965 28547 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:42.214850 28442 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.050s	user 0.008s	sys 0.011s
I20260709 13:09:42.216164 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:42.217762 28524 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.354s	user 0.010s	sys 0.019s
I20260709 13:09:42.229981 24522 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:42.219416 24523 raft_consensus.cc:2410] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:09:42.219547 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.231629 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.234933 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.217291 28492 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.171s	user 0.016s	sys 0.006s
W20260709 13:09:42.223789 28523 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.960s	user 0.015s	sys 0.033s
I20260709 13:09:42.260807 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.209976 28587 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.228201 28329 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:42.217922 28494 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.932s	user 0.013s	sys 0.013s
I20260709 13:09:42.267598 28345 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:42.267669 28477 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:42.271971 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.207466 28143 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.221784 28535 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:09:42.311932 28523 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:42.351287 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68356us
I20260709 13:09:42.209683 28479 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:09:42.319059 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 175873us
I20260709 13:09:42.327365 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:09:42.328687 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 251725us
I20260709 13:09:42.261313 28524 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.340143 24672 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:42.227095 28495 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.332343 28573 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:42.228590 28547 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.358804 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:42.261992 28442 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.374590 28596 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:42.376397 28143 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.399178 24525 raft_consensus.cc:2368] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10.
I20260709 13:09:42.376689 28240 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:42.374500 28412 raft_consensus.cc:1064] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:09:42.369104 28572 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:42.374650 28492 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:09:42.380995 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.350992 28082 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:42.403545 28340 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.351912 28599 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:42.339229 28494 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.349614 28345 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:42.401775 28531 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.353413 28477 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:42.412299 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.411203 28447 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.409175 28572 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:42.408799 28412 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.418642 25217 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:42.444530 28539 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.402410 28573 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:42.408233 28592 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:09:42.536518 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1741) took 1285 ms. Trace:
I20260709 13:09:42.536913 24523 rpcz_store.cc:276] 0709 13:09:41.251217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.251407 (+   190us) service_pool.cc:224] Handling call
0709 13:09:42.536338 (+1284931us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54003ddbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:42.536463 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212778240}
I20260709 13:09:42.499392 28599 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:42.543617 28411 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.896s	user 0.011s	sys 0.008s
I20260709 13:09:42.544193 28411 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.546468 28345 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.546924 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 868) took 1728 ms. Trace:
I20260709 13:09:42.547248 28345 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.547978 28345 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.547531 25217 rpcz_store.cc:276] 0709 13:09:40.818087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.818187 (+   100us) service_pool.cc:224] Handling call
0709 13:09:40.828915 (+ 10728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.500692 (+1671777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.546618 (+ 45926us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54002e59d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:42.546863 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3644828416}
I20260709 13:09:42.486303 28340 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.550565 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.551007 28340 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.551172 24518 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:42.419277 28547 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.512612 28605 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:42.552482 24518 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:42.552317 28605 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:42.553408 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.554334 28605 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:42.512722 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.554997 24599 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:42.514689 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:42.410040 28588 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 13:09:42.455763 28515 consensus_meta.cc:287] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.008s
I20260709 13:09:42.557188 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1482) took 1168 ms. Trace:
I20260709 13:09:42.397410 28428 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:42.460263 28442 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.443842 28546 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.558069 27387 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:42.557988 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:42.519886 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.560379 24596 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:42.498040 28531 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.417817 27806 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.453540 28275 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:42.522289 28571 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.523036 28477 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.523325 28211 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:42.561272 28428 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:42.571843 28211 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:42.562408 28586 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.530045 28367 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:42.531215 28534 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.572557 28428 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.572685 28586 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.573592 28428 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.457043 28560 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.494614 28572 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.520094 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.560967 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:42.562482 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.405561 28603 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.452152 28523 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.557572 24594 rpcz_store.cc:276] 0709 13:09:41.388509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.388703 (+   194us) service_pool.cc:224] Handling call
0709 13:09:41.532602 (+143899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.547428 (+ 14826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.547466 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.552138 (+  4672us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.137680 (+585542us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:42.137727 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.137796 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.556979 (+419183us) raft_consensus.cc:1685] finished
0709 13:09:42.556996 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.557134 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14483,"raft.queue_time_us":15657,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":22730,"thread_start_us":543174,"threads_started":1,"wal-append.queue_time_us":640556}
W20260709 13:09:42.536944 28312 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.796s	user 0.011s	sys 0.006s
I20260709 13:09:42.505314 28580 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:42.577419 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 198125us
I20260709 13:09:42.563884 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.593197 24593 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 7: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:42.574975 28586 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.475577 28597 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:09:42.570075 28531 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.591977 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:42.583257 24595 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:42.577250 28082 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:42.569475 28275 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:42.619002 28615 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:42.617772 28611 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:42.620101 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 283697us
I20260709 13:09:42.622318 28477 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:42.623025 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:42.624121 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.623767 24637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.020s	sys 0.007s
I20260709 13:09:42.586884 28560 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:42.624019 28082 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.626457 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.623833 28297 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:09:42.627831 28427 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:42.636885 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.734869 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.735266 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.643627 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.670480 24637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.020s	sys 0.007s
W20260709 13:09:42.735992 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 643729us
I20260709 13:09:42.725044 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:42.710556 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.720440 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 340125us
I20260709 13:09:42.724781 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.738543 25211 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:42.739676 25216 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:42.740720 28613 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.629438 28399 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.722013 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.696542 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.741470 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 71733.9us
W20260709 13:09:42.742798 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.592826 28367 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:09:42.572731 28211 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.744573 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.723380 25213 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:42.745952 25219 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:42.630106 28271 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.754849 28271 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.755575 25212 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:42.756495 28271 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:42.628513 28589 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.748363 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.750839 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.757020 28589 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.750382 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.758191 25216 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:42.752456 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.758972 25215 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:42.759028 28589 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:42.759833 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.760337 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.760802 28532 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:42.761263 28532 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.762912 28532 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.764189 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.624764 28479 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.132s
I20260709 13:09:42.720896 28082 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:42.687582 28442 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.687196 28560 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.628289 28587 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.141s
I20260709 13:09:42.769767 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.752574 28523 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.606561 28603 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.741281 28613 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.794471 28275 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.765550 27806 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.795750 27806 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:42.796277 28613 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.790719 25214 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:42.741389 28477 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:42.798799 24525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 798) took 1443 ms (client timeout 1527 ms). Trace:
W20260709 13:09:42.799185 24525 rpcz_store.cc:269] 0709 13:09:41.354932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.355297 (+   365us) service_pool.cc:224] Handling call
0709 13:09:42.798619 (+1443322us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003ae3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:42.798745 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2378553600}
I20260709 13:09:42.800230 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.802989 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.803519 24517 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:42.791440 28560 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.806484 28570 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:42.800249 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:42.809497 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.809902 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.810732 28547 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:42.814241 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:42.815011 24673 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:42.817554 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.818150 24593 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:42.792763 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:42.819851 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.819977 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.820502 24593 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:42.820668 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:42.821365 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.820974 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.822003 24599 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:42.770987 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.772086 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:42.716518 28611 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:42.779421 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:42.779899 24523 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:42.823258 25213 raft_consensus.cc:2410] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:42.769001 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.769883 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.823908 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.824479 25219 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:42.741784 28312 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:42.790088 25216 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:42.770357 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:42.766201 28495 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:42.826166 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.822103 24525 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:42.823423 24666 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:42.831946 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:42.832963 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 60951.9us
I20260709 13:09:42.842876 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:42.830998 24594 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:42.830984 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:42.835649 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.831280 28611 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.831874 28491 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:42.835857 28312 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:42.836799 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.837738 28597 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:42.838166 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.845553 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:42.856391 28326 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:42.856441 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:42.857889 28597 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.858594 28612 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:09:42.860229 28597 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.847810 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:42.850091 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:42.862179 28599 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.764854 28399 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.854864 25182 leader_election.cc:400] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10.
I20260709 13:09:42.868125 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:42.766968 28580 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:09:42.790362 28143 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:42.855412 24595 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
W20260709 13:09:42.853581 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 80855.9us
I20260709 13:09:42.869150 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:42.884121 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:42.884459 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.875154 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:42.856990 28326 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.813835 28271 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:09:42.884739 24597 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:42.863391 28492 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.854233 28532 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:42.823215 28523 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.854103 28494 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:42.817991 28442 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:42.923058 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47958.8us
I20260709 13:09:42.898104 25210 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:42.867106 28586 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:42.866546 28552 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.932192 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 75817.9us
I20260709 13:09:42.944474 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:42.923331 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:42.890087 28483 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.598s	user 0.014s	sys 0.019s
I20260709 13:09:42.884605 28329 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:42.940351 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:42.876750 28599 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:42.891690 28597 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:42.897537 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:42.891363 28412 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.862782 28491 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.900406 28326 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.150142 28491 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.951972 28483 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.153589 28483 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.936137 28573 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.934934 28450 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:43.154407 28450 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.154893 28450 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:43.154438 28326 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.155640 25215 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:42.969969 28599 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:42.889809 28143 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.160034 28143 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:42.984997 28442 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.985652 28580 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:43.160885 28580 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:43.161999 28580 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.986955 28627 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:43.165297 28627 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:43.165798 28627 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.167389 28450 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.987350 28523 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:42.936895 28492 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.990330 27387 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.991364 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 104209us
I20260709 13:09:42.928244 28539 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:09:42.900151 28605 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:09:42.953138 28329 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.944226 28586 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:43.002103 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:42.978629 28613 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:09:42.958336 28490 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:42.935117 28411 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:09:42.963773 28597 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.020677 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:42.972360 28524 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:43.003168 28588 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:09:42.940872 28532 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:42.958889 28552 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:43.026160 28623 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:43.061951 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 117564us
W20260709 13:09:43.065267 28626 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:09:43.066141 28617 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:09:43.066977 28620 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:09:43.067920 28621 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:09:43.068881 28600 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:09:43.064788 28312 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:43.065325 28622 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:09:43.071796 28624 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:43.071259 28629 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:09:43.078497 28082 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:43.079618 28399 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:42.923647 28565 raft_consensus.cc:2955] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
W20260709 13:09:43.080394 28428 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260709 13:09:43.076814 28531 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:43.076814 28560 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.081121 28603 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:43.081005 28534 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:09:43.088893 28211 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.080343 28611 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:43.094853 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:43.132890 25210 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 11 LEARNER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:43.138916 28237 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:43.432140 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.278091 24566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.716s (SENT) [suppressed 29 similar messages]
W20260709 13:09:43.454453 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.251243 24565 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45fddcc6d2bc4726a21bdfe31a4cae08. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:43.457895 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 240956us
W20260709 13:09:43.227201 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.460485 28515 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:43.461177 28515 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.461939 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:43.463572 28515 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.464742 28515 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:43.465361 28515 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.467905 28515 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:43.463910 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.233764 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.463102 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:43.474689 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:43.480019 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:43.481851 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:43.485433 28228 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:43.486140 28228 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.486652 28228 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.488999 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:43.356303 28599 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:43.491673 28595 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:43.491850 28547 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.492530 28547 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:43.496536 28547 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:43.498126 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 220076us
I20260709 13:09:43.493614 28599 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:43.499162 28599 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.499776 28599 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.504005 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:43.504104 28595 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.504758 28595 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.506960 28595 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.511912 28547 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:43.512481 28547 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:43.517256 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:43.518935 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:43.518867 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:43.520766 24595 raft_consensus.cc:2410] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:43.521279 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:43.521862 24598 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.522137 24593 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:43.523536 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:43.525903 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:43.526958 24593 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:43.530349 24598 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:43.529969 28547 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:43.533465 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:43.534094 24595 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:43.535056 24591 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:43.538506 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:43.549252 27806 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:43.554672 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:43.554780 28535 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.555172 28595 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:43.556686 28535 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:43.567826 28547 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:43.568542 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:43.564327 28599 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.569339 24522 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:43.570757 28599 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.571362 28599 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.557610 28595 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.571899 28599 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.568569 28535 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:43.573115 28535 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:43.573964 28599 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.573189 28595 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.573707 28535 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.574523 28599 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:43.576632 28535 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.577590 28228 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.565675 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:43.580897 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:43.582751 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:43.585250 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:43.586349 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:43.589658 24520 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:43.590822 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:43.588382 28479 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:43.595351 28479 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:43.608428 28495 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:43.609534 28495 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:43.609899 28495 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:43.610888 28495 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.608480 28228 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.612107 28495 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.603312 28535 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:43.604086 28644 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:43.614969 28642 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:43.612753 28479 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.622265 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:43.616657 28535 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.627142 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:43.621498 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.633172 28597 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.633971 28535 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.613150 28645 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.637481 28642 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.639145 28642 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.641125 28645 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:43.638204 28644 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.645848 28490 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.648973 28490 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.661908 28645 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:43.665120 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 78807.7us
I20260709 13:09:43.670109 28645 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:43.673591 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 859) took 1049 ms. Trace:
I20260709 13:09:43.674139 28645 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:43.674676 28645 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:43.674863 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:43.675470 24591 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:43.673986 24670 rpcz_store.cc:276] 0709 13:09:42.620240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.620573 (+   333us) service_pool.cc:224] Handling call
0709 13:09:42.620939 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.621274 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.621301 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.621736 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.752063 (+130327us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:42.752098 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.752173 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.669609 (+917436us) raft_consensus.cc:1685] finished
0709 13:09:43.669631 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.669755 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1963,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":129987,"threads_started":1,"wal-append.queue_time_us":248958}
I20260709 13:09:43.675535 28645 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:43.990214 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.680948 25216 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:43.717599 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:43.719614 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:44.179044 24591 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:44.179399 24673 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:43.717531 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:43.679754 28644 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:43.693593 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:44.177155 28624 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.741680 28479 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.999704 28597 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:43.683641 28370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.011s
I20260709 13:09:44.196367 24672 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:43.274408 28275 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.168100 28326 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:44.174971 28552 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.181687 28329 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.680648 28495 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.942628 28547 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:44.197635 28370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.020s	sys 0.026s
I20260709 13:09:43.288892 28627 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.190357 28624 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.019747 28642 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.211944 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 857) took 1592 ms. Trace:
I20260709 13:09:44.216374 24667 rpcz_store.cc:276] 0709 13:09:42.619580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.621293 (+  1713us) service_pool.cc:224] Handling call
0709 13:09:42.621660 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.622129 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.622178 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.622668 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.765778 (+143110us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:42.765835 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.765923 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.211676 (+1445753us) raft_consensus.cc:1685] finished
0709 13:09:44.211702 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.211871 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719,"raft.queue_time_us":1517,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":74,"thread_start_us":142683,"threads_started":1,"wal-append.queue_time_us":266431}
I20260709 13:09:44.212698 28560 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:44.223490 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 529946us
W20260709 13:09:44.225562 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.227769 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:44.222577 28655 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:44.226976 28560 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.235181 28657 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:44.234903 28655 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.235646 28657 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:44.235298 28560 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.236490 28657 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.237838 28657 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.237949 28596 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.238106 28560 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.238513 28596 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.238862 28560 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.239434 28560 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.240546 28596 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.241246 28596 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.242101 28560 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:44.244719 28627 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.241775 28655 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:44.253974 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 814) took 1475 ms. Trace:
W20260709 13:09:44.260784 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.250480 28580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.028s	sys 0.054s
I20260709 13:09:44.259874 24517 rpcz_store.cc:276] 0709 13:09:42.778242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.804843 (+ 26601us) service_pool.cc:224] Handling call
0709 13:09:42.821443 (+ 16600us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:42.832160 (+ 10717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.832188 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:42.836836 (+  4648us) log.cc:844] Serialized 52 byte log entry
0709 13:09:43.686056 (+849220us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b18000f9d00. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:09:43.929143 (+243087us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:43.929199 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.935096 (+  5897us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.250327 (+315231us) raft_consensus.cc:1685] finished
0709 13:09:44.250355 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.253910 (+  3555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11285,"raft.queue_time_us":10905,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":2874112,"thread_start_us":242803,"threads_started":1,"wal-append.queue_time_us":1361903}
I20260709 13:09:44.212155 28495 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.739063 28490 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:44.265255 28580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.029s	sys 0.055s
I20260709 13:09:44.277583 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:44.280906 24667 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:44.242319 28596 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.290779 28596 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:44.291429 28596 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:44.292091 28596 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.294132 28552 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:44.295447 28495 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:44.299549 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.299638 28490 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.280045 28326 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.307466 28326 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.308295 28660 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.308817 28660 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.309765 28326 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.310846 28660 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.311494 28624 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.311928 28596 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.314123 24595 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:44.315335 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:44.315896 28428 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.316056 24591 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:44.316358 28428 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.316761 28428 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.318279 28564 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:44.318673 28564 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:44.319483 28564 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.320010 28479 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:44.321707 28657 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:44.322321 28657 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:44.322889 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:44.323236 24668 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:44.324611 28657 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.311993 28660 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.325335 28660 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.325721 28660 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.328883 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:44.332427 28492 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.333215 25215 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.333341 28661 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.334915 28665 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:44.334818 28669 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:44.334072 28657 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.339320 28661 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.344425 28661 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:44.345333 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08001305c0 after lost signal to thread 23433
I20260709 13:09:44.338317 28665 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.346325 28665 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.190925 28573 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.346815 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:44.347040 28573 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.347565 28613 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:44.347923 28613 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.348238 28613 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.336359 28326 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:44.349439 28326 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:44.350117 28240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.006s	sys 0.010s
W20260709 13:09:44.350452 28240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.006s	sys 0.010s
I20260709 13:09:44.352191 28326 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.354120 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:44.354110 28573 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.355254 28492 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.355734 28326 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:44.379866 24596 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:44.382900 28430 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.383469 28430 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.362742 28492 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:43.278450 28367 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:44.397324 28367 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.398036 28370 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:44.399586 28370 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.363740 28329 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.404109 28411 raft_consensus.cc:993] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:09:44.404570 28411 raft_consensus.cc:1081] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:09:44.405321 25219 raft_consensus.cc:2368] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10.
I20260709 13:09:44.365244 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.407260 25212 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:44.361254 28661 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:43.238838 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.379477 28428 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.357445 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:44.450631 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 93259.6us
I20260709 13:09:44.391160 25215 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:44.354164 28657 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.449563 25213 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:44.452824 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:44.482911 25212 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.405296 28665 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.485407 28428 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.485864 28665 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:44.486981 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 127943us
I20260709 13:09:44.487653 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:44.488358 24595 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.490065 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:44.490741 24593 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.362536 28624 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.492689 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 898) took 1244 ms. Trace:
I20260709 13:09:44.495282 25213 rpcz_store.cc:276] 0709 13:09:43.238394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.238563 (+   169us) service_pool.cc:224] Handling call
0709 13:09:44.482498 (+1243935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:44.487022 28326 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:44.497912 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:44.503269 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:44.504076 24523 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:44.505363 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:44.505966 24517 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:44.506892 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:44.507593 24516 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.510308 24593 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:44.499842 28326 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.510691 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:44.511296 24523 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.512143 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:44.512616 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:44.513269 24667 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:44.512722 24517 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:44.514714 28326 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.514945 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:44.515523 24669 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.517030 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.518141 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.518791 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1297) took 1004 ms. Trace:
I20260709 13:09:44.519073 25213 rpcz_store.cc:276] 0709 13:09:43.514813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.517928 (+1003115us) service_pool.cc:224] Handling call
0709 13:09:44.518745 (+   817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:44.519795 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.520653 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.521214 28428 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:44.522058 28531 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.522433 28428 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.482530 28662 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.524106 24669 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:44.521425 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:44.521435 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:44.511776 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:44.521059 24523 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:44.526860 25213 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:09:44.527841 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.528216 25212 raft_consensus.cc:2410] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:09:44.492061 28669 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.528595 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:44.531250 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:44.492570 28645 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:44.495613 28665 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:44.504225 28430 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.482926 28661 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.523916 28662 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.801386 24673 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:44.622834 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.713680 28671 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:44.854667 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.863862 28671 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.714138 28657 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.698462 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:44.708909 28370 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.545260 28669 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.512014 28644 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:44.699412 28645 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.865916 28644 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:44.865988 24521 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:44.866693 28644 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.867035 28450 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:44.867295 28645 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.606616 28531 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:44.748006 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.576300 24516 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:44.603132 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:44.868603 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.602469 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.628986 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:44.870718 25212 raft_consensus.cc:2368] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:09:44.607925 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:44.871055 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:44.871331 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 900) took 1224 ms. Trace:
W20260709 13:09:44.764426 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.871672 25212 rpcz_store.cc:276] 0709 13:09:43.646815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.531540 (+884725us) service_pool.cc:224] Handling call
0709 13:09:44.871279 (+339739us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:43.172173 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.653935 24595 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:44.870091 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 901) took 1223 ms. Trace:
I20260709 13:09:44.535101 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:44.864877 24667 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:44.615345 28493 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:44.873908 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2879) took 2321 ms. Trace:
I20260709 13:09:44.700558 28613 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.876308 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:44.873523 25213 rpcz_store.cc:276] 0709 13:09:43.647123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.530833 (+883710us) service_pool.cc:224] Handling call
0709 13:09:44.870040 (+339207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:44.878028 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.871647 24671 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:44.879882 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:44.678956 28647 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:44.868489 28531 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:44.867651 28669 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.545476 28672 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:44.683868 28367 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.533245 28411 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.886577 25212 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:44.882671 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:44.864598 28671 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.880635 24519 rpcz_store.cc:276] 0709 13:09:42.541710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.555092 (+ 13382us) service_pool.cc:224] Handling call
0709 13:09:42.555355 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.555671 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.555698 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.556149 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.649066 (+ 92917us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:42.649166 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.649271 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.862903 (+2213632us) raft_consensus.cc:1685] finished
0709 13:09:44.862926 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.863050 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1021,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":92494,"threads_started":1,"wal-append.queue_time_us":262152}
I20260709 13:09:44.755426 28428 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.889665 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:44.893236 24593 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:44.890132 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:43.250545 28614 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.503s	user 0.003s	sys 0.000s
I20260709 13:09:44.895346 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1483) took 2662 ms. Trace:
I20260709 13:09:44.505096 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:44.895694 24600 rpcz_store.cc:276] 0709 13:09:42.233129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.233253 (+   124us) service_pool.cc:224] Handling call
0709 13:09:42.315508 (+ 82255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.315927 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.315969 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.316560 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.499937 (+183377us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:42.500035 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.500126 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.249689 (+749563us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:44.895078 (+1645389us) raft_consensus.cc:1685] finished
0709 13:09:44.895099 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.895274 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14895,"raft.queue_time_us":100,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7408,"spinlock_wait_cycles":10681600,"thread_start_us":147793,"threads_started":1,"wal-append.queue_time_us":256939}
I20260709 13:09:44.890280 24673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:52138
I20260709 13:09:44.803515 28479 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:44.898102 28479 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:44.899159 28479 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.677970 28492 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.904403 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 860) took 2283 ms. Trace:
I20260709 13:09:44.904786 24674 rpcz_store.cc:276] 0709 13:09:42.620526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.620929 (+   403us) service_pool.cc:224] Handling call
0709 13:09:42.621211 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.621507 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:42.621531 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.621912 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.814835 (+192923us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:42.814878 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.814939 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.904203 (+2089264us) raft_consensus.cc:1685] finished
0709 13:09:44.904222 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.904330 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101,"raft.queue_time_us":1986,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":58,"thread_start_us":192555,"threads_started":1,"wal-append.queue_time_us":271223}
I20260709 13:09:44.896745 24524 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:44.909605 28650 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.910095 28650 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.920094 28613 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.887107 28531 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:44.531229 28660 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:44.861400 28662 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.885493 28493 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.902819 28411 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:44.939041 28493 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:44.957171 28661 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.903467 28642 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.960481 28672 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:45.073252 28672 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.075089 28660 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:44.807235 28326 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.077986 28326 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:45.082454 24412 maintenance_manager.cc:419] P 7c40b21f34414599bc4c7e2b5c7f524d: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033393
I20260709 13:09:44.699280 28665 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:45.106021 28675 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
W20260709 13:09:45.114401 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.117897 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.118534 24516 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:45.121011 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.123208 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.123317 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.124094 25212 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:45.082114 28523 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.128548 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:45.128448 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.129177 25213 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.089578 28493 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:45.117304 24519 raft_consensus.cc:2955] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:45.134450 24490 leader_election.cc:400] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:09:45.134771 24490 leader_election.cc:403] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:45.137781 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.138545 24523 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:45.138077 28547 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:43.226500 28114 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:45.141345 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:45.141611 28114 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.146658 24595 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:45.147625 28082 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:45.143894 28114 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:45.149910 24668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 863) took 2372 ms (client timeout 2182 ms). Trace:
W20260709 13:09:45.150292 24668 rpcz_store.cc:269] 0709 13:09:42.777816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.777965 (+   149us) service_pool.cc:224] Handling call
0709 13:09:45.149729 (+2371764us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400405e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:45.149830 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3457872640}
I20260709 13:09:45.144373 28493 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.151648 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.152155 24595 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:45.152247 25219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1296) took 1638 ms (client timeout 1815 ms). Trace:
I20260709 13:09:45.152894 28493 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:45.125900 28661 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:45.152801 25219 rpcz_store.cc:269] 0709 13:09:43.514194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.546812 (+ 32618us) service_pool.cc:224] Handling call
0709 13:09:45.152017 (+1605205us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400570dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:45.152177 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953972992}
I20260709 13:09:45.154757 24516 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.157523 24600 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:45.165505 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.166368 25219 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:45.138350 28523 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.166790 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1301) took 1638 ms. Trace:
I20260709 13:09:45.167143 25219 rpcz_store.cc:276] 0709 13:09:43.528616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.165258 (+1636642us) service_pool.cc:224] Handling call
0709 13:09:45.166735 (+  1477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.168002 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.132961 28660 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:45.168646 25219 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:45.168707 28660 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.161401 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.169250 28660 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.169534 24591 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.170367 28623 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:45.170778 28623 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.172075 28661 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:45.172724 28329 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:45.158409 28547 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:09:45.165625 28611 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:45.174870 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.175105 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:45.174410 24566 leader_election.cc:336] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.506s (SENT)
I20260709 13:09:45.176009 25212 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:45.182204 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:45.182266 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.173003 28661 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.183005 24516 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:45.183944 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1728) took 1517 ms. Trace:
I20260709 13:09:45.184726 28532 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.185307 25212 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:45.186797 24517 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:45.188844 24591 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:45.184331 24598 rpcz_store.cc:276] 0709 13:09:43.666720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.666880 (+   160us) service_pool.cc:224] Handling call
0709 13:09:43.667379 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.667718 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.667756 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.668791 (+  1035us) log.cc:844] Serialized 572 byte log entry
0709 13:09:43.668928 (+   137us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:43.668958 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.669020 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.183726 (+1514706us) raft_consensus.cc:1685] finished
0709 13:09:45.183754 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.183890 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:45.191846 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.189666 24595 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
W20260709 13:09:45.217343 25211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 894) took 2185 ms (client timeout 2684 ms). Trace:
I20260709 13:09:45.217849 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1302) took 1634 ms. Trace:
I20260709 13:09:45.196246 25213 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:45.219146 25212 rpcz_store.cc:276] 0709 13:09:43.583447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.181981 (+1598534us) service_pool.cc:224] Handling call
0709 13:09:45.217790 (+ 35809us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.224097 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.224607 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.225005 24594 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:09:45.225360 24595 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:45.219012 25211 rpcz_store.cc:269] 0709 13:09:43.001378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.001687 (+   309us) service_pool.cc:224] Handling call
0709 13:09:45.186630 (+2184943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.228364 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.228993 25213 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:45.228940 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.230147 25213 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.230726 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1299) took 1703 ms. Trace:
I20260709 13:09:45.231045 25213 rpcz_store.cc:276] 0709 13:09:43.527499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.229724 (+1702225us) service_pool.cc:224] Handling call
0709 13:09:45.229989 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.230509 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.230676 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.232381 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1300) took 1704 ms. Trace:
I20260709 13:09:45.232632 25213 rpcz_store.cc:276] 0709 13:09:43.528075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.231867 (+1703792us) service_pool.cc:224] Handling call
0709 13:09:45.232076 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.232194 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.232208 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.232237 (+    29us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:45.232254 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.232283 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.232345 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.233862 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 899) took 1589 ms. Trace:
I20260709 13:09:45.234107 25213 rpcz_store.cc:276] 0709 13:09:43.644863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.233287 (+1588424us) service_pool.cc:224] Handling call
0709 13:09:45.233478 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.233596 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.233611 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.233636 (+    25us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:45.233685 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.233732 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.233821 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.236042 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.236780 25211 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:45.236783 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.160912 28644 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.228411 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.240430 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1298) took 1725 ms. Trace:
I20260709 13:09:45.240834 25211 rpcz_store.cc:276] 0709 13:09:43.515381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.236238 (+1720857us) service_pool.cc:224] Handling call
0709 13:09:45.236494 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.237558 (+  1064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.240380 (+  2822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.241703 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.190009 28454 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:45.153193 28671 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.242688 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.243954 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.245782 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.227557 28642 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:45.249917 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:45.253036 24566 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.716s (SENT)
I20260709 13:09:45.253495 24600 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:45.250773 24592 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:45.250805 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.250298 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.253495 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:45.254954 24593 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:45.186450 28531 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:45.262679 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.267094 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:45.267350 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.268054 24600 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:45.245257 28534 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:45.238638 28532 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:09:45.278239 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.288244 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.290669 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.291966 24600 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:45.270234 28114 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:45.282989 28493 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:45.329911 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.246641 28454 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.331974 24600 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:45.265030 28642 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.281198 28553 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:09:45.368649 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.297823 28534 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:45.370142 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.372499 24519 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:09:45.377503 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.406001 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:45.417811 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.418295 24516 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.418540 24519 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:45.417392 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.392973 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.333647 28493 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:45.422025 24592 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:45.347136 28114 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:45.423678 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.429065 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.431847 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:45.432344 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.432651 24519 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.434763 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.435454 24593 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:45.436430 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.437068 24593 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:45.442489 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.443116 24593 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.452047 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.452574 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:45.454134 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.455161 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.455672 24592 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.455935 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:45.425560 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 172553us
I20260709 13:09:45.399453 28240 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.425558 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:45.403262 28430 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:45.462116 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.390188 28644 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.395154 28671 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.465797 24591 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:45.422825 28493 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.464329 24519 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:45.471226 24516 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:45.427064 28547 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:45.427452 28642 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.483740 24593 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:45.392504 28660 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.459837 28613 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:45.497915 28679 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:09:45.476068 28494 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:45.501825 28494 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.502274 28494 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:45.503680 28534 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.478021 28686 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.505940 28686 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.510331 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2875) took 2969 ms. Trace:
I20260709 13:09:45.510886 24524 rpcz_store.cc:276] 0709 13:09:42.540680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.542040 (+  1360us) service_pool.cc:224] Handling call
0709 13:09:42.542315 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.908515 (+2366200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.510022 (+601507us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b540018a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:45.510243 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5413950720}
I20260709 13:09:45.517781 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 896) took 2498 ms. Trace:
I20260709 13:09:45.518064 24593 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:45.519492 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.518249 25210 rpcz_store.cc:276] 0709 13:09:43.019918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.132406 (+112488us) service_pool.cc:224] Handling call
0709 13:09:43.132644 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.517496 (+2384852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.517707 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.521536 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.523535 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:45.484920 28547 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:45.535925 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.537180 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:45.537787 25210 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.537973 24671 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:45.475260 28240 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.525866 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.539435 24674 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:45.539593 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:45.540118 24668 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:45.542858 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.524338 28483 raft_consensus.cc:2764] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:45.527465 28611 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:45.557163 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.557924 24674 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:45.521637 24591 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:45.567216 25210 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:45.575232 24674 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:45.559918 28611 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.572451 28483 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:45.528273 28114 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.559044 28531 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.536803 28623 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.577069 28547 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.588397 28547 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.578122 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.598122 24673 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:45.598654 24673 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.584353 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.607678 25210 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:45.554019 28370 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:09:45.580713 28611 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.583467 28546 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.578574 28411 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:45.615590 24674 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:45.584544 28237 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.579563 28454 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.613969 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:45.622682 24592 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:45.580859 28483 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:45.586968 28623 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:45.639236 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.642527 28571 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:45.642984 28571 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:45.643864 28571 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.628264 28546 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:45.646763 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.648566 28546 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.649168 24669 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:45.650334 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 878) took 1115 ms. Trace:
I20260709 13:09:45.650645 24669 rpcz_store.cc:276] 0709 13:09:44.534580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.534817 (+   237us) service_pool.cc:224] Handling call
0709 13:09:45.650103 (+1115286us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54002ebb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:45.650269 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783087488}
I20260709 13:09:45.651592 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.651721 28586 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.654208 28240 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:45.614734 28662 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.655565 28686 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.656080 28483 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.655831 28662 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.644917 28571 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.644766 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 842) took 1138 ms. Trace:
I20260709 13:09:45.661399 24517 rpcz_store.cc:276] 0709 13:09:44.506620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.514514 (+  7894us) service_pool.cc:224] Handling call
0709 13:09:45.644522 (+1130008us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b5400113d54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:45.644686 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522018304}
I20260709 13:09:45.662415 24674 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:09:45.665645 24566 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.050s (SENT)
W20260709 13:09:45.627436 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 201914us
I20260709 13:09:45.601585 28650 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:45.630767 25210 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:45.631362 28237 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.675411 28493 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.675874 28237 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:45.612823 28660 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.678689 24671 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:45.680262 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:45.666373 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:43.260257 28477 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.671490 28494 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.685288 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:45.685387 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.678854 24673 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.695358 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.699537 24668 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:43.288565 28487 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:45.702711 28662 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:45.703176 24669 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:45.703509 24669 pending_rounds.cc:85] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 9
I20260709 13:09:45.703706 24669 pending_rounds.cc:107] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:45.703931 24669 raft_consensus.cc:2889] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:45.704790 28494 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:45.704869 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.706030 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.706542 24669 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:45.708880 28531 raft_consensus.cc:2764] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:45.702135 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.709833 24674 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:45.709883 27387 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.710851 24520 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:45.707263 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:45.710887 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45292us
I20260709 13:09:45.711926 24669 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:45.712865 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:45.713445 24674 raft_consensus.cc:2376] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7. Re-sending same reply.
I20260709 13:09:45.713178 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.714363 24667 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:45.714762 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.715516 24669 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:45.715859 24566 leader_election.cc:336] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.711s (SENT)
I20260709 13:09:45.701960 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:45.717222 24668 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.718235 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.719558 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.720417 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.701638 28370 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.726037 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.727972 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.701150 28686 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:45.728614 24667 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:45.723361 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:45.727319 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.727195 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:45.727434 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:45.730023 24524 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.730597 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.731122 24595 raft_consensus.cc:2376] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9. Re-sending same reply.
I20260709 13:09:45.731612 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.731940 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.731678 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.732335 24523 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:45.732831 24592 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:45.732292 24598 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:45.730175 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.734041 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.734536 24598 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:45.735302 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.735724 24668 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:45.736313 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.736511 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:45.736968 24668 raft_consensus.cc:2376] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11. Re-sending same reply.
I20260709 13:09:45.737062 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.737340 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.737751 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.738119 28644 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.738540 28644 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.738758 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.739693 24668 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:45.740305 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.740965 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.740489 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:45.713203 28696 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:45.718103 28477 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:45.728425 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.741341 28494 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:45.739418 28454 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:45.738922 28644 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.744889 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.798305 24667 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:45.747159 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.799525 24598 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:09:45.800158 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.801153 24595 raft_consensus.cc:2368] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:45.802095 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:45.802479 28454 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:45.803521 28454 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:45.770464 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.722445 28493 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:45.773116 24523 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.748560 24524 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:45.739571 28697 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:45.808004 28697 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:45.798063 28240 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.809886 28240 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.809175 28697 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:45.810232 28240 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.742660 24591 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:45.742408 28688 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:09:45.795742 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 67377.4us
I20260709 13:09:45.815429 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:45.816318 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.817760 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.821159 28586 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.822299 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.822587 24670 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.822908 24667 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:45.823830 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.824362 24667 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:45.824987 28586 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.827098 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.804854 24595 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:45.821755 28613 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:45.774576 24566 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.218s (SENT)
I20260709 13:09:45.827138 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.846357 24667 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:45.747994 28611 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.813751 24639 leader_election.cc:400] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:45.847208 24639 leader_election.cc:403] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:45.800356 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:45.847837 24598 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.796286 28494 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:45.851997 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.846190 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:45.856608 24598 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
W20260709 13:09:45.857431 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43763.4us
I20260709 13:09:45.859563 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.861042 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.867727 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.817883 28411 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:45.870311 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:45.872746 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.874567 24668 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:45.875373 24667 raft_consensus.cc:2368] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12.
W20260709 13:09:45.925848 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 151313us
I20260709 13:09:45.927922 28611 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:45.853286 28494 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:45.929822 28698 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:45.930267 28367 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.931403 28367 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:45.932925 25214 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:09:45.933677 28367 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:45.936075 28367 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:45.937170 28659 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.937702 28659 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.939248 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.939971 24671 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10.
I20260709 13:09:45.940706 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:45.934052 28487 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:45.941534 28487 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:45.942381 28487 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.944128 28494 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:45.945724 24671 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.913972 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.811367 28477 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:45.947932 24669 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:45.851507 28329 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:45.949187 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:45.874765 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47747.3us
I20260709 13:09:45.956950 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:45.875861 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.940831 28659 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:45.958180 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.950769 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.961913 24669 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:45.967701 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.875063 28685 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:45.968845 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:45.970866 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.977700 24668 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:45.971745 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.979375 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:45.979911 24671 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:45.871517 28701 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.864848 28686 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:09:45.987351 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:45.990173 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.993600 24668 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:45.994508 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.995321 24668 raft_consensus.cc:2410] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:09:45.990804 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.997119 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.998258 24668 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:45.972589 28696 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:45.999635 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:45.987731 28659 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:45.972388 28623 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:45.998610 24671 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:45.971026 28329 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:45.960557 28611 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:09:45.993242 28688 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:45.995147 28411 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:45.995872 28685 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:46.011698 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:46.001895 28709 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:46.052229 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 72929.5us
I20260709 13:09:46.007896 24668 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 4.
I20260709 13:09:46.058166 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:46.059377 24595 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:09:46.008751 28427 raft_consensus.cc:2764] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:46.016618 28411 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.046331 28565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51490 (request call id 26) took 5326 ms. Trace:
I20260709 13:09:46.062894 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.067831 24671 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:46.015281 28696 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:46.068312 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.013999 28688 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:46.070134 24668 raft_consensus.cc:2410] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:46.005889 28613 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:46.054400 28623 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:46.071749 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.075098 24671 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:46.067116 28411 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:46.076606 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.076491 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:46.078709 24668 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.078694 24671 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:46.081369 28477 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:43.218489 28442 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:46.076690 28494 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:46.076273 28709 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:46.074277 28329 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.066780 28565 rpcz_store.cc:276] 0709 13:09:40.689780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.689908 (+   128us) service_pool.cc:224] Handling call
0709 13:09:40.824546 (+134638us) log.cc:844] Serialized 513 byte log entry
0709 13:09:46.016239 (+5191693us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20652,"raft.queue_time_us":99698,"raft.run_cpu_time_us":1585,"raft.run_wall_time_us":2053,"thread_start_us":116480,"threads_started":1,"wal-append.queue_time_us":165630,"wal-append.run_cpu_time_us":1741,"wal-append.run_wall_time_us":1003166}
W20260709 13:09:46.093290 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.083776 28442 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.095834 28442 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:46.087019 28709 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.070084 28483 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.092414 28240 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.105566 24600 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:46.107429 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:46.073644 28688 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.108716 28665 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:46.109481 28483 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:46.109520 28713 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:09:46.113016 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:46.117336 28706 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.002s
I20260709 13:09:46.089653 28613 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.124148 28411 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.132788 24668 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:46.193639 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.194103 24668 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
W20260709 13:09:46.106650 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.194936 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.195537 24668 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:46.195963 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:46.196651 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:46.192024 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 79094.2us
I20260709 13:09:46.200261 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.201320 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:46.202138 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.203480 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.204021 24668 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:46.204783 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.205591 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:46.205965 24668 raft_consensus.cc:2376] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10. Re-sending same reply.
I20260709 13:09:46.206511 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.207195 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.207572 24668 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:46.208098 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.192981 28367 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:46.211311 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:46.212939 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.118155 28644 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.214426 24668 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:46.195171 28709 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:46.216914 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:46.219208 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 231966us
I20260709 13:09:46.219555 24668 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:46.220129 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:46.200608 28326 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:46.222654 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:46.225379 28659 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:46.225793 28659 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.226123 28659 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.226902 28688 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:46.236320 24521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 831) took 1736 ms (client timeout 1975 ms). Trace:
I20260709 13:09:46.223043 28326 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.125363 28685 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:46.198535 28696 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.194617 28623 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.213861 28367 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:46.236752 24521 rpcz_store.cc:269] 0709 13:09:44.500241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.500358 (+   117us) service_pool.cc:224] Handling call
0709 13:09:46.236168 (+1735810us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54002788d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:46.236265 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782819840}
I20260709 13:09:46.394946 28611 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:46.846873 28611 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.847599 28597 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:46.607870 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.271670 28701 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:46.845197 28326 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:46.263236 28644 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:46.240619 28565 raft_consensus.cc:2764] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:09:46.570039 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 358764us
I20260709 13:09:46.223238 28709 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:46.341717 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.734393 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.853747 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 2995) took 1034 ms. Trace:
I20260709 13:09:46.737421 28687 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:46.725148 28411 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:46.728718 28367 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:46.571249 28713 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
W20260709 13:09:46.284657 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.229430 28454 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:46.729348 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 499640us
W20260709 13:09:46.773211 24621 debug-util.cc:398] Leaking SignalData structure 0x7b080038c840 after lost signal to thread 24457
I20260709 13:09:46.722131 28688 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:46.770541 28370 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:46.480760 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 285685us
W20260709 13:09:46.237689 24672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 858) took 3617 ms (client timeout 1960 ms). Trace:
W20260709 13:09:46.729137 24524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.036s
W20260709 13:09:46.864849 24524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.000s	sys 0.037s
I20260709 13:09:46.849108 24669 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:46.849478 28611 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:46.475656 28711 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.854113 24668 rpcz_store.cc:276] 0709 13:09:45.819550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.224061 (+404511us) service_pool.cc:224] Handling call
0709 13:09:46.853671 (+629610us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.864751 24672 rpcz_store.cc:269] 0709 13:09:42.619953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.622816 (+  2863us) service_pool.cc:224] Handling call
0709 13:09:46.237456 (+3614640us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000474d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:46.237571 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3510128896}
I20260709 13:09:46.867690 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.852397 28709 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.855768 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:46.856456 24596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1717) took 3340 ms (client timeout 1669 ms). Trace:
I20260709 13:09:46.868163 24668 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
W20260709 13:09:46.868669 24596 rpcz_store.cc:269] 0709 13:09:43.516508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.516976 (+   468us) service_pool.cc:224] Handling call
0709 13:09:46.856222 (+3339246us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540002e4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:46.856374 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981847296}
I20260709 13:09:46.869606 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.869992 24668 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:46.862156 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:46.862962 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800233920 after lost signal to thread 24471
I20260709 13:09:46.854780 28687 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:46.871163 24666 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:46.872206 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800391220 after lost signal to thread 24549
W20260709 13:09:46.873186 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0f20 after lost signal to thread 24624
W20260709 13:09:46.873423 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800377ac0 after lost signal to thread 24625
I20260709 13:09:46.874687 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.875322 24668 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:46.877736 28687 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.877979 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:46.878911 24672 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.211328 28345 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:46.879005 28687 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.861802 28454 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:46.882589 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:46.881408 28696 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:46.884109 24666 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:46.884640 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2988) took 1075 ms. Trace:
I20260709 13:09:46.889258 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 2968) took 1186 ms. Trace:
I20260709 13:09:46.889051 24668 rpcz_store.cc:276] 0709 13:09:45.809650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.884045 (+1074395us) service_pool.cc:224] Handling call
0709 13:09:46.884307 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.884444 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.884458 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.884485 (+    27us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:46.884505 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.884536 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.884602 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.888175 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:46.890542 24596 raft_consensus.cc:2368] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9.
I20260709 13:09:46.891114 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:46.891646 24596 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:09:46.883603 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:46.889758 24666 rpcz_store.cc:276] 0709 13:09:45.703277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.883531 (+1180254us) service_pool.cc:224] Handling call
0709 13:09:46.883812 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.888996 (+  5184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.889208 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.868788 28370 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.894002 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:46.895236 24668 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:46.895865 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1638) took 1049 ms. Trace:
I20260709 13:09:46.896126 24668 rpcz_store.cc:276] 0709 13:09:45.846617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.894618 (+1048001us) service_pool.cc:224] Handling call
0709 13:09:46.894995 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.895605 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.895804 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.897264 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.897862 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:46.898744 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:46.899224 24668 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:46.900054 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:46.900573 24668 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:46.901355 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.902556 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:46.904847 24666 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:46.907416 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1640) took 1060 ms. Trace:
I20260709 13:09:46.907665 24666 rpcz_store.cc:276] 0709 13:09:45.847077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.902049 (+1054972us) service_pool.cc:224] Handling call
0709 13:09:46.902341 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.907198 (+  4857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.907369 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.908617 24666 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:46.909161 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1643) took 1061 ms. Trace:
I20260709 13:09:46.909391 24666 rpcz_store.cc:276] 0709 13:09:45.847833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.908168 (+1060335us) service_pool.cc:224] Handling call
0709 13:09:46.908397 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.908935 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.909066 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.887198 28454 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.911823 24672 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:46.914076 24666 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:46.890264 28696 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:46.919198 24668 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:46.920469 24672 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:46.925789 28370 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:46.929445 25216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1304) took 3344 ms (client timeout 1643 ms). Trace:
I20260709 13:09:46.929586 25213 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:46.929939 25216 rpcz_store.cc:269] 0709 13:09:43.585112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.626913 (+ 41801us) service_pool.cc:224] Handling call
0709 13:09:46.929186 (+3302273us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b54003372d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:46.929357 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121699712}
I20260709 13:09:46.932065 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 909) took 1787 ms. Trace:
I20260709 13:09:46.904846 28541 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.935232 27387 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:46.932457 25213 rpcz_store.cc:276] 0709 13:09:45.145016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.238625 (+ 93609us) service_pool.cc:224] Handling call
0709 13:09:46.929394 (+1690769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.930122 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.931851 (+  1729us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003372d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:46.931999 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3887745920}
I20260709 13:09:46.871599 28711 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:46.917052 28659 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.000s
I20260709 13:09:46.936403 28696 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.949590 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.951313 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.951933 27387 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:46.952045 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.952767 24523 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:46.953400 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.954301 24524 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:46.954409 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.955041 24519 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:46.955322 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.956615 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.956700 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.957238 24520 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:46.957852 24517 raft_consensus.cc:2410] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:09:46.958269 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.959100 24521 raft_consensus.cc:2368] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9.
I20260709 13:09:46.933568 28541 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.960117 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.960807 24517 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 4.
I20260709 13:09:46.961514 28541 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:46.948179 28345 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:46.961903 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.962757 24521 raft_consensus.cc:2368] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:46.962420 28345 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.952633 27387 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:46.964982 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 109312us
I20260709 13:09:46.969866 24521 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:46.971280 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.973654 27387 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:46.948362 28659 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:46.976022 28523 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:46.976581 28659 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:46.978785 28546 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:46.979568 28546 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:46.983480 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:46.984270 24519 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.988665 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:46.978870 28711 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:46.994226 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:46.993755 28623 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.996723 24517 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:46.999241 24519 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:46.995958 28623 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.008018 28531 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:47.008852 28531 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.003338 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.011042 24521 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:47.020290 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.021744 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.022717 24524 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.024055 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 823) took 1648 ms. Trace:
I20260709 13:09:47.024451 24593 rpcz_store.cc:276] 0709 13:09:45.375762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.496113 (+120351us) service_pool.cc:224] Handling call
0709 13:09:45.496409 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.518540 (+ 22131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.023792 (+1505252us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b54001928d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:47.023995 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49375104}
I20260709 13:09:47.021978 24519 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:47.025542 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.026532 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.027078 25218 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:47.027208 24517 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.026909 28531 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:47.029278 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800040840 after lost signal to thread 24698
W20260709 13:09:47.030663 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003e4740 after lost signal to thread 24699
I20260709 13:09:47.030336 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.030045 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.031275 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.031538 24520 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:47.031818 24519 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:47.032368 24665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.802s	user 0.016s	sys 0.020s
W20260709 13:09:47.037837 25218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 895) took 4029 ms (client timeout 1620 ms). Trace:
W20260709 13:09:47.037848 24665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.807s	user 0.017s	sys 0.020s
I20260709 13:09:47.038921 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.039920 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.052196 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 831) took 1302 ms. Trace:
I20260709 13:09:47.041005 24491 leader_election.cc:400] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10.
I20260709 13:09:47.053464 24491 leader_election.cc:403] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:47.053216 24591 rpcz_store.cc:276] 0709 13:09:45.730834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.731496 (+   662us) service_pool.cc:224] Handling call
0709 13:09:47.033447 (+1301951us) spinlock_profiling.cc:243] Waited 9.79 ms on lock 0x7b54001ed7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.033536 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22518528}
I20260709 13:09:47.053882 24524 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:47.031818 24521 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:47.054059 24520 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.055146 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:47.038344 25218 rpcz_store.cc:269] 0709 13:09:43.008441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.094569 (+ 86128us) service_pool.cc:224] Handling call
0709 13:09:47.037758 (+3943189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:47.057358 27387 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:47.057782 27387 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:47.058144 27387 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.061437 24519 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:47.063045 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 812) took 1811 ms. Trace:
I20260709 13:09:47.056509 28523 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.063357 24599 rpcz_store.cc:276] 0709 13:09:45.251346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.262169 (+ 10823us) service_pool.cc:224] Handling call
0709 13:09:45.262446 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.262639 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:45.423624 (+160985us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.029689 (+1606065us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b18003d01e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf 00007f17bbf60038
0709 13:09:47.032572 (+  2883us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.062734 (+ 30162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.062786 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:47.062818 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.062886 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.062991 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22175,"prepare.queue_time_us":1657111,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2971,"raft.queue_time_us":22712,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":24693,"spinlock_wait_cycles":5791104,"thread_start_us":365398,"threads_started":3,"wal-append.queue_time_us":208110,"wal-append.run_cpu_time_us":1018,"wal-append.run_wall_time_us":1007233}
I20260709 13:09:47.067247 24599 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:47.068408 24599 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:47.071676 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.072410 24519 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:47.074827 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:47.075907 24668 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:47.076695 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.078394 24523 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:47.038160 28345 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.080499 24591 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:47.083289 24523 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:47.083993 24519 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:47.070078 28430 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:47.111356 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.112275 24523 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.075215 28672 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.161970 28672 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.079164 28541 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:47.162429 28367 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.164646 24596 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:47.052129 28326 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.163065 28541 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:47.027604 28546 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.173359 27387 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:43.227221 28412 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:47.176863 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.177518 24521 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:47.177254 28412 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.179435 28412 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.181850 28623 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:47.183877 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.184737 24591 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:47.193650 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.194473 28546 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.195266 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.195961 24521 raft_consensus.cc:2376] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9. Re-sending same reply.
I20260709 13:09:47.202039 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1647) took 1352 ms. Trace:
I20260709 13:09:47.202798 24669 rpcz_store.cc:276] 0709 13:09:45.849126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.967393 (+118267us) service_pool.cc:224] Handling call
0709 13:09:47.201805 (+1234412us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54002ec054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.201958 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025336704}
I20260709 13:09:47.204345 24666 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:09:47.205538 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.206326 28143 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.206539 28326 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:47.206831 28143 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.207216 28326 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.207679 28326 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.210047 28367 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.170956 28541 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.208853 28143 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.166006 28531 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:47.214123 25212 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:47.214668 28616 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.215113 28616 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.216301 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.217439 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.217625 28672 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.218025 24668 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:47.218838 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.219333 24668 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:47.220067 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.221046 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.226783 24668 raft_consensus.cc:2410] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:09:47.221925 24669 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:47.196959 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.229602 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.230757 24523 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:47.220665 28696 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.233662 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.234917 24669 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:47.236034 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.237334 24669 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:47.223289 27387 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.225355 24520 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:47.240594 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.240732 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.241333 24520 raft_consensus.cc:2376] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9. Re-sending same reply.
I20260709 13:09:47.243546 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 834) took 1187 ms. Trace:
I20260709 13:09:47.243499 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.244017 24598 rpcz_store.cc:276] 0709 13:09:46.055809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.056990 (+  1181us) service_pool.cc:224] Handling call
0709 13:09:46.062820 (+  5830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.063215 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:47.068825 (+1005610us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.243209 (+174384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.243272 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:47.243323 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.243394 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.243494 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":991595,"prepare.queue_time_us":1005953,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"thread_start_us":174068,"threads_started":1}
I20260709 13:09:47.245380 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.246754 24517 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:47.247803 24521 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:09:47.222635 28454 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.249616 28479 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.251677 28454 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.252213 24525 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:47.253296 24525 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 11. Ops: []
I20260709 13:09:47.243522 28688 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:47.254262 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.254899 24517 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.254338 28696 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.256856 24593 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:47.257705 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800335000 after lost signal to thread 25243
I20260709 13:09:47.259073 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:47.263451 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:47.269958 25214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 889) took 4444 ms (client timeout 3323 ms). Trace:
W20260709 13:09:47.270432 25214 rpcz_store.cc:269] 0709 13:09:42.819106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.819605 (+   499us) service_pool.cc:224] Handling call
0709 13:09:47.262848 (+4443243us) spinlock_profiling.cc:243] Waited 3.11 s on lock 0x7b5400084b54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.262943 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7158022016}
I20260709 13:09:47.272760 24517 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:47.273553 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.275543 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:47.276207 24523 raft_consensus.cc:2368] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9.
I20260709 13:09:47.277940 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.262151 28688 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.270222 28143 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:47.269656 28709 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:47.278863 24520 raft_consensus.cc:2410] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:47.287904 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.288810 24517 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.269738 28211 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:09:47.279582 28711 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:47.295822 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.286595 28709 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.296566 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.284706 28523 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10.
I20260709 13:09:47.299736 24669 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.287914 28326 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.301327 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.291448 28143 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:47.303944 24674 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:47.284845 28688 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.306830 24521 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 10. Ops: []
I20260709 13:09:47.308054 24517 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:09:47.310914 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 887) took 3962 ms. Trace:
I20260709 13:09:47.311474 25217 rpcz_store.cc:276] 0709 13:09:43.348312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.193361 (+3845049us) service_pool.cc:224] Handling call
0709 13:09:47.193736 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.194107 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.194138 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.194594 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.274925 (+ 80331us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:47.274962 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.275166 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.310712 (+ 35546us) raft_consensus.cc:1685] finished
0709 13:09:47.310733 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.310858 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5119,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":16883,"thread_start_us":79979,"threads_started":1,"wal-append.queue_time_us":112035}
I20260709 13:09:47.314383 24673 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.314919 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52138 (request call id 883) took 2630 ms. Trace:
I20260709 13:09:47.315255 24673 rpcz_store.cc:276] 0709 13:09:44.685307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.887342 (+202035us) service_pool.cc:224] Handling call
0709 13:09:47.313229 (+2425887us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54002b4b54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf3da3d 00007f17c0f0dcd0 00007f17ba492254 00007f17ba4921e2 00007f17ba492111 00007f17ba49208c 00007f17ba491342 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.314836 (+  1607us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608146816}
I20260709 13:09:47.316345 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.321194 25211 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:47.321869 28597 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.322121 28430 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:47.322652 28430 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.322315 28597 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:47.327644 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.328585 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.329023 24490 connection.cc:256] RPC call timeout handler was delayed by -1.51705887300011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33230000000000004s for a response
W20260709 13:09:47.330330 25185 connection.cc:256] RPC call timeout handler was delayed by -2.5609214600000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 13:09:47.316900 24673 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.332388 24669 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:47.301332 28711 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:47.333210 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.301474 28709 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.334136 24669 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.335426 28711 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.338685 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:47.338932 25185 connection.cc:256] RPC call timeout handler was delayed by -1.4819619989999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:09:47.339023 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:47.339890 27387 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:47.340379 27387 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:47.341598 28211 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.341704 27387 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.342171 28211 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.342481 28672 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:47.344460 28688 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.347373 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 821) took 3770 ms. Trace:
I20260709 13:09:47.347886 24522 rpcz_store.cc:276] 0709 13:09:43.577463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.577576 (+   113us) service_pool.cc:224] Handling call
0709 13:09:43.577901 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.178304 (+3600403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.178337 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.178375 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:47.178407 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.347081 (+168674us) spinlock_profiling.cc:243] Waited 3.6 s on lock 0x7b540018a954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:47.347141 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.347300 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8279730560}
I20260709 13:09:47.348989 28477 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:47.349669 28477 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.350107 28477 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:47.363168 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.381417 28143 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:47.383335 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.384182 28589 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:47.384647 28589 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:47.382082 28741 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
I20260709 13:09:47.385183 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1495) took 1651 ms. Trace:
I20260709 13:09:47.385711 24592 rpcz_store.cc:276] 0709 13:09:45.733985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.740091 (+  6106us) service_pool.cc:224] Handling call
0709 13:09:47.384947 (+1644856us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540033ed54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.385120 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889423232}
W20260709 13:09:47.339551 25185 connection.cc:256] RPC call timeout handler was delayed by -1.3955619990000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:09:47.393515 25185 connection.cc:256] RPC call timeout handler was delayed by -1.2839619989999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 13:09:47.394004 25185 connection.cc:256] RPC call timeout handler was delayed by -1.2362619990000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 13:09:47.394428 25185 connection.cc:256] RPC call timeout handler was delayed by -1.1147619990000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:09:47.395561 25185 connection.cc:256] RPC call timeout handler was delayed by -1.0733619989999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260709 13:09:47.397675 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.398522 25217 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:47.399724 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.401731 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:47.402817 25215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1294) took 3921 ms (client timeout 1751 ms). Trace:
W20260709 13:09:47.403219 25215 rpcz_store.cc:269] 0709 13:09:43.481426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.481553 (+   127us) service_pool.cc:224] Handling call
0709 13:09:47.402653 (+3921100us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b5400532354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.402741 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956469120}
I20260709 13:09:47.415129 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 875) took 2919 ms. Trace:
I20260709 13:09:47.415560 24670 rpcz_store.cc:276] 0709 13:09:44.496065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.496180 (+   115us) service_pool.cc:224] Handling call
0709 13:09:44.528422 (+ 32242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.823158 (+1294736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.414887 (+1591729us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002b5554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:47.415066 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2975794432}
W20260709 13:09:47.418684 28728 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.541s	user 0.006s	sys 0.029s
I20260709 13:09:47.420729 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:47.421828 25182 leader_election.cc:400] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9.
I20260709 13:09:47.422092 25182 leader_election.cc:403] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:47.424244 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1669) took 1199 ms. Trace:
I20260709 13:09:47.424716 24666 rpcz_store.cc:276] 0709 13:09:46.225017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.920626 (+695609us) service_pool.cc:224] Handling call
0709 13:09:47.203909 (+283283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.204859 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.423994 (+219135us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54002ec050. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.424172 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650870656}
I20260709 13:09:47.406358 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:47.427263 24592 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:47.407102 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:47.407895 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.408576 28412 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:47.429984 24594 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:47.430335 28412 consensus_queue.cc:1243] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:09:47.412868 25211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 911) took 2172 ms (client timeout 2008 ms). Trace:
I20260709 13:09:47.430871 28412 raft_consensus.cc:2764] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:09:47.430958 25211 rpcz_store.cc:269] 0709 13:09:45.241252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.241529 (+   277us) service_pool.cc:224] Handling call
0709 13:09:47.412696 (+2171167us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b5400602054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.412800 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4781023104}
I20260709 13:09:47.431551 28412 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:47.431777 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1506) took 1361 ms. Trace:
I20260709 13:09:47.431921 28412 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:47.432408 24596 rpcz_store.cc:276] 0709 13:09:46.070065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.902287 (+832222us) service_pool.cc:224] Handling call
0709 13:09:47.431601 (+529314us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54001caa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.431712 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591762304}
I20260709 13:09:47.433125 28412 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.434273 28412 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:47.438203 24565 connection.cc:256] RPC call timeout handler was delayed by -1.332836215000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:09:47.438606 24565 connection.cc:256] RPC call timeout handler was delayed by -1.3156245599999465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:09:47.439304 24565 connection.cc:256] RPC call timeout handler was delayed by -1.2410763330000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:09:47.440035 24491 leader_election.cc:336] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.925s (SENT)
I20260709 13:09:47.440523 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:47.440673 25212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 906) took 2576 ms (client timeout 2546 ms). Trace:
W20260709 13:09:47.445720 24491 leader_election.cc:336] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.973s (SENT)
I20260709 13:09:47.445796 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.446305 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:47.441012 25212 rpcz_store.cc:269] 0709 13:09:44.863972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.227830 (+363858us) service_pool.cc:224] Handling call
0709 13:09:47.440514 (+2212684us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540004c4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.440612 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4547825408}
I20260709 13:09:47.446951 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.448262 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.449050 24596 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:09:47.451207 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.452725 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 223187us
I20260709 13:09:47.447983 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:47.456926 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:47.460450 24491 leader_election.cc:336] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.973s (SENT)
I20260709 13:09:47.462168 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.462440 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.463670 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.463681 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.465413 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.466033 25213 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:47.466254 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:47.466781 25215 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:47.468060 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.464725 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.467221 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.470408 25210 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:47.470811 25214 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:47.470443 25218 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:47.471302 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:47.471536 24523 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:47.472728 24667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1642) took 1625 ms (client timeout 1620 ms). Trace:
W20260709 13:09:47.473179 24667 rpcz_store.cc:269] 0709 13:09:45.847577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.860766 (+ 13189us) service_pool.cc:224] Handling call
0709 13:09:47.472512 (+1611746us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b540017eb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.472649 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31054720}
I20260709 13:09:47.474588 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:47.475855 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 836) took 1419 ms. Trace:
I20260709 13:09:47.476313 24593 rpcz_store.cc:276] 0709 13:09:46.056613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.026451 (+969838us) service_pool.cc:224] Handling call
0709 13:09:47.027920 (+  1469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.257364 (+229444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.475587 (+218223us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540002dfd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:47.475786 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525985024}
I20260709 13:09:47.477006 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:47.487946 24600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 817) took 2120 ms (client timeout 1786 ms). Trace:
I20260709 13:09:47.488255 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:47.488363 24600 rpcz_store.cc:269] 0709 13:09:45.367989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.368319 (+   330us) service_pool.cc:224] Handling call
0709 13:09:47.487789 (+2119470us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b540033de54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:47.487887 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692891520}
I20260709 13:09:47.495409 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:47.496140 24600 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.496428 24669 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:47.499935 24673 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:47.502333 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.503752 24666 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 10. Ops: []
I20260709 13:09:47.390756 28659 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.504714 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.518831 24521 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:47.505645 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:47.519372 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.520197 24674 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.505733 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.522333 25212 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:47.506760 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.506946 24592 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:47.507035 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.523491 24596 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:09:47.523660 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.487362 28442 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.487571 28539 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:47.458437 28698 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:47.509755 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.510321 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:47.544322 24594 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.511207 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.511413 24522 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:47.512416 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.513593 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.515501 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.547243 24667 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:47.542305 27387 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:09:47.548408 25215 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:47.548882 25215 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:47.516729 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.517148 28696 raft_consensus.cc:2764] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:47.471422 28733 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:47.522593 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:47.524598 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 50104.6us
I20260709 13:09:47.525271 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.549839 25215 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.535058 24519 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:47.536862 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.537328 25211 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:47.459483 28479 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.452244 28672 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:47.458377 28329 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:47.536376 28552 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:47.469907 28531 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:47.487272 28082 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.610351 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.611111 24670 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:47.553202 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.594756 25218 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.590708 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:47.612857 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59784.7us
I20260709 13:09:47.612988 24595 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:47.595604 24673 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:47.537451 28523 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:09:47.596216 24666 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:47.595604 25215 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.537338 28367 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:47.541146 24592 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:47.602737 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.581974 24674 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:47.645321 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.646771 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.647643 24674 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:47.648290 24668 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.649967 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.651525 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.620870 28082 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.655515 28082 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.658200 28240 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.661659 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.664024 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.666033 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.667369 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:47.623242 28685 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:09:47.678112 24670 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:09:47.679456 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.680274 24669 raft_consensus.cc:2376] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9. Re-sending same reply.
I20260709 13:09:47.682613 24669 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:09:47.605866 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 256359us
I20260709 13:09:47.683733 24674 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:47.684448 24669 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:47.613637 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1634) took 5516 ms. Trace:
I20260709 13:09:47.688110 24669 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:47.705603 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.707401 24668 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:47.620361 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.614676 28483 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:47.560956 28698 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.626870 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:47.713001 25218 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:47.604790 28237 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:47.603804 28326 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:47.629649 28616 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.526425 28589 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.715895 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.716213 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.716531 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.620944 28531 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.630992 28477 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.632205 28541 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.621924 28597 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:47.639236 28430 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.542261 28442 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.538690 28659 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.526674 28211 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.676729 28564 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:47.715298 28237 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.719844 28329 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:47.818905 28758 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.781495 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 206724us
I20260709 13:09:47.820161 28758 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:47.822829 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.822516 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:47.782779 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 262737us
I20260709 13:09:47.787102 24516 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:47.625852 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.825736 24591 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:47.826249 28454 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:47.827050 28454 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:47.827569 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:47.617019 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:09:47.830571 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 213532us
I20260709 13:09:47.830708 28523 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:47.831780 28082 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:47.831936 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:47.832435 28082 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:47.605762 24593 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:47.832955 28082 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.834769 28685 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:47.835227 28685 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:47.835623 28685 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.719431 28326 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:47.794677 24592 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:47.636559 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:47.796572 24521 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:47.617653 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.607038 24600 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:47.613683 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.839807 24595 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:47.625103 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.714563 24672 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:47.712112 24674 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:09:47.843066 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 229313us
W20260709 13:09:47.717938 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 270002us
W20260709 13:09:47.714046 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 198867us
I20260709 13:09:47.809391 28430 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.708876 25215 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:47.715348 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:47.714205 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.718068 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:47.721572 28589 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.848584 25219 raft_consensus.cc:2368] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11.
I20260709 13:09:47.849735 24594 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:09:47.735536 28659 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:47.733115 28698 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.732999 28709 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:47.810650 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 124316us
I20260709 13:09:47.854955 24639 leader_election.cc:400] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9.
I20260709 13:09:47.855306 24639 leader_election.cc:403] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:09:47.814574 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.856223 28709 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:47.689173 24669 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.856841 28483 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9.
I20260709 13:09:47.857930 24669 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.817245 24520 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:47.686563 24665 rpcz_store.cc:276] 0709 13:09:42.087308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.087738 (+   430us) service_pool.cc:224] Handling call
0709 13:09:42.088099 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.088509 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.088548 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.089555 (+  1007us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.230363 (+1140808us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b1800239560. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:09:47.052711 (+3822348us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:47.439672 (+386961us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b1800239560. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf
0709 13:09:47.439814 (+   142us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.603120 (+163306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.603223 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.603414 (+   191us) raft_consensus.cc:1685] finished
0709 13:09:47.603433 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.603577 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4600,"prepare.queue_time_us":38886,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":68378,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":19606,"spinlock_wait_cycles":107425792,"thread_start_us":3985460,"threads_started":3,"wal-append.queue_time_us":1427717,"wal-append.run_cpu_time_us":1986,"wal-append.run_wall_time_us":1005412}
I20260709 13:09:47.861917 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.837654 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:47.865027 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 144749us
I20260709 13:09:47.865406 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:47.867237 28367 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:47.867913 28367 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:47.869648 28367 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.867684 24595 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 14: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:47.875326 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.884173 28658 raft_consensus.cc:2764] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:47.885193 24598 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:47.886961 25210 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:47.889238 28603 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.890094 28603 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:47.893535 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48173.3us
W20260709 13:09:47.897354 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51085.5us
I20260709 13:09:47.897511 28698 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:47.898012 28688 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:47.898396 25185 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.824520 28758 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.830300 28672 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:47.837606 28326 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.839586 28442 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:47.662356 24671 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.841640 28477 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:47.846244 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:47.900516 28659 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:47.903314 28760 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:47.875159 28541 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:47.892944 28603 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:47.910799 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.949183 24518 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:47.950292 28660 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.950995 28660 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.925315 28477 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:47.952729 28477 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:47.953941 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.958350 28659 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:47.958976 28659 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:47.962312 28762 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:09:47.969307 28688 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.970068 28688 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.972302 28688 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:47.917614 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 51402.9us
I20260709 13:09:47.828558 28454 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.918684 28685 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.927711 28442 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.930521 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.937252 28760 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:47.981616 28760 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.982596 28761 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:47.985965 28685 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:47.922063 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 68267.2us
I20260709 13:09:47.978643 24671 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
W20260709 13:09:47.992966 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 146963us
I20260709 13:09:47.820580 28329 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.995898 28603 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:47.988644 28442 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:47.996587 28603 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.996963 28603 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.995972 28759 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:47.960528 28659 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:47.999058 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:48.000187 28759 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:48.001187 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:48.001566 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 133547us
I20260709 13:09:48.001981 28709 raft_consensus.cc:2764] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:09:48.002916 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.008006 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 77653.1us
I20260709 13:09:48.004154 28237 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:48.009269 28761 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:48.024536 24518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 2891) took 2885 ms (client timeout 3253 ms). Trace:
I20260709 13:09:48.012926 28442 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.027661 28660 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.033042 24669 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:09:48.028985 24518 rpcz_store.cc:269] 0709 13:09:45.139105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.139235 (+   130us) service_pool.cc:224] Handling call
0709 13:09:48.024289 (+2885054us) spinlock_profiling.cc:243] Waited 2.81 s on lock 0x7b5400441954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:48.024459 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6454388480}
I20260709 13:09:48.040225 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:48.041186 28237 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.042366 28659 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.045298 28442 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:48.050645 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:09:48.061020 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.075445 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.079134 28759 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.080725 28759 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:48.082015 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:48.084422 27387 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.084923 27387 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.085305 27387 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:48.086241 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 157612us
I20260709 13:09:48.056365 28685 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:09:48.088244 24516 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:48.090155 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.091943 28143 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.092451 28143 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.092864 28531 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.093500 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.094295 24524 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:48.085216 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.066404 28326 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:48.096415 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:47.107980 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.099078 28326 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:48.103354 28603 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:48.103538 28326 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.092871 28143 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.114280 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.118637 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.111542 28758 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:48.123718 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 122693us
I20260709 13:09:48.129791 28603 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:48.131283 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 58034.8us
I20260709 13:09:48.133157 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:48.134006 24519 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:09:48.154065 24637 leader_election.cc:400] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9.
I20260709 13:09:48.159580 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:48.146502 28479 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9.
I20260709 13:09:48.160477 27387 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:48.157989 28758 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:48.177587 28758 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:48.178117 28758 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.180498 27387 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.173218 28672 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:48.173118 28660 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:48.177211 28768 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:09:48.176614 28082 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.199872 28082 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:48.183840 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45363.7us
I20260709 13:09:48.201203 28759 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:48.201987 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:48.173616 28767 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:09:48.168780 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:48.226490 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65151us
I20260709 13:09:48.226888 28370 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:48.227458 28370 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:48.201457 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:48.228840 28685 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:48.230306 24637 leader_election.cc:400] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:48.230608 24637 leader_election.cc:403] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:48.230460 28685 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:48.232275 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.167071 28143 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.177006 28477 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:48.233552 28769 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:48.233989 28769 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:48.234354 28769 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.234727 28143 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.235152 28477 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:48.235386 28603 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:48.235801 28477 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.202560 24667 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:48.237165 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.238628 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:48.192001 25214 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
W20260709 13:09:48.205603 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.207226 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:48.209785 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.258064 28688 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.215444 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.258859 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.259588 24519 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:48.259675 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.262588 24524 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:48.263002 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.263566 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:48.259200 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.264786 24523 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:48.217973 27387 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:48.219570 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:48.238751 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:48.259200 24522 raft_consensus.cc:2410] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:09:48.228425 28370 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:48.267972 28766 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:09:48.269289 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:48.269445 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:48.239741 28477 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.270833 28477 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.271405 28477 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:48.271673 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:48.273042 28237 raft_consensus.cc:2764] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:48.273361 28483 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:48.274101 28237 raft_consensus.cc:2764] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:09:48.275336 28367 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:48.276587 28082 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:48.277297 28589 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.277520 27387 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.278005 27387 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.240783 28709 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:48.278309 27387 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.278493 28709 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:48.278837 28770 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.093s	user 0.004s	sys 0.000s
I20260709 13:09:48.279541 28709 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.280998 28709 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:48.272982 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 53517.1us
I20260709 13:09:48.202642 28759 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:48.248921 25218 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:48.293399 28759 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:48.294955 28660 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:48.295210 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:48.294672 28759 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:48.296429 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 297503us
I20260709 13:09:48.296444 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:48.302637 27387 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.305644 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:48.306690 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:48.307253 28541 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.307878 28541 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:48.308266 24639 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 2.164s (SENT) [suppressed 71 similar messages]
I20260709 13:09:48.308995 28541 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.276950 28082 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:48.306936 28769 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:48.314396 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47212.6us
I20260709 13:09:48.313621 28479 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:48.315652 28430 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:48.272483 28477 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.318367 24520 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:48.321250 27387 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.325986 24522 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:48.319655 28479 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.328315 28479 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.332360 28659 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:48.333030 28659 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.335600 28659 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:48.336158 28589 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:48.337829 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 114885us
I20260709 13:09:48.319691 28430 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.341049 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:48.339365 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.347951 28082 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:48.344367 28430 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.349442 28412 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.349748 28082 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.350000 28412 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.350481 28412 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.353441 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:48.358660 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.361806 24565 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.643s (SENT)
I20260709 13:09:48.362476 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:48.362569 24637 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.313817 28760 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:48.412739 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.360857 28685 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:48.469765 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:48.366097 28774 raft_consensus.cc:2764] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:48.479902 24598 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
W20260709 13:09:48.480669 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 118181us
W20260709 13:09:48.481549 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 142271us
I20260709 13:09:48.473410 28237 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.482923 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.483596 24597 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.483920 28769 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.468006 28454 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.481643 24595 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:48.467538 28326 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.471949 28685 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.478582 28370 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.497776 24598 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:09:48.499497 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.499521 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.500240 24598 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.500782 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:48.501763 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:48.501880 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.502969 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:48.503252 28603 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.503926 28603 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:48.481243 28759 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.504998 28603 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.507543 28769 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:48.509728 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 150092us
W20260709 13:09:48.511587 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.530442 24597 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:48.500250 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.491031 28685 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:48.493772 28454 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:48.507269 28760 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.508143 28769 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.557870 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:48.603871 28774 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:48.604584 28774 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:48.605670 28774 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.608686 28758 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.612282 24419 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.614096 24419 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 9, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.615888 24419 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 8, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 8 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.617245 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:48.618172 28477 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:48.618733 28477 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:48.618796 24419 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 7, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 7 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:48.619940 28477 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.620821 24419 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 9, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.622709 24419 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 8 to 10, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 10 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.625394 28454 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.625399 24419 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 3 to 9, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.627336 28758 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.627547 24419 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.629093 24419 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 8, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 8 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.630822 24419 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 7, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.633183 24419 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 9, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.634690 24419 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 7, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.636149 24419 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:48.590415 28589 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.637847 28589 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.637590 24419 catalog_manager.cc:5697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 3 to 5, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 5 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.640077 28589 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:48.639587 24419 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 8, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 8 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.641398 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:48.643304 28758 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:48.642186 24419 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 7, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.643736 28758 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.644130 28758 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.618614 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.644829 24419 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 1 to 7, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.646214 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:48.647051 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.647537 25217 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:48.647697 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.648324 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:48.642134 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 319583us
I20260709 13:09:48.649587 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.650243 25210 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:48.651649 28483 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.651866 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:48.652397 28483 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:48.644896 28412 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.652945 28483 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:48.653920 28483 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.654659 28412 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.658299 25219 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 5.
W20260709 13:09:48.659271 24565 leader_election.cc:336] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.751s (SENT)
W20260709 13:09:48.660437 24565 leader_election.cc:336] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.815s (SENT)
I20260709 13:09:48.655457 28685 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.664876 24599 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:48.665480 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 134038us
I20260709 13:09:48.668562 24598 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:48.678422 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.679319 25219 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:48.666169 28672 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:48.672175 28759 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:48.683418 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:48.694849 28430 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:48.697659 24423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 347) took 20548 ms (client timeout 15000 ms). Trace:
I20260709 13:09:48.703897 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.705054 24598 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:48.690083 28759 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.709522 28778 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:48.690490 28769 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.713655 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.714164 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:48.714906 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68814.4us
I20260709 13:09:48.713583 28759 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:48.718717 28755 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:48.719105 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.719412 28755 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.708559 28685 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.721715 28326 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.721827 28755 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.722561 24600 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:48.723325 24490 leader_election.cc:400] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11.
W20260709 13:09:48.698225 24423 rpcz_store.cc:269] 0709 13:09:28.149543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.149733 (+   190us) service_pool.cc:224] Handling call
0709 13:09:48.697379 (+20547646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:40.065438 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:40.106900 (+ 41462us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:40.106960 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:09:40.106982 (+    22us) tablet.cc:662] Decoding operations
0709 13:09:40.108838 (+  1856us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:40.108944 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:40.108974 (+    30us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:09:40.403483 (+294509us) tablet.cc:701] Row locks acquired
0709 13:09:40.403534 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:09:40.403727 (+   193us) write_op.cc:270] Start()
0709 13:09:40.403872 (+   145us) write_op.cc:276] Timestamp: P: 1783602580403661 usec, L: 0
0709 13:09:40.403894 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:40.404642 (+   748us) log.cc:844] Serialized 8429 byte log entry
0709 13:09:41.125570 (+720928us) op_driver.cc:464] REPLICATION: finished
0709 13:09:41.273388 (+147818us) write_op.cc:301] APPLY: starting
0709 13:09:41.273476 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:41.273876 (+   400us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:41.273988 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:41.321100 (+ 47112us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:41.321507 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:09:41.321555 (+    48us) write_op.cc:312] APPLY: finished
0709 13:09:41.322110 (+   555us) log.cc:844] Serialized 145 byte log entry
0709 13:09:41.322360 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:41.322564 (+   204us) write_op.cc:454] Released schema lock
0709 13:09:41.322641 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:41.323029 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:41.323059 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1477984,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":147527,"apply.run_cpu_time_us":5638,"apply.run_wall_time_us":49634,"num_ops":21,"prepare.queue_time_us":185433,"prepare.run_cpu_time_us":17527,"prepare.run_wall_time_us":426583,"raft.queue_time_us":348746,"raft.run_cpu_time_us":6867,"raft.run_wall_time_us":101793,"replication_time_us":721517,"thread_start_us":516813,"threads_started":4,"wal-append.queue_time_us":295509,"wal-append.run_cpu_time_us":89457,"wal-append.run_wall_time_us":1690907}]]}
I20260709 13:09:48.725126 28658 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 5 to 9, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:48.726724 28430 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.718129 28769 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.728941 28769 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.729317 28769 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.717028 28778 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.735311 28778 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:48.736816 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.737444 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.740026 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:48.740525 24598 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:48.747709 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:48.745992 28759 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.750236 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.752070 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.753638 24598 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:48.757501 28755 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.757890 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:48.759280 28613 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.759651 28613 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.759915 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:48.760923 28709 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:48.761379 28779 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:48.762259 28779 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:48.759986 28613 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.763022 28240 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.764082 24597 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:48.765595 28755 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.769486 28613 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.770967 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:48.771663 28613 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:48.772078 28758 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:48.777233 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:48.782166 25219 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:48.785017 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:48.785871 24596 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:48.786877 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.787117 24595 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:48.786044 25211 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 5 to 9, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:48.784054 28412 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:09:48.789603 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:48.790669 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.791013 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.791706 24592 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.792167 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:48.792851 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45277.6us
I20260709 13:09:48.793598 28541 raft_consensus.cc:2764] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:48.794754 28541 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:48.794951 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.795248 28541 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:48.795939 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.796307 28541 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.798805 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.825009 25214 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:48.827732 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:48.798557 28479 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.799669 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.800750 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.830605 25216 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:48.801366 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.801860 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.831480 25210 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:48.804548 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:48.805523 24595 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:48.783286 28755 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:48.807241 24597 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:48.808418 24598 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:48.760219 28769 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.809917 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.792994 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:48.810298 24592 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:48.819446 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.849329 24591 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.832388 24596 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:48.841179 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.786126 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.830687 25217 raft_consensus.cc:2376] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11. Re-sending same reply.
I20260709 13:09:48.843971 28755 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:48.847004 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.846342 28613 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:48.847486 28326 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:48.852319 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.853327 24592 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:48.855029 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62098.2us
I20260709 13:09:48.861477 25212 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:48.862300 25211 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:48.863389 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.869820 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.871985 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.872864 25211 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:48.842918 28758 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.877794 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.852097 28613 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.879963 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.863405 28412 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:48.882015 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.889456 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.890393 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:48.893363 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 916) took 1179 ms. Trace:
I20260709 13:09:48.893730 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.894886 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.877537 28660 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.900995 24592 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:48.894486 25217 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:48.893743 25218 rpcz_store.cc:276] 0709 13:09:47.713780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.713929 (+   149us) service_pool.cc:224] Handling call
0709 13:09:48.888852 (+1174923us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54001b7454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:48.893292 (+  4440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870621568}
I20260709 13:09:48.906421 28769 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.908667 28786 ts_tablet_manager.cc:933] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:48.926003 28780 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:09:48.862788 28240 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:09:48.909070 28779 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.910267 28759 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:48.884514 28613 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:48.894466 28755 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.912947 25215 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:09:48.914839 25211 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:48.918116 24593 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:09:48.911672 28660 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:48.927469 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57695.7us
I20260709 13:09:48.938867 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.928917 25214 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:48.939680 24592 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.885812 28412 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.932032 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.929678 24591 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:48.943195 28789 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:48.944519 28789 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:48.945791 28613 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.946179 28789 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:48.947032 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.949069 25211 raft_consensus.cc:2376] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12. Re-sending same reply.
I20260709 13:09:48.930841 28758 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.950246 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.949415 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:48.951346 25214 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:48.952450 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.952692 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.953406 25218 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 7: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:48.952443 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:48.955693 24592 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:09:48.959383 24593 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:48.961663 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:48.961973 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 78120.8us
I20260709 13:09:48.962775 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.959298 28367 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:48.947889 28412 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:48.968550 25210 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:48.969779 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.973789 28660 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:48.974009 28758 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:48.974367 28758 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:48.974419 28367 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:48.973821 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:48.975404 28367 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.975255 28758 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:48.977571 25216 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:48.978500 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:48.979475 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.979957 25216 raft_consensus.cc:2376] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12. Re-sending same reply.
I20260709 13:09:48.981630 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:48.982969 25216 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:48.983729 24593 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:48.984582 25216 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:48.985169 28685 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:48.986193 25216 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:48.987495 25216 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:48.956400 28769 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:48.998329 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:49.000152 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:49.012761 24491 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.594s (SENT)
I20260709 13:09:49.009267 28786 tablet_copy_client.cc:323] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:09:49.015786 28326 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:49.017424 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:49.017846 28784 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:49.018388 28784 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.001739 28240 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:09:49.020581 28774 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.013439 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:49.024575 28784 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.019454 28769 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:49.033190 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 92407.4us
I20260709 13:09:49.034744 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:49.039594 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:49.031530 28774 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.041611 28791 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:49.080643 28791 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:49.081264 28791 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:49.082418 28791 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.094686 28796 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:49.101666 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 89095.4us
W20260709 13:09:49.102516 24491 leader_election.cc:336] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.607s (SENT)
I20260709 13:09:49.102942 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:49.143889 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 102576us
W20260709 13:09:49.191443 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 88983.2us
W20260709 13:09:49.192217 24491 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.659s (SENT)
W20260709 13:09:49.193205 24491 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.668s (SENT)
I20260709 13:09:49.204881 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:49.209096 28798 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.216586 28805 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:49.242235 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49068.4us
I20260709 13:09:49.248432 28806 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:49.249245 28806 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:49.252013 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:49.252722 24520 raft_consensus.cc:2368] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:49.251564 28806 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:49.253624 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:49.254432 24522 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:49.260597 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:49.261211 24522 raft_consensus.cc:2376] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12. Re-sending same reply.
I20260709 13:09:49.265965 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:49.324802 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:49.378084 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.325757 24522 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:49.670945 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.671608 24516 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.672926 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.673993 24520 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:49.676301 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.672681 28806 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.685446 28806 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.687585 28806 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.705567 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 926) took 1059 ms. Trace:
I20260709 13:09:49.706180 25212 rpcz_store.cc:276] 0709 13:09:48.646163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.647113 (+   950us) service_pool.cc:224] Handling call
0709 13:09:49.705269 (+1058156us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540004c4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:49.705475 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475382528}
I20260709 13:09:49.711735 24516 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:09:49.715091 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:49.717136 28796 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:49.718395 28796 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:09:49.723101 28782 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.016s	user 0.005s	sys 0.000s
W20260709 13:09:49.732627 28755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.018s	sys 0.040s
W20260709 13:09:49.737857 28412 consensus_meta.cc:287] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.766s	user 0.014s	sys 0.000s
I20260709 13:09:49.739408 28412 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.740696 28796 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.733064 28755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.018s	sys 0.040s
I20260709 13:09:49.747102 28796 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:49.742719 28412 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.754626 28796 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:49.758574 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.757740 24520 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.758747 24525 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:49.759397 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.756803 24522 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:49.761750 28412 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.762468 28412 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.763671 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:49.767059 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.767519 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:49.769723 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:49.773865 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:49.776096 24669 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.779441 24669 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.780848 24516 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:49.785295 28479 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:49.786329 28479 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.786926 28479 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.785318 24674 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:49.789938 28479 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:49.805581 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.807046 28819 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.807708 28819 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.819519 24667 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:49.837419 28672 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:49.838033 28672 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.839502 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:49.840219 24667 raft_consensus.cc:2368] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13.
I20260709 13:09:49.840124 28672 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.860387 28758 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.860270 28822 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:49.865499 28822 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.868705 28672 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.869308 28672 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:49.871466 28672 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:49.874601 24597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.017s	sys 0.016s
W20260709 13:09:49.874959 24597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.018s	sys 0.016s
I20260709 13:09:49.875687 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1781) took 1055 ms. Trace:
I20260709 13:09:49.883590 28796 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.884277 28791 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.884164 28796 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.884783 28791 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.886950 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.892014 24521 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:49.893219 28821 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.895644 28791 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.893715 28821 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.900578 28821 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.897559 28796 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.900741 24525 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:49.903039 28821 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:49.903609 28821 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:49.905745 28821 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:49.918066 28821 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.919226 28821 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:49.906319 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.922093 24518 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:49.922137 28821 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:49.924275 28821 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.924865 24523 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.924660 28821 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:49.925438 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 877) took 1155 ms. Trace:
I20260709 13:09:49.925768 24523 rpcz_store.cc:276] 0709 13:09:48.770073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.924319 (+1154246us) service_pool.cc:224] Handling call
0709 13:09:49.924586 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.925211 (+   625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.925390 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.906944 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:49.907151 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:49.926638 28821 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:49.910391 28660 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:49.908146 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:49.936767 28660 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:49.936116 24517 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:49.938887 28660 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:49.876034 24597 rpcz_store.cc:276] 0709 13:09:48.820702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.854188 (+ 33486us) service_pool.cc:224] Handling call
0709 13:09:48.874864 (+ 20676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.884357 (+  9493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.884402 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.911782 (+ 27380us) log.cc:844] Serialized 26 byte log entry
0709 13:09:49.875316 (+963534us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:49.875363 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.875437 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.875497 (+    60us) raft_consensus.cc:1685] finished
0709 13:09:49.875510 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.875631 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":255,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2760,"thread_start_us":926104,"threads_started":1,"wal-append.queue_time_us":183646}
I20260709 13:09:49.940560 24520 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:49.941983 28412 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:49.943552 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 928964us
I20260709 13:09:49.946184 28240 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.946969 28367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.004s	sys 0.004s
I20260709 13:09:49.946741 28240 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:49.947350 28367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.004s	sys 0.004s
I20260709 13:09:49.947955 28367 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:49.948429 28367 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:49.949224 28370 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:49.949908 28660 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:49.949823 28370 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.950197 28412 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:49.951056 28660 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:49.951383 28660 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:49.952278 28412 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:49.952734 28412 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:49.952412 25211 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.954471 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:49.952134 28660 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.953763 28412 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.956032 28660 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.956183 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:49.956468 28412 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.955179 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:49.957454 25212 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:49.957775 28442 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.957999 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:49.958635 25214 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:49.958295 28442 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.948868 28240 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:49.961400 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:49.962256 25211 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:49.963047 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:49.963267 28082 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.963868 28082 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.952090 28370 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.965883 28082 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.967181 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:49.969072 28367 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.970899 24490 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:49.971689 28658 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:49.972256 28791 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:49.972700 28791 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.973059 28791 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.974123 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:49.974759 24671 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.977031 28819 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.977560 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:49.978353 28672 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:49.978729 28672 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.979166 28672 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.980844 28430 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:49.981386 28430 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:49.983448 28430 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.983570 24671 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:49.989037 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:49.989645 28822 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.990943 28755 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:49.961035 28442 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:49.992584 28442 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:49.993034 28597 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:49.993261 28824 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:09:49.993698 28597 consensus_queue.cc:1243] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:49.995323 28659 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:49.995833 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.997483 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:49.998034 24665 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.001408 28082 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.001464 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet 45fddcc6d2bc4726a21bdfe31a4cae08 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
W20260709 13:09:50.001940 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.002055 28082 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.002136 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet 45fddcc6d2bc4726a21bdfe31a4cae08 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-45fddcc6d2bc4726a21bdfe31a4cae08
I20260709 13:09:50.004251 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.004527 28082 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.005105 24674 raft_consensus.cc:2410] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:50.005216 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.005857 24598 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 6.
I20260709 13:09:50.006294 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.006968 24674 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:50.008397 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.008854 28774 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.009052 24674 raft_consensus.cc:2376] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8. Re-sending same reply.
I20260709 13:09:50.010589 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.011205 24674 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:50.012528 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.013216 28613 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:50.013391 24674 raft_consensus.cc:2368] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9.
I20260709 13:09:50.013765 28430 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:50.014720 28769 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:50.016000 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.016088 28442 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:50.017194 28442 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:50.018035 28442 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:50.019230 28442 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.019807 24594 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:09:50.020313 24665 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:50.021487 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.022447 24674 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:50.014901 28430 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:09:50.026223 28430 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.026840 28430 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:50.031960 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.033429 24596 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:50.034746 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:50.035286 24596 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.036254 24668 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:50.038226 24610 tablet_copy_source_session.cc:215] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:50.032174 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.038470 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.048784 24668 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:50.039546 24546 debug-util.cc:398] Leaking SignalData structure 0x7b080008c180 after lost signal to thread 23433
W20260709 13:09:50.050213 24546 debug-util.cc:398] Leaking SignalData structure 0x7b0800093740 after lost signal to thread 24457
W20260709 13:09:50.051797 24546 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7120 after lost signal to thread 24549
W20260709 13:09:50.052125 24546 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1ac0 after lost signal to thread 24550
W20260709 13:09:50.053385 24546 debug-util.cc:398] Leaking SignalData structure 0x7b0800312120 after lost signal to thread 24624
W20260709 13:09:50.053714 24546 debug-util.cc:398] Leaking SignalData structure 0x7b0800354b80 after lost signal to thread 24625
W20260709 13:09:50.055032 24546 debug-util.cc:398] Leaking SignalData structure 0x7b08002268e0 after lost signal to thread 24698
W20260709 13:09:50.055333 24546 debug-util.cc:398] Leaking SignalData structure 0x7b0800164120 after lost signal to thread 24699
I20260709 13:09:50.042770 28082 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:49.995329 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1332) took 1072 ms. Trace:
I20260709 13:09:50.003317 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:50.061216 24546 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0ce0 after lost signal to thread 25243
W20260709 13:09:50.062053 24546 debug-util.cc:398] Leaking SignalData structure 0x7b0800248600 after lost signal to thread 28531
W20260709 13:09:50.062594 24546 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9540 after lost signal to thread 28688
I20260709 13:09:50.056102 25210 rpcz_store.cc:276] 0709 13:09:48.922975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.980812 (+ 57837us) service_pool.cc:224] Handling call
0709 13:09:49.010077 (+ 29265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.028647 (+ 18570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.028680 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.790205 (+761525us) log.cc:844] Serialized 26 byte log entry
0709 13:09:49.980372 (+190167us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:49.980411 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.980472 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:49.980523 (+    51us) raft_consensus.cc:1685] finished
0709 13:09:49.980536 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.995272 (+ 14736us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4555,"thread_start_us":82686,"threads_started":1,"wal-append.queue_time_us":50678}
I20260709 13:09:50.084270 24596 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:50.084834 24671 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:49.868847 28758 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:50.035396 28430 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:50.120152 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.120329 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.120396 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.120780 24665 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.121663 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.128376 24599 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:50.066891 28082 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:50.141093 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 251338us
I20260709 13:09:50.118917 28769 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.144728 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.144037 24491 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.893s (SENT)
W20260709 13:09:50.145428 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 145478us
I20260709 13:09:50.147521 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.150014 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:50.162708 25184 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.164844 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.167092 24671 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.169018 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:50.171921 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.177064 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.161151 28836 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.178834 28836 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:50.179109 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.178217 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.179852 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.179203 28836 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.180563 25210 raft_consensus.cc:2368] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12.
I20260709 13:09:50.185175 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.186146 25211 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:50.189039 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:50.189895 24521 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:50.127380 28758 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:50.190603 24665 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:50.206137 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.206777 25211 raft_consensus.cc:2376] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9. Re-sending same reply.
I20260709 13:09:50.207581 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.202991 24520 pending_rounds.cc:85] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 9
I20260709 13:09:50.202622 25212 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:50.209365 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.209291 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.220477 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.191480 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.220615 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.221714 25211 raft_consensus.cc:2376] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12. Re-sending same reply.
I20260709 13:09:50.224505 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.228870 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.229671 25216 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:50.230407 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.208250 24520 pending_rounds.cc:107] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:50.231256 24520 raft_consensus.cc:2889] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.154603 28755 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:09:50.221410 28829 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:50.238564 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.234678 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:50.220036 28840 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:50.190936 28760 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.242571 25212 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 5: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:50.242641 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.158339 28769 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.245380 25218 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:50.246114 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.247211 24599 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:09:50.245375 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.164577 28082 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:50.251053 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.256567 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.259044 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.221220 28672 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.266392 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.263506 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.264429 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.265563 24665 raft_consensus.cc:2376] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8. Re-sending same reply.
W20260709 13:09:50.262284 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.282007 25216 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:50.242602 28597 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:50.284457 25218 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.273736 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.280215 24668 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
W20260709 13:09:50.291065 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 104700us
I20260709 13:09:50.285141 28822 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.268043 28660 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:50.290526 28603 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:50.276422 28082 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.289362 28658 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.302454 28846 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:50.342338 28846 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.307950 28603 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.317437 28759 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:09:50.292635 28791 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.348452 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.313989 28477 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.352497 28477 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:50.354878 28477 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:50.355460 24516 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:50.356951 28660 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:50.357352 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.358302 24666 raft_consensus.cc:2410] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:50.357954 28660 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.361297 28430 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:50.361975 28430 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:50.362668 24491 leader_election.cc:336] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.990s (SENT)
I20260709 13:09:50.363142 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:50.364192 24491 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.026s (SENT)
I20260709 13:09:50.364327 28430 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.305400 28822 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.366755 28827 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:50.367877 28823 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:50.368307 28822 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.339386 28758 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:50.368551 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.348546 28791 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.266247 28789 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:09:50.369947 28758 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:50.449380 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.370653 28784 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:50.370539 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.341130 28672 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.338371 28769 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:50.484650 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.386931 24491 leader_election.cc:336] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.143s (SENT)
I20260709 13:09:50.480922 24671 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:50.485834 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.402436 25218 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
W20260709 13:09:50.425376 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 105382us
I20260709 13:09:50.431233 28846 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:50.432689 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.435828 24669 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:09:50.436756 24419 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 345) took 18153 ms (client timeout 15000 ms). Trace:
I20260709 13:09:50.441506 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.442380 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.494133 24665 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:50.446520 28082 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:50.496650 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.497337 24671 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:50.448542 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.456532 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.466184 28603 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:50.469452 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.471485 24420 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:50.447371 28412 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:50.462924 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 272613us
I20260709 13:09:50.462873 28784 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:50.514228 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.514973 24671 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 5: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:50.481536 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 113072us
I20260709 13:09:50.483011 28759 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:50.493016 24667 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
W20260709 13:09:50.493322 24419 rpcz_store.cc:269] 0709 13:09:32.283537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.319200 (+ 35663us) service_pool.cc:224] Handling call
0709 13:09:50.436676 (+18117476us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:49.210587 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:49.211655 (+  1068us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:49.211719 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:09:49.211741 (+    22us) tablet.cc:662] Decoding operations
0709 13:09:49.218220 (+  6479us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:49.218349 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:49.218384 (+    35us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:09:49.222895 (+  4511us) tablet.cc:701] Row locks acquired
0709 13:09:49.222955 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:09:49.223178 (+   223us) write_op.cc:270] Start()
0709 13:09:49.223331 (+   153us) write_op.cc:276] Timestamp: P: 1783602589223099 usec, L: 0
0709 13:09:49.223369 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:09:49.235160 (+ 11791us) log.cc:844] Serialized 6741 byte log entry
0709 13:09:49.993987 (+758827us) op_driver.cc:464] REPLICATION: finished
0709 13:09:50.114776 (+120789us) write_op.cc:301] APPLY: starting
0709 13:09:50.114887 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:50.116479 (+  1592us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:50.116628 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:50.330777 (+214149us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:50.331140 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=34
0709 13:09:50.331217 (+    77us) write_op.cc:312] APPLY: finished
0709 13:09:50.331894 (+   677us) log.cc:844] Serialized 119 byte log entry
0709 13:09:50.332297 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:50.332569 (+   272us) write_op.cc:454] Released schema lock
0709 13:09:50.332689 (+   120us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:50.336847 (+  4158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:50.336877 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45702,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":120448,"apply.run_cpu_time_us":7612,"apply.run_wall_time_us":222056,"num_ops":17,"prepare.queue_time_us":207410,"prepare.run_cpu_time_us":71836,"prepare.run_wall_time_us":473784,"raft.queue_time_us":27698,"raft.run_cpu_time_us":8788,"raft.run_wall_time_us":365181,"replication_time_us":531775,"thread_start_us":801463,"threads_started":4,"wal-append.queue_time_us":476236}]]}
W20260709 13:09:50.516371 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 230114us
W20260709 13:09:50.518936 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 132041us
I20260709 13:09:50.521531 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.521597 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.524389 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.525502 24517 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:09:50.525852 24491 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 2.191s (SENT)
I20260709 13:09:50.532249 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.532909 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.533942 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.534938 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.499508 28769 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:50.538348 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.538575 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.513621 24420 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 8 to 10, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 10 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:50.543237 24420 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.516517 28658 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:50.551080 24639 leader_election.cc:400] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12.
I20260709 13:09:50.556149 24639 leader_election.cc:403] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:09:50.512619 28672 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.554803 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.545879 24420 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 11, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 11 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.557546 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.560197 25215 raft_consensus.cc:2376] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11. Re-sending same reply.
I20260709 13:09:50.518570 28613 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.558607 24668 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:09:50.561556 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.562896 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.563788 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.564757 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:50.564112 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.571280 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.569124 25213 raft_consensus.cc:2376] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10. Re-sending same reply.
I20260709 13:09:50.563814 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.564762 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.565119 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.576438 24665 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:50.564484 24670 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:50.574324 25212 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:50.565275 24420 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:50.518684 28759 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:50.578903 24420 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 8, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 8 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:50.512148 28082 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.580955 24420 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 11, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 11 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.576819 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:50.556032 28240 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.598052 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:50.599973 24669 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:50.584023 24668 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:09:50.584374 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44241.1us
I20260709 13:09:50.586073 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:50.602730 24599 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:50.587332 24598 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:50.590059 24595 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:50.590394 28370 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:50.587725 24420 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 5, term changed from 3 to 7, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.592465 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.593328 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.594190 28784 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.596645 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:50.597389 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:50.599377 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:50.606251 24520 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:50.605273 24672 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:50.598703 24519 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:09:50.608366 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 57413.4us
I20260709 13:09:50.604393 24420 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.612627 24420 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 10, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 10 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.580729 28789 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.614702 24420 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 8 to 9, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.616742 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:50.617645 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 91817.9us
I20260709 13:09:50.619495 24420 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.616330 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:50.624085 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 59412.3us
I20260709 13:09:50.621941 24420 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.598387 28825 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12.
I20260709 13:09:50.577630 28613 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.609861 28755 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:50.617913 28659 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.635192 24666 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.634377 24420 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 10, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 10 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:09:50.639297 24420 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.626191 28784 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.644052 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.623660 28370 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:50.645370 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.642464 28836 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.645714 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.646021 28855 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.646394 24670 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 8: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:50.646508 28855 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.647401 28836 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.648551 28855 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:50.607939 28240 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.648871 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:50.654781 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62369.6us
I20260709 13:09:50.630792 28827 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.663137 24670 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:50.666204 24420 catalog_manager.cc:5697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.668254 24420 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.670450 24420 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 10, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 10 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:50.672178 24420 catalog_manager.cc:5697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.670855 28603 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.637559 28755 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.678687 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.641122 28759 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.683306 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.690996 24669 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:50.681152 28603 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.680899 28865 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.724774 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.717478 28367 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:50.726850 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 82877.5us
I20260709 13:09:50.730901 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:50.722461 28082 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.733908 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.735574 24639 leader_election.cc:400] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:50.736728 28430 raft_consensus.cc:2764] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:09:50.740134 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.732218 28836 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.743430 28613 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:50.749450 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.750135 24669 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:50.751020 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.751555 24669 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:50.752357 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:50.754086 24639 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.984s (SENT)
I20260709 13:09:50.755517 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:50.756436 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:50.758559 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.777769 24521 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:50.777943 24520 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:50.777844 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.777268 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.782662 24522 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:50.780789 25185 leader_election.cc:400] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13.
I20260709 13:09:50.782254 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.783512 25185 leader_election.cc:403] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:50.783576 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:50.780408 24670 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:50.789646 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.790665 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:50.791013 24666 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:50.791764 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:50.794108 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:50.795212 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 190023us
I20260709 13:09:50.800856 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:50.804004 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:50.745137 28603 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.806430 24637 leader_election.cc:400] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:50.811738 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.819061 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.807612 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:50.807598 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 53566.2us
W20260709 13:09:50.819147 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 88311.3us
I20260709 13:09:50.823956 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:50.823998 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.825538 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:50.788465 28872 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:09:50.827369 24637 leader_election.cc:403] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:50.829878 28823 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:50.800992 28791 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:50.830000 28822 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:50.782634 28789 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.832144 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.737902 28865 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:09:50.829070 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:50.788650 28659 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.745333 28867 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:09:50.836380 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.834005 28806 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:50.819891 28825 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.837216 28881 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.838809 28856 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:50.849056 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.754061 28836 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.832844 28442 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:09:50.828994 28240 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:50.807516 28873 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:50.841966 28477 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8.
I20260709 13:09:50.807390 28858 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.882495 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.886157 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.887559 25215 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:50.877737 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.883836 25217 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:50.827457 28430 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:09:50.836138 28823 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:50.886193 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 80123.7us
I20260709 13:09:50.779657 28874 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:09:50.890494 25210 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:50.882752 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 75920.2us
I20260709 13:09:50.889433 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.891933 25218 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:50.892288 25218 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:50.894289 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:50.894851 25212 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.873292 28412 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.896881 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.877589 28755 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:50.875370 28856 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:50.882611 28367 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:50.895911 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.841786 28659 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.882117 28806 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:50.887142 28796 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:50.905324 25218 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.908542 25218 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.899024 28660 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:50.917614 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:50.894158 28789 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:50.899345 28082 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.920487 28660 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:50.922899 28789 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:50.926286 28660 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:50.926354 28789 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.929378 28823 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.926417 28659 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:50.933382 28868 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13.
I20260709 13:09:50.934504 28789 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.937531 28789 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:50.937428 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46536.7us
I20260709 13:09:50.939050 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.940124 24637 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.940871 28603 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.941571 28603 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:50.941920 28603 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.942250 28603 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.944556 28791 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.899369 28873 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:50.946053 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:50.945816 28873 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.948132 28836 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:50.951524 28760 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.951987 28760 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:50.953595 28870 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.219s	user 0.003s	sys 0.001s
I20260709 13:09:50.953749 28885 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:50.955868 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.906208 28822 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.957746 24670 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:50.958186 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.958896 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.960062 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:50.961177 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.961571 25213 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:50.962217 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:50.962364 28477 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:50.965965 25217 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:50.968801 28827 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:50.969424 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.970253 25219 raft_consensus.cc:2410] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:50.970372 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.969594 28827 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:50.886344 28825 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:50.972575 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:50.907163 28856 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:50.996635 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.914808 28758 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:51.000742 25218 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:09:51.001524 28827 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:51.038174 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.039074 25213 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:51.039304 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:51.003178 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.003834 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:51.008636 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.009382 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:51.010517 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:51.011173 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.043263 24674 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:51.016543 25218 pending_rounds.cc:85] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 9
I20260709 13:09:51.043485 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:51.011866 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.044152 24668 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 5.
I20260709 13:09:51.045580 25214 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:09:51.046510 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 159989us
I20260709 13:09:51.043737 25218 pending_rounds.cc:107] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:09:51.047799 25218 raft_consensus.cc:2889] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.048722 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.049675 25218 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:51.020462 25210 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:51.051666 25219 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:51.054435 25216 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:51.055233 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:51.056588 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:50.993729 28412 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.064129 24671 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:51.067497 24672 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:51.010147 28806 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:09:51.071498 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 247538us
I20260709 13:09:51.016973 28758 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:51.077548 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.085104 28760 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.063711 28789 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.085842 28789 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.070077 28791 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.086928 28834 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:51.086895 28791 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.087463 28834 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.087852 28834 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.054996 28885 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:09:51.089147 28659 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:51.085328 28825 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.093261 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:51.094929 25212 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:09:51.095723 25211 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:51.089644 28659 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.070351 28868 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:51.103454 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:51.105238 28659 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.105293 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:51.081494 28758 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:51.098398 28796 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:51.124518 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44501us
I20260709 13:09:51.069069 28891 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:09:51.134227 28789 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.074069 28412 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.135915 28082 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:51.137271 28791 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.139608 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:51.072180 28867 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:09:51.109901 28885 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:51.149401 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.070467 28880 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:09:51.128135 28873 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:51.158390 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.164690 25214 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:51.125167 28759 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.968405 24411 maintenance_manager.cc:643] P 7c40b21f34414599bc4c7e2b5c7f524d: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.844s	user 0.189s	sys 0.108s Metrics: {"bytes_written":30382,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":445236,"dirs.run_cpu_time_us":475,"dirs.run_wall_time_us":3356,"drs_written":1,"lbm_read_time_us":419,"lbm_reads_lt_1ms":4,"lbm_write_time_us":62446,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":427181,"threads_started":1,"update_count":17}
W20260709 13:09:51.157886 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 255700us
I20260709 13:09:51.125185 28868 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:51.152169 28082 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:51.119050 28430 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:09:51.178834 28430 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:51.179167 28660 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:51.179764 28370 consensus_meta.cc:287] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.526s	user 0.001s	sys 0.009s
I20260709 13:09:51.180190 28370 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.152238 28367 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:09:51.150512 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.159292 25216 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:51.152828 28672 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:09:51.154860 28858 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:09:51.197373 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 46949.2us
I20260709 13:09:51.157234 28789 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:51.177685 28836 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:51.168378 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.162698 28885 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.163807 28873 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:51.198879 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 369854us
I20260709 13:09:51.165282 28760 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:09:51.222153 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:51.202116 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:51.231021 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:51.235615 28658 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:51.236066 28658 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.236392 28658 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.238557 28834 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:51.234649 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:51.240984 25215 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
W20260709 13:09:51.251703 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 120483us
I20260709 13:09:51.260510 25213 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:51.227573 28885 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:51.243664 28894 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:09:51.232300 28873 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:51.264665 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.305421 24412 maintenance_manager.cc:419] P 7c40b21f34414599bc4c7e2b5c7f524d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11053 bytes on disk
W20260709 13:09:51.305763 28896 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:51.265331 28769 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:51.163523 28827 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:51.266307 24490 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:51.294201 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 166857us
I20260709 13:09:51.272989 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:51.240928 28834 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.228016 28660 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.179167 28603 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.241317 28893 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:51.279628 28890 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:51.273635 28442 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:51.335742 28442 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:51.309450 28900 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.226485 28477 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:09:51.315204 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:51.341002 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 434191us
I20260709 13:09:51.342180 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:51.280109 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.241982 28412 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.259402 28822 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:51.327363 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 54484.5us
I20260709 13:09:51.345469 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:51.346858 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:51.327518 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 61330.8us
I20260709 13:09:51.266000 28240 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.272521 28791 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.207939 28823 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:09:51.335074 28908 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:51.335201 28890 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:51.220638 28796 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:51.308282 28769 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:51.338001 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 246902us
I20260709 13:09:51.364115 28909 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.300808 28858 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:51.365424 28858 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.242517 28892 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:09:51.367583 28858 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.331092 28672 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:51.338236 28886 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:09:51.332943 28893 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.378902 28893 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.352563 28367 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:51.379318 28672 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:51.379462 28367 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:51.379995 28367 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.359098 28791 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.362656 28890 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.364841 28909 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:51.340327 24411 maintenance_manager.cc:643] P 7c40b21f34414599bc4c7e2b5c7f524d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.030s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":411,"lbm_reads_lt_1ms":4}
I20260709 13:09:51.368232 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.340008 28442 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:51.369298 25184 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:51.372118 24522 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:51.330480 28758 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:51.352898 28822 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.274343 28856 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:51.410853 28856 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.352556 28603 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.383520 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.393448 28786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fddcc6d2bc4726a21bdfe31a4cae08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:51.384095 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.385453 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:51.413453 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 98381.6us
I20260709 13:09:51.413386 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.413992 24519 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.356335 28660 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:51.414685 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:51.391907 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:51.397797 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.402323 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.298051 28868 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.405761 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.407817 28908 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.359414 28412 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:09:51.401021 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:51.420055 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50842us
I20260709 13:09:51.387862 28834 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.433378 24595 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:51.434159 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:51.436264 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:51.438791 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.373706 28836 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:09:51.439436 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.414709 28822 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:51.343283 28900 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.451117 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.380342 28672 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.431154 28867 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.452915 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.428047 28660 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:51.456473 24592 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:51.444922 28759 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:51.466464 28899 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:09:51.468748 28082 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.414945 28658 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.474926 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:51.466089 24519 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:51.446537 28909 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:51.483955 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44598.3us
I20260709 13:09:51.472479 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.483204 28836 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.493729 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.483717 28660 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.444557 28834 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.505533 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.502104 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:51.507751 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.451676 28442 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.520220 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:51.529281 24673 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.498627 28891 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.495106 28759 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.471957 28659 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.535214 28912 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.535763 28905 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:51.540436 24519 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:51.536818 28904 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:09:51.543653 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:51.507467 28477 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:51.513935 28370 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:51.551002 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 48978.4us
I20260709 13:09:51.552380 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:51.548723 24597 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:51.539199 28082 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.539813 24595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:09:51.560564 24595 raft_consensus.cc:606] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.560776 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.555619 28912 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.562847 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:51.498301 28367 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.566260 28912 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:51.576579 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 233067us
W20260709 13:09:51.578279 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 318872us
I20260709 13:09:51.580073 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:51.578326 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:51.563622 28370 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.563192 28758 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.586261 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:51.625624 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45771us
I20260709 13:09:51.577662 28856 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.555748 28477 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.584955 28912 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.584652 28791 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:51.640304 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 62097.2us
I20260709 13:09:51.603137 28891 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.630947 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:51.642948 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56796us
I20260709 13:09:51.676713 24516 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:51.678373 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:51.664026 28903 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:09:51.703635 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:51.704361 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:51.632239 28900 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.763056 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:51.645046 28758 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:51.599272 28603 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:09:51.644809 28912 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:51.769860 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:51.772094 24516 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
W20260709 13:09:51.774417 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 334213us
I20260709 13:09:51.776285 24524 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:09:51.786397 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 270825us
I20260709 13:09:51.787696 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:51.642359 28856 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.788407 24525 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:51.788192 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:51.705248 28910 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.804675 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.768312 28758 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:51.819625 24519 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:51.819733 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:51.820391 25214 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:51.822672 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:51.823006 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:51.825423 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:51.826181 25212 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:51.826843 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.783860 28658 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.838624 24518 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:51.823611 28759 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.823484 28442 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.823838 28758 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:51.856850 24600 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:51.859269 25212 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:51.860671 25214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:51.860814 28922 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.865253 28889 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:51.865797 28917 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:51.866228 28918 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:51.867295 28915 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:09:51.868305 28920 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:51.873298 28928 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:09:51.833598 28827 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:51.882639 24673 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:51.840888 28908 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.839639 28659 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.922367 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:51.950620 24593 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.922996 28477 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.922384 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.924544 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.822840 28910 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:51.929131 28914 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:09:51.937634 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 306764us
W20260709 13:09:51.949214 28885 consensus_meta.cc:287] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.003s
I20260709 13:09:51.970681 28885 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:51.972724 28931 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:09:51.974331 28925 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:51.974278 28885 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:51.963232 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:51.978358 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:51.980792 25216 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:51.951987 28603 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.986842 25214 raft_consensus.cc:606] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:51.987640 28672 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:51.988649 28672 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:51.952260 28367 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:51.990803 24591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.002s	sys 0.014s
I20260709 13:09:51.994257 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:51.995496 24523 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:51.996790 24591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.002s	sys 0.014s
I20260709 13:09:51.998502 24516 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:51.961234 28908 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:52.004395 24524 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:52.004799 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:51.975510 28856 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:51.990275 28918 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.984500 28806 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:52.014866 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.017278 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.019506 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:51.925190 28917 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.022528 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.023237 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.024816 24524 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:52.024770 28928 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.994092 28658 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:52.010730 28477 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:52.038326 24521 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:52.040277 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.042446 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.000141 28603 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.016023 28827 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:52.042879 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:09:51.998673 28821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.000s	sys 0.018s
I20260709 13:09:52.043879 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:51.996053 28922 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:09:52.041527 28836 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.102617 28836 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.105554 28940 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:52.106312 28940 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:52.107833 28822 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.002s
I20260709 13:09:52.108316 28822 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.105450 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.109297 28825 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:52.110020 28825 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.110355 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:52.111192 28929 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 13:09:52.111507 28936 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:52.111963 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.113097 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:52.068214 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.067895 28908 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.068778 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.114949 24671 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.037691 28937 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:52.070680 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 92393.6us
I20260709 13:09:52.026052 28660 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.023679 28823 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.045737 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.091693 24667 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:52.057330 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.081589 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:52.065207 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:52.113025 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.016605 28906 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.244s
I20260709 13:09:52.067119 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.047851 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.024009 28806 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.116514 28868 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:09:52.041857 28658 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.060461 28659 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 13:09:52.110221 28927 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:09:52.096287 28821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.000s	sys 0.019s
I20260709 13:09:52.047394 28928 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.180881 25212 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:52.015951 28672 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.190683 28240 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.021914 28918 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:52.189038 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 107878us
I20260709 13:09:52.070024 28477 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.191761 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:52.191761 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.194881 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.231724 25219 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:52.195672 24517 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:52.199903 24671 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:52.234689 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:52.236158 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 190811us
I20260709 13:09:52.081700 28827 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.206408 24521 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:52.071254 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:52.139894 28412 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:52.201064 28658 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:52.237402 24409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 287406us
I20260709 13:09:52.240562 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.243141 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.241266 24597 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:09:52.245035 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.223932 28603 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:52.246784 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 204132us
I20260709 13:09:52.211750 28823 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:52.248396 24597 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:52.248760 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:52.228813 28613 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:52.252375 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.255991 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.243038 28937 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.240262 28836 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:52.228330 28940 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:52.257647 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:52.243134 28910 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.259747 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.248606 28659 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.263126 24593 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:52.253154 28890 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:52.274722 28890 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.275149 28890 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.277554 28918 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.278329 28950 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:52.285429 24670 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:52.286444 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.286525 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.286715 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:52.287210 24674 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.288095 28822 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.288697 28822 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.288790 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.289499 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.290055 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.245812 28412 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.290939 24673 raft_consensus.cc:2410] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:52.292546 28412 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:52.293228 28873 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.992s	user 0.004s	sys 0.010s
I20260709 13:09:52.293660 28873 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.254285 28613 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:52.266137 28935 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.243s	user 0.001s	sys 0.001s
I20260709 13:09:52.296376 28613 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:52.266462 28924 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.226s	user 0.000s	sys 0.004s
I20260709 13:09:52.297842 28613 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:52.267122 28883 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.297s	user 0.004s	sys 0.004s
W20260709 13:09:52.265618 28945 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:09:52.267930 28948 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
W20260709 13:09:52.270272 28884 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.292s	user 0.000s	sys 0.004s
I20260709 13:09:52.255123 28889 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.254916 28823 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.270728 28477 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:52.301499 28477 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.302285 28477 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.302568 28823 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.252599 28240 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.271605 28917 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.247627 28885 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:09:52.245648 28855 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:09:52.275209 28934 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:09:52.269785 28827 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:52.307320 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49711.8us
W20260709 13:09:52.273591 28893 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.894s	user 0.005s	sys 0.009s
I20260709 13:09:52.245697 28821 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:09:52.330039 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.312103 24597 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:52.300491 28889 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.321679 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.313432 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:52.314254 25210 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:09:52.285439 28951 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:52.320665 24593 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:52.310029 28240 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.321733 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.310382 28940 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.322353 28890 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:52.323086 28956 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:52.348758 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:52.324615 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 942) took 1321 ms. Trace:
W20260709 13:09:52.326905 28912 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.000s
I20260709 13:09:52.293259 28874 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:52.354755 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 98820.1us
I20260709 13:09:52.329653 28873 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:52.329049 28867 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.000s
I20260709 13:09:52.329430 24674 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:52.332612 25212 raft_consensus.cc:2376] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13. Re-sending same reply.
I20260709 13:09:52.333490 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.330888 24600 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:09:52.344826 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:52.349973 25213 rpcz_store.cc:276] 0709 13:09:51.002955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.049926 (+ 46971us) service_pool.cc:224] Handling call
0709 13:09:51.252646 (+202720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.263868 (+ 11222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.324357 (+1060489us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540007c450. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:52.324518 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465539840}
I20260709 13:09:52.355618 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:52.360740 25218 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:52.362282 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.362645 25213 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:52.311618 28758 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:52.391323 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46577.4us
I20260709 13:09:52.391695 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.393164 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.397022 24523 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:52.424480 28660 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:52.425360 28956 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:52.396859 28960 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:52.426192 28823 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:52.427043 28928 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:52.427803 28758 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.429256 28940 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:52.427438 28806 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.356909 28784 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.445932 28940 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:52.446503 28940 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.446312 28784 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.455370 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:52.456955 28370 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:52.430927 28240 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:52.342473 28893 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.394750 28827 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.398995 28939 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.361979 28603 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:52.434973 28919 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:09:52.435602 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.385210 28658 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.436081 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.433290 28963 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:09:52.437741 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.458220 28889 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:52.442560 28958 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:52.502012 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 145481us
I20260709 13:09:52.445047 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.502948 24593 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:52.459020 28952 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:09:52.459415 28370 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:52.462082 28869 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:52.393682 28867 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:52.468729 28926 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.399s	user 0.000s	sys 0.002s
I20260709 13:09:52.488849 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:52.361665 28912 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.439810 28890 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.496613 24520 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:09:52.505299 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.448969 28784 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.517252 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.517287 24516 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:52.487489 28603 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:52.492659 28786 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48926 (request call id 1313) took 3673 ms. Trace:
I20260709 13:09:52.496563 28758 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.499042 28937 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.531234 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.545439 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.546766 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:52.496479 28806 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:52.537657 25210 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:52.538826 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.548013 24672 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:52.548144 28806 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.548923 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:52.550348 28957 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:09:52.550396 28806 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:52.551100 28810 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.551426 28603 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.552423 28917 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:52.552695 28603 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.552843 28917 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:52.553403 28917 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.559930 28810 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:52.559707 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:52.538074 28412 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.529712 28869 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:52.566350 28869 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.567587 28869 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.568553 24670 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:52.569816 28893 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.570513 28917 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.572305 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.545128 28890 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.573575 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.574265 24599 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:52.573923 28890 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.575147 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.575340 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:52.576109 28937 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:52.576189 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:52.576534 28937 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:52.576902 28937 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.577373 28917 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.525568 28958 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.580425 24598 raft_consensus.cc:2368] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:09:52.562155 28758 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.508073 28822 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:09:52.487404 28939 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.565583 28810 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:52.568462 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:52.603665 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.561436 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.604741 24593 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:09:52.540961 28786 rpcz_store.cc:276] 0709 13:09:48.794929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.795041 (+   112us) service_pool.cc:224] Handling call
0709 13:09:48.925502 (+130461us) ts_tablet_manager.cc:934] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
0709 13:09:51.129531 (+2204029us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:51.994996 (+865465us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.007343 (+ 12347us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:52.432323 (+424980us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:52.432760 (+   437us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.458499 (+ 25739us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:52.461508 (+  3009us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":34625,"tablet-copy.queue_time_us":112884,"thread_start_us":131840,"threads_started":2}
I20260709 13:09:52.581919 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.504192 28672 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:52.614454 24672 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
W20260709 13:09:52.602548 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 144092us
I20260709 13:09:52.610267 28917 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:52.616386 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43981.2us
I20260709 13:09:52.620924 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.623392 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:52.632680 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.632879 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.634430 24674 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:52.634462 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.639057 24519 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:52.603281 28890 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.639984 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:52.604328 28822 consensus_queue.cc:1243] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:52.642824 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.643306 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:52.565100 28940 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.648185 24669 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:52.645843 24521 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:52.646484 28961 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:52.622133 28917 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.620536 28810 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:52.658121 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.653436 28962 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:52.672421 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:52.673406 24521 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:52.654573 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:52.655675 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.659230 28966 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.661018 28834 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.662971 28846 raft_consensus.cc:993] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:09:52.667956 28932 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:52.674332 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:52.676599 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.632253 28963 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:52.689692 24521 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:09:52.641571 28784 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:09:52.657876 28917 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:52.649138 28874 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:52.689699 24516 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:52.691277 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.699249 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.699846 24665 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:52.698046 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:52.702451 24669 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:52.706238 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:52.710589 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:52.711167 24594 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.693564 28966 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:52.714630 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51353.4us
I20260709 13:09:52.638018 28370 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:52.704526 28846 raft_consensus.cc:1081] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:09:52.724563 28970 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.725103 28964 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:52.725716 28965 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:09:52.723232 28966 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.726222 28940 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.727196 28958 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:52.728806 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 961) took 1378 ms. Trace:
I20260709 13:09:52.696273 28962 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.703982 28932 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:52.721913 28658 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.748512 24671 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:52.747043 25215 rpcz_store.cc:276] 0709 13:09:51.350294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.351445 (+  1151us) service_pool.cc:224] Handling call
0709 13:09:51.354052 (+  2607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.370851 (+ 16799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.370889 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.376182 (+  5293us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.470271 (+1094089us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18004751e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:09:52.644663 (+174392us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:52.644701 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.644776 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.728542 (+ 83766us) raft_consensus.cc:1685] finished
0709 13:09:52.728560 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.728750 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16342,"raft.queue_time_us":47300,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":20280,"spinlock_wait_cycles":25736960,"thread_start_us":174223,"threads_started":1,"wal-append.queue_time_us":1308009}
I20260709 13:09:52.769675 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.769837 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.771771 25215 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:52.770656 24599 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:52.775213 24671 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:52.775629 24671 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:52.779453 24594 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:09:52.776346 24671 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.788128 24671 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.789405 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:52.796103 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.789361 28758 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:52.804041 24595 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:52.807752 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.803387 24671 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:09:52.820205 24671 pending_rounds.cc:85] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 9
I20260709 13:09:52.821338 24671 pending_rounds.cc:107] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:09:52.822340 24671 raft_consensus.cc:2889] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:52.862582 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.781880 28834 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:52.920851 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:52.930895 28975 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.935004 28975 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.931986 25215 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
W20260709 13:09:52.940099 28968 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:09:52.942075 24599 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:52.940127 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:52.944852 28978 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:09:52.931473 28912 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:52.934418 28943 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.628s	user 0.000s	sys 0.001s
I20260709 13:09:52.950549 28834 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:52.950923 28834 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:52.748958 28970 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.953377 28975 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:52.953604 28976 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:09:52.761529 28874 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:52.748610 28810 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.956132 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:52.957202 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:52.909431 28890 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:52.931365 28940 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.960623 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:52.961192 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 179518us
I20260709 13:09:52.956842 28769 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:09:52.802240 28932 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:52.971402 28981 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.180s	user 0.000s	sys 0.003s
I20260709 13:09:52.971547 28932 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:52.976099 28980 consensus_queue.cc:1175] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "148dc963cec64232ad3b248abad6f36d" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 6 } }
I20260709 13:09:52.965752 28940 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.986527 25215 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:09:52.987989 28937 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:52.989246 24669 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:53.001746 25219 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:53.003687 28970 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:53.009759 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.011898 25210 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13.
I20260709 13:09:53.009990 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2974) took 1620 ms. Trace:
I20260709 13:09:52.996299 28917 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:53.026382 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.021625 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.013823 25213 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
W20260709 13:09:53.027725 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:09:53.028122 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.003269 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.012580 24520 rpcz_store.cc:276] 0709 13:09:51.389779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.390018 (+   239us) service_pool.cc:224] Handling call
0709 13:09:51.390422 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.536778 (+1146356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.009734 (+472956us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003dc7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.009913 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543451904}
I20260709 13:09:53.028971 25219 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:53.021209 28921 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.379s	user 0.020s	sys 0.041s
I20260709 13:09:53.036064 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.036754 25210 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.037766 24593 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.036182 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:53.022169 28477 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:09:53.043223 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.043821 24519 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:53.044727 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:52.963352 28890 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.031023 28603 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:53.049039 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.052354 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.059134 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.060554 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 962) took 1710 ms. Trace:
I20260709 13:09:53.060984 25211 rpcz_store.cc:276] 0709 13:09:51.350616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.350757 (+   141us) service_pool.cc:224] Handling call
0709 13:09:51.359920 (+  9163us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:51.369901 (+  9981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.369930 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:51.370600 (+   670us) log.cc:844] Serialized 52 byte log entry
0709 13:09:51.498664 (+128064us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:51.498718 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.498809 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.020601 (+1521792us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:53.058708 (+ 38107us) raft_consensus.cc:1685] finished
0709 13:09:53.058730 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.060491 (+  1761us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16362,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":25051,"spinlock_wait_cycles":5409152,"thread_start_us":125597,"threads_started":1,"wal-append.queue_time_us":190426}
I20260709 13:09:53.063755 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.063997 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.064284 25211 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:52.966763 28834 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:53.065858 28986 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:09:53.066591 28987 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:53.041543 28966 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.071272 25219 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:53.057132 28603 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:53.077519 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 215629us
I20260709 13:09:53.088016 28603 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.088678 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.080121 25210 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:53.080185 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.092573 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.093029 25213 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:53.090283 28834 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.093233 24674 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:09:53.094192 25219 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:53.094728 25210 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:09:53.100397 25210 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:09:53.100503 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.084429 28987 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.102141 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:53.102003 28890 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:53.102787 24672 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.101423 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:53.103865 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.105645 28082 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:53.105911 28082 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.106091 28082 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:53.095574 28937 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:53.110576 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1535) took 1134 ms. Trace:
I20260709 13:09:53.111613 28082 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.112814 24598 rpcz_store.cc:276] 0709 13:09:51.970376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.981624 (+ 11248us) service_pool.cc:224] Handling call
0709 13:09:53.104642 (+1123018us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540033d454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:53.104758 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320864512}
I20260709 13:09:53.121433 28082 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:53.104130 28917 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.102874 28869 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:53.097292 28759 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:09:53.096529 28970 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:09:53.122354 28984 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.125759 28869 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.143978 28874 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:53.156137 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.157407 28992 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:53.167282 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1804) took 1125 ms. Trace:
I20260709 13:09:53.172108 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:53.172734 24674 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:53.161345 28874 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:53.174111 28874 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.175410 28874 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.177537 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1730) took 1132 ms. Trace:
I20260709 13:09:53.177950 24666 rpcz_store.cc:276] 0709 13:09:52.044760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.114142 (+ 69382us) service_pool.cc:224] Handling call
0709 13:09:52.114387 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.251136 (+136749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.251167 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.251223 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:52.251253 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.177285 (+926032us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400405454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.177333 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.177458 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314081024}
I20260709 13:09:53.167702 24600 rpcz_store.cc:276] 0709 13:09:52.041989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.364004 (+322015us) service_pool.cc:224] Handling call
0709 13:09:52.394921 (+ 30917us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:52.427079 (+ 32158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.427108 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:52.427705 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 13:09:52.613912 (+186207us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:52.635563 (+ 21651us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.165881 (+530318us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b1800346cc0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf 00007f17bbf60038
0709 13:09:53.166054 (+   173us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.166251 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.166320 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.167062 (+   742us) raft_consensus.cc:1685] finished
0709 13:09:53.167084 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.167227 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":752,"prepare.queue_time_us":22384,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2437,"raft.queue_time_us":63428,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":181,"spinlock_wait_cycles":35380864,"thread_start_us":185829,"threads_started":1,"wal-append.queue_time_us":230851}
I20260709 13:09:53.179780 24666 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:53.199731 24674 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:09:53.203161 28966 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:53.145056 28984 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.205534 28891 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:53.217952 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58502 (request call id 26) took 1351 ms. Trace:
I20260709 13:09:53.222410 28940 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:53.223285 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 913) took 1166 ms. Trace:
I20260709 13:09:53.230155 25214 rpcz_store.cc:276] 0709 13:09:51.858070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.858203 (+   133us) service_pool.cc:224] Handling call
0709 13:09:53.209246 (+1351043us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54004fa454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf40853 00007f17c0f0e60a 00007f17ba4947d4 00007f17ba494762 00007f17ba494691 00007f17ba49460c 00007f17ba4938c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:53.209342 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247276416}
I20260709 13:09:53.229233 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:53.232072 24523 rpcz_store.cc:276] 0709 13:09:52.056945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.194359 (+137414us) service_pool.cc:224] Handling call
0709 13:09:52.230166 (+ 35807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.399646 (+169480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.223077 (+823431us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54000dcad4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.223231 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378664832}
I20260709 13:09:53.231837 24672 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
W20260709 13:09:53.237602 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 68627.7us
I20260709 13:09:53.241786 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:53.229974 28891 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:53.243712 28660 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:53.247465 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 960) took 1897 ms. Trace:
I20260709 13:09:53.249043 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 908) took 1267 ms. Trace:
I20260709 13:09:53.249406 28984 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:53.250315 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1797) took 1571 ms. Trace:
I20260709 13:09:53.250732 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 888) took 1289 ms. Trace:
I20260709 13:09:53.239292 28970 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:53.252902 24524 rpcz_store.cc:276] 0709 13:09:51.981410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.055913 (+ 74503us) service_pool.cc:224] Handling call
0709 13:09:52.056247 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.212965 (+156718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.213011 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.213071 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:52.213168 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.248817 (+1035649us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540018a954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.248865 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.248984 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359825280}
I20260709 13:09:53.255002 24518 rpcz_store.cc:276] 0709 13:09:51.679258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.767787 (+ 88529us) service_pool.cc:224] Handling call
0709 13:09:51.783921 (+ 16134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.839021 (+ 55100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.250012 (+1410991us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b54000dc5d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.250244 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112102272}
I20260709 13:09:53.252835 25216 rpcz_store.cc:276] 0709 13:09:51.349916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.350791 (+   875us) service_pool.cc:224] Handling call
0709 13:09:51.351210 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.986258 (+635048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.247240 (+1260982us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54004ee3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.247412 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440153856}
I20260709 13:09:53.255053 24595 rpcz_store.cc:276] 0709 13:09:51.961384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.961524 (+   140us) service_pool.cc:224] Handling call
0709 13:09:51.961831 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.907834 (+946003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.250496 (+342662us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540025f3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.250643 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936491904}
I20260709 13:09:53.258246 28970 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:53.259104 28970 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.260665 28827 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:53.261080 28827 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:53.257021 28891 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.262492 28891 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.254623 28660 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.265367 28660 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:53.266670 28791 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.267234 28791 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.268870 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.270638 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.271797 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:53.273285 28082 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:53.273645 28082 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:53.274412 28082 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.275496 28082 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.266613 28786 tablet_copy_client.cc:806] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:53.277725 28786 tablet_copy_client.cc:670] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:53.270128 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.284574 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:53.286682 24639 leader_election.cc:400] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:09:53.287102 24639 leader_election.cc:403] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:53.291234 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:53.293216 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:53.296916 24597 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:53.290160 28966 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:09:53.295866 28890 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.324518 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.298256 28672 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:53.333500 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.330839 28890 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.332842 28791 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.339071 28890 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.320179 28917 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:09:53.361259 28913 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:53.362277 28913 consensus_queue.cc:1243] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:53.366986 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1816) took 1112 ms. Trace:
I20260709 13:09:53.367525 24593 rpcz_store.cc:276] 0709 13:09:52.254443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.742137 (+487694us) service_pool.cc:224] Handling call
0709 13:09:52.761945 (+ 19808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.041123 (+279178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.366715 (+325592us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540025e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.366914 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633917696}
I20260709 13:09:53.340157 28672 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:53.369802 28672 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.370182 28868 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:53.370744 28868 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:53.371739 28868 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.373860 28961 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:09:53.374138 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.374394 28961 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.394269 24668 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:53.393894 28660 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.396343 28660 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.397971 28868 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.416059 28939 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:53.418675 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2973) took 2047 ms. Trace:
I20260709 13:09:53.419171 24517 rpcz_store.cc:276] 0709 13:09:51.371246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.371562 (+   316us) service_pool.cc:224] Handling call
0709 13:09:51.392738 (+ 21176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.232556 (+839818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.418440 (+1185884us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400278dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:53.418617 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846097280}
I20260709 13:09:53.425979 28962 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:53.426635 28917 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.426797 28412 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.426688 28658 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:53.427275 28917 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.427973 28658 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.429545 28917 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.427299 28412 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.431910 28987 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:53.432858 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.434878 24519 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:53.436106 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.432888 28412 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:53.437722 28658 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.438628 28869 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:53.440820 28865 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:53.441212 28865 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:53.442008 28865 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.443181 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:53.444569 28479 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.445127 28869 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:53.445961 28869 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:53.447728 28869 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:53.448062 28869 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:53.449280 28874 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:53.449694 28874 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:53.450225 24671 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:53.450600 24671 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:53.450501 28874 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.451472 24671 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.451961 28874 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:53.452242 28479 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:53.452579 24671 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:53.444375 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 127796us
I20260709 13:09:53.460501 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.461735 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 949) took 1147 ms. Trace:
I20260709 13:09:53.462078 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:53.463174 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.462133 25218 rpcz_store.cc:276] 0709 13:09:52.314149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.347380 (+ 33231us) service_pool.cc:224] Handling call
0709 13:09:52.360322 (+ 12942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.361219 (+   897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.461518 (+1100299us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b54002e59d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:53.461670 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7654144}
I20260709 13:09:53.464591 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.443292 28865 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:53.466373 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 84565.9us
W20260709 13:09:53.467635 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.470357 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.503089 24591 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:53.481122 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:53.483247 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:53.504863 24665 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.491885 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.460412 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:53.496752 24524 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:53.505319 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.506102 24673 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 8: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:53.506361 24591 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
W20260709 13:09:53.509891 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.516635 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50658.1us
I20260709 13:09:53.517527 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.518630 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.519583 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.520454 24669 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:53.521626 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.514309 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.519567 24671 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:09:53.522576 24521 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:53.523046 24671 pending_rounds.cc:85] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 10
I20260709 13:09:53.523533 24671 pending_rounds.cc:107] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:09:53.524084 24671 raft_consensus.cc:2889] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:53.524461 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.525872 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.526465 24522 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
W20260709 13:09:53.526639 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 69137.7us
I20260709 13:09:53.527275 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:53.527539 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63038.7us
I20260709 13:09:53.528515 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.526631 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:53.531800 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:53.532732 24525 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:53.534116 24518 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:53.537684 24597 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:09:53.540894 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.531383 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:53.530145 24672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:52138
I20260709 13:09:53.545811 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:53.541743 24517 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 7.
I20260709 13:09:53.534946 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.549022 24673 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:53.553097 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.554330 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.555970 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:53.514290 28658 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.408789 28890 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:53.573071 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.525597 29005 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:53.524084 28240 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.578078 24665 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:09:53.599054 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.448782 28869 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.577836 24565 leader_election.cc:400] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13.
W20260709 13:09:53.555083 28825 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:09:53.598259 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:53.603451 25218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:09:53.605057 25218 raft_consensus.cc:606] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:53.605414 25218 raft_consensus.cc:614] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:53.602576 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.557653 29009 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:09:53.536345 28791 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.578683 28931 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.608637 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.573014 28964 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:53.578944 28796 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:53.640671 24519 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:53.575798 28758 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:09:53.572695 28917 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:53.551064 28907 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:53.575698 28658 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.614171 24523 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:53.616015 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.616324 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.604159 28966 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:09:53.617983 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.619360 28082 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:53.662777 28082 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:53.619710 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45883.7us
I20260709 13:09:53.664531 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:53.556951 28660 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:53.573824 28922 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.620527 28932 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:53.621577 28887 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:53.610813 29005 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.625173 28786 tablet_copy_client.cc:538] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:53.626220 28911 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:53.636719 24600 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:53.544423 28822 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:09:53.544615 28759 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:09:53.544461 28603 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:09:53.599956 28949 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:53.575734 28810 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 13:09:53.646536 29000 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:53.640703 28964 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:53.675282 28082 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.677217 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:53.648068 28796 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:53.554945 28940 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:09:53.680701 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.688740 24520 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:09:53.680848 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:53.689857 24523 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.689762 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:53.690435 24594 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:53.678331 28603 consensus_queue.cc:1243] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:53.693984 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:53.694548 24520 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:53.694016 24600 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:53.682379 28597 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:53.646438 28931 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.690639 28856 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:53.686934 28964 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.637343 28891 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:09:53.631153 28240 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.686848 24672 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.709046 24672 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.683909 28442 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:53.687131 28911 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:53.687296 28836 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:53.698951 28597 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:53.699525 28987 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.726922 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:53.702819 28856 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:53.758198 24520 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:09:53.701833 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:53.772652 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 70911.2us
W20260709 13:09:53.698459 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 142544us
I20260709 13:09:53.776091 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:53.777678 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.690491 28796 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.716065 28911 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:53.713792 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:53.783317 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 69630.8us
I20260709 13:09:53.682199 28660 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.724318 28442 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:53.679045 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 152488us
I20260709 13:09:53.725703 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1543) took 1160 ms. Trace:
I20260709 13:09:53.760650 28874 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:53.764808 28758 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:53.762178 24517 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:53.767258 24600 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:53.767264 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:53.693204 28949 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:53.803157 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1533) took 2288 ms. Trace:
I20260709 13:09:53.801256 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.806919 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.809713 28834 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:53.808668 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.813753 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.723723 29005 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:53.719142 28836 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:53.836295 28660 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.836545 28836 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.717295 24597 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:09:53.793406 24599 rpcz_store.cc:276] 0709 13:09:52.564966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.942752 (+377786us) service_pool.cc:224] Handling call
0709 13:09:52.961431 (+ 18679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.961763 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:53.440040 (+478277us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.699033 (+258993us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.702622 (+  3589us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.702747 (+   125us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:53.702778 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.702851 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.725552 (+ 22701us) raft_consensus.cc:1685] finished
0709 13:09:53.725565 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.725660 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":580866,"prepare.queue_time_us":494573,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":100605,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":3028,"thread_start_us":159725,"threads_started":1,"wal-append.queue_time_us":281742}
I20260709 13:09:53.787505 24518 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:53.788188 28082 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:53.839458 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.790828 25218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
W20260709 13:09:53.704027 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 129246us
I20260709 13:09:53.840660 25218 raft_consensus.cc:606] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:53.841466 25218 raft_consensus.cc:614] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:53.841679 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.780076 28913 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:53.792310 28980 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.789937 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:53.752471 24672 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.809976 28856 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:53.819434 28759 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.805891 28874 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.810954 28890 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.822113 28868 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:53.822911 29011 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:53.823752 29015 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:53.826822 28898 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:53.829473 29010 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:09:53.831141 29017 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:53.781488 28907 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:09:53.847289 28660 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:53.834688 28240 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:53.834806 28911 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.791260 28940 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:53.781339 28987 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:53.875222 28759 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.843849 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:53.803848 24596 rpcz_store.cc:276] 0709 13:09:51.508095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.508256 (+   161us) service_pool.cc:224] Handling call
0709 13:09:51.535718 (+ 27462us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:51.713102 (+177384us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:51.783704 (+ 70602us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.249898 (+1466194us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b18003958c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a 00007f17bbf50a2a
0709 13:09:53.494677 (+244779us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:53.528756 (+ 34079us) log.cc:844] Serialized 52 byte log entry
0709 13:09:53.529037 (+   281us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:53.708145 (+179108us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.708394 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.708484 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.795729 (+ 87245us) raft_consensus.cc:1685] finished
0709 13:09:53.795762 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.795930 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59162,"prepare.queue_time_us":148505,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":9276,"raft.queue_time_us":21212,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":10267,"spinlock_wait_cycles":12093696,"thread_start_us":565959,"threads_started":3,"wal-append.queue_time_us":1590258}
W20260709 13:09:53.887630 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 43857.2us
W20260709 13:09:53.854077 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 64264.7us
W20260709 13:09:53.860574 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.875844 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 91590us
W20260709 13:09:53.863036 29000 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:53.863117 28825 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:53.806353 28961 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.853435 28913 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.877933 28658 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.847589 28939 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:53.889220 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:53.877663 28836 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.832378 28949 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.890528 28442 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.887420 28769 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:53.924799 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 94775us
I20260709 13:09:53.853652 29005 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:09:53.894634 28412 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:09:53.892851 28890 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:53.902588 28970 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:53.903421 28430 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.912716 28913 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.906180 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.937709 24669 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:53.877867 28898 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:09:53.910920 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 143723us
I20260709 13:09:53.883090 28856 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.806093 28597 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.918095 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.807688 28758 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.893813 28987 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:53.929072 28890 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.905349 28931 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:53.932054 28796 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:53.935119 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45983.3us
I20260709 13:09:53.930727 28970 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:53.937304 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:53.940356 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.926165 29018 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:53.954566 28898 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.953575 28479 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.926147 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:53.891037 28825 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.964457 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.979157 24666 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:53.964502 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:53.979779 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53709.8us
I20260709 13:09:53.957780 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c35412a4ad4729862392b77295639d"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:54954
I20260709 13:09:53.979810 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.980806 24517 raft_consensus.cc:606] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:53.981143 24517 raft_consensus.cc:614] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:53.981642 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.982489 25210 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:53.969852 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:53.974035 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.983644 25216 raft_consensus.cc:2376] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11. Re-sending same reply.
I20260709 13:09:53.974311 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.984449 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.893348 28810 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:09:53.925562 28939 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:53.928505 28759 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:53.957068 29017 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:53.977191 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.986217 25210 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:53.989022 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:53.969458 28597 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.969584 28890 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:53.997467 25214 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:54.001322 25216 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:09:53.990865 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:54.033648 24525 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:53.948974 28430 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.032580 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:54.040999 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:54.055861 25213 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.974833 28979 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:54.055804 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:54.080116 25219 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:09:53.977937 28240 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:53.976369 28937 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:53.972922 28603 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:54.078035 25212 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:53.979061 29018 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:53.991959 28825 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:54.083199 24668 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:09:54.114992 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 150594us
I20260709 13:09:54.128836 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:54.129098 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.129920 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:54.116271 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.119161 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:54.127511 25215 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:09:54.035826 29033 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:54.141584 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.145010 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:54.148727 25212 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:54.146349 24517 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:54.151333 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:54.152143 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.153062 24524 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:54.150461 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:53.992944 28479 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.156822 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:54.102284 29015 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 13:09:54.226106 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 96236.7us
I20260709 13:09:54.182358 25213 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:09:54.256642 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:54.158037 24520 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:54.208215 25218 raft_consensus.cc:2410] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:09:54.262624 24523 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.005s
I20260709 13:09:54.263159 24523 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
W20260709 13:09:54.232257 29024 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:09:54.265262 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:54.279412 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.236109 28964 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.002s
I20260709 13:09:54.145190 28874 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:54.259260 28865 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.000s
I20260709 13:09:54.152094 29031 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:54.239178 28987 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:54.302733 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.294562 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:54.115747 28937 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:54.176645 28240 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:54.144724 28940 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.229693 28949 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.153859 28907 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.147s
I20260709 13:09:54.243028 28961 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.308597 25212 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:54.127357 28603 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.296764 29015 consensus_queue.cc:1243] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:54.112764 28979 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.311851 28937 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:54.305933 25211 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:54.347780 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:54.360219 24598 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:54.178872 28962 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.130s
W20260709 13:09:54.294823 29023 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
W20260709 13:09:54.321511 29036 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:09:54.322053 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:54.307184 28758 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.346319 28796 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:54.361589 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:54.241953 29018 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.310202 29031 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.366113 28479 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:54.216958 29017 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.349726 28240 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.369983 28939 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.370430 28603 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:54.150978 28970 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:54.414132 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.371975 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 187656us
I20260709 13:09:54.373406 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:54.387967 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:54.388310 25211 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:54.389112 24593 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:54.360333 28907 consensus_queue.cc:1243] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:09:54.398556 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:54.399931 24598 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:09:54.301337 28964 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.404139 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:54.428952 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 172399us
W20260709 13:09:54.429730 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.352802 28949 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.422281 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:54.428452 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.430541 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:54.432443 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.437891 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:54.443744 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 324679us
I20260709 13:09:54.409242 28240 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.450428 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.446411 25211 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:54.390803 28937 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.459096 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.460843 24596 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:54.465548 24673 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:54.452812 24593 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:54.451891 28961 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.416445 29041 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:54.472291 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.020s
W20260709 13:09:54.473274 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.000s	sys 0.020s
W20260709 13:09:54.474200 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 521003us
W20260709 13:09:54.474351 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 43891.8us
I20260709 13:09:54.455160 28796 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:54.445201 29053 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:54.478499 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:54.435331 29042 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:54.479207 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:54.488763 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.490871 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.491719 24520 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:54.491993 24517 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:54.472905 29035 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:54.442919 29039 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:09:54.488047 29038 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:09:54.484918 28796 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:54.496480 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.491165 24524 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 7.
I20260709 13:09:54.497876 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:54.502113 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 64311.7us
I20260709 13:09:54.526551 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.496179 28961 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:54.506641 28603 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:54.488898 29034 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:09:54.486486 28906 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.480913 29056 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:54.507850 24523 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:54.505838 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:54.496474 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 457638us
I20260709 13:09:54.486721 28758 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:54.529109 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:54.543615 24670 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:54.519165 29030 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:09:54.519773 29058 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:54.532959 24524 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:54.534905 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.532898 29059 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:54.553189 29059 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:54.538800 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 79799.3us
I20260709 13:09:54.554088 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:54.539431 24596 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:54.533882 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:54.529284 24666 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:54.545296 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:54.555430 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:54.550990 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 105211us
I20260709 13:09:54.547174 24594 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:54.507735 28937 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:54.549041 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:54.553591 29059 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.561038 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.565809 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.529973 28796 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.547173 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:54.534978 29048 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:09:54.559957 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.541642 29034 consensus_queue.cc:1243] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:54.549934 24665 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:54.562913 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:54.570690 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:54.552569 29058 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:54.564133 29051 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:09:54.489948 29053 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.543586 28907 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:54.522696 29035 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.536603 28961 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.538836 28603 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:54.618337 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48580us
I20260709 13:09:54.563782 28979 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.576306 29067 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:54.581522 28939 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:09:54.672746 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 118778us
I20260709 13:09:54.673758 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:54.661362 29045 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:54.582087 28937 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.573397 29064 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:54.614820 29034 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.677703 29045 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.615887 29058 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:54.661576 29046 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:54.690212 28786 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
W20260709 13:09:54.705137 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 150482us
I20260709 13:09:54.710484 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.696929 29067 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.736039 29068 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.736340 29067 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.619161 29050 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:09:54.661441 28758 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:54.738438 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.697058 29063 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:54.741705 29063 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:54.742158 29063 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:54.704291 28979 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:54.736685 29068 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.741168 29071 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:54.707180 28964 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.695751 28937 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.706465 29031 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:54.749143 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:54.735098 28906 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.708654 29066 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:54.754549 28937 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.755970 29045 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:54.711066 29049 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:09:54.760766 29065 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:09:54.761164 29057 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:09:54.680177 29070 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:09:54.744222 28979 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:54.765034 28597 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.684s	user 0.004s	sys 0.005s
I20260709 13:09:54.742599 29079 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:54.752003 28758 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:09:54.807942 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:09:54.809638 28856 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.849s	user 0.012s	sys 0.000s
I20260709 13:09:54.811298 28442 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:54.811916 29079 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.809665 28827 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.812496 28931 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.813771 28603 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:54.815269 28836 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.894s	user 0.010s	sys 0.000s
W20260709 13:09:54.817204 28913 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.857s	user 0.010s	sys 0.000s
I20260709 13:09:54.832201 28827 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.832119 28913 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:54.833253 29078 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:09:54.798454 29071 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.829623 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:54.834728 25219 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:54.819905 28825 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.001s
I20260709 13:09:54.807273 28937 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.826822 29048 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:09:54.773128 28906 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.839888 28913 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:54.840029 29062 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:54.822285 28442 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:54.838064 29054 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:09:54.711440 29046 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.834201 29056 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:54.835580 28758 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:54.859103 24672 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.834378 28856 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:09:54.852883 28898 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.863s	user 0.009s	sys 0.002s
I20260709 13:09:54.862318 29071 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:54.824095 28979 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.864876 29058 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.834404 28931 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.823056 29069 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.873343 28898 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.840780 28825 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.876019 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52138 (request call id 953) took 1418 ms. Trace:
I20260709 13:09:54.875443 29079 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:54.873651 29035 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.851709 28937 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.882002 24520 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:09:54.879120 29071 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.898108 24672 rpcz_store.cc:276] 0709 13:09:53.454132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.516397 (+ 62265us) service_pool.cc:224] Handling call
0709 13:09:54.857901 (+1341504us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540026b6d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf3da3d 00007f17c0f0dcd0 00007f17ba492254 00007f17ba4921e2 00007f17ba492111 00007f17ba49208c 00007f17ba491342 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:54.872871 (+ 14970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323015040}
I20260709 13:09:54.875574 28961 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.867774 28442 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.906180 24595 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:54.910279 28240 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.913159 29076 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.913163 24669 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:54.914736 25216 raft_consensus.cc:2368] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9.
I20260709 13:09:54.896301 29056 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:54.902720 29053 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:54.919155 28796 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.906402 29035 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:54.884405 28856 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:09:54.906301 29071 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.925892 28796 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.926733 28825 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:54.927625 28906 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:54.927642 28970 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:54.929190 29067 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:54.930150 28937 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:54.933353 29068 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:54.916954 29056 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:54.917708 28240 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:54.913700 29076 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.939024 28660 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.943441 28890 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.841s	user 0.006s	sys 0.005s
I20260709 13:09:54.936846 29046 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:54.960546 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.935782 29035 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.902114 29069 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.932955 29063 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.956333 28937 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:54.970391 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:54.981739 24597 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:54.984177 28917 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:54.984592 28917 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:54.957458 28660 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.985420 28917 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:54.986617 28917 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.987141 28660 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:54.978834 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.987447 24522 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:54.978135 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.957612 28890 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.979667 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:54.980217 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1756) took 1017 ms. Trace:
I20260709 13:09:54.990653 24523 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:54.981498 28937 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:54.993290 28082 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:54.998204 24667 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:09:54.999586 24667 pending_rounds.cc:85] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 8
I20260709 13:09:54.999897 24667 pending_rounds.cc:107] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:55.000254 24667 raft_consensus.cc:2889] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:54.990787 24669 rpcz_store.cc:276] 0709 13:09:53.963088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.963218 (+   130us) service_pool.cc:224] Handling call
0709 13:09:53.977166 (+ 13948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.917853 (+940687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.977040 (+ 59187us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54000497d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:54.980157 (+  3117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140288384}
I20260709 13:09:55.002511 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:09:55.005659 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 335865us
I20260709 13:09:55.011209 28082 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:55.013833 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:55.000975 28940 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.015667 28082 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.016743 28082 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.990614 29056 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.018955 29056 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:55.020299 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 346586us
I20260709 13:09:55.003283 28822 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:55.017594 28082 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.015121 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:09:54.999398 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 420716us
W20260709 13:09:55.026214 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.026489 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:55.030505 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.010924 28890 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.039323 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.040234 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.040516 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.041370 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:55.041899 24597 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.041740 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:55.042311 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:55.042846 24598 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:55.043376 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.050356 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.051107 25214 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:09:55.052865 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.054399 25212 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:09:55.056236 29041 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:55.057456 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:55.058255 24670 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.057780 24672 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:09:55.038376 29061 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:55.053596 25214 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:55.060966 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:55.061589 25212 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.063504 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.064445 29076 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.013375 29028 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:09:55.070055 29028 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:55.070432 29028 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:55.072640 24670 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:55.032608 29058 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.033177 28240 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.034081 28961 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:55.036146 28931 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.080185 24597 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:55.058768 28984 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.083372 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3083) took 1239 ms. Trace:
I20260709 13:09:55.083788 24673 rpcz_store.cc:276] 0709 13:09:53.843831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.844521 (+   690us) service_pool.cc:224] Handling call
0709 13:09:53.844860 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.465996 (+621136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.083141 (+617145us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b5400046fd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:55.083313 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427042560}
I20260709 13:09:55.085505 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:55.086361 28769 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.092522 28430 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.093487 28868 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:55.093910 28868 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:55.094820 28868 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.095873 28868 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:55.086717 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:55.098275 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:55.099647 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:55.100821 29042 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:55.101186 29042 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:55.101656 29042 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.063189 29061 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.058975 29079 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:55.102756 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:55.021461 28940 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.061522 29047 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:55.109157 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:55.104615 24673 raft_consensus.cc:2393] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:55.105212 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:55.107447 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:55.034814 28822 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.111557 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:55.071197 29028 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.114920 24591 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:55.116515 24591 pending_rounds.cc:85] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 9
I20260709 13:09:55.116725 24591 pending_rounds.cc:107] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:55.117000 24591 raft_consensus.cc:2889] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:55.118656 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:55.119235 24665 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.119804 28082 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:55.121398 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.122387 24518 raft_consensus.cc:2410] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:55.107847 29061 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.123677 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.101822 29025 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:55.124854 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.125064 25212 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:55.142248 24598 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:55.142829 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:55.123250 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 281310us
I20260709 13:09:55.126621 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.133754 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:55.135767 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:55.147027 24524 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:55.148022 24671 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:55.148355 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:55.081151 28240 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.148398 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.160983 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:09:55.152163 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 487324us
I20260709 13:09:55.119465 28931 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.149582 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:55.161584 25210 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:55.148051 24665 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:55.163077 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:55.176651 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.178156 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.103922 28961 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:55.119437 29045 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:55.179772 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:55.180852 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:55.181119 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:55.181311 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:55.181429 24524 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.182797 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:55.184731 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:55.056923 29041 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:55.186410 28082 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.186553 24665 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:55.188143 29041 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:55.140551 28827 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:55.138134 28932 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.146998 29028 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.111898 29079 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.105003 28984 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.213033 24673 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
W20260709 13:09:55.194855 24565 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.729s (SENT) [suppressed 33 similar messages]
I20260709 13:09:55.196868 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:55.197786 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.197042 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.192816 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:55.179540 29068 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.194461 29025 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.140774 29017 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:09:55.223966 24518 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:55.230901 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:55.231788 24518 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:55.232666 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.195361 28796 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:55.195158 29018 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.195142 28672 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:55.234308 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 96957.1us
I20260709 13:09:55.145344 28858 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:09:55.240062 29080 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:55.236999 29068 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.240566 29088 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.241016 29094 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:55.206858 29035 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:55.206607 29050 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:55.212671 28937 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.197171 29076 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:09:55.221010 28939 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.295403 29072 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:09:55.296204 29089 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:55.297539 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.115597 29047 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:55.269527 28442 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:09:55.302763 29069 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.303273 29083 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:55.210758 28932 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.469561 28932 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.276167 28869 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:55.305778 28796 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:55.238073 28909 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:09:55.195173 28931 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.234553 29058 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:55.228339 29025 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:55.478168 29025 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.198308 29045 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:55.319092 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.270825 29063 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.429455 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1816) took 1300 ms. Trace:
I20260709 13:09:55.395144 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1747) took 1912 ms. Trace:
I20260709 13:09:55.484750 24667 rpcz_store.cc:276] 0709 13:09:53.482352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.485161 (+  2809us) service_pool.cc:224] Handling call
0709 13:09:53.498259 (+ 13098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.000802 (+1502543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.394864 (+394062us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54002b5554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:55.395072 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3433130752}
I20260709 13:09:55.484596 24521 rpcz_store.cc:276] 0709 13:09:54.128810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.128920 (+   110us) service_pool.cc:224] Handling call
0709 13:09:54.129237 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.129543 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.129568 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.129954 (+   386us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.817330 (+687376us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b180031f420. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:09:55.118905 (+301575us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:55.118942 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.119003 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.429153 (+310150us) raft_consensus.cc:1685] finished
0709 13:09:55.429172 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.429382 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9818,"raft.queue_time_us":13629,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":25054,"spinlock_wait_cycles":7270656,"thread_start_us":301405,"threads_started":1,"wal-append.queue_time_us":1058620}
I20260709 13:09:55.486965 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:55.487282 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:55.416426 29037 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.334s	user 0.002s	sys 0.000s
I20260709 13:09:55.233436 28479 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:09:55.194782 29086 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.129s
I20260709 13:09:55.294915 29056 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.309899 29017 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.311882 28769 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:55.321916 28987 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.432367 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.416352 28913 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:55.426625 29029 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.355s	user 0.003s	sys 0.002s
I20260709 13:09:55.418208 28940 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:55.514504 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.415244 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:55.515353 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 100191us
I20260709 13:09:55.436003 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:55.421514 28856 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.454182 28939 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:55.209854 25212 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:55.463943 28240 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.452634 28822 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.464248 28984 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.464856 28979 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:55.524760 25210 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:55.465799 28442 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:55.447959 29094 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:55.444192 29088 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.489117 29089 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:55.534866 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.491185 28796 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.494055 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.498425 28911 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.498885 28931 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.501282 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:55.503651 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:55.510871 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:55.517589 24518 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:55.488055 29079 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:55.542980 24673 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:55.520406 28873 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.524187 29081 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:55.528268 24520 raft_consensus.cc:1217] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Deduplicated request from leader. Original: 6.7->[8.8-12.9]   Dedup: 8.8->[12.9-12.9]
I20260709 13:09:55.490876 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:55.551287 24520 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: [8.8-12.9]
I20260709 13:09:55.535847 24596 raft_consensus.cc:2410] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:09:55.551491 24521 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.527204 28442 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:55.536396 25217 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:55.534533 29089 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.520823 28987 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:55.546942 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:55.544817 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.550580 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:55.558555 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:55.512714 28769 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:55.564693 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:09:55.553421 24522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.029s	sys 0.050s
I20260709 13:09:55.540019 29047 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:55.562383 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.565307 24667 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.568285 25217 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:55.522701 28856 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:55.566174 24522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.029s	sys 0.050s
I20260709 13:09:55.519893 29056 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:55.569845 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:55.559643 28922 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.035s	sys 0.049s
I20260709 13:09:55.519726 29017 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.560892 29042 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:55.563812 29071 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.630s	user 0.012s	sys 0.000s
I20260709 13:09:55.553507 28822 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:55.556617 29081 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:55.564507 28940 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.580127 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.567638 28964 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:55.553731 28873 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:55.576701 29059 consensus_meta.cc:287] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.997s	user 0.013s	sys 0.000s
W20260709 13:09:55.584204 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 389349us
I20260709 13:09:55.594429 24516 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:55.577581 28939 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:55.575440 29061 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:55.620652 24524 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:55.620810 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:55.623402 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.578842 28868 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:09:55.582969 28922 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.035s	sys 0.049s
I20260709 13:09:55.628530 24594 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:55.612776 29081 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.608007 28603 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:55.627276 29079 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:55.636894 24598 raft_consensus.cc:2368] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12.
I20260709 13:09:55.622478 28822 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:09:55.631379 29096 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:55.643525 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.643788 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:55.636544 29083 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:55.646131 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.628240 28964 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:55.649884 25210 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:55.655951 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:55.609565 29071 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.660759 24667 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:55.614606 29025 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:55.664683 25218 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.047s	sys 0.052s
I20260709 13:09:55.609340 28769 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:55.651292 29082 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:55.670639 24523 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:09:55.672412 25218 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.048s	sys 0.052s
I20260709 13:09:55.654175 29072 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:55.614524 28442 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.651957 29045 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.694773 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.651171 29083 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:55.638713 29079 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.659771 29073 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:55.700927 24596 raft_consensus.cc:2410] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:55.635098 28868 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.700112 25210 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:55.650403 28603 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.628403 29059 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.710485 24521 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
I20260709 13:09:55.693718 29072 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.694412 28479 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.674147 29082 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:55.717870 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.582283 29094 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.701647 28769 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:55.718542 28822 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.721411 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:55.725502 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 2982) took 2189 ms. Trace:
I20260709 13:09:55.737820 25213 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:09:55.740870 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:55.737506 24525 rpcz_store.cc:276] 0709 13:09:53.536238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.536419 (+   181us) service_pool.cc:224] Handling call
0709 13:09:53.577000 (+ 40581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.076764 (+499764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.725190 (+1648426us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54000bb3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:55.725407 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049560320}
I20260709 13:09:55.730320 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:55.746857 24637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.038s
W20260709 13:09:55.747184 24637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.038s
I20260709 13:09:55.727044 29068 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:55.737262 28442 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.720418 29072 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.723855 29082 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.744735 28856 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.769722 29071 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.772547 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.774770 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.723757 28479 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.778052 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:55.778851 24592 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 9: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:55.779116 28949 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.779817 24592 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:55.785542 25210 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:09:55.768738 29083 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:55.792332 29083 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.796497 28940 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:55.798928 29090 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.490s	user 0.003s	sys 0.000s
I20260709 13:09:55.802284 25210 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:55.803357 25215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1373) took 1830 ms (client timeout 1729 ms). Trace:
W20260709 13:09:55.818105 25215 rpcz_store.cc:269] 0709 13:09:53.973275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.973436 (+   161us) service_pool.cc:224] Handling call
0709 13:09:55.803163 (+1829727us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b54002e59d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:55.803290 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110419328}
I20260709 13:09:55.768071 28868 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.805807 25211 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:09:55.768604 29056 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.807778 29042 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.779552 29088 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.810205 29025 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:55.810737 29089 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.746448 28964 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:55.859339 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.008s	sys 0.064s
W20260709 13:09:55.859767 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.008s	sys 0.064s
W20260709 13:09:55.820123 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.822584 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.824720 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:55.836151 25211 pending_rounds.cc:85] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 9
I20260709 13:09:55.860816 25210 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:55.861238 25211 pending_rounds.cc:107] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:09:55.861644 25211 raft_consensus.cc:2889] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:55.809497 28479 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:55.782276 29017 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:55.871156 24638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.006s	sys 0.027s
I20260709 13:09:55.802721 29061 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:55.816598 29064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.003s	sys 0.010s
I20260709 13:09:55.863225 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:55.853579 29101 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:09:55.870520 24672 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:55.853996 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:55.910650 24666 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.852180 28940 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.913538 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.009s	sys 0.013s
W20260709 13:09:55.907733 24638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.007s	sys 0.028s
W20260709 13:09:55.942394 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 746569us
I20260709 13:09:55.867187 28922 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.862850 29046 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.976469 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.976712 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:56.010061 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.010370 24522 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:55.976775 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:09:55.905124 28827 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.009s	sys 0.023s
I20260709 13:09:55.862082 28949 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.867478 28909 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:55.988142 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:55.909904 29064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.003s	sys 0.010s
I20260709 13:09:55.997272 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:55.987044 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:56.001776 24524 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:56.010654 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:56.015913 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:56.036309 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1831) took 1690 ms. Trace:
I20260709 13:09:56.018509 24666 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:56.041810 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:56.031370 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:56.032812 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:56.036435 24521 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 6.
I20260709 13:09:56.019301 28658 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:09:56.043718 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:56.033973 24525 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:56.042385 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:55.999956 28922 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.987581 28479 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:55.987790 29073 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:56.063372 29073 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:56.019953 28827 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.010s	sys 0.024s
I20260709 13:09:56.069351 28827 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:56.069428 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:56.070272 28827 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:56.053380 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:56.072203 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:56.072759 24595 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:09:56.046362 29042 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:56.036118 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:56.073819 29042 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.054710 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:56.075871 29042 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:56.040154 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:56.045516 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:56.078130 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:56.079221 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:56.079777 24666 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:56.080529 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:56.039901 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:56.056567 25182 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:56.082712 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:56.083647 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:56.073572 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:56.049373 24522 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:09:56.041810 24599 rpcz_store.cc:276] 0709 13:09:54.346305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.346455 (+   150us) service_pool.cc:224] Handling call
0709 13:09:54.351017 (+  4562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.351252 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:54.360982 (+  9730us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.434797 (+1073815us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180038de20. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a 00007f17bbf50a2a
0709 13:09:56.035989 (+601192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.036040 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:56.036084 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.036150 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.036257 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128422,"prepare.queue_time_us":9561,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":129324,"spinlock_wait_cycles":36873216,"thread_start_us":469435,"threads_started":1}
I20260709 13:09:56.062755 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:55.999953 28940 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.091693 24595 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:09:56.025851 29071 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:56.050405 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:56.076862 24672 raft_consensus.cc:2376] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11. Re-sending same reply.
I20260709 13:09:56.040711 24591 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:09:56.085234 24521 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:09:56.061722 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1383) took 1010 ms. Trace:
W20260709 13:09:56.087313 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.073161 29079 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:56.095687 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:56.036088 29034 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:56.084415 29047 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.173725 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:56.177325 28370 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.014019 28856 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:09:56.179248 29059 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:56.168839 25219 rpcz_store.cc:276] 0709 13:09:55.051304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.052044 (+   740us) service_pool.cc:224] Handling call
0709 13:09:55.065390 (+ 13346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.065688 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.065717 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.066161 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.212005 (+145844us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:55.212046 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.212112 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.057091 (+844979us) raft_consensus.cc:1685] finished
0709 13:09:56.061502 (+  4411us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.061666 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4182,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":145508,"threads_started":1,"wal-append.queue_time_us":546367}
I20260709 13:09:56.097772 29061 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:56.181608 29060 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:56.182060 28868 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:56.182631 29088 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.211963 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:56.212672 24672 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:56.044445 29110 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:56.183494 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 99924.7us
I20260709 13:09:56.186667 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:56.121758 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:56.088898 29107 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:56.191926 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 141588us
I20260709 13:09:56.039952 29067 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:56.194383 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 98807.7us
I20260709 13:09:56.056546 28922 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.197520 29068 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.026202 29046 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:56.183032 28979 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.000s
I20260709 13:09:56.098665 28658 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.187361 29047 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:56.050151 28917 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:56.187551 28874 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.191354 24591 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:56.234933 24639 leader_election.cc:400] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:09:56.393922 24639 leader_election.cc:403] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:56.394532 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 169175us
I20260709 13:09:56.395526 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:56.236063 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:56.235076 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:56.203159 29061 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.238612 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:56.199373 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1382) took 1148 ms. Trace:
I20260709 13:09:56.403976 25218 rpcz_store.cc:276] 0709 13:09:55.050969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.052013 (+  1044us) service_pool.cc:224] Handling call
0709 13:09:55.065212 (+ 13199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.065405 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:55.681764 (+616359us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.198696 (+516932us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.198972 (+   276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.199031 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:56.199087 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.199168 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.199321 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369375,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":81,"raft.queue_time_us":98333,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":10227,"spinlock_wait_cycles":8835968,"thread_start_us":1017274,"threads_started":2}
I20260709 13:09:56.040367 28949 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:56.366345 29082 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
I20260709 13:09:56.207588 28868 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.429847 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:56.093482 28479 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.435179 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:09:56.364187 28796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.010s	sys 0.034s
I20260709 13:09:56.412963 29061 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:56.413106 29064 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
W20260709 13:09:56.402935 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 166979us
I20260709 13:09:56.045143 28909 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:56.197989 29071 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.388882 29047 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.435655 28898 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:56.396920 28917 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:56.189994 29034 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.226056 29088 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.449627 29111 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:56.429962 29083 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.431903 29068 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:56.462852 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:56.505380 25218 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:09:56.432812 28868 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:56.237277 29110 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.475063 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:56.516690 25219 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.432603 28874 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:56.201068 29025 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:56.239928 29107 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:56.446593 28796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.010s	sys 0.034s
I20260709 13:09:56.485764 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:56.518993 24672 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:56.412703 28658 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:09:56.391031 29059 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:56.434324 29082 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.458124 29115 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:56.370970 29072 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.604s	user 0.004s	sys 0.005s
W20260709 13:09:56.514959 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 651020us
I20260709 13:09:56.537739 24520 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:09:56.538709 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:56.539520 25218 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:56.653939 29121 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 13:09:56.655179 24565 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.655737 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 116666us
I20260709 13:09:56.656543 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:56.660636 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:56.504144 29083 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:56.540894 24667 raft_consensus.cc:2955] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:09:56.521876 28874 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.532150 29068 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:56.523572 29025 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:09:56.706391 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.016s	sys 0.018s
W20260709 13:09:56.706899 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.016s	sys 0.018s
W20260709 13:09:56.707424 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 505357us
I20260709 13:09:56.708287 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:56.613969 28940 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:56.610733 29116 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.675591 28979 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:56.703375 29123 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:09:56.676296 29083 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.702582 28874 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:56.612694 29059 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.507803 29111 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:56.671605 29064 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:56.712572 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:56.749050 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.788749 24490 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.004s	sys 0.015s
W20260709 13:09:56.789268 24490 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.004s	sys 0.015s
W20260709 13:09:56.789641 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 625846us
W20260709 13:09:56.751256 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.017s	sys 0.032s
I20260709 13:09:56.705950 29025 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.709851 28822 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:56.948532 28911 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.401s	user 0.013s	sys 0.001s
I20260709 13:09:56.849870 28949 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:56.869824 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:56.996107 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1396) took 1131 ms. Trace:
I20260709 13:09:56.996585 25210 rpcz_store.cc:276] 0709 13:09:55.864270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.882844 (+ 18574us) service_pool.cc:224] Handling call
0709 13:09:56.869684 (+986840us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:09:56.996023 (+126339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29480704}
I20260709 13:09:56.872064 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42304 (request call id 5) took 2346 ms. Trace:
I20260709 13:09:56.764112 29126 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:09:56.833384 25218 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:57.000505 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1001) took 1008 ms. Trace:
I20260709 13:09:56.957242 29082 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:56.992424 29117 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.587s	user 0.006s	sys 0.004s
I20260709 13:09:56.932230 29068 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:57.013975 29129 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:57.014328 29111 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:56.999933 28822 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.018100 28822 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.016350 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:57.027288 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1004) took 1015 ms. Trace:
I20260709 13:09:57.027786 25210 rpcz_store.cc:276] 0709 13:09:56.011610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.003826 (+992216us) service_pool.cc:224] Handling call
0709 13:09:57.027189 (+ 23363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.971539 29085 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.930222 29034 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:56.927762 28917 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:56.926476 28909 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:56.959158 28827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.095s	sys 0.142s
I20260709 13:09:57.036957 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 911) took 1616 ms. Trace:
I20260709 13:09:57.037396 24592 rpcz_store.cc:276] 0709 13:09:55.420268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.789946 (+369678us) service_pool.cc:224] Handling call
0709 13:09:55.790291 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.801111 (+ 10820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.801140 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:55.802085 (+   945us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.204137 (+402052us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:56.204194 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.204302 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.036733 (+832431us) raft_consensus.cc:1685] finished
0709 13:09:57.036756 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.036897 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10436,"raft.queue_time_us":10988,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":12923,"thread_start_us":391090,"threads_started":1,"wal-append.queue_time_us":1130070}
I20260709 13:09:57.039220 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:57.045531 29110 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.048717 28874 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.051573 28874 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:56.827975 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:09:56.868598 29118 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 13:09:56.768230 28898 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:56.665261 29072 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:56.966961 24596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 912) took 1537 ms (client timeout 1755 ms). Trace:
I20260709 13:09:56.750411 28796 raft_consensus.cc:2764] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:09:56.794319 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.017s	sys 0.032s
W20260709 13:09:57.053206 28827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.096s	sys 0.143s
I20260709 13:09:56.814466 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:56.923183 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.003s	sys 0.027s
W20260709 13:09:56.969823 24673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.008s
I20260709 13:09:56.970273 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1827) took 1831 ms. Trace:
I20260709 13:09:56.970575 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:57.061342 24673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.000s	sys 0.008s
W20260709 13:09:57.061250 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.010s	sys 0.030s
I20260709 13:09:57.061395 24516 rpcz_store.cc:276] 0709 13:09:55.129969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.493744 (+363775us) service_pool.cc:224] Handling call
0709 13:09:56.961072 (+1467328us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b54003dccd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:56.961257 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133780352}
W20260709 13:09:57.062287 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 823695us
W20260709 13:09:57.064021 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 249627us
I20260709 13:09:56.824676 25219 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:57.064882 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1000) took 1073 ms. Trace:
I20260709 13:09:56.955751 29071 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.000954 25218 rpcz_store.cc:276] 0709 13:09:55.991828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.506243 (+514415us) service_pool.cc:224] Handling call
0709 13:09:57.000427 (+494184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.613689 29115 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:56.997815 24593 rpcz_store.cc:276] 0709 13:09:54.525482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.525998 (+   516us) service_pool.cc:224] Handling call
0709 13:09:56.871802 (+2345804us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001cbe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4c735 00007f17bbf449fa 00007f17c0f0c4c9 00007f17ba488c54 00007f17ba488be2 00007f17ba488b11 00007f17ba488a8c 00007f17ba487d42 00007f17ba28148c 00007f17ba2808c6
0709 13:09:56.871983 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2767064832}
I20260709 13:09:57.002087 25214 raft_consensus.cc:2410] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:09:57.008409 29081 consensus_meta.cc:287] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.363s	user 0.008s	sys 0.004s
W20260709 13:09:57.031698 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 129707us
W20260709 13:09:57.033463 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.033s	sys 0.035s
W20260709 13:09:57.077899 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.033s	sys 0.035s
I20260709 13:09:57.033931 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:57.078186 29033 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.078555 25210 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.049713 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:57.078680 29115 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:57.079401 24592 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:09:57.051987 29059 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:56.754060 29116 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:56.841991 29064 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:56.869534 29120 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:09:57.033706 28979 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:09:57.059077 24596 rpcz_store.cc:269] 0709 13:09:55.429132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.552314 (+123182us) service_pool.cc:224] Handling call
0709 13:09:56.961678 (+1409364us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540018fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:56.966900 (+  5222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283323136}
W20260709 13:09:57.060016 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 1.08325e+06us
I20260709 13:09:56.735116 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:09:56.993369 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:57.085356 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 350352us
I20260709 13:09:57.085443 24599 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:57.085934 29071 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:57.086449 29071 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:57.086800 24599 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:09:57.087309 29071 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.088650 29116 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:57.089469 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:57.089883 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:57.089564 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:57.090626 24518 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:57.090770 29018 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:57.091243 29018 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:57.091288 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:57.092165 29018 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.089474 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:57.085040 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:57.066773 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:57.067080 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:57.067301 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3098) took 1213 ms. Trace:
I20260709 13:09:57.055475 29107 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:57.072669 29061 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 13:09:57.099749 29136 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:57.101996 29061 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.102137 29136 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:57.103596 29136 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.075533 28932 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:57.078826 29033 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:57.051707 28442 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.287s	user 0.009s	sys 0.000s
I20260709 13:09:57.109333 28932 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:57.109917 29082 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:57.109920 24594 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:57.110411 28932 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.111519 28932 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.078135 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1836) took 2730 ms. Trace:
I20260709 13:09:57.080696 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:57.112623 25218 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.109330 29139 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.032823 29085 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.080708 24592 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:57.112447 24600 rpcz_store.cc:276] 0709 13:09:54.348169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.348275 (+   106us) service_pool.cc:224] Handling call
0709 13:09:54.359076 (+ 10801us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:54.361797 (+  2721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.361830 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:56.959757 (+2597927us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b2c00170da8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:09:56.970393 (+ 10636us) log.cc:844] Serialized 52 byte log entry
0709 13:09:57.053662 (+ 83269us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:57.053687 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.053737 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.076928 (+ 23191us) raft_consensus.cc:1685] finished
0709 13:09:57.076947 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.078052 (+  1105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105549,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":6912,"spinlock_wait_cycles":21332352,"thread_start_us":47024,"threads_started":1,"wal-append.queue_time_us":60271}
I20260709 13:09:57.081761 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:57.086819 29064 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.079414 29081 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:57.119020 25216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 988) took 2962 ms (client timeout 1743 ms). Trace:
I20260709 13:09:57.119966 29018 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:57.081040 28868 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 13:09:57.096235 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:57.100509 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:57.095755 24667 rpcz_store.cc:276] 0709 13:09:55.854150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.854254 (+   104us) service_pool.cc:224] Handling call
0709 13:09:55.854762 (+   508us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:55.855201 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.855233 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:55.923348 (+ 68115us) log.cc:844] Serialized 539 byte log entry
0709 13:09:56.540776 (+617428us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:56.974184 (+433408us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.066969 (+ 92785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.067042 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.067086 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:57.067101 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.067232 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129,"raft.queue_time_us":58848,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":8220,"thread_start_us":564956,"threads_started":2,"wal-append.queue_time_us":876959}
I20260709 13:09:57.098361 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:57.098429 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:57.094112 24522 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:09:57.068809 28796 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.131582 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:57.066570 25219 rpcz_store.cc:276] 0709 13:09:55.991575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.440426 (+448851us) service_pool.cc:224] Handling call
0709 13:09:57.064821 (+624395us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:57.083439 28922 consensus_meta.cc:287] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
W20260709 13:09:57.119454 25216 rpcz_store.cc:269] 0709 13:09:54.156317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.156592 (+   275us) service_pool.cc:224] Handling call
0709 13:09:57.118818 (+2962226us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54008e0154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:57.118940 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516003072}
I20260709 13:09:57.125912 25218 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:57.142078 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.142321 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.120590 29081 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:57.144341 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:57.144723 25210 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:57.145262 24667 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:09:57.145407 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1002) took 1153 ms. Trace:
I20260709 13:09:57.135294 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.149533 25219 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:57.149834 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 974) took 1105 ms. Trace:
I20260709 13:09:57.150271 24667 rpcz_store.cc:276] 0709 13:09:56.044514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.144100 (+1099586us) service_pool.cc:224] Handling call
0709 13:09:57.149776 (+  5676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:57.061465 28898 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.096084 29110 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.150537 25210 rpcz_store.cc:276] 0709 13:09:55.992069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.028650 (+1036581us) service_pool.cc:224] Handling call
0709 13:09:57.145323 (+116673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:57.152220 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.156008 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.143052 29116 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:57.143674 29015 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:57.157699 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.157142 29116 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.143301 29059 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:57.138942 28917 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:57.147717 28442 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:57.146965 29079 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:57.160857 25210 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:57.143335 28909 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.163604 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:57.162068 24595 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:57.147171 29127 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.167124 29150 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.167282 29072 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.148765 29126 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:57.149101 29133 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:57.170120 28758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.271s	user 0.016s	sys 0.023s
I20260709 13:09:57.170681 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:57.171801 29059 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.152019 29082 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:57.180500 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3103) took 1268 ms. Trace:
I20260709 13:09:57.143771 28868 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.182922 24522 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:57.184122 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:57.186982 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:57.148026 28922 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.160506 29015 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:09:57.196229 28758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.311s	user 0.017s	sys 0.023s
I20260709 13:09:57.188886 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:57.207387 24518 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.190970 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:57.173682 29079 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.214699 24524 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:57.195255 25210 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.197237 24667 rpcz_store.cc:276] 0709 13:09:55.912324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.162550 (+1250226us) service_pool.cc:224] Handling call
0709 13:09:57.179926 (+ 17376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.180122 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.180158 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.180210 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:57.180253 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.180319 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.180436 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:57.157543 29110 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.203645 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:57.164460 29116 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.173069 28917 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.220098 24672 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:57.224308 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:57.216303 24522 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.188278 29127 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.242786 29127 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.180823 28909 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.202031 28856 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:57.218226 29079 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.207176 28758 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:57.216815 28442 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:57.188086 28979 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:57.264719 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 61744.5us
I20260709 13:09:57.201345 29082 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.213735 29015 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.249408 29085 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:57.260847 29133 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:57.197507 29150 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:57.278143 29047 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.000s
I20260709 13:09:57.290119 28868 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:57.291373 29059 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.277597 28786 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:57.293557 25210 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:57.294615 24522 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:57.296650 29139 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.289484 29110 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.253916 28856 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.195680 29126 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.316783 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:57.317224 24591 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:57.303663 29015 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.327206 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.329173 28442 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.281467 29146 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:57.340427 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.341749 25210 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:09:57.314816 29133 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.307973 29047 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.329510 28922 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.352042 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.352859 25210 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:09:57.336959 28758 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.339148 28898 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:57.351001 28786 tablet_bootstrap.cc:492] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
I20260709 13:09:57.370383 24666 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:57.337177 29136 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.387018 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 998) took 1396 ms. Trace:
I20260709 13:09:57.389045 24518 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:09:57.401759 24598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1565) took 2196 ms (client timeout 2021 ms). Trace:
W20260709 13:09:57.402248 24598 rpcz_store.cc:269] 0709 13:09:55.196621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.196786 (+   165us) service_pool.cc:224] Handling call
0709 13:09:57.392836 (+2196050us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54001ecdd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:57.392974 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967183616}
I20260709 13:09:57.405143 28856 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:57.405172 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1760) took 2906 ms. Trace:
I20260709 13:09:57.412241 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:57.396130 28786 ts_tablet_manager.cc:1403] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 2.782s	user 0.044s	sys 0.028s
I20260709 13:09:57.415800 28917 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:57.417609 29032 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 3.208s	user 0.000s	sys 0.012s
I20260709 13:09:57.406131 24668 rpcz_store.cc:276] 0709 13:09:54.494498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.494885 (+   387us) service_pool.cc:224] Handling call
0709 13:09:54.495195 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.530578 (+ 35383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.530616 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.540596 (+  9980us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.677199 (+136603us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:54.677329 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.394292 (+2716963us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b540040a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:57.394347 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.394387 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:57.394400 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.401282 (+  6882us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12068,"raft.queue_time_us":4189,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4295,"spinlock_wait_cycles":55118208,"thread_start_us":60482,"threads_started":1,"wal-append.queue_time_us":130173,"wal-append.run_cpu_time_us":2431,"wal-append.run_wall_time_us":1155706}
I20260709 13:09:57.407964 28909 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:57.419706 29083 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
W20260709 13:09:57.447407 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.454525 29136 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:57.463392 29025 consensus_meta.cc:287] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.000s
I20260709 13:09:57.463836 29025 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.467905 29116 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.469308 24525 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:57.469416 29083 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.471539 29083 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:57.495169 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 999) took 1503 ms. Trace:
W20260709 13:09:57.496925 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.521718 29047 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:57.550716 24565 leader_election.cc:336] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.729s (SENT)
I20260709 13:09:57.551370 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:09:57.577524 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.680904 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.682673 24594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 913) took 2253 ms (client timeout 2074 ms). Trace:
W20260709 13:09:57.683568 24594 rpcz_store.cc:269] 0709 13:09:55.429460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.633218 (+203758us) service_pool.cc:224] Handling call
0709 13:09:57.682380 (+2049162us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540025bf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:57.682579 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3353745792}
W20260709 13:09:57.686124 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.687363 28856 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:57.688031 28856 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.691849 29159 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:57.726766 29079 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:57.728487 25216 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:57.729844 29166 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:09:57.730340 29018 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.005s
W20260709 13:09:57.731354 28796 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.002s
I20260709 13:09:57.731805 28796 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.732707 24516 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:57.683678 28909 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:57.692572 29159 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:57.972950 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 997) took 1982 ms. Trace:
W20260709 13:09:57.978379 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 208806us
I20260709 13:09:57.975226 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3002) took 2937 ms. Trace:
I20260709 13:09:57.981825 24523 rpcz_store.cc:276] 0709 13:09:55.037536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.038418 (+   882us) service_pool.cc:224] Handling call
0709 13:09:55.038837 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.671839 (+633002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.974935 (+2303096us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540030f054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:57.975158 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452454144}
W20260709 13:09:57.973222 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 422543us
I20260709 13:09:57.979050 25218 rpcz_store.cc:276] 0709 13:09:55.990511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.161308 (+1170797us) service_pool.cc:224] Handling call
0709 13:09:57.161944 (+   636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.169168 (+  7224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:57.270393 (+101225us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.414084 (+143691us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.414552 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.414677 (+   125us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:57.414709 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.414792 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.972688 (+557896us) raft_consensus.cc:1685] finished
0709 13:09:57.972724 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.972890 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":92572,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":6913,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"thread_start_us":204588,"threads_started":2,"wal-append.queue_time_us":184093}
I20260709 13:09:57.986565 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 970) took 1944 ms. Trace:
I20260709 13:09:57.992890 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:57.992813 24672 rpcz_store.cc:276] 0709 13:09:56.029770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.694505 (+664735us) service_pool.cc:224] Handling call
0709 13:09:57.974123 (+1279618us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54002b5554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:57.974303 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040483712}
I20260709 13:09:57.975589 29133 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:58.001191 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 966) took 1972 ms. Trace:
I20260709 13:09:58.001668 24672 rpcz_store.cc:276] 0709 13:09:56.028801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.999183 (+1970382us) service_pool.cc:224] Handling call
0709 13:09:58.000651 (+  1468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.000837 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.000867 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.000909 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:58.000943 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.000996 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.001135 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:58.002686 28873 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.003059 24672 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:58.003726 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 967) took 1974 ms. Trace:
I20260709 13:09:58.004035 24672 rpcz_store.cc:276] 0709 13:09:56.029025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.002606 (+1973581us) service_pool.cc:224] Handling call
0709 13:09:58.002894 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.003498 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.003676 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:58.005159 24672 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:58.005686 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 971) took 1975 ms. Trace:
I20260709 13:09:57.998479 25218 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:09:58.006258 29046 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:58.006500 25218 pending_rounds.cc:85] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 11
I20260709 13:09:58.006755 25218 pending_rounds.cc:107] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:09:58.006981 25218 raft_consensus.cc:2889] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.007007 28961 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:58.007711 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1005) took 1202 ms. Trace:
I20260709 13:09:58.008038 25218 rpcz_store.cc:276] 0709 13:09:56.804977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.997538 (+1192561us) service_pool.cc:224] Handling call
0709 13:09:57.997957 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.007498 (+  9541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.007662 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:58.009100 25215 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:58.005980 24672 rpcz_store.cc:276] 0709 13:09:56.029990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.004711 (+1974721us) service_pool.cc:224] Handling call
0709 13:09:58.004983 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.005483 (+   500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.005639 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:58.011245 24672 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:58.012233 29088 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.012993 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 972) took 1973 ms. Trace:
I20260709 13:09:58.013868 24672 rpcz_store.cc:276] 0709 13:09:56.039732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.010824 (+1971092us) service_pool.cc:224] Handling call
0709 13:09:58.011094 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.012523 (+  1429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.012942 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:57.980521 29150 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.974512 29025 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:57.990593 28987 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:57.977604 29126 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:57.990672 29028 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:58.017805 29028 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.020958 29028 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:58.023926 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:09:58.028180 29167 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.613s	user 0.000s	sys 0.001s
W20260709 13:09:58.013372 24666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 969) took 1983 ms (client timeout 2238 ms). Trace:
I20260709 13:09:58.009123 25218 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:57.885191 29079 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:57.388172 25219 rpcz_store.cc:276] 0709 13:09:55.991079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.179579 (+1188500us) service_pool.cc:224] Handling call
0709 13:09:57.179950 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.180183 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:57.265326 (+ 85143us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.386668 (+121342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.386719 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:57.386776 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.386842 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.386958 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85143,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":1406,"thread_start_us":191397,"threads_started":2}
W20260709 13:09:58.046495 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.059521 25210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.011s	sys 0.043s
W20260709 13:09:58.068364 25210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.011s	sys 0.044s
I20260709 13:09:58.068998 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1765) took 2963 ms. Trace:
I20260709 13:09:58.069433 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 981) took 1002 ms. Trace:
W20260709 13:09:58.067430 24666 rpcz_store.cc:269] 0709 13:09:56.029539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.080323 (+ 50784us) service_pool.cc:224] Handling call
0709 13:09:58.013206 (+1932883us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54000492d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.013303 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2964943104}
I20260709 13:09:58.069967 25218 rpcz_store.cc:276] 0709 13:09:57.066806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.008710 (+941904us) service_pool.cc:224] Handling call
0709 13:09:58.008960 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.069112 (+ 60152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.069365 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:58.069846 25219 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:58.071966 25218 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:58.069489 24674 rpcz_store.cc:276] 0709 13:09:55.105994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.106109 (+   115us) service_pool.cc:224] Handling call
0709 13:09:55.117374 (+ 11265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.141539 (+ 24165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.141567 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.141621 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:55.141665 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.068766 (+2927101us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54001383d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:58.068808 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.068946 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55168384}
W20260709 13:09:58.059939 24563 connection.cc:256] RPC call timeout handler was delayed by -1.4312723769999138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:09:58.073764 24665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1771) took 2961 ms (client timeout 3240 ms). Trace:
W20260709 13:09:58.040743 28442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.005s
W20260709 13:09:58.074193 24665 rpcz_store.cc:269] 0709 13:09:55.107754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.162782 (+ 55028us) service_pool.cc:224] Handling call
0709 13:09:58.068948 (+2906166us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b5400409f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.069034 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52534528}
I20260709 13:09:58.074695 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:09:58.057552 28979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.008s	sys 0.008s
I20260709 13:09:58.041363 29061 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.076435 29126 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.073984 29067 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:58.075922 28442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.005s
W20260709 13:09:58.081264 28979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.009s	sys 0.010s
I20260709 13:09:58.078562 28987 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:58.088238 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.083997 29067 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.092135 29067 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.083210 29126 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.096433 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 974) took 2569 ms. Trace:
I20260709 13:09:58.096988 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1003) took 2085 ms. Trace:
I20260709 13:09:58.097419 25210 rpcz_store.cc:276] 0709 13:09:56.011285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.360571 (+1349286us) service_pool.cc:224] Handling call
0709 13:09:57.384111 (+ 23540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.384667 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.384697 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.385199 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.068789 (+683590us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:58.068842 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.068932 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.096783 (+ 27851us) raft_consensus.cc:1685] finished
0709 13:09:58.096802 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.096933 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5249,"thread_start_us":653320,"threads_started":1,"wal-append.queue_time_us":686552}
I20260709 13:09:58.098470 29073 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.096813 25213 rpcz_store.cc:276] 0709 13:09:55.529066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.751008 (+221942us) service_pool.cc:224] Handling call
0709 13:09:55.803789 (+ 52781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:55.804531 (+   742us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:55.804808 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.195216 (+390408us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.207378 (+ 12162us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.207505 (+   127us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:56.207714 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.207934 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.208023 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.488068 (+280045us) raft_consensus.cc:1685] finished
0709 13:09:56.488087 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.027514 (+1539427us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b180046a8c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f
0709 13:09:58.028608 (+  1094us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b48001b06d8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:09:58.096251 (+ 67643us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b54002e59d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.096353 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5797,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":825,"raft.run_cpu_time_us":23130,"raft.run_wall_time_us":1822749,"spinlock_wait_cycles":125858560,"thread_start_us":383695,"threads_started":1,"wal-append.queue_time_us":680858,"wal-append.run_cpu_time_us":2434,"wal-append.run_wall_time_us":1002452}
I20260709 13:09:58.096820 29126 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:58.107910 29119 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.254s	user 0.005s	sys 0.009s
W20260709 13:09:58.146471 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 151519us
W20260709 13:09:58.148839 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.151360 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.089488 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1763) took 2986 ms. Trace:
I20260709 13:09:58.154026 24669 rpcz_store.cc:276] 0709 13:09:55.103401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.103522 (+   121us) service_pool.cc:224] Handling call
0709 13:09:55.115036 (+ 11514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.460116 (+345080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.460146 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.460191 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:55.460222 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.089265 (+2629043us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400404a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:58.089310 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.089424 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793159552}
W20260709 13:09:58.155673 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 72026.6us
I20260709 13:09:58.159313 29018 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.162824 28979 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:58.160543 29018 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.167960 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:58.168082 29018 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.186031 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 993) took 4008 ms. Trace:
I20260709 13:09:58.186512 25211 rpcz_store.cc:276] 0709 13:09:54.177357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.453356 (+275999us) service_pool.cc:224] Handling call
0709 13:09:54.473331 (+ 19975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.862149 (+1388818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.185433 (+2323284us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540066b2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:58.185763 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3063626112}
I20260709 13:09:58.191062 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.192098 24525 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
W20260709 13:09:58.193274 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.195366 28827 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.197986 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.496024 25217 rpcz_store.cc:276] 0709 13:09:55.991331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.204891 (+1213560us) service_pool.cc:224] Handling call
0709 13:09:57.205193 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.205431 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:57.329901 (+124470us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.433916 (+104015us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.494722 (+ 60806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.494795 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:57.494854 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.494941 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.495097 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19891,"prepare.queue_time_us":65218,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":58,"raft.queue_time_us":9541,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":10717,"spinlock_wait_cycles":172156800,"thread_start_us":186520,"threads_started":2}
I20260709 13:09:58.203052 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:58.203223 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.204448 24518 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:58.218076 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.218781 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.219847 24523 raft_consensus.cc:2410] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:58.219669 24525 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:58.196396 28827 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.222333 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1008) took 1152 ms. Trace:
I20260709 13:09:58.222821 25216 rpcz_store.cc:276] 0709 13:09:57.069827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.141856 (+ 72029us) service_pool.cc:224] Handling call
0709 13:09:58.221758 (+1079902us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400608e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.222075 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346643328}
I20260709 13:09:58.224135 28827 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.231758 24667 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:58.224925 28827 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.233764 28827 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.236599 28827 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:58.225044 24671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1764) took 3121 ms (client timeout 1591 ms). Trace:
W20260709 13:09:58.237416 24671 rpcz_store.cc:269] 0709 13:09:55.104867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.104977 (+   110us) service_pool.cc:224] Handling call
0709 13:09:58.224512 (+3119535us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b540044e154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.224773 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85885824}
I20260709 13:09:58.240379 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.242429 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.243337 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.243537 24525 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:58.244587 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.245859 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.246773 24524 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:58.247598 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:58.248359 24524 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:58.248713 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.244868 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:58.253338 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 64136.1us
I20260709 13:09:58.254536 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:58.256033 28931 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:58.256158 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:58.256753 28931 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:58.257997 29073 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:58.258672 29073 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:58.258611 28931 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.260193 29082 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.260461 29073 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.225320 28962 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.263691 28962 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:09:58.266251 29113 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 2.184s	user 0.015s	sys 0.009s
I20260709 13:09:58.266697 28962 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:58.267376 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 2.17191e+06us
I20260709 13:09:58.269620 29116 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.275230 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:58.276719 25214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 969) took 3167 ms (client timeout 3274 ms). Trace:
W20260709 13:09:58.277288 25214 rpcz_store.cc:269] 0709 13:09:55.063132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.063259 (+   127us) service_pool.cc:224] Handling call
0709 13:09:58.228396 (+3165137us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54006801d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.230245 (+  1849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4450790144}
I20260709 13:09:58.278291 28603 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.279132 24518 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:58.230340 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.284884 28856 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:09:58.289877 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 258242us
I20260709 13:09:58.295076 24521 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:58.275627 28479 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:58.298017 28922 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.299517 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:58.303674 28827 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:58.321465 24517 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.325693 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.272969 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:58.333495 24524 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:09:58.333403 29005 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.335240 29005 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.335683 28786 raft_consensus.cc:359] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:58.336664 28786 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:09:58.338721 29005 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.338562 28922 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.340680 28865 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:58.342769 24519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 934) took 3176 ms (client timeout 1738 ms). Trace:
I20260709 13:09:58.345423 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 938) took 3161 ms. Trace:
I20260709 13:09:58.345551 28827 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:58.346773 28603 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.348093 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1864) took 1072 ms. Trace:
I20260709 13:09:58.351409 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:58.353240 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:58.353467 29081 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:58.354660 28962 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:58.355016 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 82301.2us
W20260709 13:09:58.361788 24519 rpcz_store.cc:269] 0709 13:09:55.165740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.177871 (+ 12131us) service_pool.cc:224] Handling call
0709 13:09:58.342286 (+3164415us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54003dc7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.342520 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5286274944}
I20260709 13:09:58.362097 24520 rpcz_store.cc:276] 0709 13:09:55.183830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.552163 (+368333us) service_pool.cc:224] Handling call
0709 13:09:55.563480 (+ 11317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.538540 (+975060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.344763 (+1806223us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400442354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:58.345165 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239979392}
I20260709 13:09:58.376255 28898 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:58.380187 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 177598us
I20260709 13:09:58.381547 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:58.380697 28603 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.383746 28865 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.364197 24591 rpcz_store.cc:276] 0709 13:09:57.275662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.275809 (+   147us) service_pool.cc:224] Handling call
0709 13:09:57.282946 (+  7137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.323011 (+ 40065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.347462 (+1024451us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b5400192dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:58.347854 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78263680}
I20260709 13:09:58.378218 28962 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:58.394974 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:58.396237 28370 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.397133 28370 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.405421 28479 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:58.407143 29079 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.407630 29079 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:58.408718 28922 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.389356 28898 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.392705 28962 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.388125 29020 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:58.425907 29073 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:58.426440 29020 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:58.427028 29020 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:58.427410 28931 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:58.427953 28931 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.428457 28931 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.430313 28905 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.426501 29073 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:58.432447 29073 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.433071 28603 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:58.434758 29069 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.435245 29069 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:58.436385 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1562) took 3323 ms. Trace:
I20260709 13:09:58.436200 28905 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:58.437333 29072 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:58.437737 28905 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.438352 28905 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:58.438135 29072 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.446300 28370 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.447184 29111 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:58.448223 29111 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:58.448638 29111 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:58.436864 24597 rpcz_store.cc:276] 0709 13:09:55.112691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.113221 (+   530us) service_pool.cc:224] Handling call
0709 13:09:55.113423 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.114465 (+  1042us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:55.580445 (+465980us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.435397 (+2854952us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b18001a3200. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287
0709 13:09:58.435591 (+   194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.435678 (+    87us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:58.435807 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.435923 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.436112 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":360220,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":167084,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":18949,"spinlock_wait_cycles":682493312,"thread_start_us":1125078,"threads_started":3,"wal-append.queue_time_us":812262,"wal-append.run_cpu_time_us":2124,"wal-append.run_wall_time_us":1275871}
W20260709 13:09:58.451503 29180 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
I20260709 13:09:58.455106 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3100) took 2600 ms. Trace:
I20260709 13:09:58.455528 24673 rpcz_store.cc:276] 0709 13:09:55.854691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.855444 (+   753us) service_pool.cc:224] Handling call
0709 13:09:55.855761 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:55.856204 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:56.353489 (+497285us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.064096 (+710607us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.182853 (+1118757us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18003eb9c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:09:58.183230 (+   377us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:58.184302 (+  1072us) log.cc:844] Serialized 52 byte log entry
0709 13:09:58.363469 (+179167us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:58.363507 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.379829 (+ 16322us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.450462 (+ 70633us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:58.454687 (+  4225us) raft_consensus.cc:1685] finished
0709 13:09:58.454714 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.454855 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1155,"prepare.queue_time_us":652930,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3279,"raft.queue_time_us":1130449,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":6396,"spinlock_wait_cycles":16657920,"thread_start_us":1290057,"threads_started":3,"wal-append.queue_time_us":717610,"wal-append.run_cpu_time_us":2180,"wal-append.run_wall_time_us":1141256}
I20260709 13:09:58.459142 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.461679 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.462489 24600 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:58.464303 24594 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:58.471246 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 118405us
I20260709 13:09:58.465884 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:58.456833 29111 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.476969 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:58.481658 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.483259 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.484077 24600 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:58.428915 29020 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.485893 29020 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.485945 24592 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.409235 28786 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:09:58.494192 24517 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:58.494293 29033 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.495065 28827 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:58.499078 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:58.474450 29081 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.495414 28786 ts_tablet_manager.cc:1434] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 1.079s	user 0.014s	sys 0.012s
I20260709 13:09:58.496907 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:58.501406 28786 ts_tablet_manager.cc:1467] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Tablet startup took 1086ms
I20260709 13:09:58.415267 28898 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:58.501710 24600 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:58.503183 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:58.503022 28898 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.497519 29073 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.504387 28827 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:58.498462 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:58.500994 29005 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.505353 28827 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.506492 29073 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.506603 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.497411 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:58.504557 28898 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.507805 24594 raft_consensus.cc:2410] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:09:58.436731 29069 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.509379 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:58.504490 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:58.496172 28931 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.510160 29069 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.524049 24592 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:58.507759 28827 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:58.527715 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.528375 24600 raft_consensus.cc:2368] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:58.514567 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:58.501956 29081 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.531245 29020 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:58.530236 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:09:58.526779 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3242679880000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 13:09:58.534148 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.535072 29020 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.535382 25215 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:58.535585 29020 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.535123 29111 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.536759 25211 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:58.409027 29079 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.537982 29079 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.538214 28240 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.536267 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.542729 29042 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.543211 29067 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:58.545688 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:58.541859 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:58.548992 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:58.538022 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 939) took 1451 ms. Trace:
I20260709 13:09:58.565589 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.565783 29042 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.567987 25215 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:58.573926 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 124753us
I20260709 13:09:58.578660 24592 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:58.577700 24639 leader_election.cc:400] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12.
I20260709 13:09:58.594856 24639 leader_election.cc:403] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:58.563119 24516 rpcz_store.cc:276] 0709 13:09:57.086441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.090088 (+  3647us) service_pool.cc:224] Handling call
0709 13:09:57.090319 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.733225 (+642906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.537524 (+804299us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54000dd9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:58.537810 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476749696}
W20260709 13:09:58.594601 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52965.5us
I20260709 13:09:58.569555 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.577677 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.579829 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.555502 28603 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:58.580281 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.616339 24520 raft_consensus.cc:2410] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:09:58.617494 25216 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:58.618436 24591 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:58.619445 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.615677 28240 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:58.615329 24594 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:58.573247 28931 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.623042 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.628649 24517 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:09:58.629117 24517 pending_rounds.cc:85] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 5
I20260709 13:09:58.568989 29042 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:09:58.633270 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.526873 28905 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.629345 24517 pending_rounds.cc:107] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:09:58.639963 24517 raft_consensus.cc:2889] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.645411 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.646972 28905 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.648270 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:58.649129 28964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.453s	user 0.025s	sys 0.034s
W20260709 13:09:58.649602 28964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.579s	user 0.026s	sys 0.034s
W20260709 13:09:58.501847 28786 ts_tablet_manager.cc:1469] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Trace:
0709 13:09:48.794929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.795041 (+   112us) service_pool.cc:224] Handling call
0709 13:09:48.925502 (+130461us) ts_tablet_manager.cc:934] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
0709 13:09:51.129531 (+2204029us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:51.994996 (+865465us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:52.007343 (+ 12347us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:52.432323 (+424980us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:52.432760 (+   437us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:52.458499 (+ 25739us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:52.461508 (+  3009us) inbound_call.cc:177] Queueing success response
0709 13:09:53.266508 (+805000us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4c00240140. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba212a20 00007f17ba223a29 00007f17ba1c85e6 00007f17ba1ddb13 00007f17ba1dd945 00007f17ba2507ad 00007f17c0f24198 00007f17c0f24137 00007f17c0f2409c 00007f17c0f24038 00007f17c0f23300
0709 13:09:54.575581 (+1309073us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:57.418707 (+2843126us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:58.086521 (+667814us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:58.094143 (+  7622us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":34625,"mutex_wait_us":226290,"raft.queue_time_us":2103,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":76089728,"tablet-copy.queue_time_us":112884,"tablet-download-pool.queue_time_us":166,"tablet-download-pool.run_cpu_time_us":1205,"tablet-download-pool.run_wall_time_us":346523,"thread_start_us":131840,"threads_started":2}
I20260709 13:09:56.868088 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:58.653569 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 96023.2us
I20260709 13:09:58.657505 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1866) took 1351 ms. Trace:
W20260709 13:09:58.657776 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 112191us
I20260709 13:09:58.657909 24593 rpcz_store.cc:276] 0709 13:09:57.305683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.305908 (+   225us) service_pool.cc:224] Handling call
0709 13:09:57.321013 (+ 15105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.334320 (+ 13307us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:57.344598 (+ 10278us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.426221 (+1081623us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18003de7c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf 00007f17bbf60038
0709 13:09:58.426667 (+   446us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.593455 (+166788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.611704 (+ 18249us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:58.620382 (+  8678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.653264 (+ 32882us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b540033d954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:58.653520 (+   256us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.657302 (+  3782us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1082695,"prepare.queue_time_us":1097759,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":6839,"raft.queue_time_us":37582,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":2710,"spinlock_wait_cycles":32872064,"thread_start_us":101861,"threads_started":1,"wal-append.queue_time_us":151562}
I20260709 13:09:58.660197 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.661188 28917 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.661757 28917 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:58.661427 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.662956 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.662763 28917 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.664073 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.650936 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.569382 29067 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.664768 24593 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:09:58.667461 24591 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:09:58.670488 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.671422 28905 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:58.673197 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.672914 25214 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:58.673055 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:09:58.686928 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:58.644491 28603 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.691962 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:58.695297 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:58.694459 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.696199 24594 raft_consensus.cc:2368] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:58.698647 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.708639 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:58.706496 24637 leader_election.cc:400] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:09:58.694684 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:58.714782 25211 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:58.715507 25216 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:58.714800 24595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 1861) took 1617 ms (client timeout 1720 ms). Trace:
W20260709 13:09:58.716102 24595 rpcz_store.cc:269] 0709 13:09:57.097481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.098192 (+   711us) service_pool.cc:224] Handling call
0709 13:09:58.712370 (+1614178us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54001941d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.714618 (+  2248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70115200}
I20260709 13:09:58.716507 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1867) took 1341 ms. Trace:
I20260709 13:09:58.717482 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.716946 24596 rpcz_store.cc:276] 0709 13:09:57.358281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.358467 (+   186us) service_pool.cc:224] Handling call
0709 13:09:57.378305 (+ 19838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.378701 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:58.530846 (+1152145us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.665061 (+134215us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.678398 (+ 13337us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.685040 (+  6642us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:58.693648 (+  8608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.693711 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.699472 (+  5761us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1053110,"prepare.queue_time_us":1052031,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":22307,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":9228,"thread_start_us":200670,"threads_started":2}
I20260709 13:09:58.719592 24596 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:58.713843 24591 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
W20260709 13:09:58.722121 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.722685 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:58.725199 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.725468 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.726522 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3101) took 2871 ms. Trace:
I20260709 13:09:58.726939 24670 rpcz_store.cc:276] 0709 13:09:55.872061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.872198 (+   137us) service_pool.cc:224] Handling call
0709 13:09:55.872535 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.090494 (+2217959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.090523 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.090561 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:58.090594 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.726095 (+635501us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b5400047ed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:09:58.726156 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.726361 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5100380928}
I20260709 13:09:58.728556 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3105) took 2815 ms. Trace:
I20260709 13:09:58.730602 24592 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:09:58.728957 24667 rpcz_store.cc:276] 0709 13:09:55.912923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.215499 (+1302576us) service_pool.cc:224] Handling call
0709 13:09:58.226427 (+1010928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.232265 (+  5838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.728333 (+496068us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540044e150. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:09:58.728479 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237841792}
I20260709 13:09:58.733785 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:09:58.734469 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 63874.9us
I20260709 13:09:58.734655 24593 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:58.735442 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:58.735656 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.738183 24517 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:58.739753 25216 raft_consensus.cc:2368] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:09:58.744351 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.742312 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.747526 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:58.748225 24517 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.745719 25212 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:58.749541 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.749302 28905 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:58.753500 28905 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:58.753611 29137 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.753918 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.754266 29137 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.754716 28905 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.737210 28962 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.756577 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:58.759066 24594 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:58.766062 24519 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:58.767313 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:58.765908 25216 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:09:58.769817 24592 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:58.772486 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.776420 29137 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:58.777700 25213 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:58.779354 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.780336 28962 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.758215 28865 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.787137 24517 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:58.766772 29079 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:58.789700 24516 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:58.800153 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.801659 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.799510 29081 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.802410 25213 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:09:58.800629 25216 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
W20260709 13:09:58.808588 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52019.8us
I20260709 13:09:58.791615 29079 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:58.822517 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:58.823904 25210 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:58.824012 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.825289 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.825119 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.829366 29072 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:58.830159 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:58.830900 25216 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:58.831880 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:58.834893 29182 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.503s	user 0.001s	sys 0.006s
I20260709 13:09:58.810527 25212 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:09:58.839846 29020 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.842163 28931 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:58.854686 25214 raft_consensus.cc:2376] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10. Re-sending same reply.
I20260709 13:09:58.845466 28758 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:58.845567 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 211884us
W20260709 13:09:58.846284 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 140040us
I20260709 13:09:58.860424 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:58.847884 29159 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.862564 29111 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.846984 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:58.853495 25215 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:58.854245 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 165228us
I20260709 13:09:58.853988 25213 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:58.860589 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:58.854791 29079 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.861492 28603 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12.
I20260709 13:09:58.847436 29067 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:09:58.866824 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57057.6us
I20260709 13:09:58.873824 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 965) took 2835 ms. Trace:
I20260709 13:09:58.874224 24668 rpcz_store.cc:276] 0709 13:09:56.028505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.433272 (+1404767us) service_pool.cc:224] Handling call
0709 13:09:57.433575 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.197121 (+763546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.197186 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.197901 (+   715us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.303756 (+105855us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:58.303795 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.312043 (+  8248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.834152 (+522109us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:09:58.863703 (+ 29551us) raft_consensus.cc:1685] finished
0709 13:09:58.863727 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.863977 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":754210,"raft.queue_time_us":790812,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":236,"spinlock_wait_cycles":123292032,"thread_start_us":105236,"threads_started":1,"wal-append.queue_time_us":133166}
I20260709 13:09:58.866124 28931 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.876222 28931 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:58.877207 28931 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.879135 29046 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.879726 29046 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:58.881215 25211 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:58.880733 29046 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.866827 29159 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:58.886315 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:58.889822 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:58.887693 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:58.899175 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:58.899897 24673 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:09:58.902081 25216 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:09:58.906500 28758 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.907079 28758 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:58.909755 24670 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:58.909907 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:58.911016 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:58.911477 29067 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:58.911813 28758 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:58.911965 29067 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:58.912185 29043 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:58.917474 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:58.917030 29067 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:58.918111 24667 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:58.925343 25215 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:09:58.866187 29072 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:09:58.930526 24491 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.591s (SENT)
I20260709 13:09:58.931066 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:58.933724 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:58.888387 29159 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:58.935900 25210 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.931139 24673 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:58.937913 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47986us
I20260709 13:09:58.926393 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:09:58.935560 29043 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:58.945921 25219 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
W20260709 13:09:58.943982 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 54270.7us
I20260709 13:09:58.953477 24669 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.944702 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:58.937691 29159 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:58.937603 28758 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:58.967387 24670 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.978255 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:58.979471 24673 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:58.983973 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:58.984133 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:58.984758 24665 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:58.984880 24674 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.986033 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:58.986783 24665 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:58.987831 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:58.988673 24665 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:09:58.991432 29194 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
I20260709 13:09:58.998571 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:58.999976 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:58.984915 24669 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:09:59.000561 24668 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:59.001633 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.002278 24669 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
W20260709 13:09:59.009879 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.010740 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:59.012005 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44259.6us
I20260709 13:09:59.013512 29020 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:59.013624 28917 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:59.014457 28917 consensus_queue.cc:1243] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:59.015750 24519 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:59.017689 24418 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 5 to 6, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 6 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.020587 28370 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:59.021389 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 135875us
I20260709 13:09:59.022392 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:59.012825 24670 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:59.023537 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:59.013571 24524 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:59.023525 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.027731 24667 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:59.030499 25184 leader_election.cc:400] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:59.031081 25184 leader_election.cc:403] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.031189 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:58.981561 29069 raft_consensus.cc:2764] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:59.030866 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:59.036127 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 65069.8us
I20260709 13:09:59.039122 24672 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:59.027935 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.040210 24665 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:59.019659 24418 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 4 to 5, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 5 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.034514 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.041056 24673 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:59.041757 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.042400 24668 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 6.
I20260709 13:09:59.034684 28240 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.045229 29146 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:09:59.045518 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:59.045887 29106 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:09:59.046383 29085 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:59.046765 29192 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:09:59.066000 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:59.072052 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.051026 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.057369 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.073539 24670 raft_consensus.cc:2410] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:09:59.059068 24674 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:59.064494 24521 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.066829 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.067713 24669 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:09:59.069410 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:59.070349 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.043236 29020 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:59.049942 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:59.079049 25210 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:09:59.079478 24673 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:59.072728 24666 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
W20260709 13:09:59.107172 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45843.4us
W20260709 13:09:59.107455 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57619.7us
I20260709 13:09:59.110379 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.071157 29085 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:59.116139 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.111233 24672 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:09:59.120543 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.121178 24673 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:09:59.122056 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:59.122550 24673 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.125326 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.125985 24670 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:09:59.126811 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.127339 24670 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:09:59.128379 24670 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:59.130100 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.130774 24667 raft_consensus.cc:2376] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11. Re-sending same reply.
I20260709 13:09:59.130263 24673 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:59.135907 24639 leader_election.cc:400] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:59.136238 24639 leader_election.cc:403] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.136891 28962 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:09:59.138008 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:59.138027 29064 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:59.139004 29137 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:59.139127 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:59.059870 28240 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.140753 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:59.119017 24669 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:09:59.139454 29137 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.147312 29137 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.147481 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.148082 24669 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:09:59.149943 24668 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:59.141796 29085 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.152195 24668 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:59.146113 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:59.154760 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:59.146592 24673 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.156229 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:59.161046 24418 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 4 to 5, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 5 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.162057 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.162658 24672 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:59.110132 29081 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11.
I20260709 13:09:59.168804 29137 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:59.170545 29081 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:59.170958 29081 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.171466 29081 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.176179 28412 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:59.112201 28603 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:59.112613 29073 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:59.183229 24669 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:59.139377 29064 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:59.069613 29079 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.176726 28412 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:09:59.165639 29192 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:59.115641 29069 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:59.115706 29111 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:09:59.197746 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.197642 29069 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.198611 24670 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:09:59.199982 29069 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:59.200546 29069 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:59.186265 28962 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.204824 25218 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:59.184918 29064 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:09:59.192237 28370 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.188333 28603 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:59.200975 29069 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:59.192061 29073 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:59.170941 29137 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:59.206710 28962 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.214190 28603 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:59.244899 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.230293 28962 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.253309 24673 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:59.216475 29072 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:09:59.275597 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:09:59.282573 29020 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:59.283231 29020 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:59.284116 29020 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.286847 29064 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.288491 29064 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.297310 28412 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.299124 28412 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.317596 29073 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.327968 29079 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:59.308473 29159 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.239506 29085 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:59.351126 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 75625.1us
I20260709 13:09:59.346662 29043 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.362092 28240 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:59.349349 29069 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.379315 24517 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:09:59.379741 24523 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:59.380702 29159 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:59.352139 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:59.393182 29043 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:09:59.409788 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 57759.8us
W20260709 13:09:59.410017 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 375692us
I20260709 13:09:59.399008 28931 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:59.394394 29072 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 13:09:59.421468 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 242670us
I20260709 13:09:59.427533 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:59.397925 29081 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.425982 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:59.431309 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:09:59.432118 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:59.419981 28931 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:59.454998 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:59.455708 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.460331 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:59.467002 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 436663us
W20260709 13:09:59.468989 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 471855us
I20260709 13:09:59.444818 29111 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:59.456596 28931 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:59.491874 28603 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:59.504084 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.503295 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 102750us
I20260709 13:09:59.487644 28905 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.489390 29111 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:59.509724 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 353546us
I20260709 13:09:59.427338 29043 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.514175 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:59.509348 28905 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.514796 29111 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:59.540735 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:59.545362 24521 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:09:59.507234 28962 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:59.542810 29072 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:59.542449 28905 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:59.561839 29202 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
I20260709 13:09:59.560649 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:09:59.540052 29046 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:59.563261 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.546896 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 126657us
I20260709 13:09:59.568877 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:59.549396 29085 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:59.564607 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:59.518550 29159 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:09:59.576108 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.575090 29146 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:59.573359 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:59.636785 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 63508.6us
W20260709 13:09:59.576752 29198 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:09:59.577216 29020 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.577661 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:59.646327 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:59.646767 24596 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.577773 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:59.565536 29106 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:09:59.581216 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:09:59.581768 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:09:59.584215 24592 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:59.584044 29005 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:59.585796 24591 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:59.587746 29214 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.591107 28370 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:09:59.576699 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-45fddcc6d2bc4726a21bdfe31a4cae08 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:09:59.595400 28603 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:59.601697 28962 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:59.603533 29043 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:59.564769 29072 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.617677 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:09:59.697860 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 80261.9us
W20260709 13:09:59.572557 29200 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:09:59.601783 29046 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:09:59.646225 24600 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:59.659786 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:09:59.665411 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:59.652602 29020 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:09:59.659483 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:59.674307 29226 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.664425 28370 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.674955 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-45fddcc6d2bc4726a21bdfe31a4cae08 on tablet 45fddcc6d2bc4726a21bdfe31a4cae08 with peer 983693721af6486c97ece1410a90cf30
I20260709 13:09:59.676033 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:59.676636 29081 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:59.646122 29206 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:59.681521 28931 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:59.682379 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44688.8us
I20260709 13:09:59.702484 29072 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.694533 24596 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:59.700539 24594 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:09:59.664804 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:59.704542 29056 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:59.701485 29005 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.705763 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:09:59.707749 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 60733.8us
I20260709 13:09:59.707979 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:59.767084 24673 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.708750 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:59.769505 24525 raft_consensus.cc:2368] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:09:59.770280 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:09:59.770942 24525 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:59.770848 29111 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:09:59.772246 24525 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:59.774447 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:59.663868 29073 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:09:59.778972 28931 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:59.781814 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:09:59.709199 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:59.709923 29208 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:09:59.710073 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:59.713670 29210 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.715260 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:59.716429 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:59.717600 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:59.725479 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:59.725775 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:09:59.726794 29085 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:59.726824 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:59.728042 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:09:59.729032 28898 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:59.660527 29214 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:09:59.685207 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:09:59.758354 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.759438 24671 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:59.662911 28979 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:09:59.736486 29020 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.765908 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:09:59.770720 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 133029us
I20260709 13:09:59.814918 24516 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:09:59.686309 29067 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:09:59.802265 24673 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:09:59.803409 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:09:59.752765 29206 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.806187 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.835179 24525 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:59.703622 28905 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.813689 25215 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:09:59.814075 24667 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:59.766474 29005 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.766166 29056 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:09:59.808990 25210 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 6: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:09:59.838593 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:59.840658 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:59.842494 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3034) took 1132 ms. Trace:
I20260709 13:09:59.749112 29226 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.843538 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:59.852450 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.806501 28898 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:59.829828 29146 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.813995 29214 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.835896 29085 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:59.862474 29146 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:09:59.869217 29146 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.870412 28979 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:59.871093 28979 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:09:59.874544 28898 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.876003 28898 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.839880 29206 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.882553 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:59.882822 29226 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:09:59.883214 24669 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:59.884394 24420 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 346) took 11633 ms (client timeout 15000 ms). Trace:
I20260709 13:09:59.888451 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:59.846479 24522 rpcz_store.cc:276] 0709 13:09:58.710438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.710577 (+   139us) service_pool.cc:224] Handling call
0709 13:09:58.720516 (+  9939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.846401 (+125885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.846445 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.847090 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.212239 (+365149us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:59.212300 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.212399 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.842296 (+629897us) raft_consensus.cc:1685] finished
0709 13:09:59.842316 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.842437 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126737,"raft.queue_time_us":126693,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":364651,"threads_started":1,"wal-append.queue_time_us":495949}
I20260709 13:09:59.842000 29005 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.863768 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:09:59.865375 29056 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.862236 29211 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:59.866605 28905 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:09:59.850692 29218 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:09:59.859913 25216 raft_consensus.cc:2393] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:09:59.913362 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 253778us
I20260709 13:09:59.920567 24671 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:59.906010 29226 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.898216 29111 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:09:59.902539 25211 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:09:59.872156 28979 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.905664 24672 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:59.808406 29210 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.895648 29020 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:09:59.913364 29207 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 13:09:59.920678 25219 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:09:59.928501 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:59.930263 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:09:59.868542 29085 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:09:59.947377 24671 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:09:59.948139 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 174846us
I20260709 13:09:59.962324 24667 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:09:59.927899 29211 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:09:59.943428 29056 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.977304 24669 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
W20260709 13:09:59.979079 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50702us
I20260709 13:09:59.990387 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:09:59.984055 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:09:59.973291 29226 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:59.997346 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.002205 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.002976 24667 raft_consensus.cc:2368] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12.
I20260709 13:09:59.978153 29046 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.884912 24420 rpcz_store.cc:269] 0709 13:09:48.250907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.251203 (+   296us) service_pool.cc:224] Handling call
0709 13:09:59.884162 (+11632959us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:51.113018 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:51.113683 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:51.113716 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:09:51.113733 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:51.115325 (+  1592us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:51.115454 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:51.115481 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:09:51.116799 (+  1318us) tablet.cc:701] Row locks acquired
0709 13:09:51.116814 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:09:51.116955 (+   141us) write_op.cc:270] Start()
0709 13:09:51.117069 (+   114us) write_op.cc:276] Timestamp: P: 1783602591116908 usec, L: 0
0709 13:09:51.119635 (+  2566us) op_driver.cc:348] REPLICATION: starting
0709 13:09:51.244409 (+124774us) log.cc:844] Serialized 7598 byte log entry
0709 13:09:51.630023 (+385614us) op_driver.cc:464] REPLICATION: finished
0709 13:09:52.301809 (+671786us) write_op.cc:301] APPLY: starting
0709 13:09:52.301898 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:53.008616 (+706718us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:53.008732 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:53.275345 (+266613us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:53.275614 (+   269us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:09:53.275656 (+    42us) write_op.cc:312] APPLY: finished
0709 13:09:53.276035 (+   379us) log.cc:844] Serialized 172 byte log entry
0709 13:09:53.415814 (+139779us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:53.416014 (+   200us) write_op.cc:454] Released schema lock
0709 13:09:53.416075 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:53.443282 (+ 27207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:53.443315 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25682,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":621320,"apply.run_cpu_time_us":62806,"apply.run_wall_time_us":1178120,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77330,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":56531,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":9,"num_ops":19,"prepare.queue_time_us":210870,"prepare.run_cpu_time_us":5592,"prepare.run_wall_time_us":160092,"replication_time_us":451375,"thread_start_us":587396,"threads_started":3,"wal-append.queue_time_us":139705,"wal-append.run_cpu_time_us":913,"wal-append.run_wall_time_us":1000970}]]}
W20260709 13:10:00.011456 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 83522.5us
I20260709 13:10:00.014911 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:00.018002 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 251134us
W20260709 13:10:00.018059 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 236339us
I20260709 13:09:59.979267 29159 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:10:00.030057 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:00.028844 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:00.016157 29226 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:00.046476 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.047422 24671 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:00.057055 24672 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.057581 29230 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:00.000309 29106 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:10:00.060452 24639 leader_election.cc:400] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:10:00.060832 24594 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:00.061470 24639 leader_election.cc:403] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.039868 29218 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:00.064265 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49437.1us
I20260709 13:10:00.017827 29069 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:10:00.071446 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:00.014919 29046 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.073418 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.074335 24669 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:00.074739 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:00.075968 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.076272 29215 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:00.076750 24672 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:00.077059 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 228213us
I20260709 13:10:00.055748 29237 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:00.057127 29243 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:00.079420 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:00.077703 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:00.082638 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.071493 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:00.061496 29211 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.089790 29215 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:00.091044 29215 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.099771 24599 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:00.100200 24599 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:00.125499 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:00.073414 28905 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.131285 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.132201 24673 raft_consensus.cc:2376] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11. Re-sending same reply.
I20260709 13:10:00.152235 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:00.153998 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:00.129041 24566 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.716s (SENT)
I20260709 13:10:00.147701 24599 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.081604 29230 consensus_queue.cc:1243] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:00.082335 29243 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:00.082922 29081 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.155368 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:00.082525 29237 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:00.179601 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:00.180603 24669 raft_consensus.cc:2368] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12.
I20260709 13:10:00.182056 29137 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:00.182274 29081 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:00.182564 29137 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.183138 29137 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:00.183065 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:00.185161 29237 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.184903 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:00.182402 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:00.193063 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 174124us
I20260709 13:10:00.194006 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:00.202390 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:00.158478 29218 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:00.208217 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:00.208961 24669 raft_consensus.cc:2376] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8. Re-sending same reply.
I20260709 13:10:00.204326 24599 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.146001 29233 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:00.207239 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 78235.5us
I20260709 13:10:00.164633 29226 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:10:00.186779 29106 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:00.165547 29020 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:00.239704 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:00.195021 29230 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:00.250691 24669 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.201334 29227 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:00.215969 29218 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.164075 29111 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:10:00.206362 29081 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:00.173760 28905 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.268184 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:00.270066 24672 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:00.271636 29218 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:00.271628 28370 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.005s
I20260709 13:10:00.276472 29159 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:00.237766 29069 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:00.301774 29069 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.302913 29206 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.304277 29069 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:00.305109 28370 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.269409 29238 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:00.307081 29238 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:00.307224 28370 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.307516 29238 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.250315 29106 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:00.283629 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.252920 29210 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:00.301038 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.269340 29234 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:00.317353 24672 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:10:00.321571 29214 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:00.280866 29264 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:00.350699 29264 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.351595 29238 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.355543 29238 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.357623 29106 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.359293 29106 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:00.322708 29252 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:00.363435 29252 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.363858 29252 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:00.361814 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:00.366948 29238 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.328115 29248 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.329164 29242 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:00.263435 29230 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:00.331667 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.370283 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.370990 24674 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:10:00.371982 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.332603 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:00.372483 29146 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 13:10:00.373234 24666 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:00.373931 29046 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:00.266983 29227 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.374789 29227 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.283308 29243 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.378548 29234 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:00.333866 24665 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:00.328769 29206 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.337497 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.338425 24600 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:00.383620 24600 pending_rounds.cc:85] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 9
I20260709 13:10:00.383914 24600 pending_rounds.cc:107] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:00.384179 24600 raft_consensus.cc:2889] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:00.265308 29261 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:10:00.341921 29263 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:00.395042 24671 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:00.214686 29233 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.349915 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:00.350199 29239 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:10:00.399358 29263 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.402418 29263 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:00.367645 29229 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:10:00.409044 29243 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.323144 29258 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:10:00.391399 24523 raft_consensus.cc:2368] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:10:00.398119 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:00.398213 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.415256 24672 raft_consensus.cc:2368] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12.
I20260709 13:10:00.415652 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.416213 24665 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:00.391010 29020 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:00.403972 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.405956 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.395013 29081 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:00.406823 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.407981 29072 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
I20260709 13:10:00.408429 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.352568 29137 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.416435 29230 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:00.422653 29020 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.464274 29020 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:00.382818 29264 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:00.471668 29072 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.474835 29072 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.425541 29214 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:00.435487 24671 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:00.412482 29234 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:00.500253 29005 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 13:10:00.545429 29005 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.418965 29233 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.511795 28905 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:00.514777 29237 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.484875 29137 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.528245 29218 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.533619 24673 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:00.373037 29146 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.571334 24599 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:00.583490 24668 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:00.617987 24669 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:00.621654 24665 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.639923 24519 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:00.641911 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.038s	sys 0.053s
W20260709 13:10:00.643194 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.038s	sys 0.053s
W20260709 13:10:00.643791 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 569857us
W20260709 13:10:00.639657 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.649945 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 465060us
I20260709 13:10:00.672192 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:00.638773 29043 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:10:00.678047 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1841) took 1040 ms. Trace:
I20260709 13:10:00.679704 24519 rpcz_store.cc:276] 0709 13:09:59.637557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.637941 (+   384us) service_pool.cc:224] Handling call
0709 13:10:00.677833 (+1039892us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540006dbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:00.677990 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983673728}
I20260709 13:10:00.610085 29264 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.669545 29085 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.705860 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 568644us
I20260709 13:10:00.708277 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:00.678886 29072 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:00.689234 29137 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:00.700418 29146 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.698809 29020 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.698312 29005 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.700417 29265 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:00.741886 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 91060.3us
I20260709 13:10:00.684792 29252 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:00.720814 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:00.675927 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:00.677865 29227 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.745797 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:00.744271 29215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.004s	sys 0.023s
I20260709 13:10:00.717444 29264 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:00.750162 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.008s	sys 0.002s
W20260709 13:10:00.753597 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.008s	sys 0.002s
W20260709 13:10:00.753842 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 540759us
W20260709 13:10:00.748956 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 100890us
I20260709 13:10:00.725418 29106 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:00.742230 29137 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:00.755190 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.064s	sys 0.096s
I20260709 13:10:00.723024 29072 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:00.755700 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.064s	sys 0.096s
I20260709 13:10:00.716486 29085 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.747016 29261 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:00.752408 29215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.004s	sys 0.024s
I20260709 13:10:00.751945 29005 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:00.728108 29081 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:00.727922 29233 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:00.761004 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.004s	sys 0.007s
W20260709 13:10:00.811620 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.004s	sys 0.007s
W20260709 13:10:00.812564 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 618595us
W20260709 13:10:00.838160 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 77175.4us
I20260709 13:10:00.789984 29261 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:00.839090 29069 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.839308 29269 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.839480 29261 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.839836 29069 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.745788 29265 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.744741 29020 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.847026 29265 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:00.847664 29020 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:00.848469 24665 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:10:00.849771 24637 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.511s (SENT) [suppressed 36 similar messages]
I20260709 13:10:00.847082 29234 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.852368 29234 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:00.854769 29234 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.761137 29271 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.855782 24666 raft_consensus.cc:2368] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11.
W20260709 13:10:00.869946 29267 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:10:00.790046 29230 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.879479 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:00.798028 24521 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.005s	sys 0.007s
W20260709 13:10:00.870714 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.013s	sys 0.044s
W20260709 13:10:00.937042 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.941311 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.016s	sys 0.047s
W20260709 13:10:00.941972 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 843008us
I20260709 13:10:00.911121 24665 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:00.800422 29106 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:00.948685 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:00.953646 24598 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
W20260709 13:10:00.951005 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 204944us
W20260709 13:10:00.951700 24521 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.005s	sys 0.007s
I20260709 13:10:00.951908 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:00.957684 24595 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:00.964562 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:00.799988 29067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.001s	sys 0.011s
I20260709 13:10:00.969300 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:00.923588 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:00.972707 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 134953us
I20260709 13:10:00.975023 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:00.972362 29067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.001s	sys 0.011s
I20260709 13:10:00.976089 24600 raft_consensus.cc:2410] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:10:00.936869 29137 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:00.979818 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 226560us
I20260709 13:10:00.985253 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:01.023933 24598 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:00.986598 29069 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:00.988004 28905 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:00.988696 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:00.988731 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:00.893283 29020 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.989861 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:00.993044 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:00.988884 29046 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:10:00.946601 29264 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:00.953719 29268 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.995257 29235 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:10:00.995664 29146 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:00.996802 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73295.8us
I20260709 13:10:00.963445 29218 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:01.011268 24592 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:01.013859 29272 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:00.942742 29237 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:00.841699 29005 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:01.101157 29233 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.124554 29005 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.125784 29233 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.126426 29233 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.019474 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.021636 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:01.023138 24595 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:01.030335 24593 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.893443 29081 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.033982 24665 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:01.043959 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:01.018157 29211 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.046813 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.071722 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.142575 24674 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:10:01.040971 29020 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.072604 29234 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.072351 29271 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:01.121192 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:01.122130 29085 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:01.107210 29252 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:01.130798 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.136957 29106 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:01.128894 29072 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:01.139086 29276 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:10:01.141497 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 119947us
I20260709 13:10:01.100739 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.080938 29146 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:01.150226 24409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 206641us
I20260709 13:10:01.077430 29268 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.130209 28979 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:01.185506 24669 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:01.167200 24668 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:01.186457 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:01.145545 29227 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.218446 24593 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
W20260709 13:10:01.226958 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 203080us
W20260709 13:10:01.230554 24670 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.045s	sys 0.116s
I20260709 13:10:01.189283 29146 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:01.253873 24670 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.045s	sys 0.120s
I20260709 13:10:01.108053 29272 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:01.253722 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67380.5us
I20260709 13:10:01.258256 29243 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:01.258306 29233 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.219591 29241 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:01.146821 29211 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.268971 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:01.161358 29234 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.174486 29271 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.148177 29281 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:01.287969 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 438187us
I20260709 13:10:01.282002 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:01.287232 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:01.270643 29266 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.296211 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:01.223959 28979 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.297840 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:01.278121 29243 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:01.321364 29285 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:10:01.321812 29251 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:01.301117 29281 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:01.330193 29233 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:01.332849 29288 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:10:01.317445 29266 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:01.296237 29287 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:01.335065 29268 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.336038 24566 leader_election.cc:400] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12.
I20260709 13:10:01.337433 29211 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:01.340245 29284 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:10:01.352905 29243 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:01.296137 29252 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:10:01.345494 29272 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:01.297353 29241 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.319212 28370 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.348201 29271 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:01.294660 24672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.009s	sys 0.040s
I20260709 13:10:01.293066 29067 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.359541 29266 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.361310 29146 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.355592 29251 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.342043 29020 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:01.355381 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:01.372462 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:01.355995 29230 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.383576 24672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.009s	sys 0.041s
I20260709 13:10:01.381271 29072 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:10:01.357003 29233 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.396129 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:01.394345 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3142) took 1061 ms. Trace:
W20260709 13:10:01.383163 29229 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.009s
I20260709 13:10:01.399204 24523 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:01.404299 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 450378us
I20260709 13:10:01.406237 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:01.406867 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.412266 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.393906 29273 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:01.401794 28370 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.415074 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:01.413122 24591 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 9.
W20260709 13:10:01.406821 29261 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.565s	user 0.013s	sys 0.000s
I20260709 13:10:01.401157 29085 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:01.403278 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:01.406811 29081 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:01.407910 29235 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:01.427141 29235 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:01.427580 29235 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.424801 29222 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.403455 29215 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:10:01.393781 29230 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.404819 29020 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:10:01.431774 29230 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.432361 24597 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:01.425513 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.432758 24598 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:01.438156 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:01.438558 29251 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.439360 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:01.426491 29241 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.439211 29251 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:01.423030 29261 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:01.441939 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.442442 29253 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.443356 29253 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.443647 29261 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:01.444494 24566 leader_election.cc:400] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12.
I20260709 13:10:01.431941 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.445663 24592 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:01.446076 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:01.447162 29278 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.450209 24520 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:01.454937 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:01.455706 24520 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:01.457544 29278 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:01.458532 29251 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:01.459007 29251 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:01.426093 29233 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:01.460871 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:01.462177 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 58969.3us
I20260709 13:10:01.463677 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:01.477654 29081 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.467010 29085 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:01.478585 29275 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:01.482649 28979 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.481825 29224 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:10:01.477238 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:01.483727 29218 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:01.484252 29218 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.477023 29251 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.484827 29218 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:01.485327 29251 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:01.485697 25216 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: [9.9-13.11]
I20260709 13:10:01.486601 28370 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:01.506072 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:01.483863 25217 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:01.482730 25210 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:01.482183 25218 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.481842 25215 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:01.491415 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:01.494825 24667 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:10:01.513761 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.518639 24671 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:01.518898 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:01.521044 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.482762 29085 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.525574 24667 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:01.526518 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.527768 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.528425 24667 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:01.504901 29233 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:01.529624 29233 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.481765 29081 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.532308 29233 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:01.537451 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:01.538137 25214 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.396750 24672 rpcz_store.cc:276] 0709 13:10:00.332718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.415758 (+ 83040us) service_pool.cc:224] Handling call
0709 13:10:00.416009 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.416241 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:00.706132 (+289891us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.392174 (+686042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.392219 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:01.394035 (+  1816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.394104 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.394291 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":767699,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":811,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3668,"thread_start_us":937009,"threads_started":2}
I20260709 13:10:01.541688 29224 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:01.542407 29224 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.543077 24668 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:01.543514 24668 pending_rounds.cc:85] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 9
I20260709 13:10:01.543769 24668 pending_rounds.cc:107] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:01.544021 24668 raft_consensus.cc:2889] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:01.521867 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.545128 24673 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:01.522866 29271 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:01.523480 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:01.537979 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:01.547430 24674 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.522385 29146 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:01.506376 29264 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:01.548004 25215 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:01.482728 29275 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:01.555116 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.557591 24671 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:01.417101 29281 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.559798 25210 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.560914 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:01.560987 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:01.561591 25210 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:01.562492 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:01.556793 29264 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:01.563087 29264 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.564306 24673 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:01.561604 24669 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:10:01.555485 25217 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:01.552696 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:01.563023 25210 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.552824 29235 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.551816 29072 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.573279 25218 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:01.551972 29292 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.506585 28979 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:10:01.532980 29081 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:01.553352 29233 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:01.583031 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.573326 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:01.556165 29215 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.613346 29215 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.556253 24667 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:01.614537 28979 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.615000 28979 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:01.574581 25214 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:10:01.615887 28979 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.563808 29275 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.596330 29292 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.621503 29292 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.595587 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:01.594280 29072 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:01.626854 29072 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.627216 29233 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.628124 29072 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.629415 29233 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.630434 29067 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.608837 29020 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:01.551734 29265 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:10:01.615597 29215 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:01.556545 29234 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:01.634855 29273 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:01.642884 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:01.633646 29020 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:01.644572 29224 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:01.575160 28905 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.647528 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.026s
I20260709 13:10:01.554523 29271 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.649991 24674 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:01.657689 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:01.645179 29005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.018s
I20260709 13:10:01.648185 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:01.653822 24521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.010s	sys 0.031s
W20260709 13:10:01.655927 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.000s	sys 0.026s
I20260709 13:10:01.636400 28979 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.653206 29020 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.663486 25210 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
W20260709 13:10:01.663537 24517 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.017s	sys 0.022s
W20260709 13:10:01.669519 24517 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.017s	sys 0.022s
I20260709 13:10:01.663136 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:01.660912 24521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.011s	sys 0.031s
I20260709 13:10:01.671370 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:01.672819 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3056) took 1498 ms. Trace:
W20260709 13:10:01.669052 29259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.024s	sys 0.013s
W20260709 13:10:01.675195 29259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.025s	sys 0.013s
I20260709 13:10:01.673300 24521 rpcz_store.cc:276] 0709 13:10:00.174335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.174452 (+   117us) service_pool.cc:224] Handling call
0709 13:10:00.201848 (+ 27396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.202040 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:00.958256 (+756216us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.672246 (+713990us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:01.672318 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:01.672375 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.672610 (+   235us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.672753 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":794716,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"thread_start_us":1404576,"threads_started":2}
W20260709 13:10:01.661990 29005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.010s	sys 0.018s
W20260709 13:10:01.715533 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 424580us
I20260709 13:10:01.670125 29224 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.675794 29269 raft_consensus.cc:2764] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:01.789733 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.791821 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:01.799762 29005 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:01.800221 29005 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:01.800619 29005 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.724726 29251 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:01.802779 24592 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:01.810074 24591 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.726687 29234 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:01.773358 29276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.027s
I20260709 13:10:01.657599 28905 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.819134 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:01.820461 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 316411us
I20260709 13:10:01.825743 28905 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:01.828894 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.837116 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:01.838316 24593 raft_consensus.cc:2410] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:10:01.827028 29137 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:10:01.845710 24592 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:01.848233 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:01.850634 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.857424 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.859382 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:01.864871 29276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.008s	sys 0.027s
I20260709 13:10:01.865942 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:01.868319 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:01.869916 29294 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:10:01.679116 29273 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
W20260709 13:10:01.871510 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.878382 29301 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:10:01.878597 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:01.883148 29271 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:01.883481 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 76308.3us
I20260709 13:10:01.883934 29271 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:01.884663 29271 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:01.885353 29266 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.885667 29271 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.766227 29237 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.891278 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:01.885975 29266 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.939548 24591 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:01.765414 29241 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.163s
I20260709 13:10:01.814872 29265 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.957371 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 66198.8us
W20260709 13:10:01.938936 29280 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.002s	sys 0.025s
I20260709 13:10:01.802914 29230 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.138s
I20260709 13:10:01.898919 29234 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:01.966403 29234 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:01.962594 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:01.973959 24491 leader_election.cc:400] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11.
I20260709 13:10:01.974361 24491 leader_election.cc:403] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.978603 29293 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:01.942381 29211 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.008s	sys 0.029s
I20260709 13:10:01.928465 29251 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:01.954191 29259 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:01.876845 29292 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:01.983101 29146 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.927490 29237 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:01.984567 29211 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.029s
I20260709 13:10:01.984699 29215 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:02.013867 25210 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 8 LEARNER]: Advancing to term 9
W20260709 13:10:02.010851 24522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.011s	sys 0.034s
W20260709 13:10:02.049475 24522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.011s	sys 0.034s
W20260709 13:10:02.050292 25211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.020s
W20260709 13:10:02.050700 25211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.021s
I20260709 13:10:02.052060 29292 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:01.956341 29265 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:02.057096 25219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.024s	sys 0.052s
W20260709 13:10:02.068436 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.072427 25219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.024s	sys 0.052s
I20260709 13:10:02.081489 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.087050 24598 raft_consensus.cc:2410] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:02.088821 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:02.009305 29235 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:02.081404 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 370100us
I20260709 13:10:02.092943 25218 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:10:02.098651 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 287034us
W20260709 13:10:02.064551 29243 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.002s
I20260709 13:10:02.106637 24639 leader_election.cc:400] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:02.107317 24639 leader_election.cc:403] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:02.108984 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:02.114637 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:02.115286 25217 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:02.061638 29259 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:02.157195 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:02.157965 25215 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:02.149175 24596 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.000s	sys 0.017s
W20260709 13:10:02.161566 24596 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.017s
I20260709 13:10:02.163314 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 963) took 1209 ms. Trace:
I20260709 13:10:02.150872 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1808) took 1784 ms. Trace:
I20260709 13:10:02.165800 24670 rpcz_store.cc:276] 0709 13:10:00.377759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.441664 (+ 63905us) service_pool.cc:224] Handling call
0709 13:10:00.442032 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.442342 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:01.261044 (+818702us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.150387 (+889343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.150463 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:02.150526 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.150618 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.150785 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":822837,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":53463,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":1604709,"threads_started":3,"wal-append.queue_time_us":720935}
I20260709 13:10:02.013480 29146 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.146531 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.097782 29067 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:10:02.141399 29085 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.018s	sys 0.027s
I20260709 13:10:02.047456 29304 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:10:02.163750 24596 rpcz_store.cc:276] 0709 13:10:00.953542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.953648 (+   106us) service_pool.cc:224] Handling call
0709 13:10:00.986094 (+ 32446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:01.015607 (+ 29513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.015653 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:01.035216 (+ 19563us) log.cc:844] Serialized 52 byte log entry
0709 13:10:01.419300 (+384084us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:02.162134 (+742834us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.162762 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.163013 (+   251us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.163068 (+    55us) raft_consensus.cc:1685] finished
0709 13:10:02.163086 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.163249 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111256,"raft.queue_time_us":43772,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":11155,"thread_start_us":929698,"threads_started":2,"wal-append.queue_time_us":649318}
I20260709 13:10:02.206346 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.223235 25217 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:02.124432 29305 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.237545 25218 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:02.243985 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.225903 25184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.004s	sys 0.025s
W20260709 13:10:02.247257 25184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.004s	sys 0.025s
W20260709 13:10:02.256731 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.221095 29085 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.018s	sys 0.027s
W20260709 13:10:02.247913 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 695215us
W20260709 13:10:02.230144 29275 consensus_meta.cc:287] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.001s
I20260709 13:10:02.269642 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:02.201584 29067 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:02.246496 29218 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.000s
I20260709 13:10:02.114667 29243 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.286796 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3061) took 1292 ms. Trace:
I20260709 13:10:02.280279 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:02.279085 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.294225 24674 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:02.277724 29300 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:10:02.299134 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:02.281311 29297 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:10:02.294574 25217 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:10:02.321483 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 212541us
I20260709 13:10:02.322206 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:02.149632 29251 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.322371 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:02.305721 25218 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:02.314428 24670 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: [9.9-13.11]
I20260709 13:10:02.295573 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:02.319797 24600 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:02.289582 29106 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:02.339329 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:02.340824 24674 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:02.342072 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:02.322975 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 48897.2us
I20260709 13:10:02.343555 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:02.290232 24522 rpcz_store.cc:276] 0709 13:10:00.994727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.995618 (+   891us) service_pool.cc:224] Handling call
0709 13:10:00.995999 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.996205 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:01.392525 (+396320us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.058188 (+665663us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.286168 (+227980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.286239 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:02.286339 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.286463 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.286681 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7623,"prepare.queue_time_us":5429,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":414258,"raft.run_cpu_time_us":705,"raft.run_wall_time_us":22184,"thread_start_us":1280083,"threads_started":3}
I20260709 13:10:02.319008 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:02.344542 24671 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:02.286487 29329 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:02.299815 29266 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.353725 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:02.365448 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:02.307145 29234 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:02.366550 29293 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.281796 29275 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.320188 29299 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:02.355917 25215 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
W20260709 13:10:02.373428 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.376761 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:02.345631 29291 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:10:02.290854 29218 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.400578 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:02.401547 25215 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:02.395982 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:02.397194 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 89153.4us
I20260709 13:10:02.403401 24670 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.406602 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.407454 25219 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:02.354295 29281 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:02.408880 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:02.415990 24674 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.414094 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:02.425160 25217 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:02.389143 29302 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 13:10:02.390092 29306 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.390116 29293 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.508126 25217 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
W20260709 13:10:02.456494 29316 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 13:10:02.457928 29315 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:02.461465 29299 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:02.383265 29329 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:02.462909 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.470649 29328 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:02.481935 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:02.370836 29304 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:10:02.491307 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1024) took 1027 ms. Trace:
W20260709 13:10:02.508503 29072 consensus_meta.cc:287] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.880s	user 0.000s	sys 0.009s
I20260709 13:10:02.405562 29237 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.495209 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:02.499900 29005 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.699s	user 0.010s	sys 0.000s
I20260709 13:10:02.375102 29259 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:10:02.397506 29067 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.389060 29252 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:02.390496 29069 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.399191 29273 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 13:10:02.538383 25216 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:02.511286 24674 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:10:02.620098 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:02.455538 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:02.547703 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.580231 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3059) took 1617 ms. Trace:
I20260709 13:10:02.622906 25214 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:02.582273 25219 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:02.583151 25217 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:10:02.522368 29264 consensus_meta.cc:287] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.952s	user 0.006s	sys 0.004s
W20260709 13:10:02.494805 29308 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:10:02.586766 25211 rpcz_store.cc:276] 0709 13:10:01.464222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.464384 (+   162us) service_pool.cc:224] Handling call
0709 13:10:01.464842 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:01.505741 (+ 40899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.505776 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:01.542159 (+ 36383us) log.cc:844] Serialized 52 byte log entry
0709 13:10:02.051142 (+508983us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:02.051197 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.051313 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.491061 (+439748us) raft_consensus.cc:1685] finished
0709 13:10:02.491084 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.491245 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56015,"raft.queue_time_us":40683,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":13591,"thread_start_us":508549,"threads_started":1,"wal-append.queue_time_us":947184}
W20260709 13:10:02.540488 29326 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:02.593468 24671 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:10:02.519802 29332 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:02.568763 24670 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:02.597937 24599 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:02.540856 29230 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:02.599902 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 213757us
W20260709 13:10:02.601071 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.653538 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:02.654349 24673 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:02.519636 29275 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.530283 29343 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.524611 29293 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:02.652684 29224 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.848s	user 0.011s	sys 0.000s
I20260709 13:10:02.501068 29243 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.510838 29146 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.510380 29218 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:02.505606 29265 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:02.617072 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.015s	sys 0.020s
W20260709 13:10:02.622442 24668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.009s	sys 0.009s
W20260709 13:10:02.662606 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.016s	sys 0.020s
W20260709 13:10:02.662678 24668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.009s	sys 0.009s
I20260709 13:10:02.625973 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:02.663035 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 315830us
I20260709 13:10:02.622846 24517 rpcz_store.cc:276] 0709 13:10:00.962988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.963130 (+   142us) service_pool.cc:224] Handling call
0709 13:10:00.986312 (+ 23182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.986508 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:01.669998 (+683490us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.579748 (+909750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.579822 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:02.579887 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.579990 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.580150 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10499,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":149015,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5222,"thread_start_us":1592415,"threads_started":3,"wal-append.queue_time_us":860213}
I20260709 13:10:02.632685 25214 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:02.663594 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1019) took 1147 ms. Trace:
I20260709 13:10:02.651655 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:02.651966 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3154) took 1157 ms. Trace:
I20260709 13:10:02.664397 24671 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.663663 24674 raft_consensus.cc:2393] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:02.624222 29020 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.000s
W20260709 13:10:02.627765 29272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.013s	sys 0.003s
I20260709 13:10:02.652456 29230 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:02.664052 24668 rpcz_store.cc:276] 0709 13:10:01.515702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.557632 (+ 41930us) service_pool.cc:224] Handling call
0709 13:10:01.557925 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.558134 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:01.558396 (+   262us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.663262 (+1104866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.663318 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:02.663363 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.663423 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.663541 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6726,"prepare.queue_time_us":14360,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":162870,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":37948,"thread_start_us":1097635,"threads_started":2,"wal-append.queue_time_us":917394}
I20260709 13:10:02.625466 29252 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:02.597142 29328 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.613648 29072 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:02.669248 29272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.013s	sys 0.004s
I20260709 13:10:02.684460 29328 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.664728 29343 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:02.649811 29264 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.685560 29252 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:02.687604 29343 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:02.687813 25212 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:02.689138 29354 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:02.690287 29241 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:02.689906 29354 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.690721 29241 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:02.656690 29067 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:02.691967 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.667008 24673 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:02.529951 29266 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.666213 29224 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:02.687613 29264 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:02.700318 29271 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.700598 24593 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:02.701871 24668 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:10:02.671512 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:02.608565 29005 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:02.657608 29332 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:02.660627 29293 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.675446 29342 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.676208 24596 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:02.724538 24516 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:02.676741 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 969) took 1267 ms. Trace:
I20260709 13:10:02.657719 29299 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:02.678822 29329 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:02.680338 29230 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.681380 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1022) took 1131 ms. Trace:
I20260709 13:10:02.729530 24669 rpcz_store.cc:276] 0709 13:10:01.549997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.566071 (+ 16074us) service_pool.cc:224] Handling call
0709 13:10:01.574814 (+  8743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.607532 (+ 32718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.607574 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.634016 (+ 26442us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.092724 (+458708us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:02.111419 (+ 18695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.111495 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.681161 (+569666us) raft_consensus.cc:1685] finished
0709 13:10:02.681184 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.681324 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3035,"raft.queue_time_us":29182,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":24453,"thread_start_us":432768,"threads_started":1,"wal-append.queue_time_us":743568}
I20260709 13:10:02.673784 29304 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:02.731583 29304 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.733470 29227 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:02.734031 29227 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.734531 29304 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.682278 29072 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.696440 24671 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:02.664348 24666 rpcz_store.cc:276] 0709 13:10:01.494772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.534303 (+ 39531us) service_pool.cc:224] Handling call
0709 13:10:01.534714 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.535214 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.535256 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.535747 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.996419 (+460672us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:02.261026 (+264607us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.291382 (+ 30356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.291486 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.651713 (+360227us) raft_consensus.cc:1685] finished
0709 13:10:02.651735 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.651865 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134496,"prepare.queue_time_us":57665,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":134331,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":16186,"thread_start_us":652420,"threads_started":2,"wal-append.queue_time_us":666308}
I20260709 13:10:02.698881 29266 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:02.691627 29241 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:02.699838 28979 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.030s	user 0.012s	sys 0.000s
W20260709 13:10:02.660822 29211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.012s	sys 0.032s
I20260709 13:10:02.737599 29241 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.738102 29266 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:02.705586 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.740025 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.741138 24525 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:02.742139 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.743439 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.709295 24518 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:02.744303 24518 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:02.713567 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:02.716259 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:02.745694 24598 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:02.745409 24518 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.722625 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.746783 24518 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:02.747241 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.747826 24521 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:02.751214 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.751579 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.752426 24516 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:10:02.754086 24516 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:02.755421 24516 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.756712 24521 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:02.728294 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.759688 24522 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:02.736081 29227 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.721992 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.767028 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.778012 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.768076 24519 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:02.723325 29341 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.770813 29005 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:02.789341 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1030) took 1271 ms. Trace:
I20260709 13:10:02.790428 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:02.795639 29334 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:02.798362 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1029) took 1293 ms. Trace:
I20260709 13:10:02.812304 25216 rpcz_store.cc:276] 0709 13:10:01.504544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.504682 (+   138us) service_pool.cc:224] Handling call
0709 13:10:01.522337 (+ 17655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.621898 (+1099561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.798115 (+176217us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b540034e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:02.798303 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2143005952}
I20260709 13:10:02.673138 29020 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.805639 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:02.804386 24518 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:10:02.809789 24594 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:02.802927 25213 rpcz_store.cc:276] 0709 13:10:01.518058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.518179 (+   121us) service_pool.cc:224] Handling call
0709 13:10:01.518460 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.556368 (+ 37908us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:01.989939 (+433571us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.327492 (+337553us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.331149 (+  3657us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.355643 (+ 24494us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:02.374038 (+ 18395us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.377935 (+  3897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.788864 (+410929us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b540066b2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:02.788913 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.789062 (+   149us) raft_consensus.cc:1685] finished
0709 13:10:02.789105 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.789253 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16969,"prepare.queue_time_us":1104824,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":57,"raft.queue_time_us":12460,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":40979,"spinlock_wait_cycles":64044928,"thread_start_us":688511,"threads_started":2,"wal-append.queue_time_us":474498}
I20260709 13:10:02.818159 24518 pending_rounds.cc:85] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 8
I20260709 13:10:02.818459 24518 pending_rounds.cc:107] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:02.725715 24595 rpcz_store.cc:276] 0709 13:10:01.409035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.409189 (+   154us) service_pool.cc:224] Handling call
0709 13:10:01.409519 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.409871 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:01.543995 (+134124us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b18004212a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf 00007f17bbf60038
0709 13:10:02.011396 (+467401us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.596782 (+585386us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.597405 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.597639 (+   234us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:02.597687 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.597774 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.676396 (+ 78622us) raft_consensus.cc:1685] finished
0709 13:10:02.676547 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.676683 (+   136us) inbound_call.cc:177] Queueing success response
0709 13:10:02.686698 (+ 10015us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
Metrics: {"mutex_wait_us":35704,"prepare.queue_time_us":814948,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":63,"raft.queue_time_us":128453,"raft.run_cpu_time_us":5314,"raft.run_wall_time_us":234221,"spinlock_wait_cycles":152393856,"thread_start_us":923559,"threads_started":3,"wal-append.queue_time_us":384130}
I20260709 13:10:02.818909 24518 raft_consensus.cc:2889] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:02.819661 24518 pending_rounds.cc:107] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:02.820093 24518 raft_consensus.cc:2889] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:02.820770 24518 pending_rounds.cc:107] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:10:02.821195 24518 raft_consensus.cc:2889] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:02.815322 24516 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:02.829843 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.832543 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:02.833230 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:10:02.835830 24595 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:02.769663 29230 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:02.837638 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 124138us
I20260709 13:10:02.841063 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:02.838048 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 184420us
I20260709 13:10:02.841882 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.811136 29261 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:02.845431 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.847981 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:02.850050 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:02.851451 29269 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:02.852169 29304 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:02.758069 29342 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.853565 29269 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.855166 29342 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.840413 29227 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.855988 29227 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.857992 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:02.858507 29354 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.858073 29227 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.859217 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:02.851642 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:02.859634 29359 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.860140 29359 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.860822 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:02.861704 29360 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:02.862248 29359 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:02.862421 29146 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:02.863044 29320 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.867442 29320 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.867471 29146 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:02.867969 29320 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.868667 29146 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.871697 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.872473 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.872924 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.873426 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:02.873906 29305 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.608s	user 0.000s	sys 0.009s
I20260709 13:10:02.874049 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.874323 29305 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11.
W20260709 13:10:02.875332 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.875223 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.876278 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.876966 24525 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:02.877872 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.878914 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.879261 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.879987 24525 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:02.879874 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.863050 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:02.881783 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.863786 29218 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:02.882441 29261 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.864580 29265 raft_consensus.cc:2764] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:02.841742 29264 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.865022 29211 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:02.884156 24518 raft_consensus.cc:2410] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:02.884557 29261 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.880995 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.862274 29360 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:02.817473 29341 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.886444 29360 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.882069 29020 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:02.882920 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.852624 29241 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:02.893709 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.894340 25213 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:02.880796 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.898583 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.887681 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:02.898823 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.890491 29261 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.902148 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.902994 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:02.905242 24517 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:02.906100 24525 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:02.893616 29341 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:02.918244 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:02.918583 24518 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:02.919883 29366 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:02.923408 24521 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:02.924103 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.912087 29224 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:02.915645 29305 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.917539 29252 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:02.949232 24517 raft_consensus.cc:2410] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:02.948030 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:02.950286 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.952114 25213 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:02.934963 29251 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:02.954001 29341 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:02.956028 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:02.956691 25216 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:02.957000 25210 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:10:02.962018 29251 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.920279 29343 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:10:02.974129 24666 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:02.947875 29366 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:02.867612 29332 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:02.945763 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 86594.9us
I20260709 13:10:02.979871 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:02.980983 24521 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:02.976262 29362 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:10:02.984268 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:02.982689 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:02.991677 24637 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.511s (SENT)
I20260709 13:10:02.975455 29252 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:02.953460 29224 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:02.999794 29269 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.000275 29269 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:03.000658 29269 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.008167 29269 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.009167 29261 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:03.010682 29261 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:03.011513 29261 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:03.012049 29261 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:03.012915 29005 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:03.017314 29005 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:03.019152 29348 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:03.018421 29005 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.019485 29266 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:03.019928 29266 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:03.019698 29348 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.020243 29005 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.022300 29222 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.022655 29106 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:03.023195 29106 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.024083 29354 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:03.024706 29354 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.025265 29306 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.025789 29306 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.027462 29354 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.027907 29306 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:03.030079 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.009608 29370 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:03.013621 29261 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.032855 29346 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:03.037940 29346 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:02.979648 29241 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:03.034744 29224 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.036931 29072 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.022811 29222 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.055652 24525 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:02.999156 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:03.039070 29346 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.058009 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:03.058508 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 59426.4us
I20260709 13:10:03.058740 24523 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:03.050194 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:03.059657 24517 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:02.962311 29293 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:03.068544 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.066483 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:03.074384 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:03.074177 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:03.022341 29341 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.075397 24517 raft_consensus.cc:2410] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:03.074800 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:03.076314 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.050103 29273 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.079421 24637 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.634s (SENT)
I20260709 13:10:03.076330 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:03.082691 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.085723 24671 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.049937 29348 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:03.083103 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:03.089679 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.082716 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:03.089119 24637 leader_election.cc:336] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.646s (SENT)
I20260709 13:10:03.088701 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:02.987753 29253 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:10:03.020727 29266 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.072300 29137 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:03.068351 29067 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:03.096550 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.074879 29261 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.071468 29081 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:03.081434 29341 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.066289 29299 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:03.075034 29251 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.101040 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:03.055989 29241 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.080641 29354 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.108325 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:03.116724 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.117826 24591 raft_consensus.cc:2410] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:03.109030 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:03.119808 25213 raft_consensus.cc:2368] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11.
I20260709 13:10:03.120648 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:03.121908 25210 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:03.122087 25219 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:03.123653 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:03.124511 25211 raft_consensus.cc:2368] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:03.125393 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:03.126029 25211 raft_consensus.cc:2376] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13. Re-sending same reply.
W20260709 13:10:03.127331 24600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 968) took 1721 ms (client timeout 1841 ms). Trace:
I20260709 13:10:03.127950 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:03.128458 24592 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:03.129206 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.129593 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:03.129804 24596 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:03.127727 25217 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:03.111462 24671 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:03.086858 29346 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.112383 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:03.132462 25214 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.113490 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.133617 24525 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:03.114295 24637 leader_election.cc:336] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.662s (SENT)
W20260709 13:10:03.114781 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.115224 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.134485 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:03.134912 24594 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:03.138288 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.083488 29320 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.118557 29067 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.140491 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.100162 29252 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.091312 29273 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.104822 29137 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.381927 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.370565 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:03.383002 25211 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:03.371352 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:03.177620 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:03.363961 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 249688us
I20260709 13:10:03.365988 29230 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:03.373253 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:03.244019 24522 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
W20260709 13:10:03.127702 24600 rpcz_store.cc:269] 0709 13:10:01.406183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.406620 (+   437us) service_pool.cc:224] Handling call
0709 13:10:03.127115 (+1720495us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b540013fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:03.127274 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086026112}
I20260709 13:10:03.121244 29081 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:03.392848 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:03.362386 29266 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:03.401643 24637 leader_election.cc:336] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.678s (SENT)
I20260709 13:10:03.406198 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:03.407064 24637 leader_election.cc:336] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.733s (SENT)
I20260709 13:10:03.407336 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:03.407621 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:03.097564 29366 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.405617 25211 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.276964 29222 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.407087 24591 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:03.351238 29253 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:03.413847 24525 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:03.121244 29354 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.418210 25214 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:03.420500 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.421339 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.397233 29251 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:03.422430 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.120771 29299 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:03.424808 24637 leader_election.cc:336] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.794s (SENT)
I20260709 13:10:03.426069 24525 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.409626 29241 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.433135 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:03.420537 29375 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.315s	user 0.000s	sys 0.000s
I20260709 13:10:03.418094 29332 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:03.420635 29376 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:10:03.436372 29317 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:10:03.403226 29230 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.427924 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:03.442118 24525 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:03.444454 25211 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:03.447942 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.458554 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:03.459372 24525 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:03.461171 29332 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:03.462313 29379 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:03.464255 29230 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.465402 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.466646 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.467705 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.468264 24591 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:03.426775 29363 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:03.473986 24519 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:03.475134 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.423067 29253 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.475195 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.478317 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3155) took 1983 ms. Trace:
I20260709 13:10:03.479557 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:03.482197 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.482547 29137 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.482981 24595 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:03.483772 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.489948 24598 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:03.493180 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:03.493824 24670 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:03.494086 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:03.478701 24672 rpcz_store.cc:276] 0709 13:10:01.494992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.540066 (+ 45074us) service_pool.cc:224] Handling call
0709 13:10:01.540381 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.540765 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.540796 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.552604 (+ 11808us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.992897 (+440293us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:02.053697 (+ 60800us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.261893 (+208196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.262044 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.461208 (+1199164us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b2400437e58. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8cdf9c4 00007f17b8cddacb 00007f17b8e98dc9 00007f17b8e98a55 00007f17b8e97fb0 00007f17bbb0e488 00007f17bbb0ebe8 00007f17bbae6398 00007f17bbae176a 00007f17bbae0bb6
0709 13:10:03.473414 (+ 12206us) raft_consensus.cc:1685] finished
0709 13:10:03.478135 (+  4721us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.478261 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60890,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":232880,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":10240,"spinlock_wait_cycles":27247744,"thread_start_us":605495,"threads_started":2,"wal-append.queue_time_us":904973}
I20260709 13:10:03.495229 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:03.430481 29251 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.509189 29265 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.510349 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:03.512033 29069 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:03.514568 29369 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.567s	user 0.004s	sys 0.005s
I20260709 13:10:03.502467 29264 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:03.478096 29374 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.525369 24517 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:03.495879 29332 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:03.564865 29332 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.567708 29332 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.553035 24591 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:03.517410 29137 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.570125 29137 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.572204 29137 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.548246 29342 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:10:03.531065 29363 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.573264 29363 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.573681 29363 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.450212 29081 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.523234 29265 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.577469 29265 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.579697 29067 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.531353 29293 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:03.559211 29354 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.559382 29320 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.546252 29374 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.584019 29299 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.562775 29253 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.564294 29251 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.584894 29374 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.589713 29273 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.594220 24521 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:03.594334 29341 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.522672 29069 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.598963 29069 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:03.595968 29106 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.006s
W20260709 13:10:03.604614 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 179827us
W20260709 13:10:03.607151 24637 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.813s (SENT)
I20260709 13:10:03.610350 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:03.616252 24637 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.820s (SENT)
I20260709 13:10:03.617832 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:03.634188 24637 leader_election.cc:336] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.907s (SENT)
I20260709 13:10:03.617206 29299 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:03.607925 29106 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.630963 29227 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:03.649519 24637 leader_election.cc:336] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.963s (SENT)
I20260709 13:10:03.651093 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:03.660940 24523 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:03.659950 29299 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:03.668713 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 140973us
I20260709 13:10:03.681944 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:03.683476 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:03.681113 29374 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.689189 29307 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.607s	user 0.000s	sys 0.013s
I20260709 13:10:03.739969 29363 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.714804 24594 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:03.728619 24591 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:03.731316 29378 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.353s	user 0.000s	sys 0.000s
I20260709 13:10:03.734009 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1888) took 1886 ms. Trace:
I20260709 13:10:03.734889 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 1890) took 1885 ms. Trace:
I20260709 13:10:03.735102 29266 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:03.735450 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:10:03.742300 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.756960 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.744201 29265 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.745579 29106 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.707162 29259 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:03.753257 24593 rpcz_store.cc:276] 0709 13:10:01.849802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.852243 (+  2441us) service_pool.cc:224] Handling call
0709 13:10:01.852726 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.700971 (+848245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.734672 (+1033701us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540025b554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:03.734830 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949449088}
I20260709 13:10:03.752113 24592 rpcz_store.cc:276] 0709 13:10:01.847318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.864414 (+ 17096us) service_pool.cc:224] Handling call
0709 13:10:03.128296 (+1263882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.174694 (+ 46398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.733806 (+559112us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540013fe50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:03.733937 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2905836928}
I20260709 13:10:03.694519 29341 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:03.762883 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 237568us
I20260709 13:10:03.768460 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:03.769268 25214 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.774489 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.775409 24594 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:03.778046 24592 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:03.747802 29374 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.782662 24593 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:03.783211 29374 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.784417 25217 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:03.811784 29363 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.812297 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1035) took 2277 ms. Trace:
I20260709 13:10:03.812708 25212 rpcz_store.cc:276] 0709 13:10:01.534874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.540765 (+  5891us) service_pool.cc:224] Handling call
0709 13:10:01.541053 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.688226 (+1147173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.812057 (+1123831us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540007c454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:03.812232 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2636759296}
I20260709 13:10:03.759114 29266 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.817190 29266 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:03.817849 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:03.818487 24666 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:03.819057 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:03.819466 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:03.819819 24671 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:03.821400 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1025) took 1475 ms. Trace:
I20260709 13:10:03.822351 29069 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.824368 29069 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.759294 29259 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:03.836647 24637 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 2.031s (SENT)
I20260709 13:10:03.837240 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:03.833140 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.820756 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:03.838930 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:03.839834 25213 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.841634 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.821754 24668 rpcz_store.cc:276] 0709 13:10:02.346414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.704808 (+358394us) service_pool.cc:224] Handling call
0709 13:10:02.705815 (+  1007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.706168 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.706198 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.709561 (+  3363us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.520385 (+810824us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b1800384520. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:03.665044 (+144659us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:03.665103 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.665176 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.821139 (+155963us) raft_consensus.cc:1685] finished
0709 13:10:03.821164 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.821346 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7633,"raft.queue_time_us":85,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":8019,"spinlock_wait_cycles":13546752,"thread_start_us":144464,"threads_started":1,"wal-append.queue_time_us":1058406}
I20260709 13:10:03.842244 24591 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:03.837240 25219 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:03.843916 25214 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
W20260709 13:10:03.848544 24637 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 2.151s (SENT)
W20260709 13:10:03.860441 24637 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 2.171s (SENT)
I20260709 13:10:03.860920 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:03.845914 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:03.862762 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:03.858660 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:03.865406 24637 leader_election.cc:336] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 2.175s (SENT)
I20260709 13:10:03.866209 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:03.847865 29371 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.862s	user 0.003s	sys 0.006s
I20260709 13:10:03.845022 29396 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.857545 29251 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:03.888664 24637 leader_election.cc:336] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 2.267s (SENT)
I20260709 13:10:03.845117 29253 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:03.865926 29363 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:03.891124 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 155245us
I20260709 13:10:03.890188 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:03.895720 24599 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:03.896694 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:03.898268 25213 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:03.881394 29271 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.862054 29374 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:10:03.904172 29336 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:10:03.871644 29332 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:03.909070 29278 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.909626 29278 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.889521 29251 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:03.911949 29251 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.890854 29299 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:03.892198 29306 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.894778 29348 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.894568 29363 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:03.902096 29222 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.920773 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3159) took 1595 ms. Trace:
I20260709 13:10:03.921239 24674 rpcz_store.cc:276] 0709 13:10:02.328590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.669174 (+340584us) service_pool.cc:224] Handling call
0709 13:10:02.669715 (+   541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.670041 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.670076 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.673152 (+  3076us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.891463 (+218311us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:02.891514 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.891604 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.763751 (+872147us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:03.914012 (+150261us) raft_consensus.cc:1685] finished
0709 13:10:03.914032 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.920715 (+  6683us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2615,"raft.queue_time_us":2205,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":7924,"spinlock_wait_cycles":3060096,"thread_start_us":138103,"threads_started":1,"wal-append.queue_time_us":223692}
I20260709 13:10:03.920347 29363 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.891084 29259 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.930119 29259 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.917297 29306 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.933501 29306 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.899003 29253 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:03.949399 29400 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:03.953929 29265 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:03.955155 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3157) took 2298 ms. Trace:
I20260709 13:10:03.955718 24667 rpcz_store.cc:276] 0709 13:10:01.656608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.656738 (+   130us) service_pool.cc:224] Handling call
0709 13:10:01.657141 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.657486 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.657511 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.678020 (+ 20509us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.296433 (+618413us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:02.318387 (+ 21954us) log.cc:844] Serialized 14 byte log entry
0709 13:10:02.318584 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.318670 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.017851 (+699181us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b18003dd500. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:03.696075 (+678224us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b18003dd500. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:03.903623 (+207548us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:03.954910 (+ 51287us) raft_consensus.cc:1685] finished
0709 13:10:03.954932 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.955080 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22948,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":96791,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":1656,"spinlock_wait_cycles":97306624,"thread_start_us":481631,"threads_started":1,"wal-append.queue_time_us":680643}
I20260709 13:10:03.974695 29346 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:03.975992 29146 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:03.976401 29146 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:03.977234 29146 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:03.978596 25182 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.618s (SENT)
I20260709 13:10:03.983256 29253 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.939339 29106 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:10:03.984490 29346 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:03.985685 29261 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:03.986042 29261 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:03.984839 29266 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:03.986740 29266 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:03.986815 29261 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.988322 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 1002) took 1116 ms. Trace:
I20260709 13:10:03.987897 29266 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:03.988689 24516 rpcz_store.cc:276] 0709 13:10:02.871441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.876059 (+  4618us) service_pool.cc:224] Handling call
0709 13:10:03.988109 (+1112050us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54000dcad4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:03.988232 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566191360}
I20260709 13:10:03.936650 29222 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.989686 29266 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.990976 29222 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:03.966442 29252 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:03.993460 29353 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:03.993923 29353 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:03.994863 29353 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:03.996572 29353 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.007156 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:04.010751 29304 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:04.034372 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.035452 24516 raft_consensus.cc:2410] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:04.006032 29252 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:04.040827 24521 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.042649 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:04.043932 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:04.045065 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:04.061244 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.062256 24516 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:10:04.062500 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.012585 29106 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:10:04.066143 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.066938 24523 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:04.068312 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:04.069728 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.064126 29252 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:04.075594 29252 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:04.081293 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.082118 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3170) took 1028 ms. Trace:
I20260709 13:10:04.082407 24673 rpcz_store.cc:276] 0709 13:10:03.053621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.053776 (+   155us) service_pool.cc:224] Handling call
0709 13:10:04.081144 (+1027368us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800170798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:10:04.082041 (+   897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2685312}
I20260709 13:10:04.013098 29251 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.089740 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.098383 24522 raft_consensus.cc:2376] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11. Re-sending same reply.
I20260709 13:10:04.091809 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.099471 24667 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 8.
I20260709 13:10:04.092130 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.102133 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:04.103950 29420 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:04.107929 29415 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:10:04.108829 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.114212 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.116818 24522 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:04.117439 29253 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:04.058039 29354 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.061363 29273 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:04.120519 24522 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:04.126082 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.162793 24516 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:04.129624 29211 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:04.134164 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.138931 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.166356 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.140589 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.146916 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.114756 29407 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:04.061309 28979 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:04.163388 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.147243 24521 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:04.174220 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.174937 24521 raft_consensus.cc:2410] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:04.085304 29278 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:04.169272 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.085161 29306 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:04.093340 29304 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:04.119423 29253 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:04.163522 29273 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:04.210369 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.211020 24516 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:04.211150 24639 leader_election.cc:400] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:04.194010 24517 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
W20260709 13:10:04.195477 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 127245us
W20260709 13:10:04.169416 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 159967us
I20260709 13:10:04.205307 24670 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:04.206992 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.212006 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:04.218247 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 98044.8us
I20260709 13:10:04.219694 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.170806 29407 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:04.222532 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.224423 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.225184 24565 leader_election.cc:400] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11.
I20260709 13:10:04.225562 24565 leader_election.cc:403] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:10:04.222431 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:04.222635 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:04.226650 24668 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.226766 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.227581 24667 raft_consensus.cc:2410] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:10:04.227638 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:04.228379 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:04.229130 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:04.224809 25182 leader_election.cc:336] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.608s (SENT)
I20260709 13:10:04.229938 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:04.225032 24521 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:04.227519 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:04.194537 29253 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.166393 29363 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.213594 29273 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.216614 28979 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:04.238762 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:04.246398 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:04.247373 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.248350 24521 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:04.243757 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:04.166388 29354 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.237463 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:04.176641 29211 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:04.251536 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.251463 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 995) took 1381 ms. Trace:
I20260709 13:10:04.256356 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:04.257599 28979 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.259460 29417 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:04.265617 29419 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:04.267022 29419 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.274825 29363 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.275584 29418 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:04.277563 29418 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:04.277944 29418 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:04.278952 29418 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:04.280249 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.280447 29418 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.283056 29211 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:04.231272 29407 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.291162 29253 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:04.292176 24592 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:04.299561 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55914.4us
I20260709 13:10:04.299810 29422 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:04.252310 24518 rpcz_store.cc:276] 0709 13:10:02.869605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.885310 (+ 15705us) service_pool.cc:224] Handling call
0709 13:10:02.885599 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.944894 (+ 59295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.251220 (+1306326us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b54003ae3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:04.251405 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75433216}
W20260709 13:10:04.301224 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48024.4us
I20260709 13:10:04.308561 24668 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:04.326542 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.326431 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.252287 29397 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:04.337921 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.338600 24521 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:04.339722 24521 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:04.340940 25215 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:04.343955 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.344389 29407 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.350488 29069 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:04.352579 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.354110 29366 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.354641 29366 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:04.356688 29366 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:04.370258 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.360980 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:04.376165 25182 leader_election.cc:336] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.761s (SENT)
I20260709 13:10:04.383020 25219 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.362234 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:04.364434 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 993) took 1495 ms. Trace:
W20260709 13:10:04.385854 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 165771us
I20260709 13:10:04.359186 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:04.386902 24599 raft_consensus.cc:2368] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
W20260709 13:10:04.387732 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.388986 24516 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:04.383122 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:04.361294 29428 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:04.389918 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.405975 29428 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.406805 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.407786 24517 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:04.392947 24490 leader_election.cc:400] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:04.408195 29428 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.408531 24490 leader_election.cc:403] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:04.391153 24594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:04.409246 24594 raft_consensus.cc:606] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:04.393726 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.410010 24518 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:04.394222 29306 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:04.411600 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.411736 24599 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:10:04.412194 24599 pending_rounds.cc:85] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 12
I20260709 13:10:04.412487 24599 pending_rounds.cc:107] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:10:04.412773 24599 raft_consensus.cc:2889] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:04.405514 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.414860 29426 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.396476 29419 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11.
I20260709 13:10:04.387377 29278 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.415794 29278 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.387122 29397 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:04.417920 29397 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.418445 29278 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.359957 29360 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:04.356747 29269 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.402251 29253 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:04.403267 29261 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.324630 29304 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.357756 29251 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.439761 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.440400 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:04.440502 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.442821 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.443620 24668 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:04.445746 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:04.365229 29358 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:04.449461 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:04.450282 24669 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.437860 29363 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:04.454957 29363 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:04.455381 29407 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.456089 29363 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.415248 29354 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.412832 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.424909 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.474351 29273 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:04.425261 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 213306us
I20260709 13:10:04.430743 29359 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:04.385809 29346 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:10:04.385435 24520 rpcz_store.cc:276] 0709 13:10:02.868941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.877180 (+  8239us) service_pool.cc:224] Handling call
0709 13:10:02.877490 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.886445 (+  8955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.886475 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.886990 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.998184 (+111194us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:02.998233 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.363962 (+1365729us) spinlock_profiling.cc:243] Waited 8.62 ms on lock 0x7b5400440f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:04.364024 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.364084 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:04.364104 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.364353 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":408,"raft.queue_time_us":5527,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4819,"spinlock_wait_cycles":19829632,"thread_start_us":95852,"threads_started":1,"wal-append.queue_time_us":215257}
I20260709 13:10:04.429025 24674 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:04.462323 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.478094 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.438470 29422 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 13:10:04.466967 24637 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.654s (SENT)
I20260709 13:10:04.483721 24517 raft_consensus.cc:2376] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10. Re-sending same reply.
I20260709 13:10:04.414973 24516 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:04.478238 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:04.498118 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:04.495182 25219 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:04.501945 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:04.507438 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.507820 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.508862 24520 raft_consensus.cc:2410] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:04.479143 29358 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:04.513520 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:04.477067 29273 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.515224 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.515996 24674 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.521432 24525 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:04.522456 25182 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.907s (SENT)
I20260709 13:10:04.516623 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.503726 29360 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:04.528057 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.505661 29299 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:04.532665 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:04.513705 29269 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:04.539637 24669 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:04.541491 24516 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:04.477839 29271 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:10:04.528728 24520 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:04.556135 24674 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
W20260709 13:10:04.559563 24637 leader_election.cc:336] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.691s (SENT)
I20260709 13:10:04.566361 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:04.567409 24525 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:04.568270 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.568878 24525 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:04.590730 24517 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:04.591774 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.588138 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.527724 29360 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:04.597643 24522 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:04.598867 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.601235 24520 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:04.599359 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.543115 29299 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:04.608625 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.614394 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.614701 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.617586 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.618712 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.619606 24522 raft_consensus.cc:2376] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13. Re-sending same reply.
I20260709 13:10:04.615350 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:04.613449 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 264184us
I20260709 13:10:04.625418 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.619544 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:04.626187 24522 raft_consensus.cc:2376] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13. Re-sending same reply.
I20260709 13:10:04.626809 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.628069 24516 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:04.573310 29269 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:04.628934 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.634765 24524 raft_consensus.cc:2376] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10. Re-sending same reply.
I20260709 13:10:04.629235 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.630030 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.636451 24520 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:04.630822 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:04.633307 24674 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:04.637615 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:04.637737 24525 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:04.638159 24517 raft_consensus.cc:2376] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11. Re-sending same reply.
I20260709 13:10:04.640733 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:04.620572 29299 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.642701 24520 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:10:04.641636 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 316905us
I20260709 13:10:04.637051 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:04.647346 24516 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:04.648396 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.632040 28905 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:10:04.650288 24491 connection.cc:256] RPC call timeout handler was delayed by -2.3385184620000246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:10:04.651930 24491 connection.cc:256] RPC call timeout handler was delayed by -1.2236814840000534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 13:10:04.652158 24524 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:04.635668 29081 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:04.620217 29334 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:10:04.631632 29359 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:10:04.672749 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:04.675369 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:04.678406 24523 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:04.631845 29265 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:04.649926 29397 raft_consensus.cc:2764] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:04.696900 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:04.655925 29424 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.655632 29271 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:04.708503 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 75446.5us
I20260709 13:10:04.694820 29306 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:10:04.704682 29253 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:04.715469 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 74799.9us
I20260709 13:10:04.716817 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:04.702577 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:04.704811 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 206790us
I20260709 13:10:04.704861 29304 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:04.633513 29358 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.657407 29251 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:04.702139 29222 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:04.696862 24491 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:04.737919 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.673417 29211 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:04.715065 29428 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:04.731326 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:04.655026 29360 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:04.736160 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 99183.2us
I20260709 13:10:04.736290 29358 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.719084 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:04.781533 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62525.3us
I20260709 13:10:04.780000 29252 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.780616 29272 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:10:04.784493 29272 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:04.784852 29272 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:04.785620 29431 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:04.785822 29272 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.787153 29272 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.741918 29428 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:04.793221 29360 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.793571 29428 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.794845 29428 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:04.787483 29434 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:04.801569 29353 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:04.802098 29353 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:04.788443 29440 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:04.802992 29353 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.803692 29440 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.804427 29353 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.709247 29424 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.805316 29348 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:04.805860 29348 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.806747 29424 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.780452 29211 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:04.739894 29253 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:04.811511 29253 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.811872 29253 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.808553 29211 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:04.819336 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.823490 24599 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:04.734514 29081 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:04.829286 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 46809.5us
I20260709 13:10:04.830983 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:04.792768 29426 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:04.713394 29269 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.737560 29222 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:04.846469 24672 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:04.856698 24518 raft_consensus.cc:2368] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
W20260709 13:10:04.868194 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.834401 29418 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.003s
I20260709 13:10:04.862092 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:04.907724 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.915589 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.921464 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 185434us
I20260709 13:10:04.930814 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.932350 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.844641 29424 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.957546 24521 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:04.856993 29222 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.935217 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.935566 25213 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:10:04.962127 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.940467 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:04.941095 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:04.964483 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:04.828162 29363 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:10:04.941444 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.942168 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.942890 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.943100 29366 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:04.949198 29432 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:04.924597 29334 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:04.937033 29266 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:04.929010 29442 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:10:04.954638 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.992787 29334 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.992772 29266 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:04.994447 29266 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:04.995180 29334 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:04.955246 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.995728 29432 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:04.995833 29266 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.996235 29432 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:04.996433 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:04.956017 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.992797 29397 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:10:04.997575 29366 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.997884 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:04.958928 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.998255 29397 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:04.959512 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.998683 29397 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:04.999140 25219 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:04.999811 29366 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.999965 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.912838 29374 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:04.980700 24594 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:04.890897 29422 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.988909 29440 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:04.989590 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:04.991330 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:05.025341 24598 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.992156 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.997792 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:04.956993 28905 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.999468 29397 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.975520 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:05.001796 25218 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:05.001094 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:04.964581 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 267814us
I20260709 13:10:04.890758 29252 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:10:04.948704 29253 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:04.960302 29426 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.008371 29374 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.012247 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:05.014524 29366 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:05.035796 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 60345.3us
I20260709 13:10:05.036716 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:04.957508 29424 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:04.981665 29418 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.023658 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:05.059206 24594 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:05.060010 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:05.025171 29438 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.237s	user 0.003s	sys 0.001s
I20260709 13:10:05.001035 29442 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:04.997148 29432 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:05.047966 29440 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:05.037393 29334 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.049363 28905 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.058044 25212 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.062323 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:05.162791 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 431498us
W20260709 13:10:05.163542 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 101306us
I20260709 13:10:05.064172 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:05.051952 24593 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:05.166554 24593 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:05.026070 29271 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:05.163654 24637 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.176535 25214 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:05.035781 29422 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:05.169600 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 105542us
I20260709 13:10:05.048386 29146 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.045460 29067 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:05.178470 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:05.214428 25215 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.167788 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:05.215377 25216 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.182307 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.216027 24522 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:05.194010 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.195349 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.196079 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.220284 24520 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.105756 29418 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.221446 29418 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:05.221783 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.162181 29397 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:05.200662 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 367041us
I20260709 13:10:05.098764 29353 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.211989 24598 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:05.224189 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.232334 24517 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:10:05.224969 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.225662 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.199672 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:05.228422 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.235263 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:05.238008 24593 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:05.230777 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:05.204140 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.238758 24522 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:05.179673 29346 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.240600 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.203274 29432 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.103091 29374 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:05.168722 29440 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:05.091089 29366 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:05.270190 25212 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:05.271030 29440 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.272271 29366 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:05.247125 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.247787 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43763.3us
I20260709 13:10:05.274608 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.098814 29443 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.183s
I20260709 13:10:05.063186 29426 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.248750 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.288668 24525 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:05.249394 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.250622 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.252288 24522 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:05.091028 29442 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:05.246487 29251 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.266212 28905 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:05.266923 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.241840 29363 consensus_queue.cc:1243] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:05.251596 29424 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:05.280229 25216 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:05.286976 24520 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:05.303156 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.303861 24520 raft_consensus.cc:2376] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11. Re-sending same reply.
I20260709 13:10:05.287855 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.264484 29222 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.195060 29334 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.296106 24524 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.296875 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.306885 24522 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:05.251784 29420 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:05.252183 29444 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.299793 25215 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:05.307956 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.314256 24520 raft_consensus.cc:2376] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11. Re-sending same reply.
I20260709 13:10:05.309017 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.268852 29348 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.294274 29442 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.316696 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.322153 24522 raft_consensus.cc:2410] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:05.327034 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:05.309134 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:05.301278 29265 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.330904 24520 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:05.343272 24520 pending_rounds.cc:85] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 9
I20260709 13:10:05.331928 29452 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.336033 24516 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:05.319819 29446 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:05.343626 24594 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:05.319206 29363 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.343613 24520 pending_rounds.cc:107] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:05.361514 24520 raft_consensus.cc:2889] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.364888 24524 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
W20260709 13:10:05.368901 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.346140 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.347744 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:05.308776 29443 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:05.382858 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:05.383700 25215 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:05.393718 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:05.360881 29211 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:05.395646 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3074) took 1275 ms. Trace:
I20260709 13:10:05.416214 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:05.417152 25215 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
W20260709 13:10:05.420679 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.398726 24523 rpcz_store.cc:276] 0709 13:10:04.120177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.120281 (+   104us) service_pool.cc:224] Handling call
0709 13:10:04.120562 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.690835 (+570273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.395353 (+704518us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54003dc7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:05.395576 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1282457344}
W20260709 13:10:05.391530 29358 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 13:10:05.318199 29271 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:05.444135 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 222437us
I20260709 13:10:05.390292 29449 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.450850 25213 raft_consensus.cc:2410] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:05.452526 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:05.396595 29253 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:05.455469 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.455929 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 225180us
I20260709 13:10:05.457545 25216 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:10:05.458170 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 222963us
W20260709 13:10:05.612612 24674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.012s	sys 0.032s
W20260709 13:10:05.613065 24674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.012s	sys 0.032s
I20260709 13:10:05.613574 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:05.613847 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.614542 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:05.547995 25182 leader_election.cc:336] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.733s (SENT)
W20260709 13:10:05.615674 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 67759.5us
W20260709 13:10:05.616346 25182 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.758s (SENT)
I20260709 13:10:05.616763 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:05.456084 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.618546 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:05.619910 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:05.446349 29460 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:05.556969 25215 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 13:10:05.625391 24595 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:05.626552 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:05.453781 29299 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.796s	user 0.011s	sys 0.000s
I20260709 13:10:05.633468 24669 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:05.627789 24595 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:05.628347 24598 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:05.447221 29211 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:05.638530 24669 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:10:05.636973 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 180951us
I20260709 13:10:05.643195 24519 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
W20260709 13:10:05.494874 29272 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.003s
I20260709 13:10:05.485890 29146 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.569308 29426 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:05.487440 29363 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.578166 29222 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:05.659998 25211 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:05.699378 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:05.640373 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.637468 24595 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.662166 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:05.638720 29450 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:05.672804 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:05.495688 29422 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:05.684111 25212 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:05.583413 29348 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:05.634931 29360 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.841s	user 0.011s	sys 0.000s
W20260709 13:10:05.638131 29458 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:10:05.637318 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:05.627503 29460 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:05.732596 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:05.733856 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:05.733584 29460 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.734803 29460 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.734854 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:05.735991 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:05.737231 29422 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.737733 29422 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.739935 29422 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:05.740664 24517 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
W20260709 13:10:05.708508 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 68313.9us
I20260709 13:10:05.708647 24674 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:05.646689 29443 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.635622 29265 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:05.710177 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 69864.8us
I20260709 13:10:05.744735 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.743496 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.745857 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:05.746492 24674 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:05.746610 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.621052 29397 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:05.712495 24595 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:05.741942 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:05.634861 29469 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:05.720809 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 48123.7us
I20260709 13:10:05.712411 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:05.722707 25217 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:05.713001 29463 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:05.728565 24669 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:10:05.710183 29451 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:05.732360 29374 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:05.733136 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 105763us
I20260709 13:10:05.633751 29407 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:05.626801 29470 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.644932 29299 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.759703 25212 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:05.729471 29222 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:05.726364 29363 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.763307 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.768848 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:05.698664 29146 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.787678 24669 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:05.719515 29465 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:10:05.752417 29265 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.759267 29348 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:05.780501 25212 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:10:05.802999 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58341.1us
I20260709 13:10:05.803841 25212 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:05.804745 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:05.787410 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:05.802506 29348 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.808946 29348 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.784987 29222 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.810827 29222 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:05.811173 29468 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:10:05.811568 29334 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:05.812075 29467 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:10:05.759903 29450 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:10:05.813491 29461 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 13:10:05.814165 29436 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.073s	user 0.005s	sys 0.014s
I20260709 13:10:05.800626 29211 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.797369 29452 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:05.824625 29452 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.826900 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:05.761528 29417 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:10:05.802016 25214 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:05.788321 29407 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:05.820374 29442 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:05.784808 29470 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:05.799000 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:05.828255 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:05.807103 29374 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:05.801349 29265 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.858148 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.762795 29469 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:05.859368 25214 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:05.869540 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:05.860687 29444 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
W20260709 13:10:05.861747 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.858502 29471 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:10:05.829048 29363 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:05.855491 29478 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:05.843662 29450 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:05.876147 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 77258us
I20260709 13:10:05.877329 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:05.868378 29474 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:10:05.871354 28905 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.890023 28905 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.891486 29348 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.892159 28905 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:05.874715 29460 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.892897 24672 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:05.879170 29450 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:05.866266 29464 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:05.893524 29450 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.893620 29464 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:05.768206 29463 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:05.894090 29464 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.893774 29470 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:05.895547 29463 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:05.896714 29299 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:05.898958 29146 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:05.898980 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:05.899973 29407 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:05.902503 29266 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.906s	user 0.009s	sys 0.003s
W20260709 13:10:05.903808 29455 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.507s	user 0.000s	sys 0.008s
I20260709 13:10:05.906210 24524 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
W20260709 13:10:05.908149 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.908052 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.879774 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.909245 24525 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
W20260709 13:10:05.910055 29432 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.003s
I20260709 13:10:05.871348 29069 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.869292 29374 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:05.887084 29469 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:05.889153 29437 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.108s	user 0.010s	sys 0.004s
I20260709 13:10:05.889505 29334 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:05.900660 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.873610 29444 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:05.911465 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.914852 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:05.950896 24672 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:05.908864 24524 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:05.906246 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.965615 24520 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
W20260709 13:10:05.912838 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.917618 24595 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:10:05.974471 24595 pending_rounds.cc:85] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 9
I20260709 13:10:05.974799 24595 pending_rounds.cc:107] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:10:05.975097 24595 raft_consensus.cc:2889] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.876178 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:05.976570 24523 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:05.915321 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:05.978196 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 63006.9us
I20260709 13:10:05.882165 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:05.949626 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 72407.1us
I20260709 13:10:05.990111 24524 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:10:05.990291 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.993268 29466 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:05.995261 29466 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:05.987650 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 190779us
I20260709 13:10:05.995949 29466 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:05.947054 29374 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.949139 28905 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:10:05.998842 24565 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.764s (SENT) [suppressed 61 similar messages]
I20260709 13:10:06.013223 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:06.030445 24672 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:06.033263 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.988670 29334 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:05.992027 29106 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:06.043653 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 993) took 1058 ms. Trace:
I20260709 13:10:05.953153 29363 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:10:05.950737 29272 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:10:06.049747 29360 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:10:06.051224 29334 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.054772 29443 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.998184 29146 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 13:10:06.055573 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.997936 29266 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:10:05.997792 29469 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:06.080513 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.049139 24600 rpcz_store.cc:276] 0709 13:10:04.985347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.985496 (+   149us) service_pool.cc:224] Handling call
0709 13:10:04.988881 (+  3385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.003462 (+ 14581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.003490 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.003531 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:05.003557 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.043355 (+1039798us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b540027c9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:06.043419 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.043582 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33059200}
I20260709 13:10:06.045758 29397 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.000332 29222 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.057013 29442 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:06.049103 29106 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.051596 29278 raft_consensus.cc:1064] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:10:06.093464 24669 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 12. Ops: [10.9-10.9]
I20260709 13:10:06.000686 29485 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:10:06.061540 29360 consensus_queue.cc:1243] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:10:06.103245 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.061795 29348 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.107720 29222 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.109043 29464 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.111440 29464 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.104615 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.117558 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.117429 29450 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.119032 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.144685 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.157130 25213 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:06.121703 24600 pending_rounds.cc:85] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 8
I20260709 13:10:06.142866 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:06.158669 24600 pending_rounds.cc:107] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:10:06.159049 24600 raft_consensus.cc:2889] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.159621 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:06.122941 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.161528 25214 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
W20260709 13:10:06.153829 24521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1886) took 1749 ms (client timeout 2151 ms). Trace:
W20260709 13:10:06.172354 24521 rpcz_store.cc:269] 0709 13:10:04.404555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.412582 (+  8027us) service_pool.cc:224] Handling call
0709 13:10:06.153609 (+1741027us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b540030e654. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:06.153757 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121666816}
W20260709 13:10:06.156278 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 405833us
I20260709 13:10:06.209291 24669 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:06.219501 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 337268us
I20260709 13:10:06.228041 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 990) took 1300 ms. Trace:
I20260709 13:10:06.219720 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1445) took 1288 ms. Trace:
I20260709 13:10:06.229393 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 1025) took 1044 ms. Trace:
W20260709 13:10:06.230441 24518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1889) took 1791 ms (client timeout 2267 ms). Trace:
I20260709 13:10:06.258080 24517 rpcz_store.cc:276] 0709 13:10:05.187540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.233031 (+ 45491us) service_pool.cc:224] Handling call
0709 13:10:06.229230 (+996199us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54003dd1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:06.229334 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020297472}
W20260709 13:10:06.258626 24518 rpcz_store.cc:269] 0709 13:10:04.438763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.440206 (+  1443us) service_pool.cc:224] Handling call
0709 13:10:06.230268 (+1790062us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400442854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:06.230388 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954874752}
W20260709 13:10:06.257408 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47623.9us
I20260709 13:10:06.102788 29106 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.268488 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:06.177825 29222 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.229857 29428 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.267962 25211 rpcz_store.cc:276] 0709 13:10:04.931752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.932072 (+   320us) service_pool.cc:224] Handling call
0709 13:10:06.219489 (+1287417us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54003372d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:06.219646 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671454592}
W20260709 13:10:06.146114 29278 raft_consensus.cc:1068] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Unable to promote non-voter 983693721af6486c97ece1410a90cf30: Service unavailable: leader transfer in progress
I20260709 13:10:06.145515 29466 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:06.189178 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:06.273379 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.177911 29452 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.208312 29266 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:06.125218 29490 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:10:06.260689 24596 rpcz_store.cc:276] 0709 13:10:04.928044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.968023 (+ 39979us) service_pool.cc:224] Handling call
0709 13:10:04.968285 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.968468 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:05.345199 (+376731us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.227369 (+882170us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b18003bfbc0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a
0709 13:10:06.227624 (+   255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.227693 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:06.227752 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.227833 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.227970 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":600004,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":1201,"raft.queue_time_us":1235,"spinlock_wait_cycles":20331648,"thread_start_us":610941,"threads_started":2,"wal-append.queue_time_us":373183}
W20260709 13:10:06.275471 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 331201us
I20260709 13:10:06.257643 29417 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:06.120029 29450 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:06.325189 24639 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.630s (SENT)
I20260709 13:10:06.304612 29222 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.327750 29417 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.328229 29278 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:06.325781 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:06.329550 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.330425 29266 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:06.260391 29374 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.340399 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.135901 29265 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.315438 29271 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:06.344616 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 205704us
W20260709 13:10:06.368798 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.370643 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.371431 24674 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 7.
I20260709 13:10:06.322455 29466 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:06.326226 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 97951.2us
I20260709 13:10:06.359354 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:06.369998 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:06.375689 24669 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.373163 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:06.376842 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.377621 24674 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:06.381364 24490 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:06.379738 29472 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:10:06.360260 29266 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.388124 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.388311 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.384256 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1032) took 1194 ms. Trace:
I20260709 13:10:06.389008 24670 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:06.389405 25217 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:06.363104 29211 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.390513 24670 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:06.398183 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.368151 29271 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:06.389945 24525 rpcz_store.cc:276] 0709 13:10:05.189776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.909856 (+720080us) service_pool.cc:224] Handling call
0709 13:10:05.910143 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.910307 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:05.910576 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.383895 (+473319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.383949 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:06.383995 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.384077 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.384200 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3528,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3098,"raft.queue_time_us":83770,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10963,"thread_start_us":472959,"threads_started":2,"wal-append.queue_time_us":464926}
I20260709 13:10:06.405777 24670 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:10:06.398072 29491 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:10:06.407344 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.361879 29278 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.380311 29433 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:10:06.398631 29211 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.414606 24673 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:06.402944 29497 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:06.406075 29271 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:06.423100 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.388895 24674 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.426184 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.410138 28905 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:06.448350 24670 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:06.418236 29211 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.418942 29497 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.453589 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:06.456763 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51871.3us
I20260709 13:10:06.458317 24673 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:06.457324 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:06.455983 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 73744.7us
I20260709 13:10:06.459281 24670 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:06.442766 29261 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.461939 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:06.474701 29499 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:10:06.476972 29494 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:06.479328 29278 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.480705 29266 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.481308 29261 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.481480 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:06.481779 29261 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.482729 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:06.483270 25210 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.485406 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:06.486806 29496 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:10:06.489471 29501 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:10:06.490164 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.490772 24669 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
W20260709 13:10:06.491665 29493 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:10:06.492136 29106 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.493486 29374 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:06.494531 29265 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:06.437690 29509 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:06.495312 29509 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.495657 29509 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.488996 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1453) took 1552 ms. Trace:
I20260709 13:10:06.497454 29407 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:06.460052 29497 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.497929 29407 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:06.498452 29407 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:06.500770 29211 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.503690 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:06.505486 24674 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:10:06.509477 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:06.510080 25214 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.512072 29222 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.513937 29417 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:06.514092 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.458127 28905 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:06.517252 25213 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:06.516803 28905 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.518447 29450 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.518954 29450 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.521324 29450 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.522073 29426 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.522938 24674 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:06.523983 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:06.525385 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 57377us
I20260709 13:10:06.497356 25216 rpcz_store.cc:276] 0709 13:10:04.937068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.628067 (+690999us) service_pool.cc:224] Handling call
0709 13:10:05.646955 (+ 18888us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:05.669733 (+ 22778us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:05.866178 (+196445us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.233579 (+367401us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:06.234525 (+   946us) log.cc:844] Serialized 52 byte log entry
0709 13:10:06.234698 (+   173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:06.257728 (+ 23030us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.258543 (+   815us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.259988 (+  1445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.260078 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.488782 (+228704us) raft_consensus.cc:1685] finished
0709 13:10:06.488802 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.488940 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51335,"prepare.queue_time_us":161784,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":72,"raft.queue_time_us":48927,"raft.run_cpu_time_us":558,"raft.run_wall_time_us":48905,"spinlock_wait_cycles":8494080,"thread_start_us":411590,"threads_started":2,"wal-append.queue_time_us":506957}
I20260709 13:10:06.527798 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.531706 24666 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:06.532487 25214 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
W20260709 13:10:06.533704 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.535748 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.538091 24672 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:06.539180 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.540518 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.511714 29271 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.541365 24672 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:06.452546 29354 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:06.551862 24666 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.553763 25212 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:06.526268 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:06.555002 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:06.559603 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 225364us
I20260709 13:10:06.562894 25210 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:06.565143 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:06.522552 29426 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.563606 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:06.567016 24673 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.571885 24665 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:06.589478 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:06.598891 29348 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:06.594844 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:06.599418 29469 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:06.600076 29440 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:06.600083 29485 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:06.600515 29440 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:06.600837 29485 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:06.601447 29440 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.601976 29469 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:06.601728 29485 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.602505 29469 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:06.602677 29440 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.603375 29469 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.553912 29354 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:06.610730 25210 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:06.611104 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.568050 29363 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.567159 29417 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:06.588445 29222 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:06.553864 29432 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:10:06.593194 29464 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:10:06.571584 29374 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
W20260709 13:10:06.663825 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 204480us
W20260709 13:10:06.665795 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 91548.9us
I20260709 13:10:06.666512 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:06.666705 24670 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:06.679628 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.662510 29470 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:10:06.652415 29486 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:06.681861 29486 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:06.682263 29486 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:06.683457 29486 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.684742 29486 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.685551 29261 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.688510 29261 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.691440 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 992) took 1709 ms. Trace:
W20260709 13:10:06.692749 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.691856 24597 rpcz_store.cc:276] 0709 13:10:04.982661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.982806 (+   145us) service_pool.cc:224] Handling call
0709 13:10:05.008001 (+ 25195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.058857 (+ 50856us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:05.348803 (+289946us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.632763 (+283960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:05.633747 (+   984us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:05.633809 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.691226 (+1057417us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b540002dfd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:06.691269 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.691384 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":518547,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":257,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":116408576,"thread_start_us":572775,"threads_started":2,"wal-append.queue_time_us":407758}
I20260709 13:10:06.696542 29443 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:06.697100 29443 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:06.698064 29443 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.699470 29443 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.682206 29447 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:06.700152 29447 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:06.701004 29447 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:06.702152 29447 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.702500 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1029) took 1513 ms. Trace:
I20260709 13:10:06.702872 24516 rpcz_store.cc:276] 0709 13:10:05.188910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.362781 (+173871us) service_pool.cc:224] Handling call
0709 13:10:05.363212 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:05.389330 (+ 26118us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:05.631524 (+242194us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.725044 (+ 93520us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:05.743935 (+ 18891us) log.cc:844] Serialized 52 byte log entry
0709 13:10:05.748091 (+  4156us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:05.748364 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.753531 (+  5167us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.753731 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.753798 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.693198 (+939400us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b180034f1e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:06.696269 (+  3071us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180034f1e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1
0709 13:10:06.702287 (+  6018us) raft_consensus.cc:1685] finished
0709 13:10:06.702306 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.702447 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111630,"prepare.queue_time_us":377794,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":3646,"raft.queue_time_us":24318,"raft.run_cpu_time_us":556,"raft.run_wall_time_us":21144,"spinlock_wait_cycles":19394688,"thread_start_us":258673,"threads_started":2,"wal-append.queue_time_us":130403}
I20260709 13:10:06.704691 29526 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:06.705302 29526 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.708570 29526 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.709303 29470 consensus_queue.cc:1243] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:06.709882 29470 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.710246 29470 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:06.711099 29470 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.713472 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 998) took 1722 ms. Trace:
I20260709 13:10:06.713841 24594 rpcz_store.cc:276] 0709 13:10:04.992833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.101261 (+108428us) service_pool.cc:224] Handling call
0709 13:10:05.101571 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.349574 (+248003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.713253 (+1363679us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540025f3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:06.713418 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556139392}
I20260709 13:10:06.714722 29271 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.714928 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:06.715516 24594 raft_consensus.cc:2376] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12. Re-sending same reply.
I20260709 13:10:06.717396 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:06.717952 24599 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:06.718745 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:06.719609 29497 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.720715 24595 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:06.721298 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 56728.4us
I20260709 13:10:06.721773 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:06.722440 24593 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:06.721251 29433 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:06.724572 29433 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:06.724648 24591 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:06.725735 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:06.725497 29433 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.726503 24598 raft_consensus.cc:2368] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14.
I20260709 13:10:06.726846 29433 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:06.727810 29081 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:06.729352 29106 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:06.729558 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60240.5us
I20260709 13:10:06.731698 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.732102 29358 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:06.732470 29358 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:06.671828 29222 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:06.670018 29354 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:06.733289 29358 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.734165 29354 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.733011 29222 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.737511 29222 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.648092 29363 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:10:06.744397 24418 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 345) took 44860 ms (client timeout 15000 ms). Trace:
I20260709 13:10:06.729230 28905 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:06.745654 29426 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:06.745820 29446 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:06.748587 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:06.749262 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:06.749436 29510 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:06.750321 29510 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:06.750533 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.751165 25216 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:06.750844 29510 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:06.751678 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.751986 29495 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:06.752521 29495 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:06.752882 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.753402 29495 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.754520 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.755123 29407 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:06.756155 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.756675 29426 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.753928 29511 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.757055 29426 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:06.757349 29511 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:06.758028 29426 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.759287 29426 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.759653 29511 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:06.759976 29418 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:06.760232 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47439us
W20260709 13:10:06.761363 24519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3077) took 2631 ms (client timeout 2023 ms). Trace:
I20260709 13:10:06.761574 29418 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:06.761759 24519 rpcz_store.cc:269] 0709 13:10:04.129600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.133816 (+  4216us) service_pool.cc:224] Handling call
0709 13:10:06.761207 (+2627391us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400442354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:06.761301 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2706239872}
I20260709 13:10:06.745647 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.763250 25213 raft_consensus.cc:2376] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12. Re-sending same reply.
I20260709 13:10:06.764175 24594 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:10:06.764451 29440 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:06.766155 24671 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:06.767042 24594 pending_rounds.cc:85] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 9
I20260709 13:10:06.767318 24594 pending_rounds.cc:107] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:06.767553 24594 raft_consensus.cc:2889] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.768504 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:06.769061 25212 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.769891 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.770641 24667 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.787536 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:06.788259 24597 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:06.712422 29470 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.725670 29211 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:06.828106 29420 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:06.828809 29420 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.830890 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1447) took 1898 ms. Trace:
I20260709 13:10:06.831370 25218 rpcz_store.cc:276] 0709 13:10:04.932262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.932364 (+   102us) service_pool.cc:224] Handling call
0709 13:10:06.830643 (+1898279us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b5400477cd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:06.830812 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19266304}
I20260709 13:10:06.837122 29522 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:06.842737 29522 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:06.843636 29522 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.844707 29522 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.801746 29363 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:06.865525 29363 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:06.866123 29374 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:06.868661 29374 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:06.872860 29374 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:06.866554 29363 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:06.848045 29510 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:06.891953 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:06.893359 24525 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.931380 24517 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:06.893234 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 115533us
I20260709 13:10:06.896098 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.934396 24668 raft_consensus.cc:2376] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13. Re-sending same reply.
I20260709 13:10:06.898104 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.899433 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:06.903842 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.937819 24672 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:06.908905 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:06.938612 24524 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:06.910336 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.890766 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:06.940011 24523 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:06.930307 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.940770 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.943471 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 177387us
I20260709 13:10:06.944536 25212 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:06.947081 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:06.945632 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:06.946275 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:06.948457 24522 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:06.954324 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48709.1us
W20260709 13:10:06.955000 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.930385 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:06.744802 24418 rpcz_store.cc:269] 0709 13:09:21.884217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.884408 (+   191us) service_pool.cc:224] Handling call
0709 13:10:06.744299 (+44859891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:00.243834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:00.277907 (+ 34073us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:00.277955 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:10:00.277975 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:00.278571 (+   596us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:00.278651 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:00.278678 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:00.279100 (+   422us) tablet.cc:701] Row locks acquired
0709 13:10:00.279149 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:10:00.279304 (+   155us) write_op.cc:270] Start()
0709 13:10:00.279453 (+   149us) write_op.cc:276] Timestamp: P: 1783602600279238 usec, L: 0
0709 13:10:00.279490 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:10:00.280135 (+   645us) log.cc:844] Serialized 1311 byte log entry
0709 13:10:02.097262 (+1817127us) op_driver.cc:464] REPLICATION: finished
0709 13:10:02.683231 (+585969us) write_op.cc:301] APPLY: starting
0709 13:10:02.683367 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:02.750681 (+ 67314us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:02.750835 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:02.775586 (+ 24751us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:02.775998 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:10:02.776066 (+    68us) write_op.cc:312] APPLY: finished
0709 13:10:02.776503 (+   437us) log.cc:844] Serialized 41 byte log entry
0709 13:10:02.776733 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.776828 (+    95us) write_op.cc:454] Released schema lock
0709 13:10:02.776888 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:02.814466 (+ 37578us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.814504 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":663101,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":493821,"apply.run_cpu_time_us":8329,"apply.run_wall_time_us":139554,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":261018,"prepare.run_cpu_time_us":13955,"prepare.run_wall_time_us":633212,"raft.queue_time_us":738055,"raft.run_cpu_time_us":27312,"raft.run_wall_time_us":437110,"replication_time_us":1778013,"thread_start_us":1386323,"threads_started":4,"wal-append.queue_time_us":715793,"wal-append.run_cpu_time_us":39520,"wal-append.run_wall_time_us":2785546}]]}
I20260709 13:10:06.956545 24671 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:10:06.960518 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 211531us
W20260709 13:10:06.957610 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.958520 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:06.957850 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:06.962625 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.963445 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:06.964025 24518 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
W20260709 13:10:06.966728 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.968230 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.955283 24517 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:06.972868 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:06.984344 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:06.985000 24665 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:06.986743 24667 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:06.994643 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:06.995687 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.997660 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:06.997885 24524 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:06.998847 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:06.999871 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:07.010361 24520 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:07.018047 24522 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:06.929625 29428 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.996893 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:07.029613 24523 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.929942 29146 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:07.028055 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:07.047894 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:07.041054 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:07.043540 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:07.044365 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45814.3us
I20260709 13:10:07.049661 25215 raft_consensus.cc:2368] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14.
I20260709 13:10:07.049983 29106 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:07.044606 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:07.050652 29106 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:07.050757 25210 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:07.051676 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:07.052274 25218 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:07.049507 25216 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:06.965157 29510 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.054193 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:06.974983 29456 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:07.003487 29417 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:07.021204 29363 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.027364 29266 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.057588 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 103660us
I20260709 13:10:06.974120 29432 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
W20260709 13:10:07.069010 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.082736 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.060099 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:07.060209 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 101750us
I20260709 13:10:07.041040 29261 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:07.072364 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:07.071542 29509 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.575s	user 0.015s	sys 0.000s
I20260709 13:10:07.099624 24517 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:07.061156 29422 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:07.046923 29428 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:07.063077 29446 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 13:10:07.133064 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 73097.3us
I20260709 13:10:07.146827 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:07.148450 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:07.125696 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:07.150301 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:07.141462 29466 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:07.074587 29278 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:07.059338 29146 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.064992 29510 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:07.154033 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.154771 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:07.154671 29424 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:07.151798 29497 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:07.167549 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:07.169359 29261 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:07.168864 29511 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:07.173039 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 100635us
I20260709 13:10:07.081993 29266 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.143116 29253 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.147840 29407 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:07.067539 29456 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.161619 29360 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:07.158825 29466 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:07.152422 29538 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:07.202775 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.185710 29523 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.351s	user 0.000s	sys 0.013s
W20260709 13:10:07.205343 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.126029 29509 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.153039 29526 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:10:07.192433 29513 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:07.224064 24521 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.197687 29469 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.206883 29447 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.504s	user 0.015s	sys 0.001s
I20260709 13:10:07.171401 29278 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.212282 29466 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:07.237866 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.202862 29360 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:07.195751 29253 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:07.283792 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.258862 24521 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:07.225263 29513 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.225931 29407 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:07.226363 29534 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:07.246477 29538 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:07.252730 28979 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:07.284209 29360 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.297763 29261 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.315745 24523 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:07.303143 29513 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:07.316478 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 149003us
I20260709 13:10:07.305019 29444 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.323307 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:07.325968 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:07.323807 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 172734us
I20260709 13:10:07.247799 29469 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:07.314635 28979 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:07.314731 29534 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:07.342967 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.321570 29106 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:07.220587 29417 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:07.367933 29426 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.004s
I20260709 13:10:07.368319 29456 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:07.368753 24524 raft_consensus.cc:2410] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:10:07.371380 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.372221 29428 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:07.374178 29278 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:07.374493 29523 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:10:07.377655 29266 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:07.378481 29266 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:07.379073 29266 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:07.381651 29146 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:07.383553 29222 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260709 13:10:07.384131 29222 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:07.328783 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:07.325572 29261 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.351163 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:07.414429 24669 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:07.352178 29539 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:10:07.353325 29532 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:10:07.345991 29543 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:07.332170 29530 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:10:07.417430 29222 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:07.418856 29261 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:07.420156 29420 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.010s
I20260709 13:10:07.361759 29510 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:07.372995 29354 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.002s
I20260709 13:10:07.416567 29543 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.380210 29266 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:07.422880 29543 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:07.328298 29444 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.401125 29456 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:07.425989 29456 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:07.426857 29456 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:07.362309 29253 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:07.363111 29509 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:07.363054 29538 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:07.431628 24669 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:07.434049 29534 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.436331 29469 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:07.347126 28979 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.443785 29509 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.455652 29444 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:07.458230 29509 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.459002 29509 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.462574 29509 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:07.463758 29443 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.764s	user 0.016s	sys 0.000s
I20260709 13:10:07.464747 28979 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.466806 28979 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:07.470288 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 279766us
W20260709 13:10:07.444443 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 115733us
I20260709 13:10:07.476774 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:07.478241 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:07.479100 24517 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:07.483083 24670 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
W20260709 13:10:07.489599 29433 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.006s
I20260709 13:10:07.478309 29444 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:07.494489 29444 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.506991 24517 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:07.507606 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:07.508677 24523 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:07.509601 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:07.534348 24523 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:07.535362 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:07.536113 24523 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:07.554744 24667 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:10:07.557569 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 371301us
I20260709 13:10:07.564729 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:07.557951 24523 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:07.565802 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:07.566147 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:07.566625 24665 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:07.566789 24523 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.567673 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:07.568814 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:07.569804 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:07.420578 29420 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.570782 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:07.571338 24669 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:07.572079 29420 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:07.572832 29446 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:07.574869 29514 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.575430 29514 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.561152 24516 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:07.580885 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:07.583065 24519 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:07.585721 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:07.586364 24669 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:10:07.588239 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:07.589046 24594 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:07.589320 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.021s
W20260709 13:10:07.589646 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.006s	sys 0.021s
I20260709 13:10:07.564839 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:07.590118 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 523655us
I20260709 13:10:07.590989 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:07.591539 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:07.593271 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:07.593727 24523 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:07.596105 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:07.597061 24667 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.590729 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:07.630141 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.663476 24637 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:07.664748 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:07.600392 24566 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:07.667066 24519 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:07.602501 24594 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:07.605018 29486 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.821s	user 0.010s	sys 0.009s
I20260709 13:10:07.673250 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:07.682744 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 82440.6us
I20260709 13:10:07.689623 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:07.691180 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:07.692194 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.694098 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:07.693893 24674 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:07.598734 29266 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.687634 24667 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
W20260709 13:10:07.696491 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.601401 29534 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:07.665613 29444 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:07.557945 29272 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:10:07.664619 29509 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.683800 29420 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:07.761485 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.741640 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:07.778024 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.667023 29069 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:07.666411 29363 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.599473 29265 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:10:07.678586 29433 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.803189 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.741782 29553 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:07.812255 29069 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:07.710623 29510 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:07.704631 29447 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:07.705618 29469 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:07.697907 29222 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:07.751549 29417 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:07.837325 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 246654us
I20260709 13:10:07.776844 29534 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:07.709614 29271 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.780429 29446 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:07.801065 29495 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:07.702580 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:07.897346 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 194814us
I20260709 13:10:07.712889 29266 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.789363 29466 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:07.686334 29547 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.163s
I20260709 13:10:07.705842 29426 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:07.819536 29420 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:07.858016 29069 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.705463 29449 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 13:10:07.835877 29433 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.876964 29558 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.846449 29447 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:07.880808 29513 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.001s
I20260709 13:10:07.852779 29222 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:07.831758 29522 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.986s	user 0.011s	sys 0.005s
I20260709 13:10:07.883774 29514 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:07.829353 29509 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.844376 29469 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:07.894393 29534 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.901836 29426 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.957050 29222 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.885951 29417 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.979548 24519 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:07.982631 29509 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:07.958204 29558 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.958868 29513 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:07.978243 29538 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.989629 29510 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:07.988864 29464 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.991108 29266 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:07.993496 29447 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.016474 29433 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:07.900226 29495 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:07.913767 29363 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:10:07.901980 29446 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:07.980407 29469 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.007946 24524 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:08.011782 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1043) took 1015 ms. Trace:
I20260709 13:10:08.023768 24520 rpcz_store.cc:276] 0709 13:10:06.996850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.030013 (+ 33163us) service_pool.cc:224] Handling call
0709 13:10:07.030320 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.210088 (+179768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.210120 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.210570 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.324678 (+114108us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:07.324724 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.003215 (+678491us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003defd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:08.003322 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.003390 (+    68us) raft_consensus.cc:1685] finished
0709 13:10:08.003408 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.011704 (+  8296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2017,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":10136,"spinlock_wait_cycles":404526848,"thread_start_us":90738,"threads_started":1,"wal-append.queue_time_us":97034}
I20260709 13:10:07.986075 29426 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.010020 29510 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:08.015039 29464 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:08.035007 29558 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.036448 29464 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:08.013456 29538 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:08.020931 29557 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:10:08.042707 29538 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:08.044310 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 190925us
W20260709 13:10:08.019757 29470 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.219s	user 0.012s	sys 0.017s
I20260709 13:10:08.033684 29495 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:07.914510 29486 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:10:08.033886 29534 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.045806 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:08.033288 29446 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.048283 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:08.050155 24565 leader_election.cc:400] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14.
I20260709 13:10:08.050462 24667 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.050503 24565 leader_election.cc:403] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:08.052423 24600 raft_consensus.cc:2410] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:08.055666 24674 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:08.056262 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.053754 29522 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.057598 29417 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.057687 29522 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.058383 29211 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:08.058869 29211 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:08.059211 29354 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.059726 29211 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.060745 29211 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.044193 29420 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:08.064345 29534 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:08.065670 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.036993 29464 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:08.069068 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.070346 24674 raft_consensus.cc:2410] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:10:08.046485 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 147510us
I20260709 13:10:08.074991 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.076197 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:08.076471 24667 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:08.076695 24674 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.077454 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.052850 29538 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:08.083467 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.072521 29464 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:08.085379 24667 raft_consensus.cc:2410] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:08.078235 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.091035 24668 raft_consensus.cc:2410] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:08.081159 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:08.088135 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:08.076916 29534 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.094256 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:08.093752 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.093756 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.094012 29418 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:08.107867 24674 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:08.095602 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:08.112919 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.113766 24665 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
W20260709 13:10:08.114837 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.116381 24667 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:08.115741 29470 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:08.119268 29470 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.119653 29470 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.121773 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:08.097265 29417 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:08.141259 29426 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:08.143152 29360 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.000s
I20260709 13:10:08.143774 29426 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.143621 29360 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:08.103832 29517 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:08.157433 29517 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.158100 29360 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.110285 28979 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:08.150262 29470 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.159816 29517 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.160581 29470 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.151705 29354 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:08.154933 29466 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.155465 29486 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:08.161728 29486 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.163790 29486 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.097702 29495 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.123030 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:08.173856 24518 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:08.089372 29498 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:10:08.182250 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:08.086771 29538 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.154306 29534 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14.
I20260709 13:10:08.207580 25212 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:08.211289 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:08.130136 29418 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:08.218344 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.169425 29417 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:08.210589 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:08.222304 24490 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:08.211977 24518 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:08.213148 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.225108 25213 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:08.215161 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:08.226352 25212 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:08.216040 25216 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:08.233754 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.236986 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:08.238162 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:08.253536 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.269152 25211 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:08.301491 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.367187 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.396261 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.421849 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.421576 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:08.428092 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:08.429553 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.430859 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:08.432353 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 210135us
W20260709 13:10:08.211823 29456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.008s	sys 0.024s
I20260709 13:10:08.207109 29497 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.198697 28979 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:08.487344 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.488960 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.489749 25215 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:08.489825 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:08.211578 29466 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:08.449198 25212 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:08.450405 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:08.237552 29470 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:08.454960 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.464267 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.199564 29558 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:08.237345 29417 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:08.451053 29456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.009s	sys 0.024s
I20260709 13:10:08.495514 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.554461 24674 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:08.499419 25216 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.211699 29562 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:08.565599 29418 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.565935 29562 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.568053 29562 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:08.421098 29360 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:08.170894 29464 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.423142 29556 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.434512 29354 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.199298 29495 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.559321 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.498154 29416 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.444300 29509 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:08.569782 25213 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:08.490958 29547 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.568630 29360 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:08.558579 29469 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:10:08.541496 29502 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:08.509439 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.618854 25215 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:08.545281 29559 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:08.608062 25216 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:08.569051 29211 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.570577 29565 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:08.497624 29497 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.616763 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:08.581787 29271 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:08.597436 29544 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.245s	user 0.008s	sys 0.004s
I20260709 13:10:08.581477 29334 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:08.590708 29440 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:08.571939 29470 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.580051 29558 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.598367 29354 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.614522 29464 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.615854 29360 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:08.620030 29509 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:08.597672 29556 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:08.651989 29222 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.002s
I20260709 13:10:08.750290 29222 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:08.753795 29304 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.754951 29304 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:08.758131 29222 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.758584 29106 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.723763 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:08.586153 24525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.020s	sys 0.033s
W20260709 13:10:08.725163 24517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.028s	sys 0.024s
I20260709 13:10:08.759524 29106 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.726289 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1051) took 1062 ms. Trace:
W20260709 13:10:08.727181 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.047s	sys 0.106s
I20260709 13:10:08.728412 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:08.745775 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 324108us
W20260709 13:10:08.736294 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.631743 28979 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:08.631356 29211 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.759935 29304 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:08.725176 24520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.014s	sys 0.011s
W20260709 13:10:08.760371 24525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.020s	sys 0.033s
W20260709 13:10:08.760370 24517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.028s	sys 0.025s
I20260709 13:10:08.662530 29334 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:08.763015 24600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1002) took 2052 ms (client timeout 2131 ms). Trace:
I20260709 13:10:08.764268 29354 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.612167 29416 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:08.621734 29469 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.675541 29497 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.836557 29360 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.624038 29502 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:08.840552 29469 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.840770 29502 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.669147 29538 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.767022 24516 rpcz_store.cc:276] 0709 13:10:07.663274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.996166 (+332892us) service_pool.cc:224] Handling call
0709 13:10:07.996468 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.996768 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.996797 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.997265 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.257992 (+260727us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:08.258050 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.258143 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.725436 (+467293us) raft_consensus.cc:1685] finished
0709 13:10:08.725549 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.726014 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1418,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":1661,"thread_start_us":260369,"threads_started":1,"wal-append.queue_time_us":598773}
I20260709 13:10:08.619728 29547 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.860000 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:08.860469 29547 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.680384 29558 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:08.862025 29558 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:08.634778 29559 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:08.863554 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1044) took 1866 ms. Trace:
I20260709 13:10:08.634526 29565 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.864127 24525 rpcz_store.cc:276] 0709 13:10:06.997184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.041328 (+ 44144us) service_pool.cc:224] Handling call
0709 13:10:07.041676 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.042066 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:07.065017 (+ 22951us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.226528 (+161511us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.060465 (+833937us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b18003aa5c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:10:08.171987 (+111522us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:08.832956 (+660969us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.834012 (+  1056us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.834291 (+   279us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:08.834344 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.834468 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.863170 (+ 28702us) raft_consensus.cc:1685] finished
0709 13:10:08.863203 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.863455 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24880,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":9009,"raft.queue_time_us":32339,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":12312,"spinlock_wait_cycles":304685184,"thread_start_us":908168,"threads_started":2,"wal-append.queue_time_us":256981}
I20260709 13:10:08.867594 29416 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:08.804960 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.047s	sys 0.107s
W20260709 13:10:08.813619 24520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.014s	sys 0.012s
I20260709 13:10:08.869050 29589 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:08.869817 29589 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:08.814924 29569 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:10:08.815446 29535 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:08.839605 29360 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:08.816161 29554 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.929s	user 0.011s	sys 0.000s
W20260709 13:10:08.816474 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.760785 29261 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.815989 29563 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:10:08.832369 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.908176 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1854) took 1345 ms. Trace:
I20260709 13:10:08.908598 24671 rpcz_store.cc:276] 0709 13:10:07.562204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.562342 (+   138us) service_pool.cc:224] Handling call
0709 13:10:07.578657 (+ 16315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.578991 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.579024 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.602383 (+ 23359us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.079013 (+476630us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:08.579749 (+500736us) log.cc:844] Serialized 14 byte log entry
0709 13:10:08.579937 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.580012 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.907702 (+327690us) raft_consensus.cc:1685] finished
0709 13:10:08.907746 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.907956 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8926,"prepare.queue_time_us":588266,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":52533,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":35283,"thread_start_us":729105,"threads_started":2,"wal-append.queue_time_us":738657}
W20260709 13:10:08.835436 29527 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.492s	user 0.000s	sys 0.014s
W20260709 13:10:08.836026 29521 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.860s	user 0.000s	sys 0.021s
I20260709 13:10:08.684051 29522 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.842265 29588 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:08.842099 29509 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.846632 29106 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.846767 29456 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:10:08.848146 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1925) took 1314 ms. Trace:
I20260709 13:10:08.851099 29334 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:08.806335 24600 rpcz_store.cc:269] 0709 13:10:06.710195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.718520 (+  8325us) service_pool.cc:224] Handling call
0709 13:10:08.762386 (+2043866us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540021bbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:08.762692 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3064952704}
I20260709 13:10:08.852411 29422 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:08.827505 29570 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:10:08.854671 29470 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.655113 29440 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.867671 29565 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.684171 29556 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.888094 24520 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:10:08.831797 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 81831.5us
W20260709 13:10:08.831234 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 64896us
I20260709 13:10:08.816006 29211 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:08.895076 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.896039 25184 leader_election.cc:336] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.965s (SENT)
I20260709 13:10:08.985446 29588 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:10:08.897680 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 91478us
I20260709 13:10:08.985937 24671 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:08.986143 29588 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:08.987897 29588 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:08.897993 24521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3105) took 2005 ms (client timeout 2076 ms). Trace:
W20260709 13:10:08.989244 24521 rpcz_store.cc:269] 0709 13:10:06.892850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.892969 (+   119us) service_pool.cc:224] Handling call
0709 13:10:08.897592 (+2004623us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540030f054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:08.897793 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563804032}
W20260709 13:10:08.990278 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.908211 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1048) took 1246 ms. Trace:
I20260709 13:10:08.991140 24519 rpcz_store.cc:276] 0709 13:10:07.661520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.812344 (+150824us) service_pool.cc:224] Handling call
0709 13:10:07.812746 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.998022 (+185276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.907724 (+909702us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54000bccd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:08.908040 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359836032}
I20260709 13:10:08.991631 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1047) took 2380 ms. Trace:
I20260709 13:10:08.868155 29374 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.992094 25214 rpcz_store.cc:276] 0709 13:10:06.610672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.612010 (+  1338us) service_pool.cc:224] Handling call
0709 13:10:06.612381 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:06.626540 (+ 14159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.626588 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:06.645949 (+ 19361us) log.cc:844] Serialized 52 byte log entry
0709 13:10:07.048777 (+402828us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:07.318389 (+269612us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.318973 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.319075 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.682928 (+1363853us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:08.991186 (+308258us) raft_consensus.cc:1685] finished
0709 13:10:08.991281 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.991459 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171369,"prepare.queue_time_us":198765,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":17078,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"spinlock_wait_cycles":6403328,"thread_start_us":463610,"threads_started":2,"wal-append.queue_time_us":454442}
I20260709 13:10:08.996064 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:08.889220 29535 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:08.904529 29261 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:08.927498 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3212) took 2026 ms. Trace:
I20260709 13:10:08.929534 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:08.944252 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.944931 24668 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:08.945815 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:08.864404 29559 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:09.002210 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 72898.1us
I20260709 13:10:09.003345 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:09.004398 29522 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.005628 24667 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:09.006704 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.008046 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.011050 29261 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.011989 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:08.916544 29589 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:08.959586 29449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.012s	sys 0.030s
I20260709 13:10:08.958626 24517 rpcz_store.cc:276] 0709 13:10:07.533907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.536888 (+  2981us) service_pool.cc:224] Handling call
0709 13:10:07.537275 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.537679 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.537719 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.551920 (+ 14201us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.061674 (+509754us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b180032fce0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:08.847386 (+785712us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:08.847486 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.847609 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.847667 (+    58us) raft_consensus.cc:1685] finished
0709 13:10:08.847684 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.848060 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11908,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6245,"spinlock_wait_cycles":3708672,"thread_start_us":742564,"threads_started":1,"wal-append.queue_time_us":1094704}
W20260709 13:10:08.967944 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.972487 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 75944.3us
I20260709 13:10:08.972847 29417 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:08.974071 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.977761 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:08.980032 29440 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:08.900369 24523 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:08.996424 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:09.040649 24525 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:08.986071 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 90324.4us
I20260709 13:10:09.001147 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:09.001533 29556 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:09.001883 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.012725 29535 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:08.959385 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.016739 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:09.019140 29540 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.722s	user 0.006s	sys 0.008s
I20260709 13:10:08.998392 24673 rpcz_store.cc:276] 0709 13:10:06.901498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.901633 (+   135us) service_pool.cc:224] Handling call
0709 13:10:06.974678 (+ 73045us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.986043 (+ 11365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.986070 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.986537 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.027609 (+1041072us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b18004045c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:08.215632 (+188023us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:08.215758 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.215854 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.926896 (+711042us) raft_consensus.cc:1685] finished
0709 13:10:08.926939 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.927318 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":33451,"spinlock_wait_cycles":19109760,"thread_start_us":187786,"threads_started":1,"wal-append.queue_time_us":1555958}
I20260709 13:10:09.023759 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:09.028144 24671 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:08.999591 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.059791 24668 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:09.008770 24667 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:09.045357 24520 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:09.046092 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.046705 29417 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.049201 29495 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:09.051512 29334 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.051960 25218 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:10:09.037931 29449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.013s	sys 0.031s
I20260709 13:10:09.053330 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:09.053854 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.055013 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.055204 29510 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.055627 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.056802 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:09.078334 29588 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:09.078758 24518 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.081575 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.081784 25214 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:09.082957 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:09.085264 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 107766us
I20260709 13:10:09.086915 28979 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:09.087374 28979 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.087756 28979 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.090382 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:09.091101 25213 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:09.057307 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:09.094748 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.094976 29513 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:09.095485 25216 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:09.096531 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.046983 29535 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.097276 29420 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.097652 28979 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:09.098342 29555 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.284s	user 0.000s	sys 0.002s
I20260709 13:10:09.098815 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.100020 28979 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:09.100222 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.023830 29358 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.096733 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.091126 25215 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:09.105572 24665 raft_consensus.cc:2410] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:09.106194 24667 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:09.109057 24670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3210) took 2209 ms (client timeout 1956 ms). Trace:
W20260709 13:10:09.109638 24670 rpcz_store.cc:269] 0709 13:10:06.899081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.899203 (+   122us) service_pool.cc:224] Handling call
0709 13:10:09.108629 (+2209426us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54001397d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:09.108860 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202429824}
I20260709 13:10:09.111770 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1071) took 2536 ms. Trace:
I20260709 13:10:09.113509 24672 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:09.114250 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.114969 24673 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.115243 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3216) took 1785 ms. Trace:
I20260709 13:10:09.115738 24672 rpcz_store.cc:276] 0709 13:10:07.330105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.330282 (+   177us) service_pool.cc:224] Handling call
0709 13:10:09.112789 (+1782507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.113961 (+  1172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.115009 (+  1048us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54001397d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:09.115184 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4098476288}
I20260709 13:10:09.117319 29449 consensus_queue.cc:1243] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:09.117745 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1047) took 1456 ms. Trace:
I20260709 13:10:09.118158 24523 rpcz_store.cc:276] 0709 13:10:07.661251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.662035 (+   784us) service_pool.cc:224] Handling call
0709 13:10:08.899818 (+1237783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.047422 (+147604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.117501 (+ 70079us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540030f050. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:09.117659 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2845265280}
I20260709 13:10:09.118845 24669 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:10:09.121025 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 75983.8us
I20260709 13:10:09.121425 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1053) took 1067 ms. Trace:
I20260709 13:10:09.121811 24524 rpcz_store.cc:276] 0709 13:10:08.054005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.054825 (+   820us) service_pool.cc:224] Handling call
0709 13:10:08.067258 (+ 12433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.071360 (+  4102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.071406 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.078061 (+  6655us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.725703 (+647642us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:08.725828 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.726016 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.112010 (+385994us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002b3ca0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebbdbe 00007f17bbec6930 00007f17bbec68d8 00007f17bbec6858 00007f17bbec6813 00007f17bbec5a9c 00007f17c1db1626 00007f17c1dabdd8 00007f17bbf027cb 00007f17bbf052c0
0709 13:10:09.120904 (+  8894us) raft_consensus.cc:1685] finished
0709 13:10:09.120930 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.121228 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1135,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2544,"spinlock_wait_cycles":269226240,"thread_start_us":495210,"threads_started":1,"wal-append.queue_time_us":547890}
I20260709 13:10:09.123842 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:09.112197 24666 rpcz_store.cc:276] 0709 13:10:06.575240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.575383 (+   143us) service_pool.cc:224] Handling call
0709 13:10:06.575716 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:06.576146 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:06.965369 (+389223us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.148856 (+183487us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:07.172288 (+ 23432us) log.cc:844] Serialized 52 byte log entry
0709 13:10:07.172474 (+   186us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:07.172511 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.172582 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.018221 (+1845639us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:09.111265 (+ 93044us) raft_consensus.cc:1685] finished
0709 13:10:09.111382 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.111586 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":560556,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":3554,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":30557,"spinlock_wait_cycles":7362304,"thread_start_us":428447,"threads_started":2,"wal-append.queue_time_us":175894}
I20260709 13:10:09.132704 25216 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:09.132159 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:09.137050 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 144404us
I20260709 13:10:09.141247 25213 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:09.125675 29363 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:09.125474 29522 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:09.163866 25212 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:09.169631 24518 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
W20260709 13:10:09.172578 24566 leader_election.cc:336] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.956s (SENT)
W20260709 13:10:09.173839 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.177218 29397 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:10:09.185230 29517 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.186120 29517 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.189498 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:09.190557 24522 raft_consensus.cc:2376] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10. Re-sending same reply.
W20260709 13:10:09.191239 24522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 1923) took 1667 ms (client timeout 1896 ms). Trace:
W20260709 13:10:09.191752 24522 rpcz_store.cc:269] 0709 13:10:07.523454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.523605 (+   151us) service_pool.cc:224] Handling call
0709 13:10:09.189221 (+1665616us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b5c0010488c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bf8b0161 00007f17bfa51a79 00007f17c0f0b9b6 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:09.191164 (+  1943us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7033088}
I20260709 13:10:09.195984 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.168210 29334 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.197341 29359 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:09.197736 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.198716 29334 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:09.199456 25211 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.199741 29510 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:09.197751 29359 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.201797 29359 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:09.207406 29304 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.208184 29304 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.211306 29304 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.214152 29517 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:09.165709 29363 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:09.222465 29363 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.223986 25217 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:09.224268 29363 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.125029 29538 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:09.225991 29517 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:09.226467 29517 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:09.227560 29517 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.229125 29517 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:09.231168 24639 connection.cc:256] RPC call timeout handler was delayed by -1.6113447699999597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 13:10:09.232260 24639 connection.cc:256] RPC call timeout handler was delayed by -1.4934447699999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:10:09.232590 29272 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.267738 29272 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.269048 25219 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:09.272013 29272 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:09.235750 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.237812 29304 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:09.237845 24490 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:09.241442 25217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1051) took 2296 ms (client timeout 1625 ms). Trace:
W20260709 13:10:09.252169 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 128496us
I20260709 13:10:09.275596 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:09.276782 29538 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:09.277300 29538 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.277740 29538 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.277854 29266 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.281394 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.285262 29304 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:09.257367 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 125394us
I20260709 13:10:09.257787 29447 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:09.285926 29304 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.286118 29447 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.286377 29304 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.286551 29447 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.253206 24421 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 7 to 8, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 8 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:09.265702 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 112555us
W20260709 13:10:09.273448 25217 rpcz_store.cc:269] 0709 13:10:06.945180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.945353 (+   173us) service_pool.cc:224] Handling call
0709 13:10:09.241142 (+2295789us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54008e0154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:09.241345 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5154230656}
I20260709 13:10:09.288666 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.288913 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:09.289776 29535 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:09.290165 29535 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.290560 29535 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.290688 29417 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:09.292258 29417 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:09.292820 29420 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:09.290269 29528 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:09.293860 24421 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:09.295722 24421 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.168629 29522 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.297384 29522 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:09.300036 29535 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.302294 29535 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.304302 25211 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
W20260709 13:10:09.291424 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 279633us
W20260709 13:10:09.285238 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 113797us
I20260709 13:10:09.308871 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.310339 24668 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.260010 24673 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:10:09.308122 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3556093690000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 13:10:09.286263 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:09.155082 29449 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.318576 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.306540 29417 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:10:09.319976 29528 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:09.320417 29528 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.320839 29528 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.321564 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.322320 24672 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:10:09.322441 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.318876 29449 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.324542 29304 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.326843 24671 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:10:09.307153 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.325495 29449 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:09.334434 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:09.338353 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.340394 24665 pending_rounds.cc:85] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 9
I20260709 13:10:09.341872 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.358032 29556 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:09.358613 29271 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.345932 24672 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
W20260709 13:10:09.362020 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 55034.2us
I20260709 13:10:09.364295 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:09.365648 24639 connection.cc:256] RPC call timeout handler was delayed by -1.0712093690000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 13:10:09.366259 24639 connection.cc:256] RPC call timeout handler was delayed by -1.0127093690000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 13:10:09.340862 24665 pending_rounds.cc:107] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:09.368247 24665 raft_consensus.cc:2889] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.329285 24421 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.370123 24671 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:09.374696 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.379007 29449 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.379628 29449 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.388177 29272 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:09.388674 29272 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.389117 29272 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.390590 24667 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:09.392192 29565 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.392699 29565 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.393967 24421 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:09.394819 29565 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.395383 24522 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:10:09.395737 24522 pending_rounds.cc:85] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 8
I20260709 13:10:09.395994 24522 pending_rounds.cc:107] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:10:09.396274 24522 raft_consensus.cc:2889] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.395857 24421 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 7 to 8, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 8 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.397454 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:09.398902 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:09.399626 24524 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:10:09.331132 29538 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.402434 29538 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:09.402994 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.403169 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.403632 24600 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:10:09.403740 29449 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:09.403785 24671 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:10:09.404431 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.405314 24592 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:09.406589 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.406850 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.407796 24598 raft_consensus.cc:2410] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:09.407747 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.408600 24595 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:09.403031 24594 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:09.404543 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.410913 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:09.359328 29271 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.385788 29397 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.403905 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.364493 29359 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.424446 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.424662 24595 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:09.425540 29359 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:09.426155 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.426493 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.427415 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.427464 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.428231 24592 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:10:09.428805 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.428987 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:09.429379 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.429647 24522 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:09.429807 29464 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.427637 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.430296 29464 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.430676 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.419229 29538 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:09.433956 29538 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:09.434343 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.434958 24674 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.434899 29538 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.437526 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.427542 29422 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.438926 29422 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.440977 29422 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:09.442457 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.380856 29447 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.386813 29556 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:09.445328 29556 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:09.445672 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.448079 29304 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.429452 24599 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:09.456578 24421 catalog_manager.cc:5697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 5 to 6, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 6 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:09.458349 29447 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:09.459143 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.459828 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.460330 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.460956 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.461400 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.462083 24600 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:09.460911 24597 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:10:09.464816 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.464923 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.465499 24595 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.465667 24600 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:09.445705 29556 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:09.465535 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 43847.1us
I20260709 13:10:09.419293 29509 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:09.481412 24591 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:09.450455 29464 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:09.426741 29271 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.475247 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:09.475960 24516 raft_consensus.cc:2410] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:10:09.476482 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.487673 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:09.488252 25213 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.474370 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:09.473964 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.474805 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:09.486228 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:09.485275 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:09.489301 24600 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:09.490345 24668 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:09.491695 24671 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 13:10:09.491963 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:09.466434 29528 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.497699 25219 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:09.500079 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.500202 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 266944us
I20260709 13:10:09.504739 24674 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:09.499704 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:09.506462 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.505232 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:09.520627 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.525434 25213 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:09.486974 29517 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:10:09.531886 29535 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.532248 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.561852 25211 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:09.531935 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.535084 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.563247 25213 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:09.535365 29522 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.544652 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1079) took 1330 ms. Trace:
I20260709 13:10:09.546293 29420 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.547226 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:09.548187 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73052.2us
I20260709 13:10:09.492592 29447 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 13:10:09.549729 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 50122.5us
I20260709 13:10:09.550071 29559 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:09.529006 29509 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:09.536707 29271 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:10:09.553848 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 52271.4us
I20260709 13:10:09.563724 24595 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:09.576671 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:09.526599 24421 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 8 to 10, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 10 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:09.569471 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:09.522214 29510 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:09.454401 29397 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:09.577521 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.582494 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:09.561108 29535 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.564594 25210 rpcz_store.cc:276] 0709 13:10:08.213661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.420455 (+206794us) service_pool.cc:224] Handling call
0709 13:10:09.032516 (+612061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.033004 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:09.136914 (+103910us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.528590 (+391676us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.528958 (+   368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.529008 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:09.529050 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.529146 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.543814 (+ 14668us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b180034e340. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4
0709 13:10:09.544317 (+   503us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400602050. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:09.544459 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13549,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":41445,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":185,"spinlock_wait_cycles":1395763456,"thread_start_us":435328,"threads_started":2}
I20260709 13:10:09.584955 25213 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [9.9-12.11]
I20260709 13:10:09.583425 24593 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:09.521905 29272 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.575525 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:09.585599 25218 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:09.591852 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:09.589182 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:09.622859 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:09.626103 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50669.5us
I20260709 13:10:09.627116 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.568521 29588 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:09.581964 29363 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:09.587966 29535 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:09.635248 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46166.8us
I20260709 13:10:09.593808 29513 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:09.603050 29422 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:09.582422 29304 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:10:09.602793 29374 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.654696 29588 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:09.655611 29608 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:09.656020 29266 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.652021 29565 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:09.658880 29586 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 13:10:09.660544 29363 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:09.661739 29261 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.662575 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:09.646654 29486 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.179s
I20260709 13:10:09.665865 29449 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.665962 29528 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:09.666663 29440 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:09.670169 29397 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:09.672072 25217 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:09.673847 29509 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:09.678594 29522 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.680961 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:09.830889 24674 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:09.649605 24421 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 8 to 9, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 9 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:09.652202 29422 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:09.794196 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 205877us
I20260709 13:10:09.811022 24596 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:09.811673 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 337344us
W20260709 13:10:09.816089 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 97416.7us
I20260709 13:10:09.679047 29556 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.807571 29271 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:09.840947 24592 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:09.842124 29556 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.816776 29374 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:09.842692 29271 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:09.822062 29440 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:09.806277 29589 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:10:09.843262 29422 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:09.860675 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73041.8us
I20260709 13:10:09.862778 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:09.859889 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.867372 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:09.852730 29271 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.855564 29440 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:09.878561 29510 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:09.892109 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 265081us
I20260709 13:10:09.832422 29449 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.831076 29266 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.901921 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:09.902726 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.884797 29374 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.909893 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:09.900857 24421 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:09.912578 24673 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:09.914484 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 440913us
I20260709 13:10:09.866360 29358 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:09.897641 29261 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:09.891376 29510 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:09.898690 29272 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:09.923040 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.925235 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:09.900254 29589 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.923874 24421 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 5 to 7, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 7 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.928785 29622 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.929267 29622 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:09.929637 29622 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.930271 29449 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.926570 29363 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:09.932410 29514 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:09.932821 29514 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:09.933848 29514 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:09.935204 29514 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:09.936070 29575 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:10:09.918349 29509 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:09.938599 29509 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:09.945919 29588 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:09.949771 29617 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:10:09.946165 29422 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:09.950351 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.951820 29422 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:09.955302 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:09.956271 24524 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:09.958510 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:09.962793 24674 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:09.912325 29374 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.898962 29535 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:09.967818 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 100492us
I20260709 13:10:09.970803 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:09.977624 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 385847us
I20260709 13:10:09.922499 29517 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:09.981917 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62392.4us
I20260709 13:10:09.920935 29261 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:09.986433 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.990852 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:09.991201 25212 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:09.991657 24523 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:09.978106 29374 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.924779 29464 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:10:09.979171 29422 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:10.006793 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.999660 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.982549 29517 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.988031 29449 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:10.003394 24673 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:10.005697 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:10.035416 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.042490 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:09.981792 29358 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:10:10.032032 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:09.996515 29420 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:10.087698 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.010340 29575 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:10.062345 29081 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:10.062856 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 49293.3us
I20260709 13:10:10.088821 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:10.016616 24421 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:10.090265 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:10.063357 29470 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.065392 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:10.065717 24668 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:10.096328 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:10.039391 29517 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:09.993690 29272 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:10:10.067268 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:10.067900 29588 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:10.073815 29444 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:10:10.075062 29626 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:10:10.077672 29535 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.078917 29440 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.004156 29522 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.079034 29261 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.082892 25217 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:10.085323 25213 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:10.065909 24670 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:10.098771 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:10.067160 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:10.106633 24671 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:10.113545 24665 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:10.117695 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:10.033043 29422 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.129837 24670 pending_rounds.cc:85] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 9
I20260709 13:10:10.134033 24670 pending_rounds.cc:107] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 13:10:10.134064 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 158027us
I20260709 13:10:10.134415 24670 raft_consensus.cc:2889] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:10.009115 29528 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:10:10.092434 29575 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:10.127138 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:10.094476 29449 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:10.120491 29447 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.054275 29510 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.130247 24519 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
W20260709 13:10:10.132885 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 207725us
I20260709 13:10:10.156831 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:10.118753 29509 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:10.118960 28979 raft_consensus.cc:2764] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:10:10.102439 29304 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:10.160391 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:10.162840 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.163152 24668 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:10.163705 24592 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:10.171964 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:10.154668 29621 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.173808 24421 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 5 to 7, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 7 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.181396 24667 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:10.182642 24666 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:10.168579 29418 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:10.162853 29304 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.162660 29538 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.169389 29588 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:10.169050 29522 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:10.190725 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 192365us
W20260709 13:10:10.188805 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 117868us
I20260709 13:10:10.159960 29354 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:10.190447 29304 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:10.190894 29509 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:10.237159 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 80425us
I20260709 13:10:10.217191 29418 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:10.230656 24421 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 6 to 8, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 8 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.185791 29266 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.176728 29447 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.242452 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:10.242812 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 64613.9us
W20260709 13:10:10.236071 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 118445us
I20260709 13:10:10.254570 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:10.186240 29621 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:10.256537 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.253775 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:10.229406 29081 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:10.236915 29509 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:10.238143 29528 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:10.237015 29588 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:10.264207 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:10.264748 25213 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.262717 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:10.258807 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86201.9us
W20260709 13:10:10.261233 25184 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.639s (SENT)
I20260709 13:10:10.247815 29266 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.183957 29575 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.222924 29538 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.265448 25216 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:10.272889 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.275136 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:10.259369 29639 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.263685 29509 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.260228 29464 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:10.291194 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:10.268574 29623 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:10:10.263932 29528 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:10.303872 25213 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
W20260709 13:10:10.306772 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 49064.6us
I20260709 13:10:10.256358 29271 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.326874 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:10.330194 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 73972.9us
I20260709 13:10:10.331805 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.334268 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:10.293443 29575 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:10.336223 24525 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:10.342236 24421 catalog_manager.cc:5697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 4 to 11, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 11 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:10.299965 29464 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:10.333796 29633 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:10:10.335317 29422 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:10.255467 29449 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.335675 29266 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:10.365020 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:10.299661 29522 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.349797 29464 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.294240 29639 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.351178 29649 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.355851 29440 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:10.390440 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.391870 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 99065.7us
I20260709 13:10:10.393489 29266 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:10.394006 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 141282us
I20260709 13:10:10.395715 29266 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.396287 29266 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:10.395833 25184 leader_election.cc:336] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.075s (SENT)
I20260709 13:10:10.351070 29420 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:10.397230 24421 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:10.399667 24520 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:10:10.404935 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.473246 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3244) took 1053 ms. Trace:
W20260709 13:10:10.473291 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59349.4us
W20260709 13:10:10.403613 29635 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:10:10.406525 29638 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:10:10.402807 29646 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:10.409127 29538 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.401544 29662 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:10.476112 24669 rpcz_store.cc:276] 0709 13:10:09.419499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.419679 (+   180us) service_pool.cc:224] Handling call
0709 13:10:09.433439 (+ 13760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.463547 (+ 30108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.463580 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.473253 (+  9673us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.814787 (+341534us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:09.814828 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.814938 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.472967 (+658029us) raft_consensus.cc:1685] finished
0709 13:10:10.472995 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.473173 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39241,"raft.queue_time_us":32225,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":9527,"thread_start_us":300409,"threads_started":1,"wal-append.queue_time_us":499714}
I20260709 13:10:10.345340 29418 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:10.489877 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 151638us
I20260709 13:10:10.348170 29081 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:10.492383 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 199731us
I20260709 13:10:10.496184 24523 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
W20260709 13:10:10.500875 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 187325us
I20260709 13:10:10.506147 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.387632 29588 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.516400 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:10.512169 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 116507us
I20260709 13:10:10.515352 24671 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:10.490972 29662 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.473444 29266 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.532656 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:10.539151 25184 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.117s (SENT)
I20260709 13:10:10.539774 25184 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.469020 29528 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.531863 29662 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:10.566743 29422 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:10.569720 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.569821 29513 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.881s	user 0.011s	sys 0.000s
I20260709 13:10:10.570910 29513 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:10.524183 29621 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.571900 24519 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:10.573632 29266 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.577431 29645 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:10.529871 29447 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.558992 29470 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.572431 29517 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:10.622305 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 116247us
W20260709 13:10:10.610330 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.623550 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:10.622524 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 142689us
I20260709 13:10:10.620420 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:10.624581 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 237240us
I20260709 13:10:10.630466 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:10.631397 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:10.635030 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:10.643076 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:10.633944 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.646960 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:10.647184 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.647588 24592 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.652034 24596 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:10.638038 29266 raft_consensus.cc:2764] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:10.638819 29271 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:10.651239 29374 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.642s	user 0.005s	sys 0.006s
W20260709 13:10:10.664636 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.582472 29665 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:10:10.627491 29654 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:10.631271 29663 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:10.617852 29645 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:10.682662 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 143557us
I20260709 13:10:10.664367 29266 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.683323 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:10.684283 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:10.689142 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 58743.2us
I20260709 13:10:10.690339 24667 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:10.690167 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:10.662312 29304 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.696348 29674 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:10.674932 29374 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.691092 29668 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.707803 29668 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:10.708745 29668 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.709841 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:10.715013 29666 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.715552 29666 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.717100 25216 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:10.715854 29674 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:10.717875 29674 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:10.718313 29674 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:10.722815 29657 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:10:10.724064 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:10.724933 29538 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:10.725538 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:10.725651 29538 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:10.726344 28979 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:10.726881 28979 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:10.727294 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:10.727735 28979 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.729126 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:10.729206 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.729629 29517 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:10.699514 29656 raft_consensus.cc:2764] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:10.730520 24595 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:10:10.697718 29622 consensus_meta.cc:287] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.004s
I20260709 13:10:10.731484 29622 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.732620 24593 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:10.733022 29538 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.733636 29622 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.734679 24596 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:10.735643 29669 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:10.736007 29674 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.738138 29645 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:10.738247 29674 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:10.740693 25184 leader_election.cc:336] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.131s (SENT)
I20260709 13:10:10.741205 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.742060 29659 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.742799 29304 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:10.742940 29374 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:10.743044 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.744473 24518 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:10.679446 29513 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:10:10.745798 29464 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:10.709360 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:10.753506 24525 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:10.693521 29639 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:10.770653 29666 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.773411 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.775420 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:10.776803 24599 raft_consensus.cc:2368] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:10:10.793907 29261 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.794173 29464 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:10.799787 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.804272 29629 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.620s	user 0.004s	sys 0.000s
I20260709 13:10:10.803984 29509 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.805842 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:10.806651 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:10.807191 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:10.808228 24600 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:10.779480 29359 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:10.809340 29359 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:10.810045 24599 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:10:10.810297 29359 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:10.811546 29359 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.812526 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:10.814795 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:10.815238 29559 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:10.815765 29559 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:10.827080 24595 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
W20260709 13:10:10.828734 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.832293 24519 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:10.832773 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:10.833464 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:10.833781 24666 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:10.834008 24519 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.834460 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:10.836387 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 146319us
I20260709 13:10:10.839082 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:10.830435 25184 leader_election.cc:336] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.181s (SENT)
I20260709 13:10:10.841341 24673 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:10.845925 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.847002 29514 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.849320 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:10.877555 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:10.882488 24598 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:10.880016 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:10.887965 25216 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:10.889590 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.880122 25213 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:10.890226 24595 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:10.891968 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:10.893600 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.878981 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:10.939051 24592 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
W20260709 13:10:10.942662 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49164.4us
I20260709 13:10:10.943723 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:10.945888 24591 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:10.845691 29575 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:10.947830 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:10.880122 29464 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:10.881531 29509 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:10.960495 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.964674 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:10.965775 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:10.968905 25210 raft_consensus.cc:2368] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:10.968730 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:10.942936 29654 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.972045 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:10.973330 24524 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.971395 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:10.974578 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:10.975973 25213 raft_consensus.cc:2410] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:10.972241 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:10.978827 24520 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.971946 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.979629 24598 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:10.954909 29588 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.947546 29678 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.960690 29464 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.981452 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:10.943779 29449 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:10.993893 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:10.993712 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.996922 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:10.972373 29639 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:10.970395 29266 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.970574 29513 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.010324 24672 raft_consensus.cc:2393] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:10.970455 29575 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:11.001235 24516 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:11.001502 24591 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:10.982746 29656 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:11.016319 24597 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:10.994788 29464 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.012406 29639 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:11.025485 29639 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.033932 29684 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:10:11.034729 29684 consensus_queue.cc:1243] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:11.035339 29509 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:11.038435 29636 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.783s	user 0.004s	sys 0.000s
I20260709 13:10:11.041016 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:11.041750 25216 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:10.986814 29363 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:10:11.047544 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.977365 29662 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.033197 29650 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:10:11.016408 29682 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:10:11.066999 29682 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:11.067420 29682 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:10.957021 29559 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:11.069205 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.016201 29656 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:11.054728 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:10.982278 29654 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:11.060133 29686 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:11.063549 29662 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:11.074604 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.010998 29449 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.093420 24592 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:10:11.068369 29682 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.087464 29656 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:11.105448 24598 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:11.110525 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:11.136781 29677 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.457s	user 0.002s	sys 0.000s
I20260709 13:10:11.114697 25212 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:11.119758 24519 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:11.126601 24672 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:11.127902 29420 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:11.128407 24673 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:11.129854 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:11.112845 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 742811us
I20260709 13:10:11.148113 24671 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:11.148494 24666 raft_consensus.cc:2368] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14.
I20260709 13:10:11.163149 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.140504 29683 raft_consensus.cc:2764] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:11.164898 29652 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:11.170151 29654 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:11.160632 24639 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.033s (SENT) [suppressed 40 similar messages]
I20260709 13:10:11.151366 29420 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:11.180254 24520 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:11.104856 29464 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:11.199056 24674 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:11.203402 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.158522 29588 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:11.172830 29622 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 13:10:11.210516 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49903.9us
I20260709 13:10:11.214970 29673 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:11.215492 29673 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:11.216413 29673 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:11.217873 29673 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.218916 29510 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.220348 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:11.221496 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:11.223011 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.223827 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.224375 24595 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.229444 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:11.232062 29528 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:11.235133 29692 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:10:11.235617 29422 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:11.137785 29575 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:11.236848 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.237277 29440 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.237820 29440 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.240204 29634 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:11.240737 29634 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:11.236191 29422 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:11.196034 29682 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.249055 29449 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:11.213935 29654 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:10:11.241755 29422 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.261034 24524 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:11.265717 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.266186 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.267004 24591 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.268359 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.270885 24566 leader_election.cc:400] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14.
I20260709 13:10:11.271353 24566 leader_election.cc:403] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:11.279834 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.281440 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:11.281440 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.282246 24597 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:11.196432 29556 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
W20260709 13:10:11.284015 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74032.6us
I20260709 13:10:11.285372 24594 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:11.240196 29440 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:11.288475 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.299983 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:11.273041 29622 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:11.302647 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:11.308598 24595 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:11.289381 29652 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.309751 25218 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:11.320693 24666 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:11.315052 29650 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:11.303975 29698 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:11.302299 29634 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:11.314056 29622 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.329818 29650 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:11.350035 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.330454 29513 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.350940 24593 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:10:11.352664 24593 pending_rounds.cc:85] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 8
I20260709 13:10:11.352945 24593 pending_rounds.cc:107] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:10:11.353194 24593 raft_consensus.cc:2889] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.353518 24593 pending_rounds.cc:107] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:10:11.353740 24593 raft_consensus.cc:2889] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.342226 29440 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.356196 29440 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:11.351513 29650 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:11.320834 29588 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.387984 24524 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:11.390834 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.391793 24520 raft_consensus.cc:2368] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16.
I20260709 13:10:11.395514 24519 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:11.395977 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.393249 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:11.402720 29639 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.410627 24591 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:11.420068 29639 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:11.420701 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.421505 24595 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.422888 29622 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:11.423393 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.423735 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.425685 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.426841 24524 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:11.427067 29652 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14.
I20260709 13:10:11.427857 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.428642 24524 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:11.429658 24517 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:11.429576 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.430866 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.431182 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.432271 24518 raft_consensus.cc:2410] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:11.436026 29656 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.438344 29420 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.438930 29656 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:11.439378 29420 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.439915 24522 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:11.450276 29440 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:11.453125 29695 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
I20260709 13:10:11.457602 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.458916 24522 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:11.462066 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:11.462518 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.463770 29639 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:11.464318 29639 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.466550 29639 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:11.467119 29639 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:11.467811 29639 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:11.468696 24599 raft_consensus.cc:2410] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:11.468999 24591 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:11.472986 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.476662 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:11.485510 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 95566.1us
I20260709 13:10:11.475771 24518 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:11.488420 24520 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:11.474025 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.489503 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.489667 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.474839 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.487294 24523 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:11.485015 24516 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:11.486407 24595 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:11.498545 29589 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:11.498744 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:11.499161 29589 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:11.499887 29422 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:11.499728 29510 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:11.500497 29422 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:11.500682 29510 consensus_queue.cc:1243] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:11.501672 29589 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:11.501622 29422 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.504993 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.505999 24516 raft_consensus.cc:2410] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:10:11.505906 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.513304 24519 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:10:11.498136 29522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.024s	sys 0.018s
I20260709 13:10:11.514256 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.521138 24520 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:11.523092 24595 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:11.524597 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 209142us
I20260709 13:10:11.504112 29363 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:11.518751 29522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.024s	sys 0.018s
I20260709 13:10:11.531330 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.534057 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.540963 24524 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:11.544389 24490 leader_election.cc:400] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:11.544926 24490 leader_election.cc:403] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:11.550026 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:11.554491 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.552749 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:11.553395 29513 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:11.470491 29639 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.530347 29363 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:11.561501 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.565510 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.566319 24595 raft_consensus.cc:2368] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:11.567339 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.568152 24597 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:11.569392 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.570290 24591 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:11.531842 29271 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:11.560751 29682 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:11.576756 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:11.576378 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.578925 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:11.579461 24668 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.580404 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:11.581581 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.582163 24591 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:11.563313 29588 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:11.583235 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.583729 29673 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:11.584297 29559 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:11.584708 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:11.584806 29559 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.585786 29418 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:11.586272 29418 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:11.586948 29559 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:11.587177 29418 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.587598 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:11.588495 24665 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:11.591598 29588 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:11.593745 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.587808 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:11.594883 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.594372 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.564321 29363 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.595963 29271 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:11.597241 29447 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:11.597528 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:11.597915 29464 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:11.598918 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.599586 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:11.600816 24597 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:11.598577 29464 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:11.607527 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.596879 29271 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:11.618281 24597 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:11.620088 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:11.620667 25216 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.630956 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.630376 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:11.631158 24674 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:11.635551 24591 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:11.624372 25217 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:10:11.639824 25216 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:11.624513 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:11.644174 24668 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:11.647373 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.652547 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.643951 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.652215 25217 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 9 LEARNER]: Advancing to term 10
I20260709 13:10:11.602150 29359 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.592758 29588 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:11.659145 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 112073us
W20260709 13:10:11.658043 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.655936 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:11.677456 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.679931 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:11.680099 24520 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:11.681715 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:11.682266 24524 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.658355 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:11.677500 24596 raft_consensus.cc:606] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:11.683385 24596 raft_consensus.cc:614] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.683583 24523 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:11.683991 24595 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:11.684765 24519 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:11.686463 24669 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:11.620994 29659 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.686483 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:11.684988 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:11.689054 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:11.637152 29271 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:11.691108 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.695076 24597 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:10:11.697578 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:11.697634 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:11.655135 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.689884 25211 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:11.613485 29464 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:11.625995 29701 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:11.705297 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.706027 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.706794 24591 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.708186 24491 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:11.648456 29575 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:11.698978 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:11.705054 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:11.688716 29559 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:11.716104 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.716333 24525 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:11.722218 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.734263 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.706581 29464 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.852190 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:11.852783 24596 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:11.757967 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.853513 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:11.688939 29359 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.855475 29359 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:11.764087 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.706830 29659 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:11.856632 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.858256 29659 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:11.859704 29470 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.860185 29470 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:11.860584 24596 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:11.654106 29650 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:11.793761 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:10:11.802313 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 193288us
I20260709 13:10:11.722427 29522 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:10:11.643057 29556 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:10:11.830111 25213 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:11.704919 29628 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.715037 29449 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:10:11.831235 24524 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:11.831538 25219 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:11.831957 24563 leader_election.cc:400] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16.
I20260709 13:10:11.876541 24563 leader_election.cc:403] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:11.831898 25211 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:11.834203 24598 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:11.734385 29707 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:10:11.653468 29447 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:10:11.837714 24600 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:11.839910 25217 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 10 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:11.846570 24591 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:11.849377 29701 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:11.850474 24525 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:11.838215 24593 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:11.896849 24596 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:11.851439 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.853685 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:11.871861 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:11.852435 29363 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.895900 24599 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:11.901217 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 69358.1us
W20260709 13:10:11.901070 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 204305us
I20260709 13:10:11.922896 24518 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:11.924252 24521 raft_consensus.cc:2368] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20.
W20260709 13:10:11.924407 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 216323us
I20260709 13:10:11.927103 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:11.927887 24409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 168335us
I20260709 13:10:11.870182 29575 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:11.886145 29559 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:11.924893 28979 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:11.924263 29363 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:11.932859 29683 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.933070 29698 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:11.932621 29261 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.947678 29522 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:11.964015 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:11.993101 25216 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:11.962945 29513 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.962782 29639 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:11.968452 29422 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.970479 29522 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:11.962977 29420 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:10:12.020144 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1105) took 1136 ms. Trace:
I20260709 13:10:12.020732 25216 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:12.020581 25218 rpcz_store.cc:276] 0709 13:10:10.878184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.878712 (+   528us) service_pool.cc:224] Handling call
0709 13:10:12.014135 (+1135423us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54003c7b54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:12.014241 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696711424}
I20260709 13:10:11.970168 29261 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.000478 29719 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16.
I20260709 13:10:11.966877 29683 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:11.999966 29718 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:10:11.959909 29271 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:12.031800 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 160913us
W20260709 13:10:12.033365 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 319852us
W20260709 13:10:12.031016 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 61883.4us
I20260709 13:10:12.026649 29556 consensus_queue.cc:1243] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:12.047706 29556 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:12.047887 29698 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.048117 29556 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:12.025496 29359 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:10:12.048504 29698 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.048975 29556 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.023515 29559 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.050221 29556 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.045022 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:12.025279 29736 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.032207 29447 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:12.017985 29659 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:10:12.014237 29639 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.073348 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.074215 24592 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:12.044236 29470 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:12.073348 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.076150 24593 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:12.048277 29440 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:12.023277 29422 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.083779 24597 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:12.059109 29447 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:12.085805 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 114676us
W20260709 13:10:12.096095 29715 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:10:12.096907 29683 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.097576 29683 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:12.073164 29701 consensus_queue.cc:1175] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0131806e3b9647128f32db1ab8d314fc" responder_term: 13 status { last_received { term: 13 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 13 index: 9 } }
I20260709 13:10:12.029546 29575 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:12.108110 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.052462 29736 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:12.125936 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81620.9us
I20260709 13:10:12.127558 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.062418 29731 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:12.111516 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:12.087049 29704 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.081352 29271 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.076304 29650 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.085994 29738 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.080097 29440 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:12.145597 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67543.6us
I20260709 13:10:12.154306 29261 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.170836 29422 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:12.171284 29634 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.183516 29639 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.186721 29736 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:12.191061 24519 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.090977 29513 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:10:12.195696 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.197363 29740 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:12.198083 29740 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:12.198766 29447 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.199237 29740 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.200469 29447 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:12.149670 29719 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.085916 29737 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:10:12.202749 29737 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:12.203174 29737 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:12.150056 29727 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:12.205780 29727 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.192430 29722 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:12.098070 29683 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.208482 29727 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:12.209507 29683 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.099519 29643 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:10:12.149062 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:12.210444 29440 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.211902 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.212291 29440 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.214660 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.218364 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.219372 24525 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:12.138664 29731 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:12.220500 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 180086us
I20260709 13:10:12.150586 29704 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:12.231513 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 104059us
W20260709 13:10:12.233408 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 186467us
I20260709 13:10:12.135931 24592 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:12.241042 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.241922 24592 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:10:12.247274 24594 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:12.250046 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:12.063735 29522 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.264427 24668 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:12.264736 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:12.204236 29737 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.273134 24671 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:12.277300 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:12.230204 29704 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.233168 29449 consensus_queue.cc:1243] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:12.270911 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:12.234201 29731 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.299522 24668 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:10:12.306402 24670 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:12.247645 29701 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:12.309875 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:12.311823 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:12.310492 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.312614 24519 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:12.313164 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:12.336819 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 263109us
I20260709 13:10:12.264537 29735 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:12.274675 29727 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:12.271941 29668 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.271649 29739 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:12.346900 24669 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:12.347350 24669 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:12.333837 29522 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.343068 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:12.340920 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:12.339757 29738 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:12.363828 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 130740us
I20260709 13:10:12.363776 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:12.313308 29704 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:12.368592 25212 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:12.366590 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:12.364866 24669 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.339920 29513 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:12.336534 29656 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:10:12.367238 29738 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.416178 24669 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.417372 24671 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:12.351161 29514 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:10:12.419649 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.338624 29701 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.425199 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:12.425894 25217 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:12.394197 29745 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.434837 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.435076 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:12.352597 29727 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.435822 24671 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:12.349057 29735 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.435926 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:12.403312 29707 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.394204 29729 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:12.441874 25218 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.443219 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.354622 29739 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.446787 24671 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:12.421782 29738 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.461105 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:12.385412 29668 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:10:12.471632 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.472931 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.403046 29704 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.476833 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.477643 25212 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:10:12.478303 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 243886us
I20260709 13:10:12.442370 29745 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:12.483286 29747 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:12.484892 29745 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.485435 29745 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:12.486665 29745 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:12.486830 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.487049 29745 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.487422 29745 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.459295 29449 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:12.489902 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.499291 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.500313 25217 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:12.509049 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:12.505317 29464 consensus_meta.cc:287] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.003s
I20260709 13:10:12.501508 29449 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:12.560503 29449 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:12.526364 29742 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:10:12.529230 29464 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.568106 29464 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.532503 29739 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:12.479416 29736 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:12.538457 29701 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.540076 24517 raft_consensus.cc:2410] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:12.535262 24669 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:10:12.570218 24669 pending_rounds.cc:85] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 10
I20260709 13:10:12.570521 24669 pending_rounds.cc:107] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:12.570776 24669 raft_consensus.cc:2889] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.570984 29702 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:12.545368 29634 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.571604 29702 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.571985 29634 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.545946 29669 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:12.573335 29669 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:12.573741 29720 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:10:12.573882 29702 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.574162 29634 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:12.546748 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.547303 25218 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:12.464397 29729 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.575749 29704 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:12.577324 29729 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.577590 29668 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:12.578259 29716 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.556s	user 0.004s	sys 0.001s
I20260709 13:10:12.554406 29735 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.578415 29668 consensus_queue.cc:1243] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:12.511525 29639 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:12.552713 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.574213 29669 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.520151 29665 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.581051 29669 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.584146 25215 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:12.585453 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.588479 29698 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.590672 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1024) took 1011 ms. Trace:
I20260709 13:10:12.591071 24595 rpcz_store.cc:276] 0709 13:10:11.578943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.581288 (+  2345us) service_pool.cc:224] Handling call
0709 13:10:12.590485 (+1009197us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54001cb454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:12.590595 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161553792}
I20260709 13:10:12.590571 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:12.592993 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.593343 24518 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:12.555019 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.594967 29728 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:12.595389 29728 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:12.596156 29728 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.597626 29735 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:12.598359 29735 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.601364 29735 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.602022 29739 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.602584 29739 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.603987 29449 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:12.605641 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 96712us
I20260709 13:10:12.610579 24525 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:12.625946 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.626849 24525 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:12.613834 29728 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.612043 29739 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:12.600911 29731 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:12.639225 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 361977us
W20260709 13:10:12.637975 29762 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.073s	user 0.001s	sys 0.001s
I20260709 13:10:12.633809 29589 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:12.660713 29717 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.646s	user 0.001s	sys 0.003s
I20260709 13:10:12.666836 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:12.667649 24525 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:12.656647 29589 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:12.682257 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.683617 24674 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:12.686596 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3278) took 1077 ms. Trace:
I20260709 13:10:12.686965 24672 rpcz_store.cc:276] 0709 13:10:11.609037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.619566 (+ 10529us) service_pool.cc:224] Handling call
0709 13:10:11.619877 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.620225 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.620255 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.620719 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.828883 (+208164us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:11.828947 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.829129 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.660098 (+830969us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:12.677142 (+ 17044us) raft_consensus.cc:1685] finished
0709 13:10:12.677172 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.686533 (+  9361us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1626,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"spinlock_wait_cycles":5143296,"thread_start_us":207697,"threads_started":1,"wal-append.queue_time_us":343867}
I20260709 13:10:12.690543 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:12.694788 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.698176 24525 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:12.702092 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:12.685617 29449 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:12.710112 29652 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.712570 29652 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:12.714001 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.700181 29674 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.722728 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.722642 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.724013 24597 raft_consensus.cc:2368] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:10:12.699163 29769 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.725349 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.725615 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.726131 24599 raft_consensus.cc:2368] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:10:12.726219 24592 raft_consensus.cc:2376] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10. Re-sending same reply.
I20260709 13:10:12.726706 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.727900 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.728338 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.729278 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.730829 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.732386 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.717418 29634 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.714973 29538 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:12.748543 29643 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.748623 29634 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.750885 29634 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:12.753523 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 271195us
I20260709 13:10:12.754233 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:12.754458 29738 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.756418 29738 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:12.733837 24598 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:12.723057 29420 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:12.773706 29420 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:12.774695 29420 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:12.775892 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.738868 29764 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:12.739346 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.777661 24519 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:10:12.777838 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.778219 24592 raft_consensus.cc:2368] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:12.724198 29668 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:10:12.782509 24523 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:12.783208 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:12.783677 29575 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.784744 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.786585 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:12.787423 29740 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.788100 29740 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.788436 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.775545 29514 consensus_queue.cc:1243] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:12.789433 29449 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.784948 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.790701 24597 raft_consensus.cc:2376] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14. Re-sending same reply.
I20260709 13:10:12.791450 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:12.791611 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.791941 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:12.743156 29766 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:10:12.743954 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:12.747788 29745 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:12.760043 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.801757 24525 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.760630 29669 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:12.761267 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:12.762704 29754 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.765338 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.812969 24673 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:12.814203 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:12.768224 29750 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:12.768644 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.770872 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.771919 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.821309 24600 raft_consensus.cc:2410] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:12.772064 29528 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:12.780566 24519 pending_rounds.cc:85] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 10
I20260709 13:10:12.822190 24519 pending_rounds.cc:107] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:12.822482 24519 raft_consensus.cc:2889] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.782274 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.741456 24595 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:12.785017 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.785456 29639 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:12.741882 24521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3118) took 1318 ms (client timeout 1681 ms). Trace:
I20260709 13:10:12.730330 29674 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.792806 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.793015 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.790086 24639 leader_election.cc:400] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
I20260709 13:10:12.794133 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.827924 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.835793 24639 leader_election.cc:403] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.795449 24669 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:12.795466 24672 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:12.795995 24668 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:12.742676 29731 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:12.836090 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.812604 29718 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:12.838027 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43964.7us
I20260709 13:10:12.858520 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.859176 25217 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
W20260709 13:10:12.860225 24521 rpcz_store.cc:269] 0709 13:10:11.423381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.423493 (+   112us) service_pool.cc:224] Handling call
0709 13:10:12.741696 (+1318203us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000dcad4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:12.741826 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140908800}
I20260709 13:10:12.860510 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.860716 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:12.856444 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:12.836205 24599 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:12.814888 24673 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:12.862314 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.784907 29575 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:12.825237 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.825693 24666 pending_rounds.cc:85] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 9
I20260709 13:10:12.713889 29589 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.821979 29528 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:12.861696 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.867117 25215 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.805308 29698 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:10:12.863546 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.859362 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:12.863714 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.865589 24666 pending_rounds.cc:107] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:12.876238 24666 raft_consensus.cc:2889] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.865684 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:12.866189 24525 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:12.835415 29652 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:12.867368 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:12.849033 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.808429 24591 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:12.827891 29622 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.869390 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:12.860090 29668 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 13:10:12.870224 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80258.4us
I20260709 13:10:12.902814 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.871363 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.805764 29736 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:12.805707 29669 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:12.820245 29750 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:12.882925 29514 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:12.884465 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:12.859066 29449 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.879102 29575 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:12.868747 29696 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.004s	sys 0.012s
I20260709 13:10:12.891964 24521 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:12.863581 29707 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:12.903680 24599 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:12.903841 24595 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:12.903334 24639 leader_election.cc:400] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:10:12.943851 24639 leader_election.cc:400] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:12.944254 24639 leader_election.cc:403] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.904703 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:12.879694 29738 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:12.854173 29522 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:10:12.912497 25212 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:12.848377 29418 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:12.826759 29643 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.906626 29556 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:10:12.958962 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.959750 24595 raft_consensus.cc:2368] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20.
I20260709 13:10:12.925207 29757 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:10:12.859792 29718 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.886734 29589 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.823249 29754 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.928089 24525 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:12.933784 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.944994 24591 raft_consensus.cc:2376] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11. Re-sending same reply.
I20260709 13:10:12.909049 29669 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.838191 29639 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:12.946580 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 59153.6us
W20260709 13:10:12.936460 29696 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.004s	sys 0.012s
I20260709 13:10:12.890750 29665 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:10:12.926190 29750 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:12.977557 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:13.011366 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.991092 24522 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:13.036593 24522 pending_rounds.cc:85] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 7
W20260709 13:10:13.036789 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.036862 24522 pending_rounds.cc:107] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:13.038295 24522 raft_consensus.cc:2889] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.987931 25211 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:13.039113 25211 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:12.990146 24517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3120) took 1566 ms (client timeout 1762 ms). Trace:
W20260709 13:10:13.029291 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.039920 24517 rpcz_store.cc:269] 0709 13:10:11.423979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.430627 (+  6648us) service_pool.cc:224] Handling call
0709 13:10:12.989850 (+1559223us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000bc7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:12.990070 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548924672}
I20260709 13:10:12.994658 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:13.008682 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:13.041356 24593 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.909603 29628 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:12.981485 24596 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:10:13.047659 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 160076us
I20260709 13:10:13.045481 24667 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:12.934010 29634 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:13.061017 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 188175us
W20260709 13:10:13.064185 25184 leader_election.cc:336] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.880s (SENT)
I20260709 13:10:13.049921 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:13.048986 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:13.066043 24669 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:13.070227 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:12.954653 29738 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:13.070812 24591 raft_consensus.cc:2376] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16. Re-sending same reply.
I20260709 13:10:13.070753 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.069983 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:12.991848 29761 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:13.076508 25184 leader_election.cc:336] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.639s (SENT)
I20260709 13:10:13.077724 24595 raft_consensus.cc:2410] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:12.995358 29769 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:13.080180 24599 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:13.084995 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:13.085103 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 141416us
I20260709 13:10:12.950465 29731 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:10:13.043202 29736 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.084534 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:13.006686 29643 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.069931 25211 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.093380 24595 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:13.042778 29718 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.048813 29628 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:13.105715 29648 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:10:13.107652 29759 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.108206 29759 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.109494 29754 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:13.110728 29759 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.114162 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:13.113940 29575 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.114984 24518 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:13.119128 29639 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.103652 29727 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.088780 29769 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:13.126036 29769 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.127126 29769 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.960203 29528 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.131614 29528 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:13.133436 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.099391 29750 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.138235 29674 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.141110 25211 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:13.142699 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50822.4us
I20260709 13:10:13.144196 24595 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:13.149854 24595 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:13.150103 24598 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:13.155594 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.087643 29622 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:13.161407 24599 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:13.152814 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:13.173245 29735 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:13.174129 29737 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.173977 29735 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.176681 29735 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.102792 29736 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.178289 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:13.179162 29736 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.179693 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.188091 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:13.190933 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 303811us
I20260709 13:10:13.197593 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:13.223398 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.163302 29622 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.166208 29722 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.229195 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.230227 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 153790us
I20260709 13:10:13.231166 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:13.231418 25184 leader_election.cc:336] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.944s (SENT)
I20260709 13:10:13.232016 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:13.166410 29740 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:13.179755 29745 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.211161 29304 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:13.211433 29735 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:13.190429 29736 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:13.220845 29674 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:13.232973 29622 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:13.235088 29698 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.204291 29727 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:13.242558 25211 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:13.246752 29514 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:13.250839 29650 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:13.227157 29639 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:10:13.257897 29735 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.228804 29729 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:10:13.256350 29731 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:13.303632 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.260193 29674 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:13.316490 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85090.6us
W20260709 13:10:13.317184 25184 leader_election.cc:336] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.437s (SENT)
I20260709 13:10:13.317561 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:13.227555 29738 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.273102 29759 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:13.253170 29740 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:13.303639 29728 consensus_meta.cc:287] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.002s
W20260709 13:10:13.301397 29743 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:10:13.245553 29722 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:13.322851 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 143249us
I20260709 13:10:13.230049 29628 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.308292 29735 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.346906 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.315755 29674 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.349720 24594 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:13.298156 29719 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:10:13.320017 29775 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.264287 29736 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:13.353835 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.324891 29449 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 9. Current term is 10.
W20260709 13:10:13.357303 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.272994 29304 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:10:13.354579 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.367614 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:13.377013 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 162738us
I20260709 13:10:13.339813 29759 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:13.379328 29786 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:13.380529 29759 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:13.380927 29785 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:10:13.381937 29731 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.384583 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:13.360363 29514 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:13.387113 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.414399 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46863.3us
I20260709 13:10:13.415251 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:13.416548 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:13.417148 24672 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.421567 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:13.340233 29665 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:10:13.438338 24518 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:13.389528 29727 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.440374 29727 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.440856 29727 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.442960 29727 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.443408 29538 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.444490 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.413429 29589 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.445924 29589 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.446429 29722 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:13.419883 29731 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:13.447638 29731 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.449630 29731 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:13.453889 29643 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:13.454329 29643 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:13.454682 29643 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.455060 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:13.456122 29790 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:13.456204 24521 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:13.456739 29790 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:13.457865 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73376.4us
I20260709 13:10:13.458132 29759 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:13.458954 29790 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.461824 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.462972 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.463733 29422 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.464250 29422 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.467916 29634 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:13.468449 29634 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.471012 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.471625 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:13.472299 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:13.472774 24596 raft_consensus.cc:606] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:13.458648 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:13.473534 29736 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.474603 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.477452 24669 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:13.473065 24596 raft_consensus.cc:614] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:13.484181 24672 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:13.484409 25214 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:13.486852 24591 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 8.
I20260709 13:10:13.488999 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:13.490329 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.491065 24596 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:13.491888 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:13.492602 29673 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:13.493193 29673 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.489681 24518 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:13.475301 29718 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.496697 25217 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:13.499178 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:13.499789 24518 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:13.422786 29628 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.503988 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:13.498106 29778 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
I20260709 13:10:13.505059 24519 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:13.506356 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:13.495509 29673 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.434366 29668 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:13.511899 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:13.499981 29731 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:13.525717 24593 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:13.532936 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:13.526328 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47495.2us
I20260709 13:10:13.500385 29737 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:13.534157 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:13.535583 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.536127 29639 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:13.536770 29639 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:13.537751 29639 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.545396 25219 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:13.546435 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:13.548269 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:13.560786 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:13.562427 29634 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.563617 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:13.564332 24667 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.566327 29740 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.572207 29737 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:13.572706 29737 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.577378 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:13.580323 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.584705 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 57242.6us
W20260709 13:10:13.589162 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.590955 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:13.591936 24665 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:13.596184 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 62100.4us
I20260709 13:10:13.443989 29538 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.507673 29718 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.579425 29799 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:10:13.601934 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:13.597812 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:13.613466 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.607954 24667 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:13.615520 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.608691 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.619329 24521 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 8: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:13.621603 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.622062 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.617669 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:13.660625 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:13.678943 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 82157.9us
I20260709 13:10:13.680389 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:13.531740 29528 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
W20260709 13:10:13.613597 29807 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:13.531473 29668 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.601140 29740 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.600858 29788 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.693835 24594 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:13.699852 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 84396.6us
W20260709 13:10:13.664845 29669 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
I20260709 13:10:13.706538 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3136) took 2238 ms. Trace:
W20260709 13:10:13.707504 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 98866.7us
I20260709 13:10:13.622443 29556 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:13.685505 29786 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:13.710703 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:13.614192 29739 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:13.625264 29733 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.712155 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:13.707067 24522 rpcz_store.cc:276] 0709 13:10:11.456300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.516218 (+ 59918us) service_pool.cc:224] Handling call
0709 13:10:12.990626 (+1474408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.048224 (+ 57598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.694347 (+646123us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000bc7d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:13.694486 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3364644224}
I20260709 13:10:13.613821 29722 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.714515 25210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.009s
I20260709 13:10:13.718086 24600 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:10:13.738854 24600 pending_rounds.cc:85] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 5
W20260709 13:10:13.703114 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 287913us
I20260709 13:10:13.718400 24519 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:13.718251 24518 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:13.691425 29656 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.695189 29728 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.694216 29449 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.615054 29652 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:10:13.618450 29731 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:13.739324 24600 pending_rounds.cc:107] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:10:13.744736 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1898) took 2043 ms. Trace:
I20260709 13:10:13.761618 24600 raft_consensus.cc:2889] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:13.704613 29750 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:13.705662 29665 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.761759 24674 rpcz_store.cc:276] 0709 13:10:11.700965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.703861 (+  2896us) service_pool.cc:224] Handling call
0709 13:10:12.681774 (+977913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.684044 (+  2270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.744466 (+1060422us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54001392d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:13.744660 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2248243456}
I20260709 13:10:13.623096 29727 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
W20260709 13:10:13.738755 25210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.006s	sys 0.009s
I20260709 13:10:13.720881 29683 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:13.729640 29805 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.782021 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:13.747890 29556 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:13.861245 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.712805 29669 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.769405 29634 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.714324 29788 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.861549 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:13.829320 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.869720 24516 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.871528 29538 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:13.873229 29735 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.000s
I20260709 13:10:13.873636 29735 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.874729 29643 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.784835 29659 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
W20260709 13:10:13.878456 29769 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.000s
I20260709 13:10:13.759676 29656 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.861299 29420 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:10:13.882237 29736 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:13.883244 29736 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:13.884969 29796 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:13.885468 29784 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:10:13.886161 29802 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:13.886582 29669 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.887271 25215 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.892620 29656 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.896248 25215 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:13.898665 29698 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:13.899152 29698 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:13.900138 29698 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.901073 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1085) took 1037 ms. Trace:
I20260709 13:10:13.901446 29804 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:13.919446 29698 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.919773 29804 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:13.920823 29804 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:13.922580 29422 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.787922 29665 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.924767 29665 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.919278 25215 rpcz_store.cc:276] 0709 13:10:12.864160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.869176 (+  5016us) service_pool.cc:224] Handling call
0709 13:10:13.900905 (+1031729us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540004c4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:13.901004 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285776128}
I20260709 13:10:13.901568 29707 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:13.926982 29707 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:13.927680 29788 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:13.754626 29722 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.927826 29707 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.932979 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1128) took 1460 ms. Trace:
I20260709 13:10:13.759994 29559 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:10:13.940023 29634 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.941517 29556 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.913189 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.913643 29648 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:13.985471 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44017.9us
I20260709 13:10:13.933434 25214 rpcz_store.cc:276] 0709 13:10:12.472081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.473868 (+  1787us) service_pool.cc:224] Handling call
0709 13:10:12.788108 (+314240us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:10:12.788293 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.484834 (+696541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.932740 (+447906us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540009e7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:13.932921 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609835136}
I20260709 13:10:13.935213 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:13.936550 24591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9c35412a4ad4729862392b77295639d"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:13.881049 29731 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.942010 24516 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:13.943704 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.949535 24672 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:13.950198 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.983294 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:13.957535 24597 raft_consensus.cc:2376] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11. Re-sending same reply.
W20260709 13:10:13.986763 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 214673us
I20260709 13:10:13.988323 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:13.918548 29736 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:13.988976 24669 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:13.990170 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:13.990406 24591 raft_consensus.cc:606] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:13.993149 24600 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
W20260709 13:10:13.992076 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.992419 25213 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:13.992698 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1048) took 1165 ms. Trace:
I20260709 13:10:14.000031 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.000775 24516 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
W20260709 13:10:14.003398 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 59759.3us
I20260709 13:10:13.999172 24597 rpcz_store.cc:276] 0709 13:10:12.827112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.905443 (+1078331us) service_pool.cc:224] Handling call
0709 13:10:13.992645 (+ 87202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:13.939280 28979 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.007179 28979 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:13.988481 29669 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:14.008145 29669 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.009414 28979 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.010329 24671 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:13.937988 29707 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:14.012549 25184 leader_election.cc:400] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20.
I20260709 13:10:14.026526 25184 leader_election.cc:403] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.957356 29654 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.044916 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.045812 24519 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:13.794273 29780 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.212s
I20260709 13:10:14.012935 24600 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:13.779597 29750 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.048149 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:14.053383 24516 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:14.043552 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:14.064397 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:13.989108 29420 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.075774 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:13.795903 29683 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.084332 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.076980 25182 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.010977 29696 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.085474 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:14.088702 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45225.2us
I20260709 13:10:14.093292 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:14.094838 29668 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.042217 29634 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.095413 29669 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.096037 29728 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:14.096895 29643 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.089782 29359 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:10:14.088238 29806 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:14.098446 29806 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.098949 29800 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:14.099423 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.099982 24592 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:14.100636 29806 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.101019 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.103133 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.103775 24521 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:14.105235 25216 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:14.105652 24595 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:14.075354 29654 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:14.110834 29737 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.538s	user 0.000s	sys 0.007s
I20260709 13:10:14.111263 29737 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.111634 29654 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.112286 29769 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:14.112677 29769 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.113041 29769 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.117594 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1084) took 1256 ms. Trace:
I20260709 13:10:14.117998 25217 rpcz_store.cc:276] 0709 13:10:12.863181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.863315 (+   134us) service_pool.cc:224] Handling call
0709 13:10:14.117390 (+1254075us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54005780d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:14.117533 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430009728}
I20260709 13:10:14.120100 29735 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.091147 29420 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.100014 29736 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:14.101140 29740 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.091459 25185 leader_election.cc:400] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:14.129217 25185 leader_election.cc:403] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.989128 29449 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:14.126363 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.129827 24592 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:14.130225 24516 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:13.989428 29648 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:14.134392 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:14.135195 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 142221us
I20260709 13:10:14.136502 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:14.127025 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.126425 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.131855 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:14.132318 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.133384 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:13.794569 29805 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.139931 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:14.099022 29359 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:14.126966 24599 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.005s	sys 0.014s
W20260709 13:10:14.158151 24490 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.528s (SENT)
W20260709 13:10:14.158885 24599 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.006s	sys 0.014s
I20260709 13:10:14.160408 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.161206 24669 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:14.161372 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:14.128852 29736 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.157678 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.181704 29643 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:14.184569 29683 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.137789 29759 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:14.185612 29750 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.155472 29510 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:14.186092 29739 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:14.186913 29739 consensus_queue.cc:1243] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:14.160100 29359 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:14.144133 29799 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:14.189224 29359 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.189545 29799 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:14.190604 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.190739 29805 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.186336 29510 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:14.191326 24524 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:14.191748 29510 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.193168 29795 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.141762 29669 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20.
I20260709 13:10:14.181852 29736 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:14.195827 29674 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.000s
I20260709 13:10:14.196264 29674 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.191789 29799 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.197940 29648 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.198527 29674 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.199244 29648 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.199816 29782 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:14.200245 29782 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.200611 29782 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.201301 29810 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:14.201720 29810 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:14.202105 29810 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.205189 24598 raft_consensus.cc:1217] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 13:10:14.205677 24598 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:14.206311 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2003) took 1116 ms. Trace:
I20260709 13:10:14.142434 29628 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.212426 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.208151 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.181847 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:14.217532 24668 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:14.219338 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:14.209262 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 499991us
W20260709 13:10:14.208578 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 72198.2us
I20260709 13:10:14.204107 29736 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.167001 29654 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:14.182317 29449 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:14.206738 24599 rpcz_store.cc:276] 0709 13:10:13.089513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.173122 (+ 83609us) service_pool.cc:224] Handling call
0709 13:10:13.173487 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:13.194035 (+ 20548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.194081 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:13.219744 (+ 25663us) log.cc:844] Serialized 52 byte log entry
0709 13:10:13.602606 (+382862us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:14.110027 (+507421us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:10:14.159419 (+ 49392us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.178021 (+ 18602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.178119 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.178177 (+    58us) raft_consensus.cc:1685] finished
0709 13:10:14.204927 (+ 26750us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.206260 (+  1333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38325,"prepare.queue_time_us":268834,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":52634,"raft.run_cpu_time_us":3148,"raft.run_wall_time_us":910132,"spinlock_wait_cycles":18029440,"thread_start_us":867994,"threads_started":2,"wal-append.queue_time_us":526020}
I20260709 13:10:14.240459 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.241541 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.245623 24669 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:14.247313 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.246876 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.216572 29737 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.219549 29589 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.218938 29740 raft_consensus.cc:2764] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:14.270220 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:14.272107 25216 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.248744 25184 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:14.239490 29799 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:14.266073 25217 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:14.242556 29654 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.283272 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:14.283727 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.284597 25217 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 7.
I20260709 13:10:14.286852 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:14.246279 29449 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:14.246730 29628 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:14.292426 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:14.293311 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.293610 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.266445 29735 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:14.267256 29739 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:14.277948 29759 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:14.300853 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.302979 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.313760 25219 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:14.315071 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.315855 24599 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:14.316776 29359 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.318648 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.286000 29654 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.279017 29799 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:14.297850 25217 raft_consensus.cc:2376] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11. Re-sending same reply.
I20260709 13:10:14.333186 25216 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:14.336823 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:14.337450 25213 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:14.337452 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.333761 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.013s	sys 0.038s
I20260709 13:10:14.294842 29761 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.246842 29743 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:10:14.289955 29737 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:14.296604 29449 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.338241 29739 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:14.340446 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.341274 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.298892 29735 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.294977 29806 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.313367 29740 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:14.355093 29622 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.061s	user 0.009s	sys 0.002s
I20260709 13:10:14.312867 29759 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:14.338845 29799 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:14.353842 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.013s	sys 0.038s
W20260709 13:10:14.394770 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 772752us
I20260709 13:10:14.395429 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:14.396165 24595 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.339931 24597 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:14.331624 29727 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:14.334800 29751 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:14.368361 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:14.314592 29628 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:14.387737 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.372776 29815 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:10:14.369549 29745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.006s	sys 0.030s
I20260709 13:10:14.368834 29735 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:14.357323 29420 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.370024 29575 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:14.398852 29759 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.407294 29727 consensus_queue.cc:1243] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:10:14.417672 29745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.007s	sys 0.030s
I20260709 13:10:14.358589 29737 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.456128 25216 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:14.393620 29795 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:10:14.400729 29622 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.434715 29575 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.458503 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1519) took 1377 ms. Trace:
I20260709 13:10:14.443602 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:14.448890 24595 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:14.351836 29738 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
W20260709 13:10:14.441287 29790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.003s	sys 0.022s
I20260709 13:10:14.449463 29669 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:14.399307 29740 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.502453 24591 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:14.514417 29740 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.505219 29575 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:14.469777 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 392828us
I20260709 13:10:14.471578 29522 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.517885 29522 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.502354 25210 rpcz_store.cc:276] 0709 13:10:13.081205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.081772 (+   567us) service_pool.cc:224] Handling call
0709 13:10:13.098217 (+ 16445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.139539 (+ 41322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.139571 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.140054 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.778853 (+638799us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:14.291785 (+512932us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.458011 (+166226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.458177 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.458238 (+    61us) raft_consensus.cc:1685] finished
0709 13:10:14.458250 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.458427 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66451,"prepare.queue_time_us":148237,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":64718,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":19214,"thread_start_us":1227244,"threads_started":3,"wal-append.queue_time_us":726896}
I20260709 13:10:14.508006 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.520135 24595 raft_consensus.cc:2410] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:14.512660 25216 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:14.521170 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1688) took 1104 ms. Trace:
I20260709 13:10:14.521839 29800 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:14.524930 29575 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.526867 25182 leader_election.cc:400] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:14.460393 29659 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.407599 29806 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.530226 24591 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:14.521574 24594 rpcz_store.cc:276] 0709 13:10:13.416470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.708522 (+292052us) service_pool.cc:224] Handling call
0709 13:10:13.708942 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.726325 (+ 17383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.726373 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.737810 (+ 11437us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.242467 (+504657us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:14.304865 (+ 62398us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.305483 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.305590 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.520951 (+215361us) raft_consensus.cc:1685] finished
0709 13:10:14.520974 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.521116 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12863,"prepare.queue_time_us":67386,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":44,"raft.queue_time_us":25074,"raft.run_cpu_time_us":2903,"raft.run_wall_time_us":38235,"thread_start_us":418935,"threads_started":1,"wal-append.queue_time_us":671293}
I20260709 13:10:14.541433 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.542253 24594 raft_consensus.cc:2410] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:14.531936 29731 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:10:14.537501 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.465543 29722 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:14.543908 24596 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:10:14.527920 29790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.004s	sys 0.022s
I20260709 13:10:14.510447 29736 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.499614 29788 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.565207 29788 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.567301 29788 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:14.567456 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 322920us
W20260709 13:10:14.567812 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.499347 29652 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.568610 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:14.568533 29652 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.558099 24599 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:14.543742 29628 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.575264 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.591560 24522 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:14.577311 29727 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:14.571509 29735 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.578934 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.583993 29782 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.596081 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:14.597674 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.598551 24591 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:14.599397 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:14.461848 29510 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.590315 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:14.464656 29739 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.602370 24599 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:14.586238 29359 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:14.593871 29420 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.606276 24591 raft_consensus.cc:2376] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14. Re-sending same reply.
I20260709 13:10:14.606730 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:14.587167 29722 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.568806 29654 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.591806 29750 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.618167 24599 raft_consensus.cc:2376] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11. Re-sending same reply.
I20260709 13:10:14.618229 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:14.593528 29740 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:10:14.619112 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 243274us
W20260709 13:10:14.619279 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 274228us
I20260709 13:10:14.631346 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.643232 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1088) took 1099 ms. Trace:
W20260709 13:10:14.644160 29829 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:10:14.644330 29805 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:14.644667 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:14.647063 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.649477 29738 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:14.649895 29738 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.650238 29738 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.650673 29652 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.652583 29727 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.654125 29727 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:14.654536 29727 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:14.654924 29727 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:14.654835 29805 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:14.658638 29575 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:14.643632 25218 rpcz_store.cc:276] 0709 13:10:13.543564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.549630 (+  6066us) service_pool.cc:224] Handling call
0709 13:10:13.550016 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.550470 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.550508 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.004089 (+453581us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b2c00047778. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:10:14.027385 (+ 23296us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.440986 (+413601us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:14.466003 (+ 25017us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.505412 (+ 39409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.505483 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.642999 (+137516us) raft_consensus.cc:1685] finished
0709 13:10:14.643085 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.643188 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40519,"prepare.queue_time_us":25002,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":41069,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":29777,"spinlock_wait_cycles":63071104,"thread_start_us":313871,"threads_started":1,"wal-append.queue_time_us":534993}
I20260709 13:10:14.636143 29780 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:14.661532 29780 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.661880 29780 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.663080 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.664227 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:14.664752 24597 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.666083 29782 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.667542 29737 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:14.669811 29654 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.674849 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.675602 24520 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:14.678257 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:14.681802 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.684906 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.685694 24516 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:14.707012 24525 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:10:14.611212 29810 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:14.714643 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.706740 29622 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.613152 29420 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.721930 29510 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.722724 29420 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.636101 29750 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.729132 29806 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.691262 29744 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:10:14.731213 29744 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:14.731578 29449 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.733528 24668 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:14.710600 29784 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:14.769346 29784 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.771862 29784 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.774307 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.775415 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:14.776041 24595 raft_consensus.cc:2368] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17.
I20260709 13:10:14.776687 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:14.772092 29830 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:10:14.779582 29821 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:10:14.720295 29735 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.781471 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2007) took 1508 ms. Trace:
I20260709 13:10:14.782475 24591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:14.737159 24524 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:14.783052 24591 raft_consensus.cc:606] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:14.783404 24591 raft_consensus.cc:614] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:14.743783 24597 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:14.745646 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:14.746352 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:14.746989 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:14.749645 24520 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:14.753398 29750 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:14.754673 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1049) took 1927 ms. Trace:
I20260709 13:10:14.754932 29810 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:14.761919 29449 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:14.762600 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:14.617117 29769 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:14.765131 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:14.767375 29844 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:14.781843 24593 rpcz_store.cc:276] 0709 13:10:13.272743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.534874 (+262131us) service_pool.cc:224] Handling call
0709 13:10:13.535238 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:13.598288 (+ 63050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.598318 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:13.620392 (+ 22074us) log.cc:844] Serialized 52 byte log entry
0709 13:10:14.139994 (+519602us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:14.140032 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.140090 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.779057 (+638967us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:14.781196 (+  2139us) raft_consensus.cc:1685] finished
0709 13:10:14.781214 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.781416 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48626,"raft.queue_time_us":62684,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":11566,"spinlock_wait_cycles":8833408,"thread_start_us":435649,"threads_started":1,"wal-append.queue_time_us":685904}
W20260709 13:10:14.800887 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 169614us
I20260709 13:10:14.810153 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:14.799957 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:14.804724 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 214456us
I20260709 13:10:14.802356 24598 rpcz_store.cc:276] 0709 13:10:12.827345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.150990 (+323645us) service_pool.cc:224] Handling call
0709 13:10:14.205068 (+1054078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.206021 (+   953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.754469 (+548448us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001ebed0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:14.754597 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2363285888}
I20260709 13:10:14.818792 24598 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:14.819028 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:14.820453 24598 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:10:14.826438 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:14.827778 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.768386 29738 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.828161 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:14.731582 29744 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:14.834964 24671 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:14.835531 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.837777 24669 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:14.858161 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.838506 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:14.979981 24674 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:14.793167 29728 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:14.791227 29654 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.053933 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.000674 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:15.071836 25210 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:15.003588 24600 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:15.073249 24524 pending_rounds.cc:85] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 6
I20260709 13:10:15.008579 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.073958 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.000962 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:15.074678 24518 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:15.075042 25215 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:15.076117 24524 pending_rounds.cc:107] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:10:15.000316 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:15.076481 24524 raft_consensus.cc:2889] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.011986 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.074326 24665 raft_consensus.cc:2410] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:15.079459 24672 raft_consensus.cc:2410] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:10:15.012238 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.974045 29847 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:15.115833 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.111727 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.113786 24673 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:15.117408 24519 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:15.118659 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.119277 24519 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:15.116592 24516 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:15.121169 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.122409 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.123129 24667 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:15.126176 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.127588 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.128530 24672 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:14.858660 29751 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.132334 24517 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:15.132778 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.858227 29750 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:15.134356 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:15.015177 29759 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.000s
I20260709 13:10:14.857669 29843 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:15.135262 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:15.135869 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.135974 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.974318 29735 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:15.220634 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.858377 29736 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.142935 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:15.143267 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.144976 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:14.975332 29674 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:15.211795 24666 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:15.132378 29422 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.129763 29575 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:15.130875 29654 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.116297 29847 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:14.858052 29832 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.299s
I20260709 13:10:15.008279 29738 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.244143 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:14.974757 29810 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.244s
I20260709 13:10:14.789755 29799 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:14.860389 29780 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.228253 29735 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.265872 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.277231 24595 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:15.279881 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.283267 24666 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:15.264075 29528 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:15.255359 29846 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:15.298436 25219 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:15.220345 29759 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.149443 24665 raft_consensus.cc:2368] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15.
I20260709 13:10:15.264503 29847 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.307710 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:15.312444 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.286154 29735 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.318532 29359 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:15.307757 29528 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:10:15.320395 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.260633 29575 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.335285 25216 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:15.008481 29740 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:15.021407 29795 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:15.181473 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.327939 29359 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:15.003075 29769 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:15.296025 29628 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:15.249861 29674 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:15.255926 29422 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.116559 29737 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:15.133446 29722 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:15.365662 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.377516 24517 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:15.367293 24521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.166s	sys 0.184s
I20260709 13:10:15.039095 29727 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.323946 29750 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:15.306095 24518 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
W20260709 13:10:15.378325 24521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.166s	sys 0.184s
I20260709 13:10:15.130488 29728 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.380317 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.387938 24518 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:15.388993 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.389241 25216 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:15.390352 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.388995 24519 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:15.393626 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.396690 24594 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:10:15.351414 29806 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.267970 29744 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.410171 24523 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:10:15.410549 24523 pending_rounds.cc:85] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 8
I20260709 13:10:15.410745 24523 pending_rounds.cc:107] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:10:15.410961 24523 raft_consensus.cc:2889] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.395632 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:15.431422 24673 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:15.379796 29745 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.436754 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:15.321038 29846 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.438356 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:15.375566 29420 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.430310 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:15.435141 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.432966 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:15.437526 24598 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:15.443773 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:15.401444 29784 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.368635 29795 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.493851 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:15.384053 29750 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.529699 24517 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:15.496039 24666 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:10:15.497423 29528 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:15.498226 29422 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:15.444952 29744 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.507580 24598 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:15.543884 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:15.544250 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:15.545571 24598 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:15.040874 29719 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Committing config change with OpId 11.9: config changed from index 5 to 9, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:15.400141 29722 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.372584 29628 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.509794 29799 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:15.548779 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:15.446364 29745 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.429888 29806 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.511804 29575 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.439452 29359 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.513621 29780 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:15.554091 24699 heartbeater.cc:646] Failed to heartbeat to 127.22.225.190:40709 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.225.190:40709 timed out after 15.000s (SENT)
I20260709 13:10:15.382347 29740 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.399889 29737 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.556114 29522 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.558255 29737 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.497622 29728 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.560113 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2004) took 2376 ms. Trace:
W20260709 13:10:15.532574 29852 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:10:15.533973 29674 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:15.534773 29528 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:15.535795 29784 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.509342 29759 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:15.547289 24599 raft_consensus.cc:2368] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:10:15.548354 24674 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:15.553742 29806 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.560478 24596 rpcz_store.cc:276] 0709 13:10:13.183508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.503605 (+320097us) service_pool.cc:224] Handling call
0709 13:10:13.503892 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.555507 (+1051615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.559879 (+1004372us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540025eed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:15.560060 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391245696}
W20260709 13:10:15.563351 25218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.050s	sys 0.096s
W20260709 13:10:15.570843 25218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.050s	sys 0.096s
I20260709 13:10:15.478431 29420 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.576031 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:15.576890 24674 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:15.580718 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.561281 29769 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:15.582427 24594 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:15.556137 29740 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:15.562938 29528 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:15.589546 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.568500 29449 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.584805 29769 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:15.585875 29359 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:15.597801 29769 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.593320 29528 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.604029 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1694) took 1328 ms. Trace:
I20260709 13:10:15.589634 29806 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:15.607817 24595 rpcz_store.cc:276] 0709 13:10:14.275923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.790177 (+514254us) service_pool.cc:224] Handling call
0709 13:10:14.791283 (+  1106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.283089 (+491806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.603745 (+320656us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b540033de54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:15.603973 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118937216}
W20260709 13:10:15.646375 29849 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:10:15.650041 29795 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.647099 29727 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.653831 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3171) took 1042 ms. Trace:
I20260709 13:10:15.654309 24522 rpcz_store.cc:276] 0709 13:10:14.611549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.611688 (+   139us) service_pool.cc:224] Handling call
0709 13:10:14.611975 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.612266 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.612295 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.612753 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.791867 (+179114us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:14.857833 (+ 65966us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.858072 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.858150 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.653554 (+795404us) raft_consensus.cc:1685] finished
0709 13:10:15.653582 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.653760 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182086,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":551,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6903,"spinlock_wait_cycles":71692672,"thread_start_us":101226,"threads_started":1,"wal-append.queue_time_us":693988}
I20260709 13:10:15.646708 29737 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:15.657747 29737 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.658812 29784 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.660006 29737 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.652694 29847 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.599753 29843 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:15.662801 29847 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.662510 29843 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.670286 29420 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:15.640254 24674 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:15.677529 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:15.678439 29842 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.956s	user 0.010s	sys 0.003s
I20260709 13:10:15.679396 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:15.680727 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.597494 29449 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.683836 24667 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:15.685413 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1140) took 1366 ms. Trace:
I20260709 13:10:15.686386 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.687690 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:15.688253 24667 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.685770 25212 rpcz_store.cc:276] 0709 13:10:14.319219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.338231 (+ 19012us) service_pool.cc:224] Handling call
0709 13:10:14.338583 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.339555 (+   972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.339587 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.347095 (+  7508us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.618795 (+271700us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:14.618834 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.619471 (+   637us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.678165 (+1058694us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b24002fb988. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8cdf9c4 00007f17b8cddacb 00007f17b8e98dc9 00007f17b8e98a55 00007f17b8e9809d 00007f17bbaca10e 00007f17bbae188c 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221
0709 13:10:15.685140 (+  6975us) raft_consensus.cc:1685] finished
0709 13:10:15.685160 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.685350 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":609,"raft.queue_time_us":1089,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2698,"spinlock_wait_cycles":49422080,"thread_start_us":271427,"threads_started":1,"wal-append.queue_time_us":361425}
I20260709 13:10:15.690555 29806 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.691998 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1069) took 1086 ms. Trace:
I20260709 13:10:15.692345 24597 rpcz_store.cc:276] 0709 13:10:14.608660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.822298 (+213638us) service_pool.cc:224] Handling call
0709 13:10:14.822614 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.434602 (+611988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.434633 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:15.434675 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:15.434704 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.691783 (+257079us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540033e354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:15.691828 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.691949 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407000320}
I20260709 13:10:15.695510 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:15.681908 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:15.707870 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 277654us
I20260709 13:10:15.715495 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:15.716724 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:15.731247 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.736191 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:15.736709 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.737617 24674 raft_consensus.cc:2410] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:15.720333 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:15.748836 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.745493 24667 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:15.749907 24666 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:10:15.756101 24593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.032s	sys 0.068s
I20260709 13:10:15.719678 29510 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.758764 24593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.032s	sys 0.069s
I20260709 13:10:15.736055 29784 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:15.760732 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.762925 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.763705 24521 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:15.765815 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.767735 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.761672 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.772840 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.773865 24667 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:15.773758 24517 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:15.748016 29745 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.737181 29750 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.752393 29780 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:15.771060 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.779651 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:15.863665 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:15.868896 24666 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:10:15.874619 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 388077us
W20260709 13:10:15.760581 29853 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:10:15.879506 24520 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:15.884369 24525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.020s	sys 0.033s
W20260709 13:10:15.888433 24525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.020s	sys 0.034s
I20260709 13:10:15.880846 24666 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:15.892773 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:15.897564 24666 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.762506 29728 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:15.867051 29810 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:15.923070 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:15.923524 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.920110 29728 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:15.925294 29728 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.928215 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1096) took 1103 ms. Trace:
I20260709 13:10:15.928335 29861 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:15.928972 29861 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:15.929477 29861 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.908064 29628 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:15.935158 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 1.10621e+06us
I20260709 13:10:15.935990 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:15.936591 29751 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.000s
I20260709 13:10:15.941123 29628 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:15.942124 29751 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:15.942415 29847 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:15.943079 29847 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:15.943531 24672 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.943977 29847 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.945253 29628 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:15.946270 29628 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.950541 29751 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:15.951555 29731 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:15.951953 29731 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:15.952909 29731 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:15.954250 29731 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.957378 29654 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.959198 29420 raft_consensus.cc:993] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:10:15.959652 29420 raft_consensus.cc:1081] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Signalling peer 148dc963cec64232ad3b248abad6f36d to start an election
I20260709 13:10:15.951572 24639 leader_election.cc:400] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:10:15.961385 24639 leader_election.cc:403] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:15.961552 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1139) took 1655 ms. Trace:
I20260709 13:10:15.966157 24672 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:10:15.961910 25219 rpcz_store.cc:276] 0709 13:10:14.306624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.338998 (+ 32374us) service_pool.cc:224] Handling call
0709 13:10:14.339264 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.306376 (+967112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.961323 (+654947us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b540034e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:15.961499 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2205409536}
I20260709 13:10:15.762600 29510 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:15.907009 29780 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.928642 25216 rpcz_store.cc:276] 0709 13:10:14.824798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.825503 (+   705us) service_pool.cc:224] Handling call
0709 13:10:15.928039 (+1102536us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54005d02d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:15.928158 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594428672}
I20260709 13:10:15.904443 29799 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:15.922827 24667 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 5 to 9, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:15.969719 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:15.912024 29804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.904s	user 0.063s	sys 0.113s
I20260709 13:10:15.974536 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:15.975646 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:15.991386 25219 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:15.889801 29575 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:10:15.990527 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:15.995559 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:15.991533 25212 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.977409 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:15.996449 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.996963 25213 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:15.997032 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:15.914613 29846 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:15.889621 29759 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:10:15.994289 24524 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:10:16.001709 25215 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:15.970496 29737 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11.
I20260709 13:10:15.997628 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:15.997794 25216 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:15.998484 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:15.999161 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.002055 24524 pending_rounds.cc:85] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 10
I20260709 13:10:16.010579 24524 pending_rounds.cc:107] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:16.010938 24524 raft_consensus.cc:2889] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.993054 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:16.002785 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.012565 25214 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:16.003813 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:16.004680 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:15.991181 29804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.984s	user 0.064s	sys 0.113s
I20260709 13:10:16.016753 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1166) took 1795 ms. Trace:
I20260709 13:10:15.961442 29810 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:16.091456 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.995795 29751 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:16.095103 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 90527.4us
I20260709 13:10:16.017267 24668 rpcz_store.cc:276] 0709 13:10:14.221472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.240850 (+ 19378us) service_pool.cc:224] Handling call
0709 13:10:14.241161 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:14.745457 (+504296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.016510 (+1271053us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54002b4b54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:16.016691 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131881216}
I20260709 13:10:16.096629 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:15.994642 29855 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:15.970485 29727 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:10:16.107151 24596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.031s	sys 0.039s
W20260709 13:10:16.117866 24596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.031s	sys 0.039s
I20260709 13:10:16.003202 29857 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:15.990474 29780 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.111377 25212 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
W20260709 13:10:16.114637 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.116194 24591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.011s	sys 0.042s
I20260709 13:10:16.001708 29795 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:16.117097 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.021296 29806 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:16.108991 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:16.092757 29846 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.994882 29799 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.133049 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:16.130141 29795 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.115809 29422 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:16.134299 24668 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
W20260709 13:10:16.126924 24591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.011s	sys 0.042s
I20260709 13:10:16.105648 29751 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.155831 29795 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.164000 29750 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:16.167454 29861 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:16.168183 24666 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:16.169044 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:16.170756 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:16.155145 29622 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:16.128542 29528 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:16.172821 29769 consensus_meta.cc:287] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.002s
I20260709 13:10:16.154788 29857 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:16.174876 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1065) took 1571 ms. Trace:
I20260709 13:10:16.186558 24593 rpcz_store.cc:276] 0709 13:10:14.603445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.809634 (+206189us) service_pool.cc:224] Handling call
0709 13:10:14.809999 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.832024 (+ 22025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.832058 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.832505 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.759429 (+926924us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:15.759486 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.759576 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.174593 (+415017us) raft_consensus.cc:1685] finished
0709 13:10:16.174621 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.174787 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21625,"raft.queue_time_us":164550,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"thread_start_us":621053,"threads_started":1,"wal-append.queue_time_us":894722}
W20260709 13:10:16.173574 29359 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.003s
W20260709 13:10:16.173961 29735 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.000s
W20260709 13:10:16.178188 29843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.009s	sys 0.029s
I20260709 13:10:16.139889 29846 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.120635 29855 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:16.199206 24516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.011s	sys 0.088s
W20260709 13:10:16.200718 24516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.011s	sys 0.088s
I20260709 13:10:16.174750 29422 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:16.214175 24598 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:16.213400 29843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.010s	sys 0.030s
W20260709 13:10:16.216198 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 436894us
I20260709 13:10:16.223158 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:16.239938 24592 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:10:16.237855 29795 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:16.249331 24670 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:10:16.257508 24600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2019) took 2187 ms (client timeout 1787 ms). Trace:
W20260709 13:10:16.258141 24600 rpcz_store.cc:269] 0709 13:10:14.052550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.126214 (+ 73664us) service_pool.cc:224] Handling call
0709 13:10:16.239501 (+2113287us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400192dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:16.239659 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948682112}
I20260709 13:10:16.261891 25184 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:16.263384 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:16.188176 29769 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.270206 25184 leader_election.cc:400] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17.
I20260709 13:10:16.216692 29422 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.213008 29735 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.272323 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:16.236584 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:16.240784 29795 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.235666 29784 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:16.279363 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 360018us
I20260709 13:10:16.247926 29863 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:16.296123 24669 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:16.266597 29750 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:16.292249 24668 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:16.263244 29718 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:16.270702 29359 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.301028 24671 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:16.288950 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:16.307708 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:16.273428 29810 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:16.277230 29759 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:16.275503 29510 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.286207 29538 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.284384 29861 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:16.321089 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:16.301493 29804 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:16.330595 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.332249 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:16.302342 29863 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.334918 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:16.336144 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.339814 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:16.344301 24490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.021s (SENT) [suppressed 25 similar messages]
W20260709 13:10:16.351627 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 255053us
I20260709 13:10:16.352944 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:16.355477 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:16.343451 29860 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:10:16.328128 29780 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.339883 29510 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.339906 29759 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:16.402166 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49311.3us
I20260709 13:10:16.354643 29628 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:16.332751 29728 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:16.346491 29731 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.345788 29806 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.275916 29857 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.348923 29740 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.317109 29718 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.394057 29784 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.340770 29863 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.310120 29750 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.407964 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:16.320482 29359 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.350401 29799 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:16.414228 29422 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:16.415710 29722 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.370838 29727 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:16.359480 29872 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.685650 29872 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.373513 29804 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:16.390515 29873 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:16.438446 29780 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:16.502755 29868 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:10:16.503351 29859 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:10:16.494884 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1928) took 1456 ms. Trace:
I20260709 13:10:16.694612 24669 rpcz_store.cc:276] 0709 13:10:15.038023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.134135 (+ 96112us) service_pool.cc:224] Handling call
0709 13:10:16.494583 (+1360448us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400048dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:16.494771 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491273984}
W20260709 13:10:16.504329 29869 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:10:16.507104 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1925) took 1502 ms. Trace:
I20260709 13:10:16.697548 24673 rpcz_store.cc:276] 0709 13:10:15.036906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.287931 (+251025us) service_pool.cc:224] Handling call
0709 13:10:15.288226 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.433535 (+145309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.506829 (+1073294us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001383d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:16.507042 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328878976}
I20260709 13:10:16.699247 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:16.510018 29875 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:16.510695 29759 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.511322 29674 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:16.399633 29510 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:16.528053 29858 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.654s	user 0.000s	sys 0.003s
W20260709 13:10:16.532407 29870 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:10:16.501960 29866 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:10:16.533046 29846 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.534101 29735 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:16.710865 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:16.501439 29865 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:10:16.534739 29855 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:16.714787 24421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 346) took 37716 ms (client timeout 15000 ms). Trace:
I20260709 13:10:16.715346 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1992) took 1603 ms. Trace:
I20260709 13:10:16.695930 29872 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:16.541603 29769 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:16.419106 29628 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:16.549633 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 260795us
I20260709 13:10:16.735983 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:16.513820 29622 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:16.558888 29751 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.560107 29737 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:16.435343 29728 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.564626 29528 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:16.565853 29795 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.567806 29718 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:16.569953 29449 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:16.561612 29719 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.953s	user 0.008s	sys 0.004s
I20260709 13:10:16.575661 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1701) took 1181 ms. Trace:
I20260709 13:10:16.756937 24666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9c35412a4ad4729862392b77295639d"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:44426
I20260709 13:10:16.760143 24598 rpcz_store.cc:276] 0709 13:10:15.393770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.546189 (+152419us) service_pool.cc:224] Handling call
0709 13:10:15.557379 (+ 11190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.215902 (+658523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.575417 (+359515us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b540032c154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:16.575599 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509924224}
I20260709 13:10:16.761063 24666 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.761535 24666 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.582175 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.582572 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:16.762923 24674 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:16.587983 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:16.593889 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:16.611192 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3309) took 1478 ms. Trace:
W20260709 13:10:16.766700 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 178805us
I20260709 13:10:16.614202 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1699) took 1221 ms. Trace:
W20260709 13:10:16.766907 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 173122us
I20260709 13:10:16.617902 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1146) took 1942 ms. Trace:
I20260709 13:10:16.617434 29648 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:10:16.620036 29881 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:10:16.633895 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:16.636197 29882 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.108s	user 0.000s	sys 0.005s
W20260709 13:10:16.639007 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.579967 29659 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:16.642128 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.778151 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1692) took 2522 ms. Trace:
I20260709 13:10:16.643981 29739 raft_consensus.cc:1064] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:10:16.654313 29896 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:16.654762 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 374438us
W20260709 13:10:16.655483 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 249390us
I20260709 13:10:16.661880 24418 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 9 to 14, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 14 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:16.780014 24491 leader_election.cc:400] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15.
I20260709 13:10:16.779942 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:16.780431 24491 leader_election.cc:403] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:16.433419 29740 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.438340 29514 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:16.425112 29806 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:16.439975 29879 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:16.430552 29847 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:16.680804 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1929) took 1642 ms. Trace:
I20260709 13:10:16.683607 29359 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:16.689736 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:16.693701 29804 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:16.705457 29510 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.716173 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1704) took 1321 ms. Trace:
I20260709 13:10:16.541273 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 1987) took 1431 ms. Trace:
I20260709 13:10:16.716437 24669 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:16.711428 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 365316us
W20260709 13:10:16.539892 29744 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.994s	user 0.004s	sys 0.008s
I20260709 13:10:16.715885 24516 rpcz_store.cc:276] 0709 13:10:15.111458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.132643 (+ 21185us) service_pool.cc:224] Handling call
0709 13:10:15.224162 (+ 91519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.569567 (+345405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.569617 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.570037 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.201931 (+631894us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:16.201985 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.202080 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.715133 (+513053us) raft_consensus.cc:1685] finished
0709 13:10:16.715156 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.715288 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31709,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8576,"thread_start_us":945982,"threads_started":2,"wal-append.queue_time_us":715937}
I20260709 13:10:16.707533 29674 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.719962 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:16.738802 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:16.741160 29810 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.742231 29743 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:16.743089 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1145) took 2110 ms. Trace:
I20260709 13:10:16.694199 29780 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.693802 29873 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.738677 29628 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:16.576790 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1913) took 1602 ms. Trace:
I20260709 13:10:16.846664 24595 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:16.846066 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:16.855727 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 117017us
I20260709 13:10:16.851307 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:16.856895 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 137036us
I20260709 13:10:16.768126 25218 rpcz_store.cc:276] 0709 13:10:14.675804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.675954 (+   150us) service_pool.cc:224] Handling call
0709 13:10:14.714095 (+ 38141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.785568 (+ 71473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.785598 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.786027 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.571204 (+785177us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:15.571246 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.583157 (+1011911us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b540009e7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:16.583208 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.583259 (+    51us) raft_consensus.cc:1685] finished
0709 13:10:16.583273 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.617815 (+ 34542us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51855,"raft.queue_time_us":51547,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3516,"spinlock_wait_cycles":55773440,"thread_start_us":784907,"threads_started":1,"wal-append.queue_time_us":920992}
I20260709 13:10:16.747670 29622 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:16.859163 29449 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:16.859261 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:16.859722 29449 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:16.860044 24516 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:16.766734 24665 rpcz_store.cc:276] 0709 13:10:15.132895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.333475 (+200580us) service_pool.cc:224] Handling call
0709 13:10:15.333856 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.547144 (+213288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.547174 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:15.547214 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:15.547261 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.610840 (+1063579us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54001397d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:16.610902 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.611105 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":490051456}
I20260709 13:10:16.860611 29449 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.767400 24592 rpcz_store.cc:276] 0709 13:10:15.393221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.397066 (+  3845us) service_pool.cc:224] Handling call
0709 13:10:16.239638 (+842572us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:16.240438 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.613898 (+373460us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400192dd0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:16.614117 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846984960}
I20260709 13:10:16.862217 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:16.862861 24592 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.863098 29846 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:16.776170 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3327) took 1237 ms. Trace:
I20260709 13:10:16.865338 29795 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:16.748597 29737 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:16.865883 29795 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:16.662397 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 339468us
I20260709 13:10:16.778134 29885 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:16.850092 29888 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:10:16.876230 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.866883 29795 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.792117 29514 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:16.877189 29795 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.877378 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.853346 29886 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.820978 29654 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.877934 29514 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.878722 29886 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.781723 24418 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:16.880259 24418 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.778689 24591 rpcz_store.cc:276] 0709 13:10:14.256095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.784041 (+527946us) service_pool.cc:224] Handling call
0709 13:10:14.784314 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.784642 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.784669 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.558221 (+773552us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b1800334960. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a
0709 13:10:15.558820 (+   599us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b2c00170da8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:10:15.559277 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.152114 (+592837us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:16.152173 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.152247 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.777959 (+625712us) raft_consensus.cc:1685] finished
0709 13:10:16.777979 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.778095 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22951,"raft.queue_time_us":1278,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":14518,"spinlock_wait_cycles":13812352,"thread_start_us":580953,"threads_started":1,"wal-append.queue_time_us":678756}
I20260709 13:10:16.849295 29538 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:16.882740 24597 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:16.882580 29538 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.781911 29659 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.802695 29847 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:16.886358 29847 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.849066 29894 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:16.817284 29880 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15.
I20260709 13:10:16.888103 29894 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:16.715286 24421 rpcz_store.cc:269] 0709 13:09:38.998969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.022691 (+ 23722us) service_pool.cc:224] Handling call
0709 13:10:16.714685 (+37691994us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:11.018209 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:11.018888 (+   679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:11.018937 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:10:11.018964 (+    27us) tablet.cc:662] Decoding operations
0709 13:10:11.131519 (+112555us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:11.131617 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:11.131653 (+    36us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:10:11.329268 (+197615us) tablet.cc:701] Row locks acquired
0709 13:10:11.338561 (+  9293us) write_op.cc:260] PREPARE: finished
0709 13:10:11.355176 (+ 16615us) write_op.cc:270] Start()
0709 13:10:11.371923 (+ 16747us) write_op.cc:276] Timestamp: P: 1783602611350317 usec, L: 0
0709 13:10:11.371973 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:10:11.372869 (+   896us) log.cc:844] Serialized 6340 byte log entry
0709 13:10:12.055898 (+683029us) op_driver.cc:464] REPLICATION: finished
0709 13:10:12.570622 (+514724us) write_op.cc:301] APPLY: starting
0709 13:10:12.570717 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:12.762368 (+191651us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:12.762473 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:13.462372 (+699899us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:13.462698 (+   326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:10:13.462760 (+    62us) write_op.cc:312] APPLY: finished
0709 13:10:13.463171 (+   411us) log.cc:844] Serialized 148 byte log entry
0709 13:10:13.870911 (+407740us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.871084 (+   173us) write_op.cc:454] Released schema lock
0709 13:10:13.871155 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:13.874120 (+  2965us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.874150 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8753,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":507219,"apply.run_cpu_time_us":43187,"apply.run_wall_time_us":1303474,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71007,"num_ops":16,"prepare.queue_time_us":269956,"prepare.run_cpu_time_us":18734,"prepare.run_wall_time_us":533487,"raft.queue_time_us":167037,"raft.run_cpu_time_us":28630,"raft.run_wall_time_us":321497,"replication_time_us":662882,"thread_start_us":836944,"threads_started":5,"wal-append.queue_time_us":982393,"wal-append.run_cpu_time_us":16980,"wal-append.run_wall_time_us":2237354}]]}
I20260709 13:10:16.868084 29861 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.896878 29861 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.779363 29896 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:16.807439 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:16.792096 24672 rpcz_store.cc:276] 0709 13:10:15.038326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.135034 (+ 96708us) service_pool.cc:224] Handling call
0709 13:10:16.680606 (+1545572us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b5400047ed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:16.680738 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684167040}
I20260709 13:10:16.810179 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:16.793471 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:16.808101 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:16.851656 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.869393 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:16.852008 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.856485 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:16.792374 29740 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.850958 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.920723 24594 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:16.820461 24596 rpcz_store.cc:276] 0709 13:10:15.394447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.570890 (+176443us) service_pool.cc:224] Handling call
0709 13:10:15.571282 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.571635 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.571668 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.572407 (+   739us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.118261 (+545854us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:16.118299 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.118364 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.715903 (+597539us) raft_consensus.cc:1685] finished
0709 13:10:16.715931 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.716102 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4076,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3851,"thread_start_us":523813,"threads_started":1,"wal-append.queue_time_us":683473}
I20260709 13:10:16.866068 25217 rpcz_store.cc:276] 0709 13:10:14.632990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.633147 (+   157us) service_pool.cc:224] Handling call
0709 13:10:14.633447 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.633806 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.633835 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.634254 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.315115 (+680861us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b18004f69c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:15.577538 (+262423us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:15.972134 (+394596us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.972393 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.972484 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.527370 (+554886us) spinlock_profiling.cc:243] Waited 8.79 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:16.742866 (+215496us) raft_consensus.cc:1685] finished
0709 13:10:16.742891 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.743026 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":634413,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":326,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":14392,"spinlock_wait_cycles":25792256,"thread_start_us":656460,"threads_started":2,"wal-append.queue_time_us":1117566}
I20260709 13:10:16.870395 24525 rpcz_store.cc:276] 0709 13:10:15.110002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.110130 (+   128us) service_pool.cc:224] Handling call
0709 13:10:15.145959 (+ 35829us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:15.234436 (+ 88477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.234481 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:15.235123 (+   642us) log.cc:844] Serialized 52 byte log entry
0709 13:10:15.890071 (+654948us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:15.890141 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.890236 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.540991 (+650755us) raft_consensus.cc:1685] finished
0709 13:10:16.541021 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.541207 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76877,"raft.queue_time_us":77065,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":16292,"thread_start_us":594523,"threads_started":1,"wal-append.queue_time_us":896615}
I20260709 13:10:16.855358 24670 rpcz_store.cc:276] 0709 13:10:14.974548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.974686 (+   138us) service_pool.cc:224] Handling call
0709 13:10:15.001452 (+ 26766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.250640 (+1249188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.576513 (+325873us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000483d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:16.576703 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2843232512}
I20260709 13:10:16.818114 29879 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.790649 29735 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:16.900472 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.882593 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.938687 24595 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:16.881811 24418 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.941023 24418 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.865247 24667 rpcz_store.cc:276] 0709 13:10:15.538304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.885664 (+347360us) service_pool.cc:224] Handling call
0709 13:10:15.913308 (+ 27644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.913562 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:16.115242 (+201680us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.498608 (+383366us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b1800004420. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf 00007f17bbf60038
0709 13:10:16.749400 (+250792us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.749860 (+   460us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.757700 (+  7840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.757746 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:16.757789 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.757846 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.776110 (+ 18264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30414,"prepare.queue_time_us":507883,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":18961,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":12908,"spinlock_wait_cycles":39126656,"thread_start_us":443190,"threads_started":2,"wal-append.queue_time_us":399688}
I20260709 13:10:16.792008 29806 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.904127 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:16.911033 24517 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.944037 24669 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 9: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:16.943053 24418 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 14, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 14 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.946350 24418 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.947800 24418 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 4 to 15, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 15 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:16.911731 24593 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:16.846565 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.949337 24418 catalog_manager.cc:5697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 11 to 16, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 16 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:16.912427 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 119025us
I20260709 13:10:16.870915 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.768555 24666 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.951081 24418 catalog_manager.cc:5697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:16.913100 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43771.5us
I20260709 13:10:16.952193 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:16.953250 24674 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:16.952561 24418 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.952647 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:16.953715 29890 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:16.954125 29422 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:16.954532 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:16.955209 29422 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.953269 29888 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:16.955837 29422 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.922519 24594 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:16.956326 29422 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:16.924222 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.957676 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.907160 29892 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.958330 29892 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:16.929690 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73293.4us
I20260709 13:10:16.962406 25214 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:16.963699 25217 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:16.965406 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:16.965345 29422 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:16.966672 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.967556 29422 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:16.937530 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 168685us
I20260709 13:10:16.777421 29769 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.969410 29769 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.969981 29769 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.950452 29806 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.970438 29743 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:16.971751 29743 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:16.972411 29743 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:16.973332 24671 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:16.974856 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.975307 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:16.976052 25211 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.976526 24418 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 8 to 12, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 12 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:16.977242 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.977387 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.977945 24418 catalog_manager.cc:5697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.973698 25213 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:16.973968 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.973599 29743 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:16.982883 24418 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 10 to 13, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 13 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.974259 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:16.985256 29743 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.985576 24418 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.988049 24418 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 6 to 8, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 8 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:16.985626 25216 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:16.993220 24418 catalog_manager.cc:5697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 8 to 10, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 10 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:16.978420 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.974161 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.995842 24418 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 10 to 12, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 12 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.976011 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.998024 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.004657 25216 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:17.006486 24517 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:16.778612 29528 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 13:10:16.869223 29718 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:16.910130 29514 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:17.019213 25211 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:10:17.019811 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 100155us
W20260709 13:10:17.019315 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 102816us
I20260709 13:10:17.021481 24596 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:17.022691 25213 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:17.013712 24591 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:16.911010 29885 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:17.027894 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 98844.9us
I20260709 13:10:17.029940 24592 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:16.917157 29855 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:17.033138 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.034385 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.034840 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:16.910682 29896 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.057716 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.036798 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:16.909487 29895 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:10:17.038383 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:16.938813 29643 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.910742 29799 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.122s
I20260709 13:10:17.050402 29879 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.969431 29422 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:10:17.052767 24594 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.053638 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.054148 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.073942 25211 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:17.054601 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.939688 29538 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.052424 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:17.056968 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:17.058564 24599 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:17.037616 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:17.064638 24591 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:16.866761 29737 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.056650 29855 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.021306 29744 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.068151 24596 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:17.068689 24595 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:17.017644 29784 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:10:17.057423 29718 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.075057 25216 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:17.065009 29648 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.084803 24670 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:17.039306 29674 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:16.916913 29891 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.151s
I20260709 13:10:17.017325 29722 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 13:10:17.097257 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:17.098344 29806 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.098403 29799 consensus_queue.cc:1243] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:10:17.098723 29728 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.020349 29735 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:17.083086 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.102269 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.033265 29872 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:10:17.084148 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.105352 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:16.888098 29804 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.065601 29750 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:17.112526 24594 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9.
I20260709 13:10:17.092746 29855 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:17.122231 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:17.108526 29887 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:17.134181 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 178396us
I20260709 13:10:17.186038 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:17.132555 29890 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:17.135968 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 101665us
I20260709 13:10:17.102279 29538 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.107996 29894 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.170514 25213 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 9.
I20260709 13:10:17.170730 25210 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
W20260709 13:10:17.255716 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.171778 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:17.256395 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.174515 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 79594.8us
W20260709 13:10:17.258216 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 72363.4us
I20260709 13:10:17.120545 29873 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:17.264218 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 142053us
I20260709 13:10:17.265400 24668 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.172860 29722 consensus_queue.cc:1243] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:17.108635 29718 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.174342 29575 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:17.291627 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:17.309648 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52153.3us
I20260709 13:10:17.123039 29648 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.207003 29887 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:17.337612 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.359588 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:17.256839 29886 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:17.363863 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 72325.8us
I20260709 13:10:17.299827 29780 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.323134 29857 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:17.270259 29918 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:17.326480 29575 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:17.384991 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.410063 24668 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:17.404409 29727 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:17.412230 25211 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:17.430688 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53222.4us
W20260709 13:10:17.436090 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 177013us
I20260709 13:10:17.436955 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:17.452693 29622 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.000s
I20260709 13:10:17.437811 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:17.486022 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:17.486407 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 48699.2us
I20260709 13:10:17.487183 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.487699 29891 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:17.487994 29882 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:17.488366 29891 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.488819 29891 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.490346 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.490984 29891 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:17.439009 29904 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
W20260709 13:10:17.491420 29863 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.000s
I20260709 13:10:17.491916 29863 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.299417 29885 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.441180 29887 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.493633 29887 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.494189 29863 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.437317 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:17.453596 29916 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260709 13:10:17.454447 29909 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:10:17.431037 29575 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:17.461776 29910 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:10:17.461930 29654 consensus_meta.cc:287] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.003s
I20260709 13:10:17.463088 29735 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:17.472492 29628 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.003s
W20260709 13:10:17.475234 29769 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.002s
I20260709 13:10:17.301975 29739 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.430241 29918 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.481026 29922 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:17.482030 29912 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:17.483856 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.485301 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:17.563602 24517 raft_consensus.cc:2368] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17.
W20260709 13:10:17.485546 29795 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 13:10:17.495024 24598 raft_consensus.cc:2368] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:17.494145 29622 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.566607 29622 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.446978 29659 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:17.567464 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.497517 29718 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:17.497447 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43883.9us
I20260709 13:10:17.497787 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:17.569123 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.497458 29915 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.546572 29538 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.498478 24519 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:17.499450 29674 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.411633 29857 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.587698 29857 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.511370 24669 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:17.426281 29886 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:17.593598 29886 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:17.594089 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.594558 29886 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.595280 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.596065 24516 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:17.514209 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:17.516036 25212 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:17.422045 29719 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.460148 29890 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:17.537256 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.430188 29727 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:17.538793 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:17.506242 29648 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.572165 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.573781 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.553306 29654 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.586768 29913 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:17.596797 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:17.599720 24599 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
I20260709 13:10:17.649240 24599 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:17.650254 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.651094 24599 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:10:17.605613 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 91500.3us
I20260709 13:10:17.608871 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.609513 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.613461 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.652310 24597 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:17.613734 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.653230 24595 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:17.619551 25210 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:17.629972 24519 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:17.634011 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.638656 29861 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.639618 29905 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:17.640717 29924 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:17.641450 29874 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:17.642336 29923 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:10:17.643958 29918 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.574369 29799 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:17.660199 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 300672us
W20260709 13:10:17.689844 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 83537.2us
I20260709 13:10:17.563392 29769 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.690881 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:17.560861 29628 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.660671 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:17.663332 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:17.618049 29910 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:17.666636 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.667774 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.658636 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:17.652374 25212 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:17.664335 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.671392 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.663311 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:17.658774 29847 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.000s
I20260709 13:10:17.625536 29795 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:17.577682 29915 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:17.705395 29915 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.707159 29855 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.710016 29727 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.711014 29727 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.606751 29674 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.700546 24593 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:17.713045 24522 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:17.704535 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.717916 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.692435 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:17.726758 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.721575 24597 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
W20260709 13:10:17.726670 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68127.4us
I20260709 13:10:17.728484 24597 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:10:17.719547 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:17.725606 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.729693 24522 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:17.730561 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:17.606570 29538 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:17.733877 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73301us
I20260709 13:10:17.731204 24522 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:17.738832 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 46466us
I20260709 13:10:17.740762 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:17.728364 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:17.741882 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:17.681030 29883 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:17.756143 24592 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:10:17.755276 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52019.7us
I20260709 13:10:17.765062 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.765877 24516 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:17.766497 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:17.768122 24519 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:17.768181 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:17.770048 24522 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:17.771170 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.772912 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.773814 24522 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:17.775183 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:17.775811 24522 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.771257 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:17.711848 29795 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:17.719228 29918 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:17.776672 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:17.577205 29922 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.731704 29750 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:17.786388 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.789904 24599 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
W20260709 13:10:17.792112 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.787672 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:17.797025 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.797998 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56212.7us
W20260709 13:10:17.798041 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 69741.5us
I20260709 13:10:17.801302 24672 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:17.805063 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.805315 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.805994 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:17.806345 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:17.808593 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.809845 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.810335 25182 leader_election.cc:400] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17.
I20260709 13:10:17.810746 25182 leader_election.cc:403] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:10:17.810875 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:17.811585 24592 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:17.811786 29914 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.813243 29921 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:17.813881 29510 consensus_meta.cc:287] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.914s	user 0.009s	sys 0.000s
I20260709 13:10:17.776830 29719 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:17.814277 29510 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.814726 29874 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.712535 29799 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.816368 29510 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.756155 29722 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:10:17.816985 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:17.673877 29905 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.817675 29799 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.818097 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:17.818255 29799 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:17.818857 29905 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:17.819226 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:17.819348 29799 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17.
I20260709 13:10:17.820254 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:17.820892 29743 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:17.821465 29932 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:17.821409 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.838512 24516 raft_consensus.cc:2410] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:17.838332 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.718559 29847 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.785220 29863 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.825663 29855 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.777881 29883 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.826557 29907 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.827319 29857 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.766999 29861 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.814301 29926 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.784896 29622 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:17.822093 24524 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:17.839840 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:17.812394 29914 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.783939 29795 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.784092 29918 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:17.852108 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.830235 29740 consensus_meta.cc:287] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.000s
I20260709 13:10:17.790508 29873 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:17.819417 29905 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:17.829499 29885 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.888155 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.835724 29659 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:17.862388 29938 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:10:17.878989 24665 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:17.880971 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.883443 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:17.907210 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.908607 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:17.848207 29804 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:17.864569 29863 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.871503 29907 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:17.865864 29743 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:17.912047 29907 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.911866 29935 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:17.890645 29750 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:10:17.913869 29750 consensus_queue.cc:1243] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:10:17.912791 29743 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.892645 29674 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.917585 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.918715 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.919239 29895 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:17.919597 29895 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:17.919689 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:17.895210 29857 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.923578 29857 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:17.923494 29918 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.924088 29857 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.924008 29907 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.924669 29857 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.924816 29918 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:17.896894 29896 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.826s	user 0.003s	sys 0.007s
I20260709 13:10:17.897993 29883 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.897639 24522 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:17.888038 29740 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.902338 29873 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:17.876410 29622 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:17.939507 29575 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.921221 29745 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.940395 29745 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.940932 24673 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:17.911857 29863 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.941565 29628 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.942423 29769 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.891270 29654 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:17.943236 29922 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:17.943586 29939 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:10:17.928638 29932 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.921989 29947 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:17.934875 29896 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.922778 29891 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:17.946213 24521 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:17.946918 29950 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.947309 29896 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.947405 29950 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:17.892840 29933 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:10:17.946331 29891 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:17.949358 25214 raft_consensus.cc:2376] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16. Re-sending same reply.
I20260709 13:10:17.949817 29891 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.950565 29944 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.922062 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.951201 29944 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.952385 24517 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [9.6-10.7]
I20260709 13:10:17.932857 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.953956 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:17.928005 29804 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.954511 24517 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:17.879559 29926 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:17.938159 29740 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.938416 29914 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.939019 29873 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:17.939795 29847 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.939901 29622 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.950629 29745 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:17.929893 24596 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:17.931756 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:17.955053 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:17.955564 29804 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:17.963656 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 229520us
W20260709 13:10:17.955101 29936 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:10:17.957232 24517 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:10:17.965441 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.986797 29944 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:17.987939 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 200591us
I20260709 13:10:17.988763 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:17.989565 29944 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.990661 29926 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:17.990821 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:17.991571 29944 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.997653 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:17.996163 24516 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:18.001830 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.002133 24517 pending_rounds.cc:85] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 10
I20260709 13:10:18.002506 24517 pending_rounds.cc:107] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:18.002849 24517 raft_consensus.cc:2889] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:18.005052 24516 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:17.993121 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:18.007831 29847 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.008414 29847 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.008864 29847 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:18.007865 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.019779 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.020262 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:18.021397 29799 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:18.032308 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.033241 25210 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:17.992648 29857 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.035403 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:18.038802 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.040246 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:18.036379 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.042567 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.044106 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.030169 29926 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:18.004119 29896 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:17.994649 29915 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.021781 29960 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.048621 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:18.047866 29926 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:18.053263 29926 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:18.058117 29795 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:18.059465 29943 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:10:18.060377 29795 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.061041 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.062260 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.064585 29926 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.065595 29915 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:18.066149 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:18.067781 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:18.068254 25210 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.071544 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:18.065698 24520 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:18.040076 29950 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:18.078099 29957 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:10:18.081566 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:18.082338 24597 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:18.086982 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.075119 29728 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:10:18.090633 29937 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:10:18.075562 29914 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.094368 29622 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.096609 29622 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.075685 29745 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:18.070677 29883 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:10:18.097266 24591 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:18.098099 29883 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:18.098173 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3346) took 1191 ms. Trace:
I20260709 13:10:18.098546 29883 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:18.098678 24665 rpcz_store.cc:276] 0709 13:10:16.906421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.906939 (+   518us) service_pool.cc:224] Handling call
0709 13:10:16.907248 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.910037 (+1002789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.097942 (+187905us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400046fd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:18.098116 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232561408}
I20260709 13:10:18.099175 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.089314 29780 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:10:18.100241 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.101289 29937 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:18.071043 29863 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.101720 29937 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:18.103257 29863 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.077382 29449 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:18.101301 29575 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.102638 29937 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.106436 29857 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:18.105865 29906 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.106703 29937 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.107064 29906 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.107851 29745 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:18.099364 29883 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.080761 29804 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.122867 29745 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.125844 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:18.126900 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:18.127415 25216 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.131759 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3192) took 1312 ms. Trace:
I20260709 13:10:18.132295 29914 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.136029 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.136210 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:18.137269 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.137547 24522 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:18.139127 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.139866 29879 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:18.140295 29879 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:18.141170 29769 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.141132 29879 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.142073 29769 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.142874 29769 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:18.143069 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:18.144224 29420 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:18.144670 29420 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:18.145136 29420 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:18.147750 24665 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:18.147948 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.132402 24521 rpcz_store.cc:276] 0709 13:10:16.819368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.825191 (+  5823us) service_pool.cc:224] Handling call
0709 13:10:16.825549 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.946614 (+1121065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.131492 (+184878us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003de0d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:18.131695 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576865024}
I20260709 13:10:18.149290 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.151409 24667 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:18.117615 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:18.156544 24667 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:18.117875 29926 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.120599 29780 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:18.159701 29780 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:18.122012 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.122220 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.161357 24597 raft_consensus.cc:2376] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16. Re-sending same reply.
I20260709 13:10:18.161895 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.162230 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:18.162835 24597 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
I20260709 13:10:18.159782 24672 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:18.163501 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.165294 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:18.166785 24665 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:18.168088 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.118911 25210 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:18.168490 25216 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:18.170331 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.170596 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.171680 24591 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.171751 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:18.177968 25210 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:10:18.181684 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 109519us
I20260709 13:10:18.182694 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.184131 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.186060 29892 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.186823 29892 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.187620 29892 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.189020 29906 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:18.190466 29804 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:18.193466 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.197305 29918 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:18.199275 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.199934 25214 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:18.200913 25218 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:18.201735 29659 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:18.202437 29659 consensus_queue.cc:1243] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:10:18.203372 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:18.211210 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.212191 24597 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 10: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:18.212424 24591 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:18.214883 24591 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 13:10:18.219986 25210 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:10:18.220980 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 177177us
I20260709 13:10:18.160595 29780 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.223618 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:18.177067 29872 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.235328 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.236995 25218 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 10 LEARNER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:18.238332 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:18.216286 29861 raft_consensus.cc:2764] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:18.227746 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:18.228401 29847 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.229353 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:18.229506 29887 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:18.242487 24597 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:18.175076 29863 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:18.240417 24519 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:18.245253 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:18.241581 25214 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:18.246394 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.166296 29769 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:10:18.257964 24600 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:18.199350 29643 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:10:18.259341 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:18.260409 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:18.264155 24597 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 11: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:18.230618 29719 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:10:18.242151 29718 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.272087 24519 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
W20260709 13:10:18.273766 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 104500us
I20260709 13:10:18.251081 29883 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.278851 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:18.281797 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.282445 24597 raft_consensus.cc:2376] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12. Re-sending same reply.
I20260709 13:10:18.259783 29780 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:18.281257 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:18.296793 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66469.6us
I20260709 13:10:18.290145 29795 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:10:18.298843 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:18.301575 29906 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:18.302268 29906 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:18.280512 29575 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:18.332939 29575 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.289063 29731 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:18.303342 29906 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.284759 29449 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:18.325779 29643 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:18.305651 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.362421 24597 raft_consensus.cc:2376] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 9. Re-sending same reply.
I20260709 13:10:18.334597 25218 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:18.289003 29950 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:10:18.372108 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:18.362224 29731 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:18.367539 29449 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:18.368698 29847 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:18.388734 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:18.392019 24597 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.419714 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3340) took 1918 ms. Trace:
I20260709 13:10:18.420126 24674 rpcz_store.cc:276] 0709 13:10:16.500916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.765651 (+264735us) service_pool.cc:224] Handling call
0709 13:10:16.765946 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.953632 (+187686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.419482 (+1465850us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001392d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:18.419658 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430373760}
W20260709 13:10:18.422082 24598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1713) took 1575 ms (client timeout 1553 ms). Trace:
W20260709 13:10:18.422432 24598 rpcz_store.cc:269] 0709 13:10:16.847030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.850722 (+  3692us) service_pool.cc:224] Handling call
0709 13:10:18.421922 (+1571200us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540025e4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:18.422036 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319169920}
I20260709 13:10:18.425258 24597 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:18.409487 29847 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:18.433728 24597 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:18.436333 24598 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:18.442898 24597 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:18.447608 29847 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.449148 29449 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.453161 29575 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:18.457650 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.423985 29359 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:18.409004 29731 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.472256 25214 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:18.484346 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.474231 29538 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:18.475257 24673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3337) took 2106 ms (client timeout 2773 ms). Trace:
I20260709 13:10:18.477033 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:18.477816 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:18.479336 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:18.485637 24520 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:18.481961 24521 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:10:18.486424 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:18.486577 24673 rpcz_store.cc:269] 0709 13:10:16.369416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.698896 (+329480us) service_pool.cc:224] Handling call
0709 13:10:18.475059 (+1776163us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001388d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:18.475197 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2853614848}
I20260709 13:10:18.487784 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.488098 24519 raft_consensus.cc:2410] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:18.489555 24524 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:18.492336 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:18.500388 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.504297 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:18.505055 24520 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:18.505894 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.518929 24491 leader_election.cc:336] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.559s (SENT)
I20260709 13:10:18.519529 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.485014 29575 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.530119 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.534077 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.529537 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:18.468930 29359 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:18.539902 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:18.540277 24637 connection.cc:256] RPC call timeout handler was delayed by -1.4744463889999224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:10:18.488781 29735 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.536003 29914 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.544190 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:18.554891 24637 connection.cc:256] RPC call timeout handler was delayed by -1.3230538860000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 13:10:18.490897 29795 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.499552 29891 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:18.563481 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 86827.5us
W20260709 13:10:18.560210 24637 connection.cc:256] RPC call timeout handler was delayed by -1.2575471770001059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:10:18.569705 24637 connection.cc:256] RPC call timeout handler was delayed by -1.0197538859999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 13:10:18.560294 24525 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:18.573210 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:18.573974 24525 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:18.575008 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:18.535962 29739 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.536207 29944 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:18.578822 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:18.579681 24525 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.543707 29740 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:18.582362 24520 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:18.576803 29857 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:18.581748 29795 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.584481 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:18.562939 29420 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.544371 29575 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.579339 29944 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:18.596233 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56403.9us
I20260709 13:10:18.582167 29891 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:18.594985 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:18.582437 29847 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.605803 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1538) took 1632 ms. Trace:
I20260709 13:10:18.606323 25217 rpcz_store.cc:276] 0709 13:10:16.973019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.977021 (+  4002us) service_pool.cc:224] Handling call
0709 13:10:18.605590 (+1628569us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400477cd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:18.605738 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855330688}
I20260709 13:10:18.611795 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1137) took 1128 ms. Trace:
I20260709 13:10:18.612268 24523 rpcz_store.cc:276] 0709 13:10:17.482967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.485166 (+  2199us) service_pool.cc:224] Handling call
0709 13:10:17.485553 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.597857 (+112304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.597894 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.597951 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:17.597996 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.611543 (+1013547us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54003defd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:18.611598 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.611732 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257793280}
I20260709 13:10:18.590278 29740 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:18.614094 24523 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:18.614020 29740 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.615411 29575 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.615595 24523 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:18.594796 29795 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.616649 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3193) took 1797 ms. Trace:
I20260709 13:10:18.617707 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1117) took 1526 ms. Trace:
I20260709 13:10:18.617821 29795 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:18.576452 29359 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.618451 29420 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:18.618099 29891 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.618603 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1082) took 1007 ms. Trace:
I20260709 13:10:18.618917 29359 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.619025 24596 rpcz_store.cc:276] 0709 13:10:17.611256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.709846 (+ 98590us) service_pool.cc:224] Handling call
0709 13:10:17.929657 (+219811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.982022 (+ 52365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.618418 (+636396us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001cbe50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:18.618550 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504628608}
I20260709 13:10:18.620447 29891 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:18.597564 29944 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:18.626230 24491 leader_election.cc:336] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.650s (SENT)
I20260709 13:10:18.626784 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:18.631397 24595 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:18.637274 24525 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:18.650651 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:18.618124 25211 rpcz_store.cc:276] 0709 13:10:17.091292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.091443 (+   151us) service_pool.cc:224] Handling call
0709 13:10:17.091840 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.428296 (+336456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.617513 (+1189217us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54006801d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:18.617651 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672169856}
I20260709 13:10:18.617005 24518 rpcz_store.cc:276] 0709 13:10:16.819759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.819933 (+   174us) service_pool.cc:224] Handling call
0709 13:10:16.820211 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.033195 (+212984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.033223 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.033263 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:17.033293 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.616441 (+1583148us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400441954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:18.616496 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.616598 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489352448}
I20260709 13:10:18.589270 29857 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:18.684383 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.686789 29986 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:18.687511 29986 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.653544 29914 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.629446 29739 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:10:18.672418 29915 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.670208 29985 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:18.671603 29795 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.699129 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.701231 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.701601 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.702440 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:18.706617 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.707350 24674 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:18.708209 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:18.708931 24491 leader_election.cc:336] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.737s (SENT)
I20260709 13:10:18.709012 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:18.709590 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.710335 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:18.711083 24667 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:18.672199 29891 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:10:18.716637 24491 leader_election.cc:336] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.746s (SENT)
I20260709 13:10:18.717250 29914 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.717653 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:18.751856 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.754699 29810 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:18.755259 29810 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:18.758661 29735 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.701478 29985 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.763073 29985 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:18.730490 29857 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.766865 29737 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.752697 24673 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:18.718024 29995 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:18.729844 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.773646 24672 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:18.730414 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.774374 24666 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:18.771025 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:18.771567 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:18.776155 24674 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:18.776361 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 56393.5us
I20260709 13:10:18.715040 29795 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.779673 24669 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:18.781859 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 216012us
I20260709 13:10:18.782740 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44426 (request call id 3335) took 2511 ms. Trace:
I20260709 13:10:18.783304 24666 rpcz_store.cc:276] 0709 13:10:16.268838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.751809 (+482971us) service_pool.cc:224] Handling call
0709 13:10:18.772587 (+2020778us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b4c001b2c40. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba212a20 00007f17ba223a29 00007f17ba22413f 00007f17ba1e82ab 00007f17ba215f3c 00007f17ba2163fe 00007f17ba4a388b 00007f17bbea2495 00007f17bbef330f 00007f17bbf3da55 00007f17c0f0dcd0
0709 13:10:18.774790 (+  2203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162153728}
I20260709 13:10:18.789230 24523 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:18.795540 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.780131 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:18.804940 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.756305 29810 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.811112 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.816931 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.699506 29915 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.806730 24637 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:18.806572 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:18.830096 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:18.831848 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.811833 29891 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:18.785322 29886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.013s	sys 0.014s
I20260709 13:10:18.846366 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.847078 24670 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:18.859140 24674 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:18.859495 24667 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:18.861243 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:18.863854 29810 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.864020 29986 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:18.864642 29993 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.866974 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3345) took 1970 ms. Trace:
I20260709 13:10:18.867367 24671 rpcz_store.cc:276] 0709 13:10:16.896195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.907894 (+ 11699us) service_pool.cc:224] Handling call
0709 13:10:16.908195 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.973716 (+ 65521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.866748 (+1893032us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b54002b5a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:18.866916 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149372288}
I20260709 13:10:18.827710 29735 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:18.833999 29731 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:18.860105 29886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.014s	sys 0.016s
I20260709 13:10:18.877498 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.844324 29914 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:18.878520 25215 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:18.785225 29995 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.880182 25215 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:18.858574 29740 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.844772 29739 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:10:18.900226 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:18.880316 29993 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.902863 25215 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.906119 25215 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.918516 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:18.903815 29575 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:18.921659 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:18.883201 29914 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.937338 29998 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:18.932041 29857 raft_consensus.cc:2764] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:18.932003 29731 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:10:18.932092 29575 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:18.921639 29735 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:10:18.913321 29956 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:10:18.913874 29944 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.937875 29891 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:10:18.948434 29575 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.977728 29995 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:18.981142 29795 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.982640 29915 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:18.983508 24672 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:18.985117 29993 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.985337 29944 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:18.974294 29914 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:18.946095 29857 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:18.990296 29846 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.990886 29846 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:18.999593 29998 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:19.001113 29998 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:18.912158 29740 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.010263 29575 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.014621 25215 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:10:19.015367 29759 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:10:19.015460 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1115) took 1959 ms. Trace:
I20260709 13:10:19.015829 25215 rpcz_store.cc:276] 0709 13:10:17.055787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.055898 (+   111us) service_pool.cc:224] Handling call
0709 13:10:17.073569 (+ 17671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.878416 (+1804847us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54005c1820. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebddc0 00007f17bbf481c0 00007f17bbf49231 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c
0709 13:10:19.015126 (+136710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.015403 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117786368}
I20260709 13:10:19.024338 29575 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.093322 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:19.096197 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.098470 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.099392 24596 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
W20260709 13:10:19.105846 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 170614us
I20260709 13:10:19.110754 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:19.111655 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:19.113025 24518 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:19.114841 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:19.115880 24518 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:19.118892 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:19.126346 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:19.126659 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.129818 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:19.132891 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.139803 29914 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.141094 29914 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.142036 29914 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.142804 29914 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:19.143292 29914 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:19.143752 29914 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:19.157140 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.169624 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:19.171000 25215 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:19.176411 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:19.201251 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 717156us
I20260709 13:10:19.208310 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:19.209203 24519 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:19.211515 30000 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.526s	user 0.000s	sys 0.001s
I20260709 13:10:19.213384 29718 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.214378 29718 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.223490 29780 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:19.224092 29780 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:19.225817 29780 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.228108 29907 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:19.236922 29719 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.237485 29719 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:19.239143 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.228157 29780 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.244555 29890 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.253490 29745 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:19.254738 29745 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:19.255138 29745 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:19.257419 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.260188 29718 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:19.264632 24518 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:19.265734 29879 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:19.239183 29719 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.273350 29886 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.273623 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1734) took 1244 ms. Trace:
I20260709 13:10:19.274176 29886 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.274817 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2055) took 1045 ms. Trace:
I20260709 13:10:19.275308 24595 rpcz_store.cc:276] 0709 13:10:18.228848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.246155 (+ 17307us) service_pool.cc:224] Handling call
0709 13:10:19.274337 (+1028182us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54001928d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:19.274605 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860701568}
I20260709 13:10:19.272775 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1728) took 1252 ms. Trace:
W20260709 13:10:19.286806 24668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3342) took 2719 ms (client timeout 2010 ms). Trace:
W20260709 13:10:19.287488 24668 rpcz_store.cc:269] 0709 13:10:16.566860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.688968 (+122108us) service_pool.cc:224] Handling call
0709 13:10:19.286148 (+2597180us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540044fa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:19.286464 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062799104}
I20260709 13:10:19.256506 29745 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.280444 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:19.293565 24666 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:19.294234 24524 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:19.294374 29996 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.252558 29861 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:10:19.295228 29996 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.297676 24517 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.283692 24600 rpcz_store.cc:276] 0709 13:10:18.019868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.020033 (+   165us) service_pool.cc:224] Handling call
0709 13:10:18.035947 (+ 15914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.258540 (+222593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.272128 (+1013588us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540033ed54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:19.272517 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510018432}
I20260709 13:10:19.300956 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:19.302102 24518 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:19.304518 29996 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:19.307639 29847 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:19.308193 29847 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:19.309470 29922 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.311774 29886 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.320251 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.327064 29707 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:19.329947 29799 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:19.330489 29799 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:19.332001 29799 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:19.312644 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 139293us
I20260709 13:10:19.324440 29895 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.335193 29895 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.324472 29861 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:10:19.342268 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:19.342988 29799 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.345533 29922 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:19.346143 29922 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:19.347122 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:19.348609 29941 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:19.349313 29880 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:19.351336 29928 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:19.351877 29928 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:19.352402 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1083) took 1740 ms (client timeout 1547 ms). Trace:
W20260709 13:10:19.352919 24599 rpcz_store.cc:269] 0709 13:10:17.611534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.671131 (+ 59597us) service_pool.cc:224] Handling call
0709 13:10:19.352000 (+1680869us) spinlock_profiling.cc:243] Waited 79.5 ms on lock 0x7b540013fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:19.352176 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182774528}
I20260709 13:10:19.347435 29922 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.304828 29846 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.313596 29847 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.357355 29928 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.315541 29745 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.316949 29955 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.274196 24591 rpcz_store.cc:276] 0709 13:10:18.029404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.216901 (+187497us) service_pool.cc:224] Handling call
0709 13:10:18.217370 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:18.217879 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.217964 (+    85us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:18.219038 (+  1074us) log.cc:844] Serialized 52 byte log entry
0709 13:10:18.286601 (+ 67563us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:18.309530 (+ 22929us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.246187 (+936657us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:10:19.272945 (+ 26758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.273071 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.273144 (+    73us) raft_consensus.cc:1685] finished
0709 13:10:19.273244 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.273442 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":905228,"prepare.queue_time_us":42199,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":910393,"raft.run_cpu_time_us":9289,"raft.run_wall_time_us":1027822,"spinlock_wait_cycles":8328576,"thread_start_us":106045,"threads_started":2,"wal-append.queue_time_us":165579}
I20260709 13:10:19.361380 29955 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.363777 29955 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:19.371129 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1170) took 1155 ms. Trace:
I20260709 13:10:19.371660 25214 rpcz_store.cc:276] 0709 13:10:18.215811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.276775 (+ 60964us) service_pool.cc:224] Handling call
0709 13:10:18.472081 (+195306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.484675 (+ 12594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.370629 (+885954us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54004ee3d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:19.370905 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423885568}
I20260709 13:10:19.372902 29522 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:19.320276 30006 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.416s	user 0.009s	sys 0.012s
I20260709 13:10:19.317211 29954 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:19.375368 29883 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.375823 29883 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:19.376044 29941 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.376530 29941 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:19.377183 29883 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.377801 29941 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.378562 29883 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.381131 29861 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:19.382445 29719 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.417114 29857 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.390046 24666 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:19.396415 29522 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:19.422140 29941 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.383257 29886 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:19.385411 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.422056 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:19.436808 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:19.378942 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51177.5us
I20260709 13:10:19.428360 29847 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:19.432648 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 81248.9us
I20260709 13:10:19.427752 29928 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.444826 24521 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:19.441684 29886 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:19.482085 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 46808.4us
W20260709 13:10:19.493021 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.500202 24519 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:19.443306 29857 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.494130 29885 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.492672 29914 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.502233 29707 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.531165 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.529556 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.523011 29861 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.542223 29906 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.542493 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.543172 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.542987 29906 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.543601 24671 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:19.544173 24668 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.542991 29874 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:19.545480 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.545686 29874 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.548029 29931 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:10:19.548416 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:19.551993 24522 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:10:19.551862 29885 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.541960 30016 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:10:19.554628 29914 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.557493 24665 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:19.557626 24599 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:19.551903 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1730) took 1527 ms. Trace:
I20260709 13:10:19.498557 29522 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.580860 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.560364 24592 rpcz_store.cc:276] 0709 13:10:18.024211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.175747 (+151536us) service_pool.cc:224] Handling call
0709 13:10:18.176151 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:18.202320 (+ 26169us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:18.202714 (+   394us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.200496 (+997782us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b180043d440. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17bfe1a58f 00007f17b8e59571 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd
0709 13:10:19.260146 (+ 59650us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b180043d440. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a 00007f17bbf50a2a
0709 13:10:19.378112 (+117966us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b180043d440. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:19.445134 (+ 67022us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:19.446365 (+  1231us) log.cc:844] Serialized 52 byte log entry
0709 13:10:19.446595 (+   230us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:19.448508 (+  1913us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.475452 (+ 26944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.502139 (+ 26687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.551477 (+ 49338us) raft_consensus.cc:1685] finished
0709 13:10:19.551504 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.551737 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65874,"prepare.queue_time_us":15119,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":102,"raft.queue_time_us":66470,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":55096,"spinlock_wait_cycles":36341632,"thread_start_us":177676,"threads_started":1,"wal-append.queue_time_us":1345943}
I20260709 13:10:19.566720 29722 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:10:19.586899 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:19.590055 24665 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:19.589931 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:19.602922 24600 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:19.606637 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.606951 24672 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:19.562726 29575 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:19.601577 29906 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.617934 29522 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.615355 29806 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.626737 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:19.627645 24596 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:19.627871 29890 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.628357 24522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 1154) took 1401 ms (client timeout 1504 ms). Trace:
I20260709 13:10:19.628417 29890 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:19.628868 24522 rpcz_store.cc:269] 0709 13:10:18.227316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.227482 (+   166us) service_pool.cc:224] Handling call
0709 13:10:19.628151 (+1400669us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54003ad9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:19.628290 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2962021120}
I20260709 13:10:19.635301 29890 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.588050 29861 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:19.638702 24516 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:19.645865 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2013) took 1139 ms. Trace:
I20260709 13:10:19.646423 29861 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:19.646788 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.646849 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.646209 24516 rpcz_store.cc:276] 0709 13:10:18.506729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.507235 (+   506us) service_pool.cc:224] Handling call
0709 13:10:19.632517 (+1125282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.644629 (+ 12112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.645612 (+   983us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003ad9d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:19.645764 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2582529792}
I20260709 13:10:19.648109 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:19.648754 24598 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:19.642530 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.643076 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.644032 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.662102 24596 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:19.670892 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.663213 29847 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:19.675346 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:19.684964 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 113991us
I20260709 13:10:19.684850 29449 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:10:19.685773 24592 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:19.685897 29449 consensus_queue.cc:1243] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:19.686560 29449 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:19.686887 29449 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:19.687091 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.687305 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.685364 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:19.688962 24668 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.689383 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:19.693037 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.688355 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:19.708139 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.713253 24670 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.720152 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.724911 29885 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.730914 24667 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:19.733266 29799 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:19.733879 29799 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.734417 24674 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:19.713933 24599 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:19.711674 29857 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:19.743216 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 194913us
W20260709 13:10:19.744374 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 223727us
I20260709 13:10:19.744889 29922 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.788606 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.741433 24599 raft_consensus.cc:1217] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.11->[14.12-14.12]   Dedup: 14.12->[]
W20260709 13:10:19.788652 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 257827us
I20260709 13:10:19.748502 24670 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:19.739717 24594 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:10:19.766819 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.746198 24596 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.686916 29847 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:19.744928 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.825186 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.817459 24591 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:19.821009 24599 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:19.821939 24665 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:19.822888 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:19.827416 25215 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:19.743588 29954 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:19.829607 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:19.828734 24598 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:19.739720 29707 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:19.744755 29926 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.769632 29874 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.839545 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:19.840050 29759 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.841845 29934 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.841970 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.842420 29934 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.843484 29885 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:19.844116 29885 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.844760 29934 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.845847 24516 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:19.846318 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:19.846958 29885 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.847054 24522 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
W20260709 13:10:19.848385 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.849249 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:19.687932 29449 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.737052 29799 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.737119 29806 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:19.833252 29861 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:19.855918 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:19.840652 29759 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.864919 24591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
W20260709 13:10:19.858204 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.873603 29874 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:19.874341 29874 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.876986 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:19.877214 29806 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.878628 24674 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:10:19.879290 29806 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.879670 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.880174 29449 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.880482 24674 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:19.885336 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.817430 29922 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.886813 24668 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:19.887939 29922 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.889977 24669 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.887940 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.891404 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.891940 24666 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:19.893555 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.894452 24566 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:19.896699 29780 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.897428 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:19.898131 25215 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:19.899384 29745 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:19.900539 29745 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:10:19.900696 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 76115.7us
I20260709 13:10:19.900929 29745 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:19.902020 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.902878 29883 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.903337 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.903545 29883 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:19.904475 29922 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:19.865988 30015 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.868387 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:19.870354 29857 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.904543 29926 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.745244 29932 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.865298 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:19.908152 30015 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.835911 29895 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.835692 29707 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:19.916174 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:19.738073 29886 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.919890 24673 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:10:19.918285 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53117.1us
I20260709 13:10:19.905462 29922 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:19.919351 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 68876us
I20260709 13:10:19.918378 24669 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:19.893558 29759 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:19.925436 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:19.902174 29874 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:19.902139 29745 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.908182 29857 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.913630 29575 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:19.920275 24673 pending_rounds.cc:85] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 6
I20260709 13:10:19.872975 29861 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:19.941691 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:19.912177 29954 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:19.956455 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 53194.1us
I20260709 13:10:19.955475 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:19.959429 29922 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.924455 29719 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:19.963155 24667 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:19.921775 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:19.957222 24673 pending_rounds.cc:107] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:19.969736 24673 raft_consensus.cc:2889] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:19.972452 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:19.973802 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.974414 29857 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.955084 29780 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:10:19.976130 29622 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:19.942902 29847 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.977564 29719 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:19.977799 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.978026 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:19.983049 25215 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
W20260709 13:10:19.978857 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 126444us
I20260709 13:10:19.984035 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:19.984431 24674 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.978734 29719 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.979588 29759 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.981240 29861 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:19.981678 29955 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:20.014058 24519 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: [16.11-17.12]
I20260709 13:10:19.964537 29522 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:19.994273 29879 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:19.977566 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:19.997997 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:20.000469 24672 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:20.002511 29937 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:20.003787 29880 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.004769 29906 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:20.005944 29885 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:20.006009 29799 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:20.009614 24518 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:20.010442 29883 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:20.012569 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:20.016922 29575 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:19.993993 29449 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:20.048524 29449 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:20.048920 29449 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:20.049258 24525 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:20.049858 29449 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.050695 25213 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:20.051198 29449 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:20.051401 29880 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.021219 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:20.022719 24591 raft_consensus.cc:606] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:20.053359 24591 raft_consensus.cc:614] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:19.942377 29895 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.054301 29880 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.056016 29895 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:19.990623 29890 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:20.056757 29890 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:20.057785 29890 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:19.924264 29932 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.023962 29522 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.042395 24666 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:19.962953 29954 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.054163 29857 raft_consensus.cc:2764] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:20.023212 29745 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:20.061383 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:20.063625 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 144546us
I20260709 13:10:20.072031 24671 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:20.072217 29522 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:20.072947 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.068821 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:20.081916 29921 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:20.041865 29934 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:20.091709 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.043506 29955 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:20.090271 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 134909us
I20260709 13:10:20.083415 30016 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.098198 25211 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:20.068496 29883 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.103958 25216 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:10:20.105247 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 84095.8us
W20260709 13:10:20.100513 30029 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:20.106211 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:20.109218 24517 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.111670 25215 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:20.091243 24670 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:20.121219 24523 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:20.124850 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.134886 24516 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
W20260709 13:10:20.147054 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.147555 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.151810 29954 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.084893 29707 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:20.157989 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 321849us
I20260709 13:10:20.122275 29857 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:20.162573 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:20.160151 29847 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.179597 29847 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:20.181038 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.160538 24490 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:20.187183 24516 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:20.187683 24516 pending_rounds.cc:85] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 7
I20260709 13:10:20.207962 24516 pending_rounds.cc:107] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:20.208303 24516 raft_consensus.cc:2889] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.202721 25182 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:20.118475 29934 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.163873 29857 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.217375 29857 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.222143 24523 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:20.153158 29799 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:20.181664 29906 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:20.125003 30016 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.182545 29847 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.213063 29707 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.242429 29928 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:20.262037 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.267110 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.204998 29954 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:10:20.254694 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.246702 30015 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.277053 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.277832 30015 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:20.278359 24523 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:20.247520 29941 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.779s	user 0.012s	sys 0.000s
W20260709 13:10:20.268833 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 108399us
I20260709 13:10:20.238286 29937 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:20.238945 29906 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:20.266301 29928 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:20.295420 24592 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
W20260709 13:10:20.298484 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.298364 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:20.299705 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.309568 29780 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:20.288928 29937 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.288676 29759 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:20.266160 29799 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.307161 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.318485 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:20.246620 29955 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.311126 29941 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:20.314389 29879 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:20.327764 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 324222us
I20260709 13:10:20.326237 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.313688 29937 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.331156 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.331979 24523 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:20.343313 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:20.333554 29879 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:20.334281 29883 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:20.354003 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 366889us
I20260709 13:10:20.337786 29895 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:20.333169 29932 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:20.370045 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.371562 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.372327 24591 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:20.349300 29954 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:20.393306 29954 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:20.393760 29954 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:20.397369 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.400604 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:20.401849 29937 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.402221 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:20.403158 29722 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:20.403591 29722 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.403990 29722 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.405777 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.406358 24594 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:20.407487 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.409721 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.411130 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.412129 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.412693 24518 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:20.413718 24595 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:10:20.413600 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:20.414803 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.415568 24595 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:20.416321 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.416944 29722 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.417874 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.418449 24518 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:20.419235 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.420954 29937 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:20.422252 29937 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:20.422152 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:20.422897 29937 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:20.423373 29937 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.423472 29799 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:20.424603 29449 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:20.437268 29449 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.386480 24597 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:20.334399 29759 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.376358 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.376875 24516 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:20.378782 30034 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:20.379958 24600 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:20.416865 24595 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:10:20.386480 29622 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:20.387147 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.389335 29874 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:20.390051 29932 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:20.361107 29879 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:20.390859 30040 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.380890 30030 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:10:20.442600 24592 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:20.380868 24596 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:20.359720 29890 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:20.464450 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:20.464504 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:20.490687 24671 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:20.464931 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:20.491806 24674 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:20.419158 29722 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:20.365437 29934 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:20.465870 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 273508us
I20260709 13:10:20.470954 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:20.495085 24669 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:20.481783 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:20.483165 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.478823 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:20.437902 29449 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.488547 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.489145 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:20.500793 29932 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:20.501448 29932 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.502219 29921 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:20.502713 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.503280 24516 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:20.503494 29922 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:20.503901 29922 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.504240 29922 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:20.504601 29883 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:20.505255 29934 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:20.505628 29934 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:20.506438 29934 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.506611 29906 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.507668 29906 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.508324 30041 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:20.509951 29874 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:20.510378 29874 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:20.510784 29874 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:20.511391 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.512362 24519 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:10:20.513741 30043 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:20.515163 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.459344 29622 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:20.358870 29928 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.516106 24596 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:20.516635 29622 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.485534 29575 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:10:20.501740 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:20.500496 30040 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.504148 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:20.519357 24592 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.524057 24516 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.496137 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.527026 24597 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:20.517053 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.422128 29522 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:10:20.545106 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62126.8us
I20260709 13:10:20.570403 29622 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:20.573616 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 77633.6us
I20260709 13:10:20.570470 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:20.594933 24600 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.538707 29932 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:20.508701 29857 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.488768 29885 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:20.583905 24597 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:10:20.584352 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 247401us
I20260709 13:10:20.517488 29890 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:20.583053 24591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
W20260709 13:10:20.592794 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.508708 30041 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:20.578282 24592 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
W20260709 13:10:20.596679 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 183838us
I20260709 13:10:20.579258 29880 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.651233 24591 raft_consensus.cc:606] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:20.659282 24591 raft_consensus.cc:614] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:20.519997 29575 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:10:20.545351 29722 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:10:20.660889 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:20.662094 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:20.674649 24594 raft_consensus.cc:2368] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12.
I20260709 13:10:20.607857 29885 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:20.682605 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 196483us
I20260709 13:10:20.649559 29780 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.658674 29932 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.668459 29886 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.699744 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:20.697098 29759 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:20.702564 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 53349.4us
I20260709 13:10:20.713982 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.681221 29449 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.691915 29885 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:20.717381 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 220315us
W20260709 13:10:20.717687 30025 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:10:20.718456 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60458.6us
I20260709 13:10:20.734321 29857 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:20.718879 30042 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:20.703408 29780 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.727080 29932 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.729456 29449 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.679824 30031 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:20.679692 29880 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.703783 29883 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.732013 29926 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.824s	user 0.006s	sys 0.006s
I20260709 13:10:20.732880 30041 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.735304 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:20.714571 24597 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:20.741451 29857 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.756294 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:20.762583 24600 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
W20260709 13:10:20.763535 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.729698 29890 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:20.768643 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 71084.9us
W20260709 13:10:20.742244 24517 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.002s
I20260709 13:10:20.773052 24517 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:20.773703 24523 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:20.735039 30040 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.765241 29759 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.771835 29926 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:20.783733 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.789403 29918 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:10:20.784934 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.789999 30062 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.783309 30031 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.791046 29874 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.825510 29874 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:20.826092 29874 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:20.826454 29874 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.826771 29874 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.827564 29954 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.792001 29522 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:20.792462 30041 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.768744 29449 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.835363 29449 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.835960 29449 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.775900 29857 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.838176 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.772305 29883 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.839015 29857 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.794025 29922 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.839999 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.841235 29922 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.841411 24520 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:20.798249 30065 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.841961 30055 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:20.836618 29449 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:20.842414 30055 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.842067 30065 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.842842 30055 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:20.844519 30065 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.799726 29780 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:20.801224 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.845582 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.802464 29880 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:20.806304 29932 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:20.823618 29918 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:20.846652 29918 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:20.847775 29918 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.840610 29883 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:20.794806 29707 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:10:20.797690 29575 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:20.849885 24598 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:20.835390 24516 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:20.849046 29918 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.853197 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:20.857296 30062 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:20.859656 30062 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:20.859588 29874 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.862612 29874 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:20.850369 30042 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:20.870570 24525 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
W20260709 13:10:20.899293 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 106850us
I20260709 13:10:20.911679 29885 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.900301 29937 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:20.913515 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 318528us
I20260709 13:10:20.914971 29937 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:20.922906 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 166672us
W20260709 13:10:20.917963 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.925473 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 190769us
I20260709 13:10:20.916774 29759 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:20.906527 29921 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.916903 29931 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:20.916847 30031 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.943979 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:20.947851 29622 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:20.971120 29622 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.973917 29622 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.976886 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.953410 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:20.977519 24517 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:20.977739 24592 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:20.942337 29921 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.980610 29921 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.943449 30067 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:20.943341 29955 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:10:21.003333 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59447.4us
I20260709 13:10:21.004314 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:20.958674 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.005471 24597 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:20.959175 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.006616 24594 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:20.961191 29885 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:20.936865 30062 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:20.926762 29937 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:10:20.964926 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.022975 24596 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:20.966234 29954 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.917263 30044 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:10:20.967654 29871 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.968201 30016 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.969646 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:20.971580 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.974880 29879 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:20.975739 29722 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:20.948446 30050 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:21.032150 30050 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.034663 30050 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:20.953541 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:20.986979 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:20.942934 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:21.013237 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 86225.2us
W20260709 13:10:21.038200 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 95338.5us
I20260709 13:10:21.041762 30075 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:21.044360 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:21.046651 29879 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.047546 29857 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:21.047933 29885 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:21.048153 29857 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:21.048365 29885 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:21.048822 29885 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.049247 29857 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:21.002857 29918 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:21.027571 29931 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:21.025206 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:21.053743 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:21.054239 24517 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.027426 25184 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:21.021483 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:21.031051 25219 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:21.030930 29722 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.045364 24516 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.981792 30067 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.026659 29575 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:21.057788 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:21.060304 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:21.061098 24597 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.056437 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:21.014382 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 71786.7us
I20260709 13:10:21.067507 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.064644 29575 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.068454 29575 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.071189 29934 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.025731 30055 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.073330 29955 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:21.073529 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.073836 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.074393 25219 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 10: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:21.075081 29928 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:21.075245 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.075353 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.075775 30059 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:21.076046 25214 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:21.076146 25219 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:21.077454 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.076784 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.079363 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:21.059580 29918 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:21.066731 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:21.081336 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.077525 30062 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:21.082409 24674 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:21.085561 24670 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:21.088258 24517 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:21.088820 25214 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:21.098882 25184 leader_election.cc:400] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12.
I20260709 13:10:21.099344 25184 leader_election.cc:403] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:21.101122 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.102274 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.101070 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.108804 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.109417 24672 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:21.101720 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.101977 24666 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:21.111081 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:21.110260 24671 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:21.073899 29955 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.081023 29449 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:21.116039 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:21.083125 30034 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:21.075124 30055 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.121042 25215 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:21.037422 29871 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.130751 29871 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.122268 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.132455 25211 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:21.133438 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.134124 25211 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:21.134881 30067 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.134953 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.135654 30074 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:21.135982 25211 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:21.136153 30074 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:21.136618 30074 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.097038 29937 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:21.137421 29937 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:21.137733 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.138535 25213 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:21.139309 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.138543 29937 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.140049 25213 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:21.141422 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.142165 24594 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:21.142001 29931 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.143117 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.143594 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:21.144207 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.096613 29847 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:21.125438 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:21.126665 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.136826 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:21.146606 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90222.1us
I20260709 13:10:21.149549 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:21.150116 24519 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.151589 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:21.140834 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.082716 29906 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:21.161424 24520 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:21.156888 24516 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:21.159732 25213 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:21.165771 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:21.169602 24598 raft_consensus.cc:606] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:21.169955 24598 raft_consensus.cc:614] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:21.166009 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.166392 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.166410 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.170254 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.171106 25215 raft_consensus.cc:2368] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
W20260709 13:10:21.173251 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.169224 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:21.182230 24594 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:21.121171 29955 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.119760 30041 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.183598 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:21.185735 25214 raft_consensus.cc:2368] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16.
I20260709 13:10:21.186008 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.197885 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.201210 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.198562 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:21.203373 24522 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.200512 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:21.199954 24600 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:21.203290 24519 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:21.152139 29847 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.205277 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.108294 30062 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.211054 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.214000 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.215353 24598 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:21.171669 29449 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:21.218116 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.219156 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.219297 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:21.219215 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.170720 30075 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:21.218605 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:21.197781 30031 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.225536 24490 leader_election.cc:400] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:21.225837 24490 leader_election.cc:403] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:21.232329 30034 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.233517 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.209543 29847 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.234597 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.246101 24600 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:21.247320 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.247581 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.235278 25214 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:21.249603 30064 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:21.250101 30064 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.252414 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:21.253960 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.249447 25214 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:21.220053 29799 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:21.265030 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.265807 25219 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:21.269415 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.270224 25216 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:21.272816 24600 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:21.234869 29954 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
W20260709 13:10:21.290848 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.275162 29799 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:21.291729 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.293154 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.298497 24666 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:10:21.298784 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.275655 24670 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:21.281490 24598 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:10:21.287766 25213 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:21.287890 29575 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.289755 29722 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.232892 30034 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.299527 24598 pending_rounds.cc:85] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 8
I20260709 13:10:21.301067 24598 pending_rounds.cc:107] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:10:21.301349 24598 raft_consensus.cc:2889] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:21.247107 29879 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:21.302320 29879 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:21.302732 29879 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.303094 30034 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.303781 24420 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 8 to 10, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 10 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:21.304955 25215 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:21.335367 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.273521 29890 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:21.245832 30031 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:21.334008 29886 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.594s	user 0.007s	sys 0.003s
I20260709 13:10:21.341343 24594 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:10:21.345912 24596 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:21.292970 29799 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:21.230554 30075 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.350329 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.354264 24670 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
W20260709 13:10:21.354485 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 272912us
I20260709 13:10:21.342054 29890 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.360236 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:21.333688 29954 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:10:21.360971 24594 raft_consensus.cc:2368] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
W20260709 13:10:21.363050 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 91618.8us
W20260709 13:10:21.363293 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.366552 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:21.366732 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 147485us
I20260709 13:10:21.356611 29918 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.359423 29890 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.350108 30088 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:21.392426 30088 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.393020 30088 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.364243 29759 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:21.380110 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.393859 24667 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:21.393755 29759 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.394884 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.395596 24667 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:21.395929 29759 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.396669 24667 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:21.381322 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:21.397395 24672 raft_consensus.cc:2376] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11. Re-sending same reply.
I20260709 13:10:21.381839 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:21.386526 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:21.398159 24670 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.377115 29575 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.402733 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:21.393929 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:21.392470 30075 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.356734 29449 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.420531 24597 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:21.400189 24522 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:21.398087 24523 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:21.422616 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.403460 24669 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.389526 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:21.403460 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.425123 25213 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:21.406713 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:21.410246 30084 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:10:21.410832 30085 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:10:21.413931 30031 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.417048 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.383320 29885 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.425657 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.423229 25215 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:21.431793 30064 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.433681 30094 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:10:21.434830 30089 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:21.430971 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.441347 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:21.459137 24670 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:21.464716 24595 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:21.468726 30031 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.466689 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:21.468803 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.473013 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.426626 29934 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.468906 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.469378 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:21.454936 24593 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:21.474612 25212 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 14: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:21.449895 29759 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:21.475625 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 72966.2us
I20260709 13:10:21.474606 24667 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:21.478694 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:21.484189 25213 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:21.487648 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:21.468138 30062 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:21.492373 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 61497.3us
I20260709 13:10:21.482908 29861 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:21.492966 29861 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.493167 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.493386 29861 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:21.478885 30067 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:21.494041 30067 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:21.494920 30067 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:21.478782 29954 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.499271 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:21.478452 29759 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.478071 29780 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.504571 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.508826 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:21.510555 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:21.511111 24670 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.485318 30016 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:21.543159 30064 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:21.543826 30064 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:21.546293 30064 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:21.550247 24593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1748) took 1968 ms (client timeout 1894 ms). Trace:
W20260709 13:10:21.550666 24593 rpcz_store.cc:269] 0709 13:10:19.582221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.582339 (+   118us) service_pool.cc:224] Handling call
0709 13:10:21.550050 (+1967711us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001937d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:21.550178 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4042562816}
I20260709 13:10:21.552940 25212 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:21.559684 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.560293 24597 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:21.513320 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:21.514966 30087 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:10:21.517655 30068 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:21.519409 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.526206 29885 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:21.526760 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 53759.5us
I20260709 13:10:21.527442 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.529551 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:21.481185 29906 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:21.533831 29890 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.575702 29890 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.576407 29890 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.534776 30074 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.576951 30040 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:21.577422 30040 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.577761 30040 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:21.578963 30074 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:21.579977 30074 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.512610 29759 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.536966 29780 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:21.585795 24599 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:21.586175 25217 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 12: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:21.585240 30040 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.588363 29780 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.588374 30040 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.539402 29955 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.590875 29955 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.482827 29928 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:10:21.481328 29934 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.592720 25210 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:21.594070 29934 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.477984 29879 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.595943 29879 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.601770 24666 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:21.513826 24669 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:21.564258 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.490403 29799 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:21.491348 30055 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:21.606290 29906 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.606725 29799 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.606640 24420 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 7 to 10, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 10 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.608544 29906 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:21.570289 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50937.5us
I20260709 13:10:21.611074 24639 leader_election.cc:400] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16.
I20260709 13:10:21.611459 24639 leader_election.cc:403] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:21.566731 30068 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:21.512333 29871 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:21.555718 29886 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:21.572117 25212 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.512533 30034 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.512836 29954 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:21.605638 24670 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:21.606757 30055 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.556185 30044 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:21.569177 24523 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:21.613806 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:21.614233 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.624342 24674 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:21.580637 29861 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:21.651799 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.652217 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.609755 30075 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:21.615510 30068 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.659013 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.588967 29780 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:10:21.577004 29890 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:21.618997 29955 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16.
W20260709 13:10:21.706333 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 226463us
I20260709 13:10:21.623157 29857 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:21.705061 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:21.725944 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:21.731086 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 221137us
I20260709 13:10:21.732147 25214 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:21.657157 30044 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:21.738648 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 127734us
I20260709 13:10:21.739440 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.739997 29890 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.694904 29799 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.744503 24667 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:21.651661 29954 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:21.731220 30041 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.001s
I20260709 13:10:21.752964 30044 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:21.753861 30055 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.747033 30088 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.758175 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.758908 25219 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.759541 30088 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.760198 30041 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12.
I20260709 13:10:21.761286 25211 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:21.765694 24669 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14.
I20260709 13:10:21.757364 30097 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.744517 30034 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.737996 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:21.778239 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 217573us
I20260709 13:10:21.778506 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:21.785452 25212 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:21.733932 29918 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:10:21.791435 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 223991us
W20260709 13:10:21.788767 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 259314us
W20260709 13:10:21.790254 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52364.8us
I20260709 13:10:21.784937 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:21.787009 24639 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.894s (SENT) [suppressed 21 similar messages]
I20260709 13:10:21.745831 29847 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.746382 29759 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.800799 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:21.802181 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:21.804433 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 291219us
W20260709 13:10:21.804867 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.791177 29955 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:21.759572 29890 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:10:21.809031 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.794886 30055 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:21.810848 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:21.810063 29955 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.813645 29955 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.812150 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:21.822897 29954 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.824174 24671 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:21.827389 24667 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:21.829401 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:21.830255 29871 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.830845 30102 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:21.832180 29954 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:21.832691 29954 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:21.833014 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1762) took 1468 ms. Trace:
I20260709 13:10:21.833513 24599 rpcz_store.cc:276] 0709 13:10:20.365046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.365172 (+   126us) service_pool.cc:224] Handling call
0709 13:10:21.553163 (+1187991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.586161 (+ 32998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.832308 (+246147us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54001937d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:21.832818 (+   510us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001937d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:21.832957 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2780185728}
I20260709 13:10:21.834137 29954 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.837661 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:21.839535 30099 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.002s
I20260709 13:10:21.839798 29937 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:21.840407 29937 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:21.841383 29937 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.842720 29847 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:21.843761 30041 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:21.844336 30041 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:21.844447 29906 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:21.845402 30041 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.846709 29861 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:21.791915 30034 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.849400 30055 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:21.850350 30055 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:21.853051 29954 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:21.810556 30100 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:10:21.862396 30104 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:10:21.810992 30040 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:21.867004 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 66266.4us
W20260709 13:10:21.865957 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55187.1us
I20260709 13:10:21.869858 25217 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:21.870872 24522 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:10:21.871330 24522 pending_rounds.cc:85] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 4
I20260709 13:10:21.871622 24522 pending_rounds.cc:107] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:10:21.871894 24522 raft_consensus.cc:2889] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:21.877389 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:21.806046 29931 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:21.878751 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:21.882222 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:21.883051 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:21.818243 29857 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:21.886404 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:21.962636 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 75496.5us
I20260709 13:10:21.867288 30040 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:21.875615 29918 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:21.884764 29890 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:21.875866 30031 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.963980 29857 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:21.812207 30067 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.160s
I20260709 13:10:21.979338 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:21.980360 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:21.981948 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:21.883713 30111 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:10:21.887269 30074 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.913923 30102 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:21.978228 24420 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:10:21.877835 30113 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:10:21.990535 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:21.980726 30040 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.990429 29906 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:21.978116 29931 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:22.001340 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:21.976636 24523 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:10:22.003541 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 120576us
W20260709 13:10:22.004359 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.005254 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:22.006871 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:22.011368 25219 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:22.013032 24523 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:21.994882 30102 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:22.060035 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 273033us
W20260709 13:10:22.073990 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 265040us
I20260709 13:10:21.987600 29918 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:22.075232 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 282564us
I20260709 13:10:22.054128 24523 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:10:22.080572 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:22.081032 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.988140 30031 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:22.084964 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 79792.5us
I20260709 13:10:22.085912 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:22.014947 30100 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.082167 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:22.088670 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:22.095289 24522 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:22.092866 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:22.010818 29955 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.073845 30102 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.102519 24521 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.086972 29449 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.106385 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:22.108126 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:22.090325 29928 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.139369 30105 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.285s	user 0.001s	sys 0.001s
I20260709 13:10:22.117005 30075 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.145895 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:22.146745 29918 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:22.147557 24596 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:22.149179 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:22.149662 30031 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:22.150492 24598 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:22.154695 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:22.124908 30112 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:10:22.094266 29861 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:10:22.107025 30088 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:22.158167 24594 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:22.158732 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:22.111876 30100 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:22.157929 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:22.159610 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:22.167912 24600 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:22.161556 25219 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:22.112318 30044 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:22.105263 29847 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:22.184305 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 192836us
I20260709 13:10:22.185240 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:22.189905 24598 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:22.197399 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:22.166606 30088 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.204762 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:22.175714 30031 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:22.200234 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.116529 29449 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:22.204932 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:22.212810 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:22.213461 30101 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:10:22.160202 30068 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.214234 29449 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:22.214792 24674 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:22.210222 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.184602 29847 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.215324 30068 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:22.214138 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.215543 29847 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:22.217535 30100 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:22.190692 30044 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.219633 29759 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:22.220202 30044 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:22.220784 30100 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:22.184518 29934 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:22.221812 30100 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.223151 24521 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:22.217718 24600 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:22.209848 24593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:22.226280 24593 raft_consensus.cc:606] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
W20260709 13:10:22.256621 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44938.2us
I20260709 13:10:22.268639 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.272459 24670 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:22.268558 24671 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:22.175850 29928 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:22.274062 24593 raft_consensus.cc:614] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:22.272420 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:22.210805 30088 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.284317 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:22.225024 29918 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.225121 30031 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:22.288417 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:22.289249 24672 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.304833 25217 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.289826 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:22.290051 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.291822 30102 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.292932 29955 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:22.295352 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.297143 30108 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:22.224689 29857 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.299562 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.300647 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:22.225337 29934 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:22.308142 24598 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:22.308593 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:22.311295 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:22.311619 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.301657 30054 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.312150 29780 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.315218 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:22.336404 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:22.317322 29928 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:22.348909 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:22.349555 24668 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:22.348927 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:22.353071 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:22.353797 24669 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14.
I20260709 13:10:22.346378 25217 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:10:22.316890 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 231073us
I20260709 13:10:22.331192 24672 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:22.224530 29847 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.286667 30074 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.376032 30074 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.334564 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:22.378536 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44046us
I20260709 13:10:22.342175 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:22.319934 30068 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.390574 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:22.391654 24521 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:22.365762 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:22.366055 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:22.393139 24520 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:22.368923 29857 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:22.370543 30102 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:22.345932 29871 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:22.374621 30031 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.397881 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:22.379284 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:22.399181 24598 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:22.247030 29931 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:22.307890 29918 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:22.448146 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.449276 24671 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:22.451159 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:22.416170 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:22.429433 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:22.363610 30111 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:22.470156 24518 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:22.486559 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:22.377753 29928 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:22.332298 29906 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:10:22.390148 30109 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:22.523311 24669 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:22.352324 30054 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:22.551393 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 172157us
I20260709 13:10:22.404431 29885 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.530207 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:22.589672 24522 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:22.590811 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:22.591645 24522 raft_consensus.cc:2368] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:22.592422 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:22.539305 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:22.404233 29871 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.395735 29955 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.549605 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:22.529891 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:22.553387 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:22.556352 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:22.595876 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:22.596268 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:22.596843 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 57602.4us
I20260709 13:10:22.597831 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:22.598178 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:22.599429 24522 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
W20260709 13:10:22.600176 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55182.5us
I20260709 13:10:22.601230 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:22.599386 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:22.604637 24518 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:22.615702 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:22.530807 30044 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:22.576802 24521 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
W20260709 13:10:22.529485 30041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.010s	sys 0.025s
I20260709 13:10:22.412648 30110 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:10:22.563202 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:22.619057 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 473236us
I20260709 13:10:22.617897 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:22.624007 30041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.010s	sys 0.025s
I20260709 13:10:22.624084 25216 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:22.624647 30041 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:22.392572 30040 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.630945 30040 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:22.631585 30040 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.635636 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:22.620278 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:22.587566 30105 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:10:22.404235 30068 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:22.623580 30110 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:22.643412 30110 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:22.552143 30111 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:22.596208 29871 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.687952 25216 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:22.694140 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:22.692705 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:22.703503 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.032s	sys 0.026s
W20260709 13:10:22.703934 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.032s	sys 0.026s
W20260709 13:10:22.704181 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 590692us
I20260709 13:10:22.717512 24523 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:22.719497 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:22.733575 24518 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
W20260709 13:10:22.690583 24673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.013s	sys 0.042s
I20260709 13:10:22.595851 29857 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:10:22.588158 30016 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:10:22.621053 30059 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:22.696012 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:22.742724 24519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.015s	sys 0.013s
I20260709 13:10:22.763604 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:22.798775 24519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.015s	sys 0.013s
I20260709 13:10:22.799180 24674 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:22.646066 30034 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:22.767758 24665 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.024s	sys 0.044s
W20260709 13:10:22.803622 24665 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.024s	sys 0.044s
W20260709 13:10:22.772501 30098 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.058s	sys 0.065s
I20260709 13:10:22.781296 30123 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:22.792999 29861 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.649715 30067 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:22.594580 29928 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.600453 29885 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.551259 29934 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:22.785840 24673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.013s	sys 0.042s
I20260709 13:10:22.786621 24670 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:22.612506 29955 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.789583 24668 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
W20260709 13:10:22.773207 30105 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:10:22.868202 24596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.008s	sys 0.016s
W20260709 13:10:22.868925 24596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.008s	sys 0.016s
W20260709 13:10:22.811508 30098 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.059s	sys 0.065s
W20260709 13:10:22.808930 30077 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.014s
I20260709 13:10:22.871668 29861 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:22.812682 30059 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:22.806802 30016 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:22.866882 30088 consensus_meta.cc:287] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
W20260709 13:10:22.924211 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.023s
I20260709 13:10:22.836395 30100 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:22.932062 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.012s	sys 0.023s
W20260709 13:10:22.933116 25219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.015s	sys 0.020s
W20260709 13:10:22.933863 25219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.015s	sys 0.021s
I20260709 13:10:22.877298 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3374) took 1499 ms. Trace:
I20260709 13:10:22.878242 30054 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:22.937245 30118 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:10:22.876982 29937 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:22.925170 30068 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:22.939765 24673 rpcz_store.cc:276] 0709 13:10:21.368712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.368910 (+   198us) service_pool.cc:224] Handling call
0709 13:10:21.378823 (+  9913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.643089 (+264266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.643121 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.727122 (+ 84001us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.100297 (+373175us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:22.156667 (+ 56370us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.863045 (+706378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.863160 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.863225 (+    65us) raft_consensus.cc:1685] finished
0709 13:10:22.863245 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.868153 (+  4908us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84461,"prepare.queue_time_us":56578,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1449,"raft.queue_time_us":126933,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":139,"thread_start_us":1206694,"threads_started":3,"wal-append.queue_time_us":517445}
W20260709 13:10:22.880921 30077 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.009s	sys 0.014s
I20260709 13:10:22.904625 29954 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:22.979586 25211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.047s	sys 0.042s
I20260709 13:10:22.894284 30098 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:22.910507 29885 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:22.903561 30059 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:22.912429 29847 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:22.877802 30121 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
W20260709 13:10:22.973471 29799 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.011s	sys 0.014s
W20260709 13:10:23.025396 29799 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.011s	sys 0.015s
W20260709 13:10:22.949551 30116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.010s	sys 0.016s
W20260709 13:10:22.963582 30075 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.027s	sys 0.030s
I20260709 13:10:22.965173 29918 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:22.980438 30054 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:22.904191 29857 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:10:22.934275 30016 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:22.937616 30088 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:22.983879 29449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.028s	sys 0.044s
I20260709 13:10:22.904373 30067 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:23.013693 25211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.047s	sys 0.046s
W20260709 13:10:23.035599 25183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.042s
I20260709 13:10:22.877535 30111 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:23.065097 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 511744us
I20260709 13:10:23.026280 30074 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:23.026662 29954 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:23.042721 30116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.010s	sys 0.016s
W20260709 13:10:23.054639 30075 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.027s	sys 0.030s
W20260709 13:10:23.076345 25183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.007s	sys 0.042s
I20260709 13:10:23.077683 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:23.060109 30136 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:23.093560 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:23.059595 29847 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.114084 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:23.082806 29449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.032s	sys 0.044s
I20260709 13:10:22.904304 30123 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.113332 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:23.033970 30044 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.984760 29937 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.114890 24666 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:23.126626 24671 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:23.109917 24517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.016s	sys 0.023s
W20260709 13:10:23.152614 24517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.016s	sys 0.023s
W20260709 13:10:23.154392 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 449596us
I20260709 13:10:23.033692 30130 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.085s
W20260709 13:10:23.117156 30055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.133s	user 0.014s	sys 0.014s
W20260709 13:10:23.150835 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 411936us
W20260709 13:10:23.180840 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.015s	sys 0.010s
W20260709 13:10:23.183738 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.015s	sys 0.010s
W20260709 13:10:23.204387 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 608149us
W20260709 13:10:23.203320 24637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.010s
I20260709 13:10:23.069866 30054 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.148818 29857 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:23.160063 30055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.014s	sys 0.014s
W20260709 13:10:23.209547 24637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.009s	sys 0.011s
I20260709 13:10:23.209213 24491 leader_election.cc:400] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14.
W20260709 13:10:23.179787 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.016s
W20260709 13:10:23.248958 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 88026.3us
I20260709 13:10:23.154537 30126 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:23.159092 30044 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.254247 24491 leader_election.cc:400] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14.
W20260709 13:10:23.251062 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 631904us
I20260709 13:10:23.139096 29847 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.254871 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2051) took 1384 ms. Trace:
I20260709 13:10:23.209179 29928 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:23.129387 30136 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:23.179265 30074 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:23.256722 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 621137us
I20260709 13:10:23.265714 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:23.275597 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:23.260564 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3376) took 1891 ms. Trace:
I20260709 13:10:23.252527 29955 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:23.261361 30118 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:10:23.285987 24669 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:23.266256 24519 rpcz_store.cc:276] 0709 13:10:21.870466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.870571 (+   105us) service_pool.cc:224] Handling call
0709 13:10:21.870814 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.871002 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:22.196640 (+325638us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.254461 (+1057821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.254526 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:23.254586 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.254669 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.254803 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1384,"prepare.queue_time_us":604355,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":11275,"raft.queue_time_us":168603,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4720,"thread_start_us":1367847,"threads_started":3,"wal-append.queue_time_us":807120}
W20260709 13:10:23.287310 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 323817us
W20260709 13:10:23.270776 30127 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:10:23.289237 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:23.289721 24525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.018s
I20260709 13:10:23.263986 29874 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:23.298436 24525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.012s	sys 0.018s
I20260709 13:10:23.299362 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2052) took 1428 ms. Trace:
I20260709 13:10:23.312016 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:23.312909 24518 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:23.306486 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:23.252385 29918 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:23.314234 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:23.315004 24523 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:23.252684 29857 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:23.322865 24521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.005s	sys 0.025s
W20260709 13:10:23.323272 24521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.005s	sys 0.025s
I20260709 13:10:23.286583 29928 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:23.276217 24665 rpcz_store.cc:276] 0709 13:10:21.369300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.369397 (+    97us) service_pool.cc:224] Handling call
0709 13:10:21.380844 (+ 11447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.609888 (+229044us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:21.643787 (+ 33899us) log.cc:844] Serialized 14 byte log entry
0709 13:10:21.846598 (+202811us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b1800434fe0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a 00007f17bbf50a2a
0709 13:10:22.804006 (+957408us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.804616 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.804783 (+   167us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.808501 (+  3718us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.236266 (+427765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.236370 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.253328 (+ 16958us) raft_consensus.cc:1685] finished
0709 13:10:23.253390 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.260445 (+  7055us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92573,"prepare.queue_time_us":41585,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":1734,"raft.queue_time_us":343453,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":18321,"spinlock_wait_cycles":15460736,"thread_start_us":1548306,"threads_started":4,"wal-append.queue_time_us":618899}
I20260709 13:10:23.289332 30159 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.307075 24525 rpcz_store.cc:276] 0709 13:10:21.870732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.871038 (+   306us) service_pool.cc:224] Handling call
0709 13:10:21.871288 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.871455 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:22.392467 (+521012us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.298927 (+906460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:23.299003 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:23.299060 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.299148 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.299295 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124292,"prepare.queue_time_us":740282,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":176950,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10463,"thread_start_us":1272870,"threads_started":3,"wal-append.queue_time_us":677978}
W20260709 13:10:23.319280 30040 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.001s
W20260709 13:10:23.322504 30128 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
W20260709 13:10:23.413532 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 253007us
I20260709 13:10:23.414798 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:23.286168 30074 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.319304 30031 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:23.399353 30157 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.463284 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 385647us
W20260709 13:10:23.409984 30133 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
I20260709 13:10:23.393375 29928 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:23.476615 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 210923us
I20260709 13:10:23.285698 29954 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.441121 30040 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:23.507280 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 254726us
I20260709 13:10:23.505542 24637 leader_election.cc:400] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:23.448588 30041 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:23.537994 24637 leader_election.cc:403] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:10:23.552186 29871 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.001s
I20260709 13:10:23.552754 29871 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.555565 29871 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:23.566469 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2048) took 1697 ms. Trace:
I20260709 13:10:23.567026 24516 rpcz_store.cc:276] 0709 13:10:21.868806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.868995 (+   189us) service_pool.cc:224] Handling call
0709 13:10:21.869303 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.881306 (+ 12003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.881350 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.887434 (+  6084us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.480284 (+592850us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:23.076754 (+596470us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.103189 (+ 26435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.103258 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.566261 (+463003us) raft_consensus.cc:1685] finished
0709 13:10:23.566280 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.566400 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90238,"prepare.queue_time_us":285085,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":52,"raft.queue_time_us":33116,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":19044,"thread_start_us":872843,"threads_started":2,"wal-append.queue_time_us":735176}
I20260709 13:10:23.505245 29928 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:23.454370 30098 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:10:23.534880 29934 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:23.475770 30088 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:23.538210 30016 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:23.479127 30077 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:10:23.549114 30152 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:23.409369 30159 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:23.592563 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 303256us
I20260709 13:10:23.563998 29879 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.579667 30147 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
I20260709 13:10:23.588671 29918 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:23.616194 24600 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:10:23.608404 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:23.585408 29937 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:23.535285 30157 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:23.576839 29871 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:23.507157 30031 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.621589 24593 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:23.620538 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:23.622066 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:23.622532 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 207784us
I20260709 13:10:23.653903 24598 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:23.622892 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:23.598699 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:23.624927 24599 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:23.679385 24600 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:10:23.625048 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:23.612663 30141 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 13:10:23.634938 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:23.610816 30016 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:23.613579 30088 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:23.620504 29780 consensus_meta.cc:287] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.276s	user 0.009s	sys 0.003s
W20260709 13:10:23.783684 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.620321 29885 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:23.801873 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 203467us
I20260709 13:10:23.802699 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:23.634248 30110 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:23.612115 29879 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.639285 29871 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:23.814610 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:23.809926 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 328702us
I20260709 13:10:23.816426 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:23.784982 29847 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:23.791828 29780 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:23.780651 30088 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:23.618574 29918 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.610103 30152 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.813161 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:23.791623 29885 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:23.854099 29885 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:23.816231 29871 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:23.855569 29885 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:23.855983 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2053) took 1984 ms. Trace:
I20260709 13:10:23.856384 24517 rpcz_store.cc:276] 0709 13:10:21.871789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.871899 (+   110us) service_pool.cc:224] Handling call
0709 13:10:21.886425 (+ 14526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.413269 (+526844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.413317 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.450704 (+ 37387us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.153062 (+702358us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:23.153139 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.153223 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.855779 (+702556us) raft_consensus.cc:1685] finished
0709 13:10:23.855803 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.855928 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50632,"raft.queue_time_us":121311,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4917,"spinlock_wait_cycles":1920,"thread_start_us":1049955,"threads_started":2,"wal-append.queue_time_us":1403262}
I20260709 13:10:23.841380 30088 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.807308 30075 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:23.825628 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:23.828253 30163 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:10:23.828506 30139 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
I20260709 13:10:23.828608 30146 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:23.829120 29879 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:23.829492 30137 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.527s	user 0.001s	sys 0.000s
I20260709 13:10:23.829756 29955 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:23.830129 30134 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.453s	user 0.000s	sys 0.001s
W20260709 13:10:23.830340 30144 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.414s	user 0.000s	sys 0.001s
W20260709 13:10:23.830664 30142 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 13:10:23.830384 29914 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:23.835204 30132 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:23.838522 30158 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.434s	user 0.000s	sys 0.001s
I20260709 13:10:23.814265 29937 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:23.867892 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:23.821645 30055 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:23.882640 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:23.814930 30110 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:23.867430 29857 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:23.936653 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 158617us
I20260709 13:10:23.829144 30153 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:23.942982 30167 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.943687 30198 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:23.825096 30123 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:23.946000 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.000s	sys 0.024s
W20260709 13:10:24.077688 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.000s	sys 0.024s
W20260709 13:10:24.078076 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 922159us
I20260709 13:10:24.079190 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:24.016527 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 148706us
I20260709 13:10:23.891057 29955 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:24.017455 24595 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
W20260709 13:10:24.032382 25212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.000s	sys 0.041s
W20260709 13:10:24.083184 25212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.001s	sys 0.041s
I20260709 13:10:24.084012 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1171) took 1677 ms. Trace:
I20260709 13:10:23.922912 30074 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:23.932685 29879 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:24.084429 25212 rpcz_store.cc:276] 0709 13:10:22.406417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.406858 (+   441us) service_pool.cc:224] Handling call
0709 13:10:22.475596 (+ 68738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.475866 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:23.029037 (+553171us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.083572 (+1054535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.083644 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:24.083702 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.083788 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.083947 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3000,"prepare.queue_time_us":288185,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":243041,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":1532073,"threads_started":3,"wal-append.queue_time_us":789069}
I20260709 13:10:24.047091 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1170) took 1652 ms. Trace:
W20260709 13:10:24.012616 30163 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:10:23.936092 29914 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:24.111510 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1197) took 1956 ms. Trace:
I20260709 13:10:24.055097 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:24.113269 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58254.8us
I20260709 13:10:24.066957 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.068353 24592 raft_consensus.cc:2410] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:10:24.033445 30146 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:24.081127 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:24.082125 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:24.082893 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 390984us
I20260709 13:10:24.062278 30116 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:24.011402 30132 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.128243 30125 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:24.128350 30197 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:24.128922 30125 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:24.129119 30197 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.130105 30132 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.094586 25219 rpcz_store.cc:276] 0709 13:10:22.394674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.394825 (+   151us) service_pool.cc:224] Handling call
0709 13:10:22.416749 (+ 21924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.949751 (+533002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.949780 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.957618 (+  7838us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.411969 (+454351us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:23.412103 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.412248 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.021612 (+609364us) raft_consensus.cc:1685] finished
0709 13:10:24.021641 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.047001 (+ 25360us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111563,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10833,"thread_start_us":904616,"threads_started":2,"wal-append.queue_time_us":801750}
I20260709 13:10:24.117843 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.120364 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:24.213198 24522 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:24.121066 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.126282 30188 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:24.126533 30135 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:10:24.127123 30175 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:10:24.127362 30182 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:24.127511 30116 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:24.127861 30069 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:24.128158 30203 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:24.149185 30181 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 13:10:24.154312 30171 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:10:24.155647 30132 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:24.156059 30166 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:24.156389 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:24.087903 29955 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:24.227509 30188 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:24.221123 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3958439550000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 13:10:24.157528 30157 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.161415 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.232791 24517 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:24.162190 29918 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.162665 30164 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:24.054075 30153 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.163844 30109 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:24.088543 29847 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:10:24.164613 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1199) took 1774 ms. Trace:
I20260709 13:10:24.110853 29879 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.165584 29931 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.166411 30155 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.169687 30129 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:24.170845 30194 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.171725 30183 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:24.173632 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.111914 25211 rpcz_store.cc:276] 0709 13:10:22.155332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.155457 (+   125us) service_pool.cc:224] Handling call
0709 13:10:22.166683 (+ 11226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.167149 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.167188 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.209804 (+ 42616us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.076271 (+866467us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:23.076312 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.076383 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.111280 (+1034897us) raft_consensus.cc:1685] finished
0709 13:10:24.111300 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.111452 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8791,"thread_start_us":863737,"threads_started":1,"wal-append.queue_time_us":1054847}
I20260709 13:10:24.174741 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.173673 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.255728 24594 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:24.176038 30193 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:24.181391 30075 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:24.189416 30031 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.058631 30167 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.082617 29780 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:24.194065 30152 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.195207 29857 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.089812 30159 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.062096 30198 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.274602 30153 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.264062 30211 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:24.275429 30198 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:24.197923 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 116909us
I20260709 13:10:24.275521 30211 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.277242 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:24.277997 30211 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.278661 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:24.148141 30162 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:24.280081 30088 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.280015 30162 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.242820 30116 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.147758 30187 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:24.146067 30168 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:24.146735 30200 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.267s
I20260709 13:10:24.086553 30176 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.298312 30176 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:24.299057 29928 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.000s
I20260709 13:10:24.299578 29928 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:24.223235 30201 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:10:24.086961 30123 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:24.230024 24639 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:24.221743 30135 consensus_queue.cc:1243] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:24.234560 30203 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.228015 30188 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.225358 30182 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.309324 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.310498 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.311021 30182 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.243942 24520 rpcz_store.cc:276] 0709 13:10:22.409149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.418435 (+  9286us) service_pool.cc:224] Handling call
0709 13:10:22.418792 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.925261 (+506469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.925294 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.925336 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:22.925366 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.164330 (+1238964us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540006d1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:24.164392 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.164544 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164229376}
I20260709 13:10:24.267779 30031 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:24.257423 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.228029 30110 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.264526 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.244412 30197 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.301589 30123 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:24.270690 29861 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.272392 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 1252) took 1179 ms. Trace:
I20260709 13:10:24.253857 30129 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:24.243137 30125 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.260542 30194 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.260667 30183 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.254493 30155 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.289919 29879 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.228407 30069 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.290371 30088 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.255367 29914 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.293308 30146 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:24.313995 30190 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:24.296339 30153 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.301255 29871 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.258095 30109 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:24.256147 29931 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.222433 29799 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.336628 30123 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.337252 29914 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.337893 30109 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.336649 29799 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:24.311497 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.341470 24597 raft_consensus.cc:2376] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13. Re-sending same reply.
I20260709 13:10:24.313838 24599 raft_consensus.cc:2410] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:24.316066 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.302968 30187 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.259131 30170 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:24.305786 30116 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:24.304617 30200 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.262004 30075 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:24.320497 24669 rpcz_store.cc:276] 0709 13:10:23.093019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.093226 (+   207us) service_pool.cc:224] Handling call
0709 13:10:24.272129 (+1178903us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54000474d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:24.272285 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409571200}
I20260709 13:10:24.312232 30168 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.267850 29780 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.314419 30031 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.326807 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.312562 30152 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:24.315281 30164 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:24.331248 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 185047us
I20260709 13:10:24.333391 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:24.342469 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 112537us
I20260709 13:10:24.360765 24517 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:24.345296 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.361025 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:24.330031 30146 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:24.346138 24637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.018s
I20260709 13:10:24.332010 30190 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.363709 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:24.364094 24637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.001s	sys 0.018s
I20260709 13:10:24.334332 29937 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:24.368253 30100 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:24.368685 30100 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:24.369714 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1130) took 2225 ms. Trace:
I20260709 13:10:24.369479 30100 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.370242 30075 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:24.346382 30170 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.370728 30100 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:24.372486 30170 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.335006 30153 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.362648 30152 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.374193 30183 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.374719 30164 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:24.375083 30152 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.375156 30153 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.365453 29931 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.376660 29780 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.377216 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.378455 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.379522 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.380419 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.381198 29871 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.383833 30162 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.359576 30214 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:24.372934 30155 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.384887 30214 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.385326 30176 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.355360 30129 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.386463 30129 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:24.380889 24597 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:24.387017 30214 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.340679 29799 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.342993 29928 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.357326 24525 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:24.357908 24594 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.345860 30187 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.342613 24520 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 8.
I20260709 13:10:24.365423 30188 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.359431 30031 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.366170 30167 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:24.364423 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 544873us
I20260709 13:10:24.387529 30190 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.390018 30146 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:24.434360 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.322921 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3260) took 1641 ms. Trace:
I20260709 13:10:24.370067 24596 rpcz_store.cc:276] 0709 13:10:22.144420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.200210 (+ 55790us) service_pool.cc:224] Handling call
0709 13:10:22.200494 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.225692 (+ 25198us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:22.226206 (+   514us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.869395 (+643189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.869463 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:22.869532 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.369443 (+1499911us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b540033de54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:24.369491 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.369607 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":355,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":56244,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16788,"spinlock_wait_cycles":57487232,"thread_start_us":642809,"threads_started":1,"wal-append.queue_time_us":913445}
I20260709 13:10:24.366024 30203 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:24.400305 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.359622 30157 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.398113 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:10:24.510711 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 112677us
I20260709 13:10:24.511979 29955 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:24.358067 30132 consensus_queue.cc:1243] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:24.513461 30167 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.513988 30167 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:24.514325 29955 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:24.514846 30167 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:24.518352 30131 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.369s	user 0.009s	sys 0.016s
I20260709 13:10:24.519528 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2049) took 2649 ms. Trace:
I20260709 13:10:24.519876 24524 rpcz_store.cc:276] 0709 13:10:21.869897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.870003 (+   106us) service_pool.cc:224] Handling call
0709 13:10:21.978500 (+108497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.108045 (+129545us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:22.108073 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.148147 (+ 40074us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.600955 (+452808us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:22.600993 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.709660 (+108667us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000dcfd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:22.709729 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.517802 (+1808073us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:24.519305 (+  1503us) raft_consensus.cc:1685] finished
0709 13:10:24.519332 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.519453 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567,"raft.queue_time_us":90112,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":8037,"spinlock_wait_cycles":343238656,"thread_start_us":392795,"threads_started":1,"wal-append.queue_time_us":884009}
I20260709 13:10:24.523542 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:24.397294 30075 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.525240 30153 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.525684 30153 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.527698 30153 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.528308 30153 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:24.529268 30170 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.529953 30170 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.531505 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.528782 30153 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.503366 24597 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:24.534029 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.534338 30153 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.460901 24521 rpcz_store.cc:276] 0709 13:10:22.681917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.689171 (+  7254us) service_pool.cc:224] Handling call
0709 13:10:22.689656 (+   485us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:23.323683 (+634027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.323712 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:23.430642 (+106930us) log.cc:844] Serialized 78 byte log entry
0709 13:10:24.018612 (+587970us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:24.214593 (+195981us) log.cc:844] Serialized 14 byte log entry
0709 13:10:24.322595 (+108002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.322671 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.322713 (+    42us) raft_consensus.cc:1685] finished
0709 13:10:24.322725 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.322855 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":245087,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":263716,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":6357,"thread_start_us":1385533,"threads_started":4,"wal-append.queue_time_us":608081}
W20260709 13:10:24.508651 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:24.535502 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.509708 30162 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.510305 30157 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.543366 30194 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.534634 24597 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:24.545104 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.542958 30162 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:24.548122 30162 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.501857 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.549398 24596 raft_consensus.cc:2368] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:24.550226 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.551031 24596 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:24.551757 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.552724 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:24.553000 24597 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:24.553563 30111 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.553828 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.554379 24597 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.554041 30111 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.554816 30041 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:24.555238 30041 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:24.555598 30041 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.556102 30111 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:24.557792 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.552754 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.506969 24594 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:24.560545 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.566393 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.567338 24524 raft_consensus.cc:2410] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:24.568531 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:24.569378 24519 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.571022 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.581096 24594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:24.581681 24594 raft_consensus.cc:606] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:24.582052 24594 raft_consensus.cc:614] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:24.583765 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.585525 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:24.586337 24673 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:24.587042 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.587927 24669 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:24.590025 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.568531 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.592505 24596 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:24.593642 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.593832 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.594359 25219 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:24.590682 24525 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:24.603335 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.604097 24665 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:24.604507 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.604777 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.603358 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.606398 24670 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:24.609602 25211 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:10:24.609980 25211 pending_rounds.cc:85] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 10
I20260709 13:10:24.610283 25211 pending_rounds.cc:107] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:10:24.610559 25211 raft_consensus.cc:2889] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:24.614697 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.615412 25218 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.617161 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:24.622277 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 103661us
I20260709 13:10:24.625427 24597 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:24.606163 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.649592 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.655197 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.657966 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.660012 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.660569 24594 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:24.660828 25211 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:24.578382 30148 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:10:24.661729 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.662592 24594 raft_consensus.cc:2410] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:24.663916 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2082) took 1049 ms. Trace:
I20260709 13:10:24.665616 24594 rpcz_store.cc:276] 0709 13:10:23.614601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.663212 (+1048611us) service_pool.cc:224] Handling call
0709 13:10:24.663479 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.663631 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.663665 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:24.663703 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:24.663737 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.663785 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.663870 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.635833 24519 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:24.668057 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.669170 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.669770 24519 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:24.656039 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.670567 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:24.671070 24519 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.675036 25218 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:24.676478 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.677562 24594 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:24.679049 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2085) took 1063 ms. Trace:
I20260709 13:10:24.680083 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.679776 24594 rpcz_store.cc:276] 0709 13:10:23.615400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.671573 (+1056173us) service_pool.cc:224] Handling call
0709 13:10:24.677440 (+  5867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.678816 (+  1376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.678991 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:24.684621 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 59898us
I20260709 13:10:24.686058 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:24.687145 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.688150 25219 raft_consensus.cc:2368] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:24.611721 30152 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.618280 30074 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:24.614162 30088 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:24.694186 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:24.693954 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:24.694125 24594 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:24.697592 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2088) took 1059 ms. Trace:
I20260709 13:10:24.697955 24594 rpcz_store.cc:276] 0709 13:10:23.638130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.690916 (+1052786us) service_pool.cc:224] Handling call
0709 13:10:24.693818 (+  2902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.697338 (+  3520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.697540 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.698628 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.695956 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.700929 25211 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:24.700973 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.702067 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.703200 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.704495 25218 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:24.705133 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.710350 24519 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:24.711047 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.711426 24519 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:24.711935 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:24.712671 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.713297 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:24.713948 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.718470 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.718693 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.721369 24519 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:24.719511 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:24.724038 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:24.724160 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:24.701606 30148 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:24.725633 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.704237 30111 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.702617 30165 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:24.729111 25211 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:24.733844 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.734414 25211 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:24.714864 30216 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.716290 29847 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:24.700541 30152 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.714149 29857 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.705623 30088 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:24.736774 30148 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.742242 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.755228 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.732961 30054 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.759357 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.738030 30157 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.739593 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.739440 25218 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:24.764976 30195 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:24.729796 30109 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:24.766053 30109 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:24.766582 30109 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.763957 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.768656 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.742717 30215 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:24.742851 29847 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.769843 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.770818 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.771449 29847 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:24.771831 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.740312 30111 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.740228 30208 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.774593 30111 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.776672 30088 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:24.777561 24668 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:24.778378 24639 leader_election.cc:400] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:24.779541 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:24.744530 30165 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:24.784145 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.785012 24599 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:24.786844 24671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1979) took 2249 ms (client timeout 2113 ms). Trace:
I20260709 13:10:24.787012 24672 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:24.785043 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.788925 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:24.787377 24671 rpcz_store.cc:269] 0709 13:10:22.537869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.693845 (+155976us) service_pool.cc:224] Handling call
0709 13:10:24.786597 (+2092752us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540044fa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:24.786764 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963900160}
I20260709 13:10:24.772869 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:24.790482 25211 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:24.828702 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.738059 29780 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:10:24.857053 24594 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:24.859730 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 80301.4us
I20260709 13:10:24.864434 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:24.882507 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.883196 25218 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:24.887419 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:24.890610 30227 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:10:24.892341 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 156843us
I20260709 13:10:24.896234 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:24.899323 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.900771 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.871775 30216 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:24.902949 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:24.910769 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.788533 29449 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:10:24.918213 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:24.927276 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:24.933492 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.914937 30111 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:24.774706 30208 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.941337 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.942020 25214 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:24.944031 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.944276 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:24.944810 25214 raft_consensus.cc:2410] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:24.950675 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:24.880070 30187 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.915223 30219 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:24.916672 30121 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:24.935611 30224 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:10:24.985814 30190 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 13:10:24.986505 24523 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:24.986302 30190 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.986876 24523 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:24.987458 25219 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:24.987330 25211 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:24.989382 25211 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:24.989774 25219 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:24.990231 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:24.992878 24600 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:25.001833 30116 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.001s
I20260709 13:10:25.004763 30190 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.953984 30169 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:25.014325 30169 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.014750 30169 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:25.005631 25212 raft_consensus.cc:2368] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14.
I20260709 13:10:24.953055 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:24.963589 30121 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:25.030741 30121 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.980075 30148 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:24.924823 30198 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:25.022151 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 69477.7us
I20260709 13:10:24.906381 29799 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:10:24.783267 30165 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:24.901033 30031 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:25.006858 30187 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:25.022956 25218 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:24.944082 30100 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:25.035286 24671 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:25.035391 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:25.023447 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.069738 24593 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
W20260709 13:10:25.070209 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 46838.5us
I20260709 13:10:25.041038 30198 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:25.041422 30140 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.935s	user 0.007s	sys 0.008s
I20260709 13:10:25.029520 24523 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:25.072036 24523 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:25.076311 25214 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:25.079196 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:24.951776 30111 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.028297 30219 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:25.261754 24565 leader_election.cc:400] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14.
I20260709 13:10:25.046938 29954 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:25.265121 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.081094 24594 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:25.083233 24521 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:10:25.130738 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1137) took 1016 ms. Trace:
I20260709 13:10:25.220867 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.131551 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:25.122272 24595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1782) took 3238 ms (client timeout 2333 ms). Trace:
I20260709 13:10:25.245337 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.125411 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.222698 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.065155 30054 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.218459 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.077769 24525 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:25.268759 25211 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:25.128945 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.272827 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.174492 24523 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:10:25.132792 25218 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:25.274245 24525 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:25.239365 29780 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:25.275960 29780 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:25.278895 29780 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.267009 24593 rpcz_store.cc:276] 0709 13:10:24.114239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.123770 (+  9531us) service_pool.cc:224] Handling call
0709 13:10:25.130541 (+1006771us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b540021be54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:25.130671 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718971520}
W20260709 13:10:25.112982 30146 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.003s
I20260709 13:10:25.126833 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:25.106256 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.273598 24523 pending_rounds.cc:85] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 8
W20260709 13:10:25.269110 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 137625us
I20260709 13:10:25.226819 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1138) took 1112 ms. Trace:
I20260709 13:10:25.127878 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.113090 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:25.269124 24595 rpcz_store.cc:269] 0709 13:10:21.883998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.914451 (+ 30453us) service_pool.cc:224] Handling call
0709 13:10:22.348760 (+434309us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:10:25.122023 (+2773263us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001cbe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:25.122160 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3520519936}
I20260709 13:10:25.078681 30068 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:25.304906 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.236799 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:25.303618 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.285708 25214 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:25.320169 24671 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:25.320523 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.320874 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.308136 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:25.313511 24523 pending_rounds.cc:107] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:10:25.323916 24523 raft_consensus.cc:2889] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:25.325387 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3266) took 1205 ms. Trace:
I20260709 13:10:25.267069 24594 pending_rounds.cc:85] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 5
I20260709 13:10:25.305788 24674 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:25.305824 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:25.073933 30198 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:25.326794 24594 pending_rounds.cc:107] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:10:25.327579 24594 raft_consensus.cc:2889] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:25.229774 30218 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.279881 30179 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.447s	user 0.009s	sys 0.006s
I20260709 13:10:25.131630 30152 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.133996 30208 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:25.336642 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 99928.8us
I20260709 13:10:25.279676 30098 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:25.361935 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.325896 24523 rpcz_store.cc:276] 0709 13:10:24.119502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.131371 (+ 11869us) service_pool.cc:224] Handling call
0709 13:10:24.197313 (+ 65942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.986373 (+789060us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400450c20. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebddc0 00007f17bbf481c0 00007f17bbf49231 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c
0709 13:10:25.324777 (+338404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.325254 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735756160}
I20260709 13:10:25.281446 30126 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:25.311754 24599 rpcz_store.cc:276] 0709 13:10:24.114465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.856111 (+741646us) service_pool.cc:224] Handling call
0709 13:10:24.856562 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.877657 (+ 21095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.877686 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.885209 (+  7523us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.088702 (+203493us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:25.088762 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.088855 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.226603 (+137748us) raft_consensus.cc:1685] finished
0709 13:10:25.226639 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.226763 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20709,"raft.queue_time_us":24195,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":12088,"thread_start_us":192464,"threads_started":1,"wal-append.queue_time_us":303324}
I20260709 13:10:25.352664 24593 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:25.116084 30031 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.350806 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.356901 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.356909 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.357250 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:25.353786 30191 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:10:25.337913 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:25.370015 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.271731 29954 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:25.335330 29799 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.350394 30130 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.373317 24671 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:25.305050 30054 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.372768 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:25.365177 30041 consensus_meta.cc:287] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.809s	user 0.006s	sys 0.006s
I20260709 13:10:25.122443 30109 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.400632 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.392591 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:25.373858 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 425973us
I20260709 13:10:25.366194 30098 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:25.317528 30146 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.394306 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.396330 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.377605 29954 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.401463 24671 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:25.355261 30218 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:25.390167 30031 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.405825 24666 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:25.402743 24599 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:25.410439 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.429973 30136 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:25.432085 24524 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:25.432498 24524 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:25.433243 24524 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.434193 24524 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.434273 30100 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:25.434737 30100 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.436305 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.436905 25212 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:25.437741 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.438261 30230 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:25.438627 30230 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:25.438726 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.439421 30230 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.440644 30230 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:25.441744 30067 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.442467 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.443068 24667 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:25.443847 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.444413 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:25.445626 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.446237 24670 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:25.439431 25212 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:25.449364 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.442484 30067 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:25.450832 30067 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:25.451339 30161 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.903s	user 0.004s	sys 0.024s
I20260709 13:10:25.452251 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.451308 30067 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.453711 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1169) took 3094 ms. Trace:
I20260709 13:10:25.454094 25217 rpcz_store.cc:276] 0709 13:10:22.359625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.359807 (+   182us) service_pool.cc:224] Handling call
0709 13:10:22.360166 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.405946 (+ 45780us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:22.523410 (+117464us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.176074 (+652664us) log.cc:844] Serialized 14 byte log entry
0709 13:10:23.249497 (+ 73423us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.260021 (+ 10524us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.260171 (+   150us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:23.260205 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.260301 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.451053 (+2190752us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b24002fb8f8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8cdf9c4 00007f17b8cddacb 00007f17b8e98dc9 00007f17b8e98a55 00007f17b8e9809d 00007f17bbaca10e 00007f17bbae188c 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221
0709 13:10:25.453475 (+  2422us) raft_consensus.cc:1685] finished
0709 13:10:25.453501 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.453633 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":193781,"prepare.queue_time_us":71983,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":630651,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":85505,"spinlock_wait_cycles":24472448,"thread_start_us":495772,"threads_started":1,"wal-append.queue_time_us":812290}
I20260709 13:10:25.456132 30146 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:25.456809 25210 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:25.457706 24596 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:10:25.458614 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.459190 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.460011 25212 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:25.457655 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.461572 24670 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:25.460340 25212 pending_rounds.cc:85] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 7
I20260709 13:10:25.444945 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:25.372078 30169 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.467391 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.475044 24674 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:25.404747 30098 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.472249 24670 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:25.473569 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.463788 24667 raft_consensus.cc:2376] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14. Re-sending same reply.
I20260709 13:10:25.462970 25212 pending_rounds.cc:107] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 10.8
I20260709 13:10:25.491024 25212 raft_consensus.cc:2917] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Aborting config change with OpId 10.8: Aborted: Op aborted by new leader
I20260709 13:10:25.481657 24665 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:25.486341 30111 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:25.486970 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:25.376209 30126 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:25.387969 29799 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.491560 25212 raft_consensus.cc:2889] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:25.508893 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 291426us
I20260709 13:10:25.509428 30250 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:25.511166 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.513875 30211 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.514477 30211 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:25.522027 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.526242 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:10:25.531020 30124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.427s	user 0.035s	sys 0.060s
W20260709 13:10:25.531746 30124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.434s	user 0.035s	sys 0.061s
I20260709 13:10:25.532941 30124 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:25.533391 30124 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:25.534547 30124 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.535987 30124 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:25.535745 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 202628us
I20260709 13:10:25.537441 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:25.538165 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 232405us
I20260709 13:10:25.540156 30251 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:25.540763 30250 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.541862 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.539021 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.546828 24420 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 10 to 13, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 13 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:25.548738 24490 leader_election.cc:400] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:25.549125 24490 leader_election.cc:403] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:25.393432 30130 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:25.404103 30041 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.546164 24674 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:25.546761 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:25.464563 30031 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:25.554184 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 194093us
I20260709 13:10:25.562779 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.567581 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.567942 24524 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:10:25.568435 24524 pending_rounds.cc:85] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 10
I20260709 13:10:25.568650 24524 pending_rounds.cc:107] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:10:25.568863 24524 raft_consensus.cc:2889] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:25.566905 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.551638 30068 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:25.583468 24674 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:25.546761 30251 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:25.586270 25215 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:25.601101 24668 raft_consensus.cc:2368] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15.
I20260709 13:10:25.612646 24674 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:25.612731 25213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1175) took 3082 ms (client timeout 3206 ms). Trace:
I20260709 13:10:25.556161 30250 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:25.613334 25213 rpcz_store.cc:269] 0709 13:10:22.523796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.540680 (+ 16884us) service_pool.cc:224] Handling call
0709 13:10:25.606093 (+3065413us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400570dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:25.606222 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3669971200}
I20260709 13:10:25.614109 24674 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:25.615228 30250 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.615785 30250 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:25.616160 30250 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:25.616568 30250 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.583802 30230 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:25.587368 30251 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.626497 24674 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:25.629565 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 87778.7us
I20260709 13:10:25.629499 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.630487 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.632691 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.634493 24524 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:25.624755 30219 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.640048 24517 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:25.622747 30230 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.645907 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.651403 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.652038 24517 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:25.634817 30054 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.641383 30124 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:25.639789 30109 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.648419 30219 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
W20260709 13:10:25.654727 30238 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:10:25.661702 30168 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.660615 30044 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.676851 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.668083 30260 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.684676 30031 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:25.690752 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 142190us
I20260709 13:10:25.692713 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.695097 30263 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:25.692948 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1178) took 1088 ms. Trace:
I20260709 13:10:25.695575 30263 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:25.696043 30263 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:25.695675 25215 rpcz_store.cc:276] 0709 13:10:24.604424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.604594 (+   170us) service_pool.cc:224] Handling call
0709 13:10:24.604827 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.586677 (+981850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.692678 (+106001us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54004ee3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:25.692877 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253019008}
I20260709 13:10:25.697603 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.698704 30250 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.701241 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2081) took 2087 ms. Trace:
I20260709 13:10:25.666527 30124 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:25.668359 30069 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.673840 30218 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.717235 30198 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.725952 30263 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:25.675168 30245 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:10:25.708418 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.672228 30169 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.711417 30264 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.678597 30126 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.713995 30067 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:25.714994 30124 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.719259 30250 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:25.732183 30121 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.701s	user 0.006s	sys 0.020s
W20260709 13:10:25.729173 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 96564.4us
I20260709 13:10:25.768741 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.732151 30098 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.734598 30230 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:25.678961 30041 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.737887 30130 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:25.739521 24665 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:25.741008 24673 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:25.744995 24490 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:25.706851 24592 rpcz_store.cc:276] 0709 13:10:23.613907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.614177 (+   270us) service_pool.cc:224] Handling call
0709 13:10:25.701043 (+2086866us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540025b554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:25.701191 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679147904}
W20260709 13:10:25.750782 30215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.011s	sys 0.005s
I20260709 13:10:25.752676 30263 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.745117 30260 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:25.754530 30259 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.222s	user 0.002s	sys 0.001s
I20260709 13:10:25.789498 30250 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:25.790994 30250 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:25.791411 30250 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.791558 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2084) took 1075 ms. Trace:
I20260709 13:10:25.791929 24525 rpcz_store.cc:276] 0709 13:10:24.716638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.275701 (+559063us) service_pool.cc:224] Handling call
0709 13:10:25.276206 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.479933 (+203727us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:25.479972 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.480382 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.533229 (+ 52847us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:25.533270 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.664252 (+130982us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54003dd6d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:25.664302 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.753938 (+ 89636us) spinlock_profiling.cc:243] Waited 9.72 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:25.791361 (+ 37423us) raft_consensus.cc:1685] finished
0709 13:10:25.791381 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.791501 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31339,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":487991424,"thread_start_us":52460,"threads_started":1,"wal-append.queue_time_us":52225}
I20260709 13:10:25.793308 29799 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.787943 30148 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:10:25.761370 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2069) took 1196 ms. Trace:
I20260709 13:10:25.796576 24521 rpcz_store.cc:276] 0709 13:10:24.565338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.565451 (+   113us) service_pool.cc:224] Handling call
0709 13:10:24.565736 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.266968 (+701232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.761130 (+494162us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54000bc2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:25.761314 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189547264}
I20260709 13:10:25.787345 24670 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:25.760479 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 1986) took 1100 ms. Trace:
I20260709 13:10:25.797927 24668 rpcz_store.cc:276] 0709 13:10:24.659607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.347549 (+687942us) service_pool.cc:224] Handling call
0709 13:10:25.760244 (+412695us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54002b6454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:25.760417 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542696320}
I20260709 13:10:25.794703 30148 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:25.799273 30148 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:25.800191 30148 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.793809 30098 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.801426 30148 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.802901 30250 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:25.789697 30215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.012s	sys 0.005s
I20260709 13:10:25.799916 24420 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 9 to 11, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 11 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.805536 30215 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:25.806322 29954 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.782162 30264 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:25.806507 30215 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.807228 30264 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:25.807694 30264 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.808473 29954 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.774045 30121 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.809880 25210 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:25.788493 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43617.2us
I20260709 13:10:25.813933 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.815174 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.798965 30100 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.817513 30191 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:25.821353 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.829463 30102 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.829775 30263 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.804930 30250 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.829041 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.832264 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.834029 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:25.835124 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:25.835170 24522 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.837494 30074 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:25.837992 30074 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.838861 30124 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.840909 30124 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.827468 29954 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:25.843873 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:25.855324 24519 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:25.842602 30260 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:25.845270 30268 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:25.845736 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1797) took 1602 ms. Trace:
I20260709 13:10:25.859419 24522 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:25.847136 30126 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:25.848419 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 322245us
I20260709 13:10:25.849298 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1805) took 1500 ms. Trace:
W20260709 13:10:25.849238 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 286546us
I20260709 13:10:25.849860 29871 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:25.860975 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:25.850705 24523 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:25.851496 30211 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:25.864516 30269 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:10:25.849272 30252 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:25.860459 30268 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.865620 30252 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.866097 30268 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:25.866146 30252 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.869395 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:25.870087 30067 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.860810 24591 rpcz_store.cc:276] 0709 13:10:24.348801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.217860 (+869059us) service_pool.cc:224] Handling call
0709 13:10:25.219050 (+  1190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.219300 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:25.219649 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.848903 (+629254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.848965 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:25.849007 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.849131 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.849241 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315165,"prepare.queue_time_us":5159,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":316156,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":313717,"threads_started":1,"wal-append.queue_time_us":366945}
I20260709 13:10:25.871330 24420 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 10 to 12, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 12 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.871886 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:25.872958 24420 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 5 to 11, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 11 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.873427 30264 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.875097 30198 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.876009 30264 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.853825 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.827185 30191 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:25.880110 30191 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:25.880568 30067 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:25.854036 30121 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.858181 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:25.859261 24598 rpcz_store.cc:276] 0709 13:10:24.243538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.983703 (+740165us) service_pool.cc:224] Handling call
0709 13:10:24.984010 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.984216 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:24.984536 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.410355 (+425819us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.759206 (+348851us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:10:25.845254 (+ 86048us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b1800404c80. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:10:25.845410 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.845470 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:25.845512 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.845576 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.845684 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150682,"prepare.queue_time_us":1937,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":496224,"raft.run_cpu_time_us":1676,"raft.run_wall_time_us":292382,"spinlock_wait_cycles":23004672,"thread_start_us":421009,"threads_started":1,"wal-append.queue_time_us":529128}
I20260709 13:10:25.850062 30180 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:25.834729 30102 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.865242 30109 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:25.871882 30254 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:25.875149 24420 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:10:25.853505 30164 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:25.901913 25219 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:25.902323 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.902850 25185 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:25.897878 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 1982) took 1239 ms. Trace:
I20260709 13:10:25.884693 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.854771 24521 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:25.904335 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:25.886360 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:25.904196 24420 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 4 to 10, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 10 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:25.905051 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.905707 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.887092 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1804) took 1552 ms. Trace:
I20260709 13:10:25.886984 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:25.887684 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:25.904964 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.888265 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.888610 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:25.889613 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:25.907212 24522 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:25.905004 25211 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.890559 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.908147 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:25.885274 24519 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:25.882624 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.895136 24525 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.909246 25215 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:25.889922 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:25.893939 25210 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:25.897886 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:25.898036 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:25.899442 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:25.899407 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:25.900605 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3393) took 3533 ms. Trace:
W20260709 13:10:25.880890 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.900408 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:25.911171 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.904515 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:25.897466 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3409) took 1240 ms. Trace:
I20260709 13:10:25.906495 24600 rpcz_store.cc:276] 0709 13:10:24.334322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.993712 (+659390us) service_pool.cc:224] Handling call
0709 13:10:25.701171 (+707459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.701370 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:25.701639 (+   269us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.852278 (+150639us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.852455 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:25.852499 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:25.852537 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.852594 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.886937 (+ 34343us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b540025b550. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:25.887040 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107339,"prepare.queue_time_us":534,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":107619,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"spinlock_wait_cycles":1626436224,"thread_start_us":42793,"threads_started":1,"wal-append.queue_time_us":68383}
W20260709 13:10:25.912485 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.900993 30109 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:25.913024 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:25.914255 30157 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:25.914448 30109 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.920475 29780 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:25.914579 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:25.915151 29885 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:25.921875 29885 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:25.922240 29885 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.915313 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:25.910950 24672 rpcz_store.cc:276] 0709 13:10:22.354856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.700097 (+345241us) service_pool.cc:224] Handling call
0709 13:10:24.786780 (+2086683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.787549 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.887597 (+1100048us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b540044fa50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:25.887712 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4649509120}
I20260709 13:10:25.915951 24591 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:25.911949 24666 rpcz_store.cc:276] 0709 13:10:24.656815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.410235 (+753420us) service_pool.cc:224] Handling call
0709 13:10:25.897294 (+487059us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54002b5a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:25.897414 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029798144}
I20260709 13:10:25.911237 24670 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:25.928470 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.931243 25211 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:25.933981 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:25.934108 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.934409 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:25.936528 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74109.4us
I20260709 13:10:25.937609 25212 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:25.940124 30067 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:25.915319 30176 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:25.940822 30067 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:25.941864 30067 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.916834 29871 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:25.935014 24523 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
W20260709 13:10:25.946496 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 56011us
I20260709 13:10:25.903585 24671 rpcz_store.cc:276] 0709 13:10:24.658563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.584694 (+926131us) service_pool.cc:224] Handling call
0709 13:10:25.606053 (+ 21359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.606423 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.606454 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.623865 (+ 17411us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.785453 (+161588us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:25.785492 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.785555 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:25.854464 (+ 68909us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:25.883647 (+ 29183us) raft_consensus.cc:1685] finished
0709 13:10:25.883669 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:25.897821 (+ 14152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2202,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":11675,"spinlock_wait_cycles":2333440,"thread_start_us":149313,"threads_started":1,"wal-append.queue_time_us":152810}
I20260709 13:10:25.947439 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.929255 30264 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:25.949013 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:25.923568 30102 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:25.956681 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58291.3us
I20260709 13:10:25.956997 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.921496 30254 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:25.957777 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:25.960932 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:25.964695 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.933907 30200 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:25.972117 24522 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:25.975092 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.966265 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.950433 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:25.949134 30068 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:25.982025 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:25.981503 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:25.970646 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:25.982932 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:25.948429 30180 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:25.976583 24521 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:25.959424 30260 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:25.985939 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.986850 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.949782 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:25.958796 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:25.915232 30211 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:10:25.978503 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.979557 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.953495 29871 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.981034 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:25.982834 24595 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:25.983544 24593 raft_consensus.cc:2376] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17. Re-sending same reply.
I20260709 13:10:25.984683 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:25.969419 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:25.985420 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:25.987485 24523 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:25.960500 29449 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.960314 30167 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:25.988040 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.978238 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:25.989660 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:25.961184 30254 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:25.983407 29906 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:26.048769 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.990231 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:26.131886 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 141749us
I20260709 13:10:26.054512 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:26.132674 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:25.953207 29954 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:10:26.057509 24591 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:26.056969 24521 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:25.974520 29931 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:25.990233 30260 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.965382 29780 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:26.063164 24418 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 347) took 13638 ms (client timeout 15000 ms). Trace:
I20260709 13:10:26.065701 30109 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.061158 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:26.067032 25218 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:25.984781 30198 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:25.980715 30208 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:10:26.077279 25216 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:25.971876 30200 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:26.077775 30277 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:26.080377 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:25.988775 30251 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:26.085368 30274 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:10:26.089308 30276 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:10:26.092515 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:26.097249 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:25.960285 30264 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:25.990792 30272 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:26.198186 30272 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:26.199131 30272 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.151731 30268 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.204679 30268 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:25.962862 30263 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:26.102190 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:26.209352 25215 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:26.211071 30251 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.211738 24520 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:26.166879 30198 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:26.211755 24517 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:26.216291 30109 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.111164 24525 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:25.999845 30124 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:26.166632 30183 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:10:25.982537 30215 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:26.222514 30215 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:26.222930 30215 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:26.112257 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 162537us
W20260709 13:10:26.113004 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 129231us
I20260709 13:10:26.121910 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:26.121941 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 137338us
I20260709 13:10:26.226706 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.228022 30075 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:26.228412 30075 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:26.122514 24600 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:26.125059 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:26.225587 30252 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.229266 30075 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.126328 25212 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:26.125430 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:26.230419 24598 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:26.230501 30075 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.129846 24522 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:26.055028 30121 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:26.231739 30098 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:26.143378 24597 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:26.232409 25210 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:26.232421 30098 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:26.234404 30208 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:26.234841 30208 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:26.236095 29871 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.235810 30208 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.158218 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:26.153421 24596 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:26.159435 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:26.239970 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 80608.1us
I20260709 13:10:26.121384 30155 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:26.163892 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:26.241312 24519 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:26.124214 29955 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.121459 30068 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:26.131280 29906 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.171298 25211 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.131506 29449 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.149981 29874 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.155014 30130 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.168278 30152 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:26.178218 30074 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.195379 30264 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.196914 29885 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.170405 30100 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.222024 24524 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:25.990811 30108 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:10:26.226850 30167 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:26.141934 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:26.292520 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 150653us
W20260709 13:10:26.145048 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 159166us
I20260709 13:10:26.293526 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:26.154844 30260 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:26.237391 30254 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.152894 29780 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:26.238639 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.243064 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:26.172634 30200 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.213003 30198 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.260823 25211 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:26.231420 30252 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.242870 30155 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:26.244508 30121 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:26.251420 30111 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:10:26.220763 30191 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:26.333932 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90941.5us
W20260709 13:10:26.335988 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 110488us
I20260709 13:10:26.257216 29906 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.278257 30183 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:10:26.269832 30130 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:26.349978 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.362592 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.381902 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.382853 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:26.383124 24522 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:26.362578 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:26.338878 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.285986 30253 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:26.296417 30167 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:26.315205 30208 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.277490 30116 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
W20260709 13:10:26.387128 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.388649 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.403699 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.405241 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:26.391369 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.320358 29874 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:26.320593 29780 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:26.393646 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:26.395442 24518 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:26.343395 29799 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.347551 30108 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:26.341977 30155 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:26.377739 30271 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:26.292112 30040 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:10:26.345929 30124 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:26.361665 30098 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:26.433835 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:26.375489 30254 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.422286 29874 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:26.394379 30157 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:26.446018 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.149180 24418 rpcz_store.cc:269] 0709 13:10:12.478622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.485555 (+  6933us) service_pool.cc:224] Handling call
0709 13:10:26.016234 (+13530679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:17.118105 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:17.118718 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:17.118753 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:10:17.118772 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:17.408389 (+289617us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:17.429846 (+ 21457us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:17.433603 (+  3757us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:10:17.484508 (+ 50905us) tablet.cc:701] Row locks acquired
0709 13:10:17.484530 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:10:17.484699 (+   169us) write_op.cc:270] Start()
0709 13:10:17.484814 (+   115us) write_op.cc:276] Timestamp: P: 1783602617484647 usec, L: 0
0709 13:10:17.484836 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:17.538338 (+ 53502us) log.cc:844] Serialized 7142 byte log entry
0709 13:10:18.075072 (+536734us) op_driver.cc:464] REPLICATION: finished
0709 13:10:19.356900 (+1281828us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b1800310a20. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:19.365293 (+  8393us) write_op.cc:301] APPLY: starting
0709 13:10:19.365437 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:19.397409 (+ 31972us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:19.397457 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:19.760345 (+362888us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:19.760833 (+   488us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:10:19.760894 (+    61us) write_op.cc:312] APPLY: finished
0709 13:10:19.964149 (+203255us) log.cc:844] Serialized 164 byte log entry
0709 13:10:20.607908 (+643759us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:20.725686 (+117778us) write_op.cc:454] Released schema lock
0709 13:10:20.725760 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:20.726285 (+   525us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:20.726322 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41248,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":126666,"apply.run_cpu_time_us":53099,"apply.run_wall_time_us":1369086,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":108543,"prepare.run_cpu_time_us":52989,"prepare.run_wall_time_us":585461,"raft.queue_time_us":130256,"raft.run_cpu_time_us":7489,"raft.run_wall_time_us":102472,"replication_time_us":590094,"spinlock_wait_cycles":21012352,"thread_start_us":873716,"threads_started":5,"wal-append.queue_time_us":1071648,"wal-append.run_cpu_time_us":56975,"wal-append.run_wall_time_us":2242011}]]}
I20260709 13:10:26.413182 30164 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.423590 30180 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.389532 30130 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.479820 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1219) took 1765 ms. Trace:
I20260709 13:10:26.490523 24518 rpcz_store.cc:276] 0709 13:10:24.714628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.138028 (+423400us) service_pool.cc:224] Handling call
0709 13:10:25.850233 (+712205us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5800002798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:10:25.850417 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:26.427639 (+577222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.479472 (+ 51833us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400442354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:26.479731 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544012032}
W20260709 13:10:26.494295 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.445785 29871 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.430874 30148 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:10:26.426164 30253 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:26.528396 30287 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:10:26.529522 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 255502us
I20260709 13:10:26.538431 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:26.540987 25211 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:26.552651 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 153882us
I20260709 13:10:26.483494 29799 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:26.477512 29874 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.480674 30152 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:26.413516 30068 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:26.567204 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 162047us
I20260709 13:10:26.568305 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.519147 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:26.569571 24524 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.514730 30109 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:26.575196 24491 leader_election.cc:400] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15.
I20260709 13:10:26.575814 24491 leader_election.cc:403] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:26.576637 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:26.537344 30194 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:26.564110 29799 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.559355 30126 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:26.593169 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 299694us
I20260709 13:10:26.567265 30152 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:26.529505 30180 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:10:26.565340 30044 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:26.591526 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.574348 30109 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:26.563373 30268 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:26.613278 30263 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.603287 30164 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:26.584424 30194 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:26.611755 30124 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.645005 30194 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.646245 30194 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.489334 30167 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.582326 30108 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:26.611953 30211 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.632521 30285 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:26.610562 29799 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.637043 30130 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.637555 30109 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.604624 30067 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15.
I20260709 13:10:26.610961 29449 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.587565 29954 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:10:26.612272 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.694834 30253 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.695803 30290 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.696115 30102 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:26.696684 30102 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:26.610738 30074 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.701697 29885 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.660822 30191 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:26.705443 30283 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:26.706905 30109 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:26.657569 30263 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.666285 30211 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.709702 30263 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.711086 30102 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.712714 30102 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.666029 29871 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:10:26.719511 30251 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:26.665851 30157 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:26.720341 30167 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.682626 29931 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:26.721131 29931 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:26.722102 29931 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:26.723120 30286 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:10:26.723502 29931 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.723834 30116 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:26.724239 30116 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:26.725069 30116 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.726663 30116 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:26.735119 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 122915us
W20260709 13:10:26.675791 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.615510 30136 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
W20260709 13:10:26.659409 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67963us
I20260709 13:10:26.651633 30164 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:26.739930 30164 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.719914 30251 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:26.680150 30215 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.773303 30211 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.775350 30164 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.764372 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:26.796034 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 454604us
I20260709 13:10:26.786371 24671 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:26.789547 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 302794us
I20260709 13:10:26.763556 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:26.813962 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 50498.5us
I20260709 13:10:26.815572 30211 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.816318 30211 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:26.817950 30167 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:26.819023 30167 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:26.819628 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:26.820133 30290 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:26.820674 30290 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:26.820816 30167 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:26.821516 30290 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.822201 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.806130 24524 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:26.822794 30290 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.823311 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.823518 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.825006 24670 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:10:26.825691 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.826879 24666 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:26.828449 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:26.829795 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.830618 24666 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:26.798559 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.843542 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.796607 30157 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:26.805970 24668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.029s	sys 0.070s
W20260709 13:10:26.872505 24668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.029s	sys 0.070s
I20260709 13:10:26.791115 30121 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:26.792897 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 430396us
I20260709 13:10:26.846333 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.875686 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:26.876614 30230 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:26.876751 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.876955 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.877224 30230 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:26.878261 30230 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.879000 30194 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:26.882823 30152 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.874648 30100 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:26.884204 30100 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.864364 29906 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.886437 30100 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.887248 29906 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.888142 25214 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:26.888795 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:26.890383 30164 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.864440 30108 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:26.846927 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.891497 30108 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:26.892647 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:26.841118 29874 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:26.895182 30200 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 13:10:26.895839 29874 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.895685 30200 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:26.892627 30108 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:26.788558 30165 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.002s	sys 0.012s
I20260709 13:10:26.898823 25182 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:26.871682 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:26.902138 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:26.902300 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:26.903383 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.906193 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:26.907963 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:26.909222 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 354569us
I20260709 13:10:26.914652 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.915951 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:26.809479 30116 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
W20260709 13:10:26.900614 30165 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.003s	sys 0.013s
W20260709 13:10:26.918838 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47273.5us
I20260709 13:10:26.924628 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.920089 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.927768 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.930943 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:26.875910 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 77443.5us
I20260709 13:10:26.914402 29906 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.908916 30102 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.934338 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.927943 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.918231 30215 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:26.917897 30074 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.914601 29871 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:26.923056 30208 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:26.940398 24668 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:26.922837 30159 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:26.844028 30251 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.942728 30155 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.944257 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.944744 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.915977 29885 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 13:10:26.948822 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.948731 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:26.954525 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.956164 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.949874 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:26.940474 30260 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.613s	user 0.005s	sys 0.008s
W20260709 13:10:26.903061 29874 raft_consensus.cc:2771] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 LEARNER]: Leader pre-election decision while not in active config. Result: Term 13: won. RaftConfig: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:26.964001 29885 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:26.953790 30296 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.965313 30130 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.933612 30136 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.938211 30102 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:26.918614 30111 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:10:26.925855 30167 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:10:26.991580 29449 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:26.991925 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:26.971108 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.992538 30305 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:10:26.993134 29780 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:10:26.993047 30305 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:26.966753 30260 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.993624 29780 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.994287 30305 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.995414 30260 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.995697 29780 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.996088 30305 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:26.999631 24671 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 14 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:26.991489 30102 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.969090 30251 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.939915 30294 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:26.973471 24591 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:26.973531 30159 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:27.002466 30136 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:26.943291 29871 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.003070 30136 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.003325 30159 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.004706 29871 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.974171 30069 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:27.005246 30069 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:26.945806 30074 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:27.005630 30136 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:27.005832 30074 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:27.006120 30069 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.007287 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:27.008883 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:26.974746 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.009773 24668 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:26.966949 30121 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.974466 30155 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:26.977770 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:27.017833 24672 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:26.978426 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:27.019029 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 69244.4us
I20260709 13:10:27.017168 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:26.959241 30169 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:26.988279 24524 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:10:27.024214 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.025504 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.965587 30296 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:26.989864 24674 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:27.029968 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:26.943802 30152 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:26.966166 30100 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:27.033927 25217 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:26.992110 29449 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:26.991533 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:26.990473 30299 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:10:26.997144 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:27.037937 24521 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:26.921973 30292 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:10:26.997977 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:26.972340 30200 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:26.998375 29799 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:26.991586 30111 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:26.960188 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:27.062083 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 101963us
I20260709 13:10:27.021358 30191 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.001955 24516 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:26.977043 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:26.981283 24666 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:27.002455 30294 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:27.031499 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.033825 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:26.966274 30044 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:27.034629 24673 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:27.042135 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:27.044073 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:27.031736 30253 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:27.065719 24670 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:27.055805 30303 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:27.056648 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.085013 24669 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:27.057740 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:27.059851 24519 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:27.064378 24523 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:26.992283 30167 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:27.065650 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.041304 29449 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:27.054458 24672 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
W20260709 13:10:27.067561 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 77475.3us
I20260709 13:10:27.093827 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:27.094514 24593 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.073190 24674 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:27.068663 25210 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:27.068872 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 52324.3us
I20260709 13:10:27.029870 30296 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:27.098680 30296 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.100142 30296 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.065177 30100 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.076362 24597 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:27.035859 30263 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:27.034471 30148 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:10:27.089691 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:27.104657 24598 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:27.073578 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:27.061383 30111 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:27.090374 24669 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:27.074345 30165 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:27.090718 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:27.074895 30290 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 13:10:27.091922 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60505us
I20260709 13:10:27.095893 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:27.074724 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.114603 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.067991 30040 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.069010 30044 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:27.103811 29931 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:27.087824 30167 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:27.066545 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:27.115180 24593 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:27.116194 24670 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:27.116947 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.101656 30260 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:27.118501 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 43833.9us
I20260709 13:10:27.102495 30152 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.144301 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.119186 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:27.119818 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:27.067732 30116 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:10:27.122401 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:27.144919 25218 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:27.145581 24595 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:27.124768 24669 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:27.126138 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.128664 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.146519 25218 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:27.131243 24598 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:27.123006 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:27.088117 30268 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:10:27.147617 30268 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:27.147727 25218 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:10:27.147985 30268 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:27.134673 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 203814us
I20260709 13:10:27.148100 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:27.149719 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:27.137037 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 202662us
I20260709 13:10:27.138059 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.138535 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.152070 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:27.139034 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.153169 25212 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:27.139382 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.140053 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.143249 24593 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:27.123474 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:27.146755 30191 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:27.135716 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:27.151176 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:27.120227 29874 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:27.149494 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:27.149847 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:27.156697 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:27.152060 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:27.161125 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.157642 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:27.120165 30165 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:27.164958 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:27.165170 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.109472 30109 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:10:27.168352 25213 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:27.123356 30200 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:27.170181 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.171931 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:27.133857 30100 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:27.172695 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.173832 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:27.067337 30294 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:27.226639 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.148939 30108 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.122043 30040 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.123543 29931 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:27.168534 30124 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:27.251292 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:27.255589 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:27.251948 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.171063 30176 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:27.161178 30148 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:10:27.223577 30253 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.162091 30136 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:10:27.229035 30067 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:27.258488 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 88368.5us
I20260709 13:10:27.161373 30251 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:10:27.227492 30164 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.171011 30303 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:27.260488 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:27.283699 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 125659us
I20260709 13:10:27.166410 30298 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:27.236138 30180 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:27.160205 30152 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.246984 30191 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:27.171099 30254 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 13:10:27.243479 30291 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:10:27.174721 30230 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.102s
I20260709 13:10:27.326778 30298 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.237610 30075 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:10:27.259476 30176 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:27.298900 30308 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:27.375397 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 202762us
I20260709 13:10:27.247607 30108 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.325323 30303 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.312562 30318 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:27.329656 29799 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:27.371620 24597 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:27.237226 30268 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:27.327648 30180 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:27.308451 29906 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:10:27.376358 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.342782 30067 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:27.275411 30044 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.409137 24595 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:27.430622 24600 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
W20260709 13:10:27.431259 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55085.3us
I20260709 13:10:27.356330 30298 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:27.466894 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:27.373685 30312 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:10:27.294195 30124 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:27.373802 29874 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:27.489763 29931 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:27.495980 25210 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:27.427764 30180 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:27.515144 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.432201 30303 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:27.474134 30310 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:10:27.430171 30130 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:27.399750 30331 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:27.523823 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.474877 29954 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:27.528905 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.530148 25212 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:27.530365 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.531936 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.518757 30251 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.522069 30268 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:27.488608 30167 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:27.541265 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.527910 30329 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.492094 30191 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:10:27.536238 30313 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:10:27.529160 30130 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:27.551283 30314 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:10:27.552093 30342 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.546420 30338 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:10:27.558256 30074 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:10:27.568531 30338 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:27.569007 30074 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.569530 30338 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.570990 30338 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:27.571270 30074 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:27.492659 30176 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.574031 30176 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.574484 30111 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.575130 30098 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:27.575539 30098 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:27.576882 30342 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:27.578034 30334 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
I20260709 13:10:27.579331 30342 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:27.584648 24667 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:27.552820 30322 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:10:27.585116 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:27.553440 30323 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260709 13:10:27.586643 30253 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:27.544871 29954 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:27.587289 30253 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:27.562852 30315 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:10:27.534889 30331 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.588276 30253 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:27.589867 30341 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:27.559554 29874 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.590270 30341 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:27.591312 30341 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.553999 30251 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.566349 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:27.593269 30108 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:27.592912 30251 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.597487 30251 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.598855 30230 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:27.567777 24598 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:27.564970 30297 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.600678 30251 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:27.587285 29954 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:27.591799 24519 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:27.585179 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.601166 30297 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.586717 30068 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:27.602798 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 304884us
W20260709 13:10:27.574239 30316 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:10:27.604373 30069 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.608289 30157 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:27.644241 30157 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:27.629667 30068 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:27.646411 30068 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.646884 30152 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:27.646982 30260 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.001s
I20260709 13:10:27.647537 30260 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:27.647670 30068 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:27.609052 24595 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:10:27.610531 29871 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:27.648720 29871 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:27.630366 29954 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:27.653144 29871 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.654307 29871 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:27.613610 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.648599 24595 pending_rounds.cc:85] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 6
I20260709 13:10:27.657361 24595 pending_rounds.cc:107] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 13:10:27.657521 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.657619 24595 raft_consensus.cc:2889] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.619033 25214 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:27.657961 30298 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.659644 29799 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:27.660096 30298 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:27.660228 29799 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:27.661693 30317 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:10:27.663029 30303 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:27.664184 30102 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.663s	user 0.008s	sys 0.002s
I20260709 13:10:27.664328 24665 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:27.646421 30157 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:27.668591 25213 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:27.555140 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.623081 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.625455 24599 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
W20260709 13:10:27.665706 30327 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:27.603312 30116 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:27.630496 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3290) took 1135 ms. Trace:
I20260709 13:10:27.673550 24518 rpcz_store.cc:276] 0709 13:10:26.495133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.495272 (+   139us) service_pool.cc:224] Handling call
0709 13:10:26.495598 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.573477 (+ 77879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.573525 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.613772 (+ 40247us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.930148 (+316376us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:26.930189 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.930261 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.630291 (+700030us) raft_consensus.cc:1685] finished
0709 13:10:27.630313 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.630440 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77429,"raft.queue_time_us":77573,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8619,"thread_start_us":262369,"threads_started":1,"wal-append.queue_time_us":413054}
I20260709 13:10:27.377208 30165 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.590282 30331 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:27.625041 30305 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
W20260709 13:10:27.671519 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48513.1us
I20260709 13:10:27.664610 30102 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.681950 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.630159 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:27.629920 30040 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:27.678877 30157 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:27.685710 30130 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.697492 30130 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:27.704146 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74065.1us
I20260709 13:10:27.706060 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:27.716648 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.716881 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.678575 29449 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.003s
I20260709 13:10:27.717617 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.718612 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.671310 30260 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:27.679855 30075 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.735626 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:27.736176 25210 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:27.737769 25212 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:10:27.729033 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.741461 24672 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:27.729511 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:27.729660 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.727638 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.731104 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.746680 24673 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:27.730530 24671 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:27.747149 24671 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:27.719823 30157 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:27.750479 25210 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:27.702581 30343 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:27.701537 30180 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.732409 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.749801 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:27.758718 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.759011 24674 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 14 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:27.721489 30040 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.549368 30067 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.754114 25211 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:27.733592 30252 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.558285 30329 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.772374 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.772665 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.775398 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.757229 24595 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:27.751322 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:27.776701 24519 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:10:27.760466 24521 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:27.747852 24671 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:27.640337 30124 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.756843 25213 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:27.726236 30191 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:27.767621 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:27.780130 24599 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
W20260709 13:10:27.780510 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 250206us
I20260709 13:10:27.767889 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.782044 24596 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:27.783140 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:27.783733 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.773013 25211 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:27.758915 24516 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:27.785537 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:27.783707 24523 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:27.743827 30260 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.746086 30075 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.785733 30299 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:10:27.855525 30075 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:27.857517 30260 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:27.857973 30180 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:27.858515 30180 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:27.858834 30180 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:27.859581 30180 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:27.860678 30180 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.785699 30335 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:27.840399 29954 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:27.863739 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81035.3us
W20260709 13:10:27.864854 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85322.8us
I20260709 13:10:27.865428 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:27.841905 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:27.865808 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:27.866537 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:27.786679 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:27.789430 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:27.786664 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:27.868268 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 80200.5us
I20260709 13:10:27.868991 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:27.863322 29954 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:27.790103 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:27.867835 25217 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:27.801007 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:27.872430 24518 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:27.790403 24520 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:27.874835 24674 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:10:27.877743 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 76813.5us
I20260709 13:10:27.880282 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.881364 25210 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:10:27.883224 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.883991 24672 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:27.885639 25219 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:27.887272 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.888002 24674 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:27.727645 29449 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:27.886482 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:27.847451 30297 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:27.764925 30343 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.048103 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:28.036514 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.891542 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:27.947358 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 68483.7us
I20260709 13:10:27.757730 30198 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:28.053280 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:27.963816 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 94916.9us
W20260709 13:10:27.971822 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 105293us
I20260709 13:10:27.914660 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.057394 24520 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:27.830571 30164 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:27.757611 30108 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.890949 24525 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:28.052699 24518 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:27.891391 24666 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:27.923831 24669 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:27.922438 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:27.895234 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:27.830816 30339 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:27.806056 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.765648 30292 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:28.059978 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:27.838912 30329 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:27.846655 30303 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:27.849062 29799 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:28.064457 24668 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:28.064870 24522 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:27.922840 30344 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:28.096971 30349 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:10:27.763288 30321 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.295s
I20260709 13:10:27.922747 30291 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:28.070371 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 175204us
I20260709 13:10:27.975709 29954 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:28.082402 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.082816 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:28.077612 24517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.006s	sys 0.013s
I20260709 13:10:27.876750 30130 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.194s
I20260709 13:10:28.061605 30102 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:28.126433 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:28.091224 25211 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:28.098204 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.109344 24520 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:27.891311 30290 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.188s
I20260709 13:10:27.791488 30191 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.070974 30335 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.953145 30348 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 13:10:27.962720 30159 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:28.083950 30121 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:28.121069 24518 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:28.148053 30347 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.126055 25210 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:10:28.167649 25210 pending_rounds.cc:85] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 12
I20260709 13:10:28.167995 25210 pending_rounds.cc:107] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:10:28.168262 25210 raft_consensus.cc:2889] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.142102 24669 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:28.142802 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:28.144239 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 61507.2us
W20260709 13:10:28.144667 24517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.008s	sys 0.015s
I20260709 13:10:28.170110 25213 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:28.132258 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.128392 24666 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:28.079049 30108 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.068269 30360 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
W20260709 13:10:28.155557 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.123679 30268 consensus_meta.cc:287] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.001s
I20260709 13:10:28.174420 30130 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:28.140774 30296 consensus_meta.cc:287] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.040s	user 0.010s	sys 0.004s
I20260709 13:10:28.096561 30260 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:10:28.177445 30340 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:10:28.062454 30297 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:10:28.179633 30297 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:28.179962 30297 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:28.180786 30297 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.182124 30297 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:28.183192 30353 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:28.184234 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1219) took 1017 ms. Trace:
I20260709 13:10:28.184580 25215 rpcz_store.cc:276] 0709 13:10:27.167213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.167330 (+   117us) service_pool.cc:224] Handling call
0709 13:10:27.167618 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.307081 (+139463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.307133 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.312032 (+  4899us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.752160 (+440128us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:27.752199 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.752260 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.184035 (+431775us) raft_consensus.cc:1685] finished
0709 13:10:28.184056 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.184182 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29178,"raft.queue_time_us":242336,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":51768,"thread_start_us":543640,"threads_started":2,"wal-append.queue_time_us":650393}
I20260709 13:10:28.148010 30339 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.190212 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:28.151525 30352 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:28.198873 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.202059 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:28.204263 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:28.154464 30344 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:10:28.161317 30121 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:28.160211 30159 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:28.209841 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1829) took 1073 ms. Trace:
I20260709 13:10:28.214629 24518 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:10:28.166133 30291 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:28.217829 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:28.198109 29954 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:10:28.215788 24592 rpcz_store.cc:276] 0709 13:10:27.135943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.136119 (+   176us) service_pool.cc:224] Handling call
0709 13:10:27.165864 (+ 29745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.234913 (+ 69049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.234945 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.248350 (+ 13405us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.511920 (+263570us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:27.511960 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.512045 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.209628 (+697583us) raft_consensus.cc:1685] finished
0709 13:10:28.209650 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.209789 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":352583,"raft.queue_time_us":81791,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":47748,"thread_start_us":184481,"threads_started":1,"wal-append.queue_time_us":475884}
W20260709 13:10:28.213064 30351 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:10:28.210492 30260 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:28.210726 30268 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:28.231979 24522 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:28.161724 30335 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.211508 30352 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:28.215440 30121 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.248634 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.254936 24522 raft_consensus.cc:2410] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:28.250842 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:28.249573 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:28.255978 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:28.257961 29874 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.258286 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2120) took 1141 ms. Trace:
I20260709 13:10:28.258580 29874 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.258859 24597 rpcz_store.cc:276] 0709 13:10:27.116811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.122788 (+  5977us) service_pool.cc:224] Handling call
0709 13:10:28.258084 (+1135296us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001cbe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:28.258214 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515584384}
I20260709 13:10:28.261998 30098 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.263171 30303 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:28.263608 30098 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:28.271814 24671 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.273919 30159 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.275257 30159 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:28.275677 30326 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.855s	user 0.003s	sys 0.000s
I20260709 13:10:28.173111 30347 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.280843 24597 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:28.281860 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:28.289392 24596 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:28.291299 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1827) took 1155 ms. Trace:
I20260709 13:10:28.291801 24600 rpcz_store.cc:276] 0709 13:10:27.135387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.135502 (+   115us) service_pool.cc:224] Handling call
0709 13:10:28.291119 (+1155617us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540021be54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:28.291236 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632625536}
I20260709 13:10:28.299372 24520 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:28.283141 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:28.283957 30253 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.200181 30339 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.243685 30260 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.304843 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:28.305833 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:28.307165 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:28.307755 24597 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:10:28.313390 24594 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.308588 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:28.314133 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:28.308888 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:28.310187 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:28.320164 24592 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:28.317339 24599 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:28.317799 24600 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:28.316954 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:28.285367 30290 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:28.263643 30303 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:28.278570 30268 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:28.332406 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2100) took 1316 ms. Trace:
I20260709 13:10:28.338251 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:28.333685 24517 rpcz_store.cc:276] 0709 13:10:27.016300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.016653 (+   353us) service_pool.cc:224] Handling call
0709 13:10:27.016943 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.017200 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:27.029206 (+ 12006us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.222449 (+193243us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.491116 (+268667us) spinlock_profiling.cc:243] Waited 9.82 ms on lock 0x7b180047d3a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:10:27.569731 (+ 78615us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b180047d3a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:28.275196 (+705465us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:28.331687 (+ 56491us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.331969 (+   282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.332034 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:28.332094 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.332181 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.332335 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48053,"prepare.queue_time_us":12530,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":21511,"raft.queue_time_us":73386,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":37833,"spinlock_wait_cycles":181111808,"thread_start_us":985641,"threads_started":3,"wal-append.queue_time_us":326616}
I20260709 13:10:28.314599 30348 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:28.314839 30260 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:28.326151 30130 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.289460 30263 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:10:28.330436 30291 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.337801 30264 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:28.353588 30361 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:10:28.353487 29449 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.354100 30108 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:28.386580 30339 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:28.314393 30356 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 13:10:28.354455 30364 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:28.348706 30191 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.354571 30268 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:28.353518 30069 consensus_meta.cc:287] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.001s
I20260709 13:10:28.355886 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:28.310921 30321 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:10:28.347826 30341 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.314201 29955 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:10:28.330327 30305 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:28.368918 24594 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:28.313959 30253 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.372807 30347 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.361582 30130 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.375150 30152 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:28.346050 30352 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:28.392114 24490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.881s (SENT) [suppressed 13 similar messages]
I20260709 13:10:28.404719 24671 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:28.371680 30343 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:28.356137 30303 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.415091 30253 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.427541 25216 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:28.429795 30111 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:28.432439 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.418476 30130 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.418694 30152 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:28.484884 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.468626 30165 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:28.472599 30303 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:28.488977 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 96901.8us
I20260709 13:10:28.493268 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.493973 24520 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:28.491255 24517 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:28.491485 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:28.494663 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:28.494931 24674 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
W20260709 13:10:28.495589 30371 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:28.496039 24517 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:28.497660 24517 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:28.498931 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:28.500306 24520 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:28.500646 24520 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:28.501364 24520 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.502408 24520 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.490403 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:28.509565 30339 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:28.511991 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.512264 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.512627 24518 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:28.513026 24522 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:28.513187 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.513649 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.513797 24524 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 8.
I20260709 13:10:28.514115 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:28.487708 30100 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:28.514899 24524 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:10:28.515592 24524 pending_rounds.cc:85] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 11
I20260709 13:10:28.515822 24524 pending_rounds.cc:107] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:10:28.516043 24524 raft_consensus.cc:2889] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.516808 24516 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:28.517890 24520 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:10:28.518304 24520 pending_rounds.cc:85] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 10
W20260709 13:10:28.518452 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.518604 24520 pending_rounds.cc:107] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:10:28.518854 24520 raft_consensus.cc:2889] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.492702 30165 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:28.520905 30176 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.946s	user 0.006s	sys 0.005s
I20260709 13:10:28.515348 30100 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:28.522504 30165 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.522287 30100 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.523640 30100 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.475212 30260 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.532500 30260 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.533439 24517 raft_consensus.cc:2368] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18.
I20260709 13:10:28.519428 25182 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:28.538183 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:28.538801 25212 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:28.544896 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:28.547753 25212 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:28.538173 30191 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:28.543704 30152 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.550086 30191 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:28.551116 30372 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:10:28.551239 30152 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.552134 30191 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.543447 30069 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:28.518083 30124 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:28.554636 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:28.555248 25211 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:28.556871 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:28.558651 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 692137us
I20260709 13:10:28.558207 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:28.560134 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 770035us
I20260709 13:10:28.516146 30297 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:28.559495 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:28.563938 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:28.558224 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1171) took 1300 ms. Trace:
I20260709 13:10:28.570829 24598 rpcz_store.cc:276] 0709 13:10:27.259984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.600353 (+340369us) service_pool.cc:224] Handling call
0709 13:10:27.600627 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.610781 (+ 10154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.610810 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.611198 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.744293 (+133095us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:27.779606 (+ 35313us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.274801 (+495195us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18003d6e40. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59557 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:28.557734 (+282933us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18003d6e40. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:10:28.557901 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.557988 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.558030 (+    42us) raft_consensus.cc:1685] finished
0709 13:10:28.558046 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.558162 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100837,"prepare.queue_time_us":19996,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":791521,"spinlock_wait_cycles":54837760,"thread_start_us":132772,"threads_started":1,"wal-append.queue_time_us":445645}
W20260709 13:10:28.557883 30377 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:10:28.575510 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:28.574947 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:28.567193 30343 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:28.585958 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:28.586673 24520 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:28.566032 30263 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:28.695837 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 119193us
I20260709 13:10:28.572662 30252 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:28.637430 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 62004.6us
W20260709 13:10:28.686337 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:28.700538 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.572495 30116 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:28.574347 30347 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:28.582867 30069 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:28.716679 30347 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.718801 30347 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:28.574818 30308 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:28.718673 30121 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.719568 30308 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.721330 30344 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:28.721628 30308 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:28.588508 30343 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.722000 30344 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.722751 30343 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:28.724382 30344 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:28.706218 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:28.561641 30339 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:10:28.584407 30297 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:28.711025 30374 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:10:28.725132 30165 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:28.725684 30321 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.726377 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:28.727633 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 409272us
I20260709 13:10:28.752169 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:28.727810 30299 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:28.728562 30176 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:28.729308 30263 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:28.729400 30069 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:28.729548 30191 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:28.728338 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 160224us
I20260709 13:10:28.740564 30253 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.584645 29954 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:28.702809 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:28.784085 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81368.3us
I20260709 13:10:28.740720 25217 raft_consensus.cc:2376] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12. Re-sending same reply.
I20260709 13:10:28.786688 30291 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:28.787081 30291 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.787421 30291 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.787860 30347 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:28.744993 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.742887 25211 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:28.790007 24520 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:28.699678 30067 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:28.794624 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.753000 25182 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:28.795450 24520 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:28.758441 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:28.761857 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:28.731202 30254 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:28.775279 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3423) took 1726 ms. Trace:
I20260709 13:10:28.800074 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:28.753454 30294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.006s	sys 0.017s
W20260709 13:10:28.781056 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.746699 30116 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:28.766278 30159 raft_consensus.cc:670] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:10:28.791723 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.792205 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:28.792351 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:28.793452 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:28.794485 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:28.765353 30329 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:28.800707 24668 rpcz_store.cc:276] 0709 13:10:27.048487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.050092 (+  1605us) service_pool.cc:224] Handling call
0709 13:10:27.057319 (+  7227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.113450 (+1056131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.775006 (+661556us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400404f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:28.775221 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315622656}
I20260709 13:10:28.805871 24596 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:28.807111 24599 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:28.759904 30102 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:10:28.780735 30098 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.775492 30069 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.757859 30165 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.824199 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:28.804692 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:28.824656 24593 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:28.825619 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:28.826345 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:28.759328 30341 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:10:28.827353 24597 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:10:28.766453 30121 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:28.829571 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:28.795185 30067 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.841830 24599 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 10.
I20260709 13:10:28.823071 30329 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.814880 29780 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:28.796228 30044 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.796900 29871 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:28.813980 30294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.007s	sys 0.017s
I20260709 13:10:28.826973 30155 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:28.814193 30344 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:28.894021 30344 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.894567 30344 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.895943 30299 raft_consensus.cc:1064] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:10:28.760089 30321 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.898995 30321 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:28.818037 30157 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.899674 30157 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.846308 24597 pending_rounds.cc:85] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 11
I20260709 13:10:28.903553 24597 pending_rounds.cc:107] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:10:28.903824 24597 raft_consensus.cc:2889] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:28.789598 30253 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.798785 30040 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:28.801983 30108 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.838847 30098 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.864660 24593 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:28.832374 24670 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:28.879463 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.855500 30176 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.840363 30385 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.851318 30263 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.866617 29780 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:28.867777 30044 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.865798 29871 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:28.891755 30294 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.912797 30352 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.861733 30116 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.864398 30292 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:28.852561 30339 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:10:28.793190 29954 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:28.859418 30067 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:28.902849 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:28.859455 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48322.6us
I20260709 13:10:28.918715 30109 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:28.920293 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 169611us
I20260709 13:10:28.864993 30121 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:28.915630 30297 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:28.962287 24666 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:28.922664 29955 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.863193 30329 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:28.905613 30194 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:28.970450 24523 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
W20260709 13:10:28.969951 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 211575us
I20260709 13:10:28.956624 29871 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:28.976986 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 142377us
I20260709 13:10:28.985419 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:28.986615 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 186620us
I20260709 13:10:29.000365 30398 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.969727 29954 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.009846 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:28.931960 30176 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.921689 30108 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.976593 30121 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:28.982079 30167 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.983441 30347 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.020656 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.022011 25211 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 10.
I20260709 13:10:28.936604 30385 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:28.964567 30352 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.009862 30194 consensus_queue.cc:1243] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:29.032807 25211 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:28.969537 30292 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:29.015491 30383 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:29.013276 30388 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.014322 30180 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.069334 24598 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:29.017361 30121 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:28.964726 30294 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.084406 24673 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:29.029912 30341 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:29.020447 30152 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:29.086742 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.002992 29955 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.134143 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.136921 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.138240 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:29.010933 30398 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:29.145254 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 112720us
I20260709 13:10:29.126557 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:29.130762 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.146344 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:29.146983 25216 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 9.
W20260709 13:10:29.131982 30380 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:10:29.040683 30040 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.127259 30124 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.157485 25219 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:29.155781 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:29.035132 30347 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:29.147197 30381 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:10:29.159596 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:29.162117 25216 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:10:29.164780 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.056262 30390 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:10:29.136547 30165 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:29.077293 30394 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 13:10:29.149518 30100 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.086886 30180 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.031316 30297 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.156334 30339 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:29.087003 30388 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.162081 30405 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.171072 30384 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:10:29.166333 30252 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:29.193692 30165 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.215142 30165 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:29.215605 30386 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:10:29.217799 30294 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.180716 30098 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:29.218597 30396 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:29.181159 30407 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:10:29.219712 30098 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:29.220106 30098 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.220449 30098 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:29.221112 30404 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:29.221483 30157 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.222811 30157 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:29.223258 30157 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:29.224620 30343 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:10:29.226305 30347 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:29.229835 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.159111 30124 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.159353 30040 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.192847 30100 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.234206 29955 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.238042 30385 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.242828 30388 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.184523 30253 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.244045 30335 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:29.244479 30389 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:10:29.191109 30339 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:29.258158 24594 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:29.199759 30402 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:29.205798 30321 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:29.202843 30393 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:29.257427 30157 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:29.274883 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 148448us
I20260709 13:10:29.277899 24593 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:29.282478 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:29.246028 30403 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:29.286677 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.287565 25218 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:29.258095 30165 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.257627 30404 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.290429 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.225018 30343 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:29.281884 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 222410us
I20260709 13:10:29.300830 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1222) took 1574 ms. Trace:
I20260709 13:10:29.280050 30339 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.302394 25214 rpcz_store.cc:276] 0709 13:10:27.726059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.726435 (+   376us) service_pool.cc:224] Handling call
0709 13:10:27.726710 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.067517 (+340807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.067581 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.067639 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:28.067685 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.300536 (+1232851us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540066c954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:29.300597 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.300762 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783203200}
I20260709 13:10:29.304111 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.310899 25217 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:29.279597 29780 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.214167 30405 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.291458 30321 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.320839 30100 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.303478 30108 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.321174 29871 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.321951 30098 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.323339 29871 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.299219 30130 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.324150 30130 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.324298 30121 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.321197 30292 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.290961 30176 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.326232 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.328173 25211 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:29.298578 30409 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:29.333222 30303 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.009s
I20260709 13:10:29.331538 30198 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:29.328145 30344 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.345469 30398 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.346606 30180 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.346714 30344 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.343593 30198 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.347522 30198 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:29.350610 30268 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:29.350987 30268 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:29.353761 30329 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.354462 30308 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:29.354854 30308 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:29.355883 30343 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.355628 30308 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.356521 30329 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.342402 30352 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.352679 30268 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.357038 30308 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:29.360980 30291 consensus_meta.cc:287] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.003s
I20260709 13:10:29.357577 30183 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:29.358700 30405 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:29.361894 30348 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:10:29.367764 30291 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.365798 30268 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:29.490415 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 330696us
I20260709 13:10:29.493925 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.490415 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.498044 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:29.500341 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.491953 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.508793 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:29.491953 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:29.512899 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 202772us
I20260709 13:10:29.513522 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2031) took 1022 ms. Trace:
W20260709 13:10:29.514459 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 204178us
I20260709 13:10:29.516533 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:29.523240 25215 raft_consensus.cc:2368] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:29.328274 25219 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:29.525684 29871 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:29.645819 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:29.559144 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1242) took 1774 ms. Trace:
I20260709 13:10:29.561429 29874 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.563277 24594 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:29.564386 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2110) took 1347 ms. Trace:
I20260709 13:10:29.567404 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:29.567711 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.575344 30040 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.579515 30044 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.581598 30116 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:29.583698 30124 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.584915 24595 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:29.362927 30339 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.663914 24517 raft_consensus.cc:2410] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:10:29.666297 30252 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.449376 30387 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.477s	user 0.004s	sys 0.000s
I20260709 13:10:29.667425 30252 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.302979 30404 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.671000 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.671672 24596 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:29.674134 30130 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:29.675074 24523 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:29.603765 30344 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.360707 30299 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.677579 30344 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.605572 30352 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.604812 30406 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.681320 30352 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.681600 30406 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.683971 30352 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.650259 24671 rpcz_store.cc:276] 0709 13:10:28.490833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.490978 (+   145us) service_pool.cc:224] Handling call
0709 13:10:28.491279 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.492546 (+  1267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.492571 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.493012 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.754845 (+261833us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18004bc220. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:28.837801 (+ 82956us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:28.837837 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.837905 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.512787 (+674882us) raft_consensus.cc:1685] finished
0709 13:10:29.512822 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.513224 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":930,"raft.queue_time_us":1648,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":3333,"spinlock_wait_cycles":2916736,"thread_start_us":82774,"threads_started":1,"wal-append.queue_time_us":472389}
I20260709 13:10:29.684679 24516 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:29.606297 30356 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.606499 25182 leader_election.cc:400] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18.
I20260709 13:10:29.688926 25182 leader_election.cc:403] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:29.292085 30403 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.626166 30321 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:29.528766 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.373114 30183 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:29.631127 30121 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:29.653822 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.629066 30111 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.159s	user 0.010s	sys 0.007s
I20260709 13:10:29.661089 30116 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.661728 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:29.662089 30297 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.708863 30297 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.709263 24518 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:29.711498 30297 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.666473 30339 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.715988 30291 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.721167 30356 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.723809 30356 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.339213 30409 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.726924 30409 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:29.730262 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 124290us
I20260709 13:10:29.684476 30406 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:29.651780 24521 rpcz_store.cc:276] 0709 13:10:27.784652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.788671 (+  4019us) service_pool.cc:224] Handling call
0709 13:10:27.788930 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.169445 (+380515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.169472 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.169509 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:28.169535 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.558425 (+1388890us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54000bb8d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:29.558540 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.558864 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874741632}
I20260709 13:10:29.735018 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:29.736207 30425 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.288s	user 0.004s	sys 0.000s
I20260709 13:10:29.671205 30404 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.361522 30254 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:29.677738 29871 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.288399 30402 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.743901 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:29.744848 24673 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:29.745142 29871 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.744848 30321 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.746510 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 255051us
I20260709 13:10:29.746745 30321 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.672837 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:29.686853 30344 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:29.652683 24525 rpcz_store.cc:276] 0709 13:10:28.217391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.217561 (+   170us) service_pool.cc:224] Handling call
0709 13:10:29.563958 (+1346397us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003ddbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:29.564200 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452571904}
I20260709 13:10:29.749598 24596 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:29.751041 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:29.752862 30403 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.733583 30406 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18.
W20260709 13:10:29.755043 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.605736 30176 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:29.695878 30303 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:29.699828 30155 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:29.700095 29885 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.700680 30111 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:29.700466 30183 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.705027 30252 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.707434 30116 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.708092 24598 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:29.711421 30040 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.333426 30098 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:29.739960 30254 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:29.785769 30263 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.786449 30263 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:29.786998 30432 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.003s
I20260709 13:10:29.743240 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:29.789664 24671 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
W20260709 13:10:29.697048 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.758139 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 54530us
I20260709 13:10:29.756866 30321 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:29.756949 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.791800 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:29.792140 24523 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 12: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:29.793299 30388 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.793434 30297 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.760448 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46311.6us
I20260709 13:10:29.793973 30388 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.794173 30297 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.796420 30388 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.745867 30402 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.766038 29885 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.767129 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:29.799407 24594 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:29.800580 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:29.800828 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.801386 24594 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:29.767899 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:29.768757 30111 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.769865 30348 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.771802 30067 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.793s	user 0.000s	sys 0.015s
I20260709 13:10:29.772076 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:29.773101 30404 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:29.775553 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.776541 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:29.812918 24597 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
W20260709 13:10:29.780253 30427 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.331s	user 0.004s	sys 0.000s
I20260709 13:10:29.781107 24520 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:29.781193 30303 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.781746 30344 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:29.784826 30403 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:29.789574 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:29.759996 30176 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.821005 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:29.803386 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55295.4us
W20260709 13:10:29.804044 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53272.5us
I20260709 13:10:29.807565 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.819252 29871 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:29.819589 24517 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:29.814046 30252 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:29.801004 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2126) took 1008 ms. Trace:
I20260709 13:10:29.826139 24598 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:29.788977 30263 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.828122 24595 rpcz_store.cc:276] 0709 13:10:28.792329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.793667 (+  1338us) service_pool.cc:224] Handling call
0709 13:10:28.793982 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.662927 (+868945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.800739 (+137812us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54001ed7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:29.800939 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817355136}
I20260709 13:10:29.819666 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.834805 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.837255 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.837972 25212 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:29.837251 24591 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:29.827101 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:29.821063 30111 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.827948 30252 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:29.831561 30155 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.850659 30155 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.807590 30040 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:29.853259 30303 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.853885 30040 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.854674 24593 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:29.856082 30303 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.848707 25219 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:29.857101 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.864709 24521 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 14: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:29.827697 30067 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.852870 30155 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.821607 30348 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.857758 30252 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.880623 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:29.859032 30263 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:29.884550 30394 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:29.885804 24671 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:29.886255 30040 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.907799 30303 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:29.907632 30040 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:29.888257 30428 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.439s	user 0.002s	sys 0.000s
I20260709 13:10:29.910772 30254 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.911995 24599 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:29.913276 30263 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.915714 30263 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.916651 30067 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.891705 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.919234 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:29.919764 25217 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:29.919596 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:29.920907 30394 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:29.922200 30394 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.922760 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:29.925854 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:29.893354 30176 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:29.894469 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 102857us
I20260709 13:10:29.929066 25215 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:29.929867 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:29.930792 25211 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:10:29.931285 25211 pending_rounds.cc:85] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 12
I20260709 13:10:29.931383 29885 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:29.931694 25211 pending_rounds.cc:107] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:10:29.932173 25211 raft_consensus.cc:2889] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:29.932464 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:29.888585 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:29.899659 24520 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:29.897753 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:29.904887 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 82593.1us
I20260709 13:10:29.917485 24522 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:10:29.916357 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:29.934978 24667 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.901877 30251 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:10:29.918592 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:29.936245 24516 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:29.860654 30297 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:29.937968 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 49567.5us
I20260709 13:10:29.933516 30044 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:29.859858 30344 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.949357 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:29.952280 24517 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:29.958465 25212 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:29.944161 30044 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:29.963399 30254 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:29.963941 30044 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.968065 24669 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:29.969187 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:29.941351 29871 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.980340 24667 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
W20260709 13:10:29.983242 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50889.2us
I20260709 13:10:29.983644 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:29.983731 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.981155 24669 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:29.945771 30067 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:29.988250 30431 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.330s	user 0.002s	sys 0.000s
I20260709 13:10:29.989015 30308 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:29.989557 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:29.942611 30176 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:10:29.992594 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:30.003249 30410 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:30.003758 30410 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:30.004141 30410 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:29.982043 30155 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:30.014217 24519 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:30.014119 24665 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:29.994405 30308 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.024741 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.027630 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:29.993393 29871 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:29.983105 30404 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:10:30.011039 30303 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.998427 30263 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:10:30.022565 30308 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:30.038412 30395 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:30.041702 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.035037 30109 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 13:10:30.047716 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 95598.9us
I20260709 13:10:30.045408 30395 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:30.033387 30409 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:30.050264 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.053066 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.056717 24520 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
I20260709 13:10:30.037585 30040 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.060532 29955 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.061230 29955 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.047044 30402 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:30.068002 30268 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.050503 30155 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:30.068372 24672 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:30.072345 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:30.035331 30067 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.044920 30297 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.068192 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.077611 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.065723 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:30.083863 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.076268 30176 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:30.085927 24592 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:30.086124 30176 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.086588 30176 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.090489 29955 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:30.090997 29954 consensus_meta.cc:287] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.005s	user 0.004s	sys 0.020s
I20260709 13:10:30.091485 29954 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.093506 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.094393 24591 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:30.095623 24524 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:30.097322 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:30.101596 30406 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:30.102097 30406 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:30.102572 30406 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.103852 30194 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.104465 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.105257 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.105513 30159 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.105933 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.106130 30159 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.106583 24592 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:30.104489 30194 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.108323 24598 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:30.109550 30194 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.110026 30344 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:30.109555 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 51129.7us
I20260709 13:10:30.112097 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.113726 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.114584 24667 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 11.
I20260709 13:10:30.116169 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.115623 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.120728 24516 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:10:30.093729 29954 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.117375 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.069629 30402 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.120875 24667 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:30.127250 24674 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:30.080302 30155 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.134038 24599 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:30.134785 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:30.135393 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.136050 24674 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:30.137387 30305 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:30.139550 30305 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:30.140653 30098 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:30.141003 30098 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:30.141381 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.142009 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1261) took 1305 ms. Trace:
I20260709 13:10:30.142282 24672 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:30.141908 30098 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.142474 24522 rpcz_store.cc:276] 0709 13:10:28.836471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.836646 (+   175us) service_pool.cc:224] Handling call
0709 13:10:28.837044 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.943995 (+1106951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.141710 (+197715us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400113d54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:30.141942 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483338496}
W20260709 13:10:30.143057 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 92216.5us
I20260709 13:10:30.143347 30098 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.144214 30176 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.146044 24591 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:30.148025 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.148250 24665 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:30.127409 30403 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:30.149122 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.149619 30403 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:30.151432 30176 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.151872 30403 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.153439 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.153882 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3316) took 1568 ms. Trace:
I20260709 13:10:30.184353 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:30.156098 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.194495 24671 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:30.156754 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.195268 24595 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:10:30.156998 24420 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 347) took 29637 ms (client timeout 15000 ms). Trace:
I20260709 13:10:30.157608 24639 leader_election.cc:400] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:30.195976 24639 leader_election.cc:403] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:30.063383 30303 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.200511 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.108275 30159 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.167825 30352 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:30.203706 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.173337 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:30.163810 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:30.175164 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.178058 24591 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:30.178974 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:30.130452 30402 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.210649 24669 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:30.187525 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:30.188287 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.161041 30155 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.168463 30388 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:10:30.186771 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:30.193859 24524 rpcz_store.cc:276] 0709 13:10:28.585887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.586747 (+   860us) service_pool.cc:224] Handling call
0709 13:10:28.586988 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.096194 (+1509206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.153570 (+ 57376us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400441954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:30.153808 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3468527872}
I20260709 13:10:30.210516 25216 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:30.219952 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:30.218410 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55113.6us
W20260709 13:10:30.221278 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.196714 30356 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:30.223317 25217 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.226059 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.060581 30395 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.252197 30260 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:30.253744 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:30.192658 30109 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:30.195616 24420 rpcz_store.cc:269] 0709 13:10:00.519321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.519578 (+   257us) service_pool.cc:224] Handling call
0709 13:10:00.792200 (+272622us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:10:30.156748 (+29364548us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:26.490371 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:26.634486 (+144115us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:26.634553 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:10:26.634575 (+    22us) tablet.cc:662] Decoding operations
0709 13:10:26.635671 (+  1096us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:26.635792 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:26.635822 (+    30us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:10:26.636702 (+   880us) tablet.cc:701] Row locks acquired
0709 13:10:26.636764 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:10:26.636958 (+   194us) write_op.cc:270] Start()
0709 13:10:26.653632 (+ 16674us) write_op.cc:276] Timestamp: P: 1783602626636884 usec, L: 0
0709 13:10:26.653656 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:10:26.775781 (+122125us) log.cc:844] Serialized 3693 byte log entry
0709 13:10:28.245382 (+1469601us) op_driver.cc:464] REPLICATION: finished
0709 13:10:28.470469 (+225087us) write_op.cc:301] APPLY: starting
0709 13:10:28.472207 (+  1738us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:28.820176 (+347969us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:28.828658 (+  8482us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:29.067991 (+239333us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:29.146138 (+ 78147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:10:29.151847 (+  5709us) write_op.cc:312] APPLY: finished
0709 13:10:29.201414 (+ 49567us) log.cc:844] Serialized 89 byte log entry
0709 13:10:29.287898 (+ 86484us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.288050 (+   152us) write_op.cc:454] Released schema lock
0709 13:10:29.288100 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:29.292789 (+  4689us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.292823 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4645960,"reported_tablets":46,"spinlock_wait_cycles":542296064,"child_traces":[["op",{"apply.queue_time_us":168209,"apply.run_cpu_time_us":21193,"apply.run_wall_time_us":858197,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":342113,"prepare.run_cpu_time_us":25381,"prepare.run_wall_time_us":731409,"raft.queue_time_us":410096,"raft.run_cpu_time_us":6161,"raft.run_wall_time_us":173335,"replication_time_us":1561624,"thread_start_us":878146,"threads_started":5,"wal-append.queue_time_us":680722,"wal-append.run_cpu_time_us":12134,"wal-append.run_wall_time_us":1818279}]]}
W20260709 13:10:30.261462 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 104102us
I20260709 13:10:30.189729 30297 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.262089 29955 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:30.262544 30198 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.914s	user 0.008s	sys 0.012s
I20260709 13:10:30.201574 30348 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.213712 30121 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:30.249913 30356 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:30.266126 30067 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.212941 30409 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:30.180207 30268 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.274765 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.175591 30321 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
W20260709 13:10:30.276652 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55484.4us
I20260709 13:10:30.279847 30303 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.281268 30395 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.272826 24592 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:30.284066 24672 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:30.291708 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.289316 25211 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:30.281735 30344 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.280539 30109 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.287678 30339 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.281790 29955 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:30.289804 30159 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:30.296650 30356 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.271864 30260 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.322365 24598 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:30.325661 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.325857 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.326321 24592 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:30.326853 24593 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:30.307559 30404 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:30.332737 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 209805us
I20260709 13:10:30.314605 29955 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.316812 30159 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.341878 24599 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:30.296434 30198 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.328598 29871 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.353169 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.354034 24593 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:30.361305 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:30.341485 30194 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:30.341800 30159 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.319187 30121 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.368408 24673 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:30.350078 30303 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:30.328923 30339 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.334381 30344 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.382810 30260 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.386868 30291 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:30.387553 30291 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.388521 24593 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:10:30.389820 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.367129 29871 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.397702 25217 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
W20260709 13:10:30.406834 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 58240.3us
I20260709 13:10:30.373828 30268 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.406733 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.362473 30308 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.410403 24517 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:10:30.410207 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 67606.6us
I20260709 13:10:30.411675 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.411510 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.412401 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.393548 30409 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:30.366240 30404 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.389945 30044 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.426040 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.415338 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.429061 24667 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:30.430418 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.419346 24521 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:30.420138 24519 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:30.380277 30297 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.414644 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.389936 30291 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:30.373492 30194 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.411494 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.436393 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.436414 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.436720 24671 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:30.416353 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:30.419795 30409 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.439790 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.440119 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.436932 24666 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:30.443380 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.402485 30303 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.450493 24674 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
I20260709 13:10:30.450847 24670 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:30.444438 24667 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:30.472736 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:30.417297 29871 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.479504 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:30.482044 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.442242 30409 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.485162 24669 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:30.486119 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:30.464862 30252 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:10:30.489842 24519 raft_consensus.cc:2410] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:30.444285 30268 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.494868 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.495478 24669 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:30.495729 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:30.499027 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.501694 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.511231 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.492234 30352 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:30.474146 30260 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:10:30.512130 24591 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
W20260709 13:10:30.522284 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 146002us
I20260709 13:10:30.473028 30155 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:30.524852 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 90859us
I20260709 13:10:30.525686 25185 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.490293 30410 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.517321 30297 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:30.530928 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:30.533623 30442 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:30.494199 30252 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:30.535418 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 114320us
I20260709 13:10:30.525959 29885 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.538502 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:30.504251 30268 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.520804 30067 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:30.540460 30443 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:30.548081 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:30.548332 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:30.549394 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:30.552328 30440 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:10:30.565367 30321 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:30.567502 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.567798 30321 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:30.568290 30321 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:30.568464 24522 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.569254 30321 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.570230 30194 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.570567 30321 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:30.570816 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.563262 29885 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.565925 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:30.574018 30303 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:30.574307 29885 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.574717 30303 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.575080 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:30.576190 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:30.563551 30067 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.577481 30067 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:30.578420 30183 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.531400 30198 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.589213 24522 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:30.552551 29955 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.588656 24668 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 11.
W20260709 13:10:30.591972 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57480.3us
I20260709 13:10:30.593709 30098 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:30.593885 30124 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:30.594197 30098 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.594748 30098 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:30.596056 30402 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.596563 30155 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.594134 30388 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:30.597313 24518 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:30.602269 24516 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.602618 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:30.600435 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74846.6us
W20260709 13:10:30.603726 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 71809.5us
I20260709 13:10:30.605870 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:30.606427 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:30.601248 30388 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.607357 24673 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:30.607554 30388 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.608381 30291 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:30.608783 30291 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.534843 30352 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.607196 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:30.610939 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:30.616165 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:30.618315 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:30.620232 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.609171 30291 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.620973 24522 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:30.604372 30344 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.621963 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:30.636226 30251 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.619203 30263 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:30.636600 30251 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.636864 30263 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.637014 30251 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.623173 30260 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:30.624065 29955 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:30.638895 30260 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:30.639835 29955 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:30.639016 29954 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:10:30.640518 29955 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.623159 24673 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:30.640945 29955 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.642004 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:30.642699 30260 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.628415 29871 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.632587 30403 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:30.634406 30410 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.611836 30124 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:30.612653 29885 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:30.650902 29955 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.637432 30263 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.652691 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.654237 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:30.612010 30443 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:10:30.655506 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:30.629953 30447 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:10:30.661389 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44281.3us
I20260709 13:10:30.662391 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:30.614126 30308 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.665477 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:30.632966 30406 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.001s
I20260709 13:10:30.666414 24522 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:30.670452 30344 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.671042 30344 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.672410 30453 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:30.673346 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:30.673921 24523 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:30.672101 24516 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:30.676849 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.658545 30124 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:30.678932 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 61272.7us
I20260709 13:10:30.679623 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:30.680325 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.680826 24522 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:30.681901 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.682667 24673 raft_consensus.cc:2410] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:30.688953 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:30.690368 30303 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:30.675855 30406 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.693241 30406 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.693848 25212 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:30.674486 29885 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:30.719763 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 98868.1us
I20260709 13:10:30.720320 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:30.718851 30461 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:30.718869 30297 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:30.683854 30124 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.719147 30459 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:30.687702 30348 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.726318 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.716966 30344 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:30.736647 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.728844 30124 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.744963 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.725540 30303 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:30.748051 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.748688 24673 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:30.734593 30459 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.747771 30183 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:30.754935 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.739894 30348 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.750483 30297 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.757347 30183 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.760169 24668 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:30.761229 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.759433 30183 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.750833 30303 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:30.737206 30454 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:10:30.753633 30268 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.775938 30463 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:30.754063 30459 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:30.796589 29885 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.799499 30263 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.802470 30263 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.807659 30352 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.808362 29955 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.784849 30348 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.794926 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.813750 30044 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.814918 30339 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.815510 30339 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:30.815878 30339 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:30.819008 24517 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:10:30.819630 30395 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.004s
I20260709 13:10:30.820814 24593 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:30.821376 30121 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:30.821954 30121 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:30.822311 30121 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.822635 30121 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:30.822554 30409 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.824765 30409 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.826929 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.827896 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.828168 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:30.828812 24669 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.829450 30124 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.831090 24522 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:30.825296 30252 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:30.825587 30098 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.801780 24417 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 7 to 12, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 12 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:30.828822 24667 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:30.832247 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.775514 30303 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:30.807390 30251 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:30.833240 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 186333us
W20260709 13:10:30.834194 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 78926.8us
I20260709 13:10:30.815164 30159 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:30.843986 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.844327 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:30.845906 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:30.847515 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:30.851668 24666 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:30.884757 24665 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:30.884697 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:30.884788 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51360.3us
I20260709 13:10:30.888175 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:30.890136 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.890605 24674 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:10:30.894934 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:30.895735 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:30.899470 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 257532us
I20260709 13:10:30.816808 30339 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:30.907255 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.911581 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:30.940057 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.968025 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:30.968362 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.905691 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:30.974464 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:30.986747 24669 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:30.990926 24667 raft_consensus.cc:2368] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10.
W20260709 13:10:30.991735 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86136.3us
I20260709 13:10:30.888273 30453 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:30.848606 30260 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:30.999366 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:30.995173 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:31.002941 24600 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.992164 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:31.004328 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:30.905869 30111 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:30.997279 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:31.010937 24597 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:31.009004 30463 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:31.009939 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.010278 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.013453 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:30.999600 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 93425us
I20260709 13:10:30.906343 30454 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:31.014560 24596 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:10:31.016283 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 104789us
I20260709 13:10:30.974068 30252 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:31.014076 24595 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:30.996225 30474 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:31.045938 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:31.046876 24598 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:31.048053 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:31.012806 30339 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:31.009611 30130 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:31.015165 30308 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:31.013381 30348 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:31.010718 30111 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.082772 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.029449 24524 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:31.079324 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:31.044922 29885 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:10:31.023223 30454 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.041160 30470 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:31.025224 30252 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.023425 30409 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:31.045739 30474 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:31.162205 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 114194us
I20260709 13:10:31.171593 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:31.078567 30124 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.172771 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.175495 24598 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
W20260709 13:10:31.166491 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 87255.8us
I20260709 13:10:31.131670 30130 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.188457 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.189059 25212 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:31.162390 30111 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.150357 30348 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.160791 30454 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:31.192358 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:31.202332 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.133535 30352 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:10:31.188262 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.170465 30252 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.207971 24520 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:31.168412 30470 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:31.186259 30409 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:31.194177 30308 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:31.171900 30155 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.203092 24598 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:31.183723 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:31.175320 30410 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:31.175308 30263 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:31.130064 30067 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.188660 30130 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.205758 30348 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:31.227965 24523 consensus_meta.cc:287] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.000s
I20260709 13:10:31.220588 30470 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:31.239673 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.234627 30308 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:31.242019 30308 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:31.242617 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.243273 24520 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:31.239478 30044 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:31.240249 30251 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.245231 30044 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:31.245767 30044 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:31.247280 30388 consensus_meta.cc:287] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.000s
I20260709 13:10:31.247681 30388 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.229334 30466 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:31.249642 30469 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.250144 30469 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.252220 30469 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:31.237736 30263 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:31.253857 30263 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.184854 30453 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.258580 30067 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.234009 29955 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:31.259614 29955 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.204484 30463 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.261783 29955 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.261977 30260 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.244185 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:31.249150 30356 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.003s
I20260709 13:10:31.206579 30465 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:31.226508 30098 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:31.288424 24597 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
W20260709 13:10:31.280799 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.016s
W20260709 13:10:31.289697 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.000s	sys 0.016s
I20260709 13:10:31.267409 30044 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.267357 30474 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:31.269358 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 85750.1us
I20260709 13:10:31.236433 30109 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.274015 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.265949 30308 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.276116 24519 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:31.279557 30124 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.282636 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.160524 24417 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: config changed from index 5 to 9, term changed from 9 to 15, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to <none>, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:31.278196 24600 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:31.233880 30159 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.282474 30466 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:31.294039 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:31.196700 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 295267us
I20260709 13:10:31.281752 24523 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
W20260709 13:10:31.318388 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 656055us
I20260709 13:10:31.320158 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:31.325271 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:31.290031 30465 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.329165 24597 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:31.293587 25185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.010s
W20260709 13:10:31.331211 25185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.001s	sys 0.010s
I20260709 13:10:31.332327 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:31.274397 30254 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:10:31.334729 24520 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:31.240476 30410 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.335960 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:31.335999 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:31.338497 24593 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:31.344337 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:31.344964 24598 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.285596 30356 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.339273 30260 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:31.331568 30465 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.336989 30474 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.337399 30251 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:31.354981 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 675354us
I20260709 13:10:31.356381 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:31.341750 30388 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.358623 24525 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:31.359617 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:31.365151 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.365798 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.366809 25219 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 9: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:31.367730 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.369145 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:31.370395 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:31.371906 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:31.372684 25213 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.374437 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.375123 30044 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:31.388762 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.383900 25213 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:31.387320 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:31.408439 24598 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
W20260709 13:10:31.409683 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 53405.8us
I20260709 13:10:31.410822 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:31.408915 24597 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:31.355825 30251 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:31.415588 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.435707 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.416496 30445 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:31.416975 30159 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:31.380990 30111 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.438009 30159 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.440249 30159 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.441706 30308 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.419416 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:31.420449 30470 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.380606 30130 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.448686 29954 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:31.449235 29954 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:31.449887 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.450500 24595 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:31.450142 29954 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.451393 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.451925 24595 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:31.349677 30409 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.454234 30403 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:31.454782 30403 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.457432 24517 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:31.458721 30348 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.461508 30473 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:31.461915 30473 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:31.462004 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.462399 30473 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:31.462683 24595 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:31.463120 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:31.463819 25213 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.460747 30130 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:31.456956 30403 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.425271 30098 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:31.424443 30410 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.465229 30098 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.467478 30098 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:31.468672 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.425037 24417 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 8 to 13, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 13 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.470124 24417 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 5 to 12, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 12 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:31.428526 30263 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.471724 24417 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 10 to 11, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 11 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:31.432719 30121 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.003s
I20260709 13:10:31.418412 29885 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.431977 30404 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.473493 29885 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:31.468693 30459 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
I20260709 13:10:31.475198 30459 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.475894 29885 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.476647 30121 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.478039 25211 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:10:31.479089 30459 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.383198 30466 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:31.464669 30291 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.790s	user 0.001s	sys 0.010s
W20260709 13:10:31.480577 30303 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.001s
I20260709 13:10:31.480412 30291 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.482380 30263 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.482793 30291 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.483294 30263 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:31.483714 24672 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:31.485435 30121 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:31.446969 30461 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.382577 30356 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.487772 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.463857 24595 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:31.488418 24591 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:31.500067 30198 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:31.500733 30198 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.503252 30198 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.503809 30198 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:31.504343 30198 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.517104 24591 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:31.492777 25213 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
W20260709 13:10:31.571457 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 374704us
I20260709 13:10:31.572358 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:31.583283 30410 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:31.583794 30410 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.584201 30410 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.592509 30410 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.595057 30410 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.595852 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:31.444133 30251 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.460687 30348 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.483747 30263 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:31.619953 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 273257us
I20260709 13:10:31.627708 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.632665 24592 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:31.480966 30303 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.635247 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:31.635986 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 258810us
I20260709 13:10:31.656307 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.657104 25213 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:31.657110 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:31.613883 30291 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.584838 30198 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.670858 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.671257 24491 leader_election.cc:400] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10.
I20260709 13:10:31.674942 24491 leader_election.cc:403] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:31.679324 24595 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:31.680634 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.675069 25215 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:31.686612 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:31.695760 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:31.699540 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.699752 30395 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:31.699829 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:31.700419 25210 raft_consensus.cc:2368] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:31.700711 24670 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:31.700548 30395 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.699591 25214 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:31.703023 30488 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.703606 30488 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.705322 30111 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.706817 30454 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.708025 25216 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:31.656395 30308 raft_consensus.cc:2764] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:31.710546 24591 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:31.712704 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:31.713476 24667 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:31.716773 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 1267) took 1169 ms. Trace:
I20260709 13:10:31.664183 30260 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:31.717224 24516 rpcz_store.cc:276] 0709 13:10:30.547032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.547808 (+   776us) service_pool.cc:224] Handling call
0709 13:10:31.716601 (+1168793us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54003defd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:31.716713 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92068096}
I20260709 13:10:31.720479 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:31.721288 24417 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 11, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 11 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:31.723989 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:31.634930 30263 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:31.726788 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 222973us
I20260709 13:10:31.717926 30260 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.723363 30504 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.758028 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:31.758635 24673 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.759567 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:31.760353 24672 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.666278 30356 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:10:31.738418 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:31.751490 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.766459 24516 raft_consensus.cc:2410] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:31.753036 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.753353 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:31.769395 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.754257 25213 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:31.708535 30465 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:31.749509 30486 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:10:31.783860 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:31.752411 30252 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.001s
I20260709 13:10:31.692967 30403 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:31.762691 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:31.779520 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.779543 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.793367 24523 raft_consensus.cc:2368] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:31.793295 25214 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:31.739704 30348 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 9. Current term is 10.
I20260709 13:10:31.741936 30198 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:31.768507 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:31.786553 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:31.779548 30159 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:31.787021 30470 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.803833 30159 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.804039 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.804382 30159 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:31.804731 24523 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:31.804858 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:31.787755 25211 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:31.807180 24518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 1274) took 1258 ms (client timeout 1540 ms). Trace:
I20260709 13:10:31.786553 25210 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:31.796985 24517 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:31.794688 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:31.795397 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:31.809211 24665 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 12: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:31.809211 24600 raft_consensus.cc:2368] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:31.795776 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.791440 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.800839 25215 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.682471 30291 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.815284 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:31.812750 24593 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:31.816764 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.819386 25213 raft_consensus.cc:2368] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
W20260709 13:10:31.807611 24518 rpcz_store.cc:269] 0709 13:10:30.561518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.567223 (+  5705us) service_pool.cc:224] Handling call
0709 13:10:31.806982 (+1239759us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b540018a954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:31.807122 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66511232}
I20260709 13:10:31.823138 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 1266) took 1492 ms. Trace:
I20260709 13:10:31.823578 24525 rpcz_store.cc:276] 0709 13:10:30.330534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.549155 (+218621us) service_pool.cc:224] Handling call
0709 13:10:31.822935 (+1273780us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b540021dc54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:31.823083 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829077888}
I20260709 13:10:31.824966 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.746124 30409 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:10:31.827283 24521 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:31.830528 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:31.836944 24670 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:31.831753 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:31.832526 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:31.833444 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:31.841423 24671 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:31.791999 30356 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:31.840286 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.808048 30198 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.834995 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:31.816326 30480 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:31.849176 24525 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:31.856272 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.857017 24525 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:31.849468 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.858983 25216 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:31.852392 24666 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.859385 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.853375 30476 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:31.827047 30410 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.865371 30476 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:31.865824 30476 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.865583 30410 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.868712 30410 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.869764 30409 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:31.871604 30402 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.872316 30459 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:31.912799 30130 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.913023 30473 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.913645 30130 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.874483 30198 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:31.854606 30491 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:31.928015 30395 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:31.797703 30252 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.929576 30459 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:31.931126 30459 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.931881 30252 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:31.933277 24599 raft_consensus.cc:2368] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:31.896557 30409 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:31.934765 30409 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:31.779636 30297 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:10:31.939105 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.882308 30476 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.884153 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2146) took 1219 ms. Trace:
I20260709 13:10:31.940224 24521 rpcz_store.cc:276] 0709 13:10:30.664749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.810221 (+145472us) service_pool.cc:224] Handling call
0709 13:10:31.824498 (+1014277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.840903 (+ 16405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.883955 (+ 43052us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540021dc50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:31.884098 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331917568}
I20260709 13:10:31.885257 30109 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:31.889696 30254 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:31.893304 30356 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:31.893874 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1276) took 1248 ms. Trace:
I20260709 13:10:31.896538 24666 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:31.880694 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:31.909283 24417 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 7 to 11, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 11 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:31.937729 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.882059 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.951165 24525 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:31.945011 25215 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:31.948784 24519 rpcz_store.cc:276] 0709 13:10:30.645316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.695122 (+ 49806us) service_pool.cc:224] Handling call
0709 13:10:30.695383 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.318421 (+623038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.893547 (+575126us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54003dc7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:31.893798 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335011200}
I20260709 13:10:31.954018 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.954912 24519 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:31.847944 29885 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:10:31.961009 25215 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:31.957181 25216 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:31.957551 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.958036 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.963135 24521 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:31.959051 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.963507 25211 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:31.965569 25212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.049s	sys 0.046s
I20260709 13:10:31.959417 24670 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
W20260709 13:10:31.965976 25212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.049s	sys 0.046s
I20260709 13:10:31.948871 30409 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:31.973958 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:31.979230 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:31.980065 24519 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.945667 30109 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:31.906360 30251 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:31.984491 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.022s	sys 0.046s
W20260709 13:10:32.027122 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.022s	sys 0.046s
W20260709 13:10:32.027781 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 640531us
I20260709 13:10:32.031167 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:32.031840 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.032763 25215 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:32.034989 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:32.037122 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:32.040691 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.043742 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.044746 24593 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:32.047067 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.047775 24592 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.050251 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:32.052812 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 1862) took 1040 ms. Trace:
I20260709 13:10:31.984257 30395 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.053489 24637 leader_election.cc:400] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:32.059870 24637 leader_election.cc:403] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:32.055675 24599 rpcz_store.cc:276] 0709 13:10:31.012195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.045226 (+ 33031us) service_pool.cc:224] Handling call
0709 13:10:32.041467 (+996241us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540002dfd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:32.052740 (+ 11273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788205824}
I20260709 13:10:31.961447 30254 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.056838 24593 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:32.058135 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:32.061771 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.062611 25215 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.052119 30109 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.064206 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:32.064419 30109 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:32.066215 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.066794 25216 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:32.068619 24525 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:32.069968 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.070648 24600 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.073380 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.074144 24596 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:32.074929 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.075546 24595 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:32.077019 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:32.077877 24594 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:32.079398 30251 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:32.081497 30476 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:32.075515 24672 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:32.085250 24518 raft_consensus.cc:2368] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:32.087937 30254 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:32.063041 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.092298 24593 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.094736 24595 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:32.111196 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.142390 24595 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:32.110448 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:32.132366 24600 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:32.143493 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.144717 25215 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
W20260709 13:10:32.116285 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52138.8us
I20260709 13:10:32.148934 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:32.108523 24673 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:32.061898 29955 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:32.154497 24593 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:32.155071 24592 raft_consensus.cc:2410] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:10:32.156960 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:32.151096 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 344796us
W20260709 13:10:32.163178 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.160023 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:32.155690 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.170027 24596 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:10:32.171331 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:32.172873 24593 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:32.173094 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.130765 30124 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:32.126850 30488 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:32.090489 30395 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:32.203826 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.130308 30494 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:32.154709 30348 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:32.243734 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 72499.8us
I20260709 13:10:32.185375 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:32.264981 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.341842 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.345243 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:32.346305 24597 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:32.187615 29955 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:32.353569 29955 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.356277 29955 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:32.359225 29954 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:32.359560 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1270) took 1153 ms. Trace:
I20260709 13:10:32.359861 29954 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:32.360132 25212 rpcz_store.cc:276] 0709 13:10:31.206241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.207391 (+  1150us) service_pool.cc:224] Handling call
0709 13:10:31.210304 (+  2913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.286096 (+ 75792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.286132 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.330324 (+ 44192us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.027217 (+696893us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:32.027262 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.028154 (+   892us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.359265 (+331111us) raft_consensus.cc:1685] finished
0709 13:10:32.359295 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.359470 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52089,"raft.queue_time_us":45738,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":22367,"thread_start_us":614608,"threads_started":1,"wal-append.queue_time_us":806188}
I20260709 13:10:32.362186 29954 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:32.362524 30403 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:32.363279 30403 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:32.365864 30403 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:32.356945 29955 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.367168 29955 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:32.181102 30067 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:32.372027 24639 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.057s	sys 0.068s
W20260709 13:10:32.373373 24639 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.058s	sys 0.068s
I20260709 13:10:32.373624 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.379881 25212 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:32.269531 30496 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:32.383297 25216 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
W20260709 13:10:32.378671 24669 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.010s	sys 0.031s
W20260709 13:10:32.384544 24669 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.010s	sys 0.031s
I20260709 13:10:32.172605 30388 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:32.380026 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 864582us
I20260709 13:10:32.171746 30402 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:32.385921 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 200646us
W20260709 13:10:32.389828 24524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2142) took 1732 ms (client timeout 2093 ms). Trace:
I20260709 13:10:32.390365 25182 leader_election.cc:400] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:32.390792 25182 leader_election.cc:403] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:10:32.390407 24524 rpcz_store.cc:269] 0709 13:10:30.657356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.665659 (+  8303us) service_pool.cc:224] Handling call
0709 13:10:32.389589 (+1723930us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54003de5d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:32.389753 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809431808}
I20260709 13:10:32.396446 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:32.397552 25182 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:32.404465 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:32.180260 30497 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:32.250593 30498 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.204s
I20260709 13:10:32.417200 29955 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:32.417798 29955 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.418280 29955 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:32.420747 29955 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:32.406754 30111 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:32.423672 30130 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:32.339171 24417 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 11 to 13, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 13 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:32.343861 30494 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:32.403275 30260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.013s	sys 0.032s
I20260709 13:10:32.426812 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.428488 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.429498 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.430152 30454 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:32.430299 30498 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:32.431711 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.482285 25210 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:32.432842 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.482904 24593 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:32.433266 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.433622 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:32.483982 24524 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:32.434113 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.434350 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.485052 24597 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:32.485224 25215 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.434960 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.435915 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.387212 30388 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:32.388213 30263 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 13:10:32.388463 30487 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:32.438031 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:32.438290 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:32.413215 30339 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:32.439052 30474 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:32.386775 30356 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:32.403839 30479 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.018s	sys 0.034s
W20260709 13:10:32.443146 30512 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:10:32.413998 30462 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:32.443346 30522 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:32.451365 30497 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:32.456235 25212 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
W20260709 13:10:32.456995 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 71940.2us
W20260709 13:10:32.463636 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 47921.1us
I20260709 13:10:32.504558 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.488129 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.488294 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.489217 25218 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.410077 30496 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:32.492741 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.508729 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:32.481395 30260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.013s	sys 0.032s
I20260709 13:10:32.501019 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:32.501639 30479 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.018s	sys 0.035s
I20260709 13:10:32.494570 30339 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.483242 30498 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:32.509419 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.511052 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:32.508245 30159 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.703s	user 0.006s	sys 0.006s
I20260709 13:10:32.512794 30487 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:32.513841 30505 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.640s	user 0.003s	sys 0.003s
I20260709 13:10:32.533015 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.542537 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.543406 25213 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.514647 25214 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.504208 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.544432 25216 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:32.517153 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.518508 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.521000 25212 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 11: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.460191 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:32.545536 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 85419.6us
I20260709 13:10:32.546160 25219 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:10:32.546458 24519 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:10:32.503229 30462 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.527247 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.528255 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:32.528575 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.529145 24597 raft_consensus.cc:2410] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:10:32.532967 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:32.533553 24596 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:32.503334 30520 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:10:32.537772 30388 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:32.539191 30497 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.562132 25211 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:32.493661 30263 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.559075 25218 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.541499 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.541908 30395 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:32.557955 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.591454 25215 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:32.589215 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.518602 30254 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:32.540617 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:32.594935 25215 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:32.595283 24600 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:32.594925 25211 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:32.505646 30454 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:10:32.559671 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.541321 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:32.520540 30339 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.540001 24417 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 2 to 11. New cstate: current_term: 11 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:32.605041 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.586665 30488 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:32.527269 30409 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.001s
I20260709 13:10:32.592329 25214 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
W20260709 13:10:32.583864 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55684.7us
I20260709 13:10:32.611217 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:32.611809 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.529932 30098 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:10:32.527330 30522 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:32.586419 30109 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:10:32.557741 30462 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.578542 24593 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:32.589694 30260 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:32.608807 25215 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:32.559005 24519 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:32.589017 30493 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:10:32.541543 30496 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.542879 30159 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.613978 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.623387 24490 leader_election.cc:400] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:32.623324 25218 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:32.594777 30130 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.659168 25214 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.659533 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.608301 30488 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.657406 24490 leader_election.cc:403] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:32.604183 30520 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:32.532296 30067 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:32.614506 30494 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:32.657454 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.614185 30404 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:32.660324 24673 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:32.662362 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.674716 25216 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:32.632434 24667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.012s	sys 0.014s
W20260709 13:10:32.675218 24667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.013s	sys 0.014s
I20260709 13:10:32.603955 30254 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:32.664062 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 51262.1us
I20260709 13:10:32.665617 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.653704 30260 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:32.667536 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.632187 30522 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:32.561188 30498 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.673828 30403 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.674795 25217 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.714946 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2053) took 1026 ms. Trace:
W20260709 13:10:32.661038 30504 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.870s	user 0.004s	sys 0.007s
I20260709 13:10:32.666229 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:32.719713 24665 raft_consensus.cc:2368] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
W20260709 13:10:32.676544 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 236433us
I20260709 13:10:32.677348 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:32.666839 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.680424 24674 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:32.663121 30488 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:32.690763 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.692941 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.725231 24666 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:32.680112 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:32.721944 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:32.681934 30404 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:32.662937 30520 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:32.672101 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:32.721812 24673 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:32.738867 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.735773 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.739804 25214 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 14: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:32.714615 30198 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.794s	user 0.010s	sys 0.002s
I20260709 13:10:32.728626 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:32.743685 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57909.5us
W20260709 13:10:32.694051 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 240132us
I20260709 13:10:32.750109 24672 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:32.715376 24669 rpcz_store.cc:276] 0709 13:10:31.689035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.694087 (+  5052us) service_pool.cc:224] Handling call
0709 13:10:31.694476 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.694773 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:32.385177 (+690404us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.714594 (+329417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.714649 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:32.714704 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.714769 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.714890 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18161,"prepare.queue_time_us":820539,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":23977,"thread_start_us":856777,"threads_started":2}
I20260709 13:10:32.754191 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.661567 30130 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.735559 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:32.729239 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.758787 25215 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:32.674927 30067 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.761360 24666 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:32.735517 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:32.761641 24673 raft_consensus.cc:2410] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:10:32.741520 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 69524.3us
I20260709 13:10:32.720885 30504 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:32.755537 24668 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:32.737520 30498 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:32.755471 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.759207 24671 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:32.758826 24665 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.740614 30494 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:32.771921 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.746477 30198 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.742329 30109 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:32.759948 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.764818 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:32.784099 25211 raft_consensus.cc:2368] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
I20260709 13:10:32.767983 24668 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:32.784242 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:32.784721 25215 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:32.736287 30476 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:10:32.763572 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:32.819561 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56087.2us
W20260709 13:10:32.787674 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 210333us
I20260709 13:10:32.820312 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:32.752074 30263 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:32.824644 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:32.822535 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:32.827323 24523 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:32.829859 24670 raft_consensus.cc:2368] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
I20260709 13:10:32.819103 24668 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.850737 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:32.851346 25210 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:32.852085 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:32.855283 30524 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:10:32.820062 30494 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:32.861671 25185 leader_election.cc:400] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
I20260709 13:10:32.895435 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:32.893693 24665 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:32.827092 30527 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:32.828456 30459 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:32.827414 30303 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:32.896181 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 71374.2us
I20260709 13:10:32.903539 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:32.900905 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:32.895736 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:32.906718 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:32.907773 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:32.908412 24519 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:32.857332 30109 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:32.856884 29955 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:10:32.912096 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:32.913916 24519 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:10:32.915661 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:32.919003 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 88597.9us
I20260709 13:10:32.898355 30395 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:32.920154 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:32.900403 30527 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.900321 30459 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.933681 30542 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:32.904899 30159 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:32.827451 30260 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.911217 30476 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:32.984826 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.829192 30520 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:32.909992 30538 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:32.913127 30109 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:33.005501 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 93449.6us
I20260709 13:10:32.935148 30527 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.962363 30459 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.752677 24417 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 11 to 14, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 14 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:32.993013 30121 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:32.991945 30529 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.026577 25211 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:32.998716 30254 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.012882 30493 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.008496 30395 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:33.043905 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.066788 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:33.040231 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2149) took 1224 ms. Trace:
I20260709 13:10:33.067750 24518 rpcz_store.cc:276] 0709 13:10:31.818340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.820485 (+  2145us) service_pool.cc:224] Handling call
0709 13:10:33.040041 (+1219556us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003de0d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:33.040173 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495229184}
I20260709 13:10:33.022378 30473 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:33.022318 30538 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.906577 30404 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.025168 30109 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:33.076750 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 175905us
I20260709 13:10:33.066988 30520 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:33.091229 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 170974us
I20260709 13:10:33.091733 30465 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:33.075081 30254 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:33.095558 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:33.105196 24594 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:33.105973 24490 leader_election.cc:400] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:33.077852 30538 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:33.096206 30530 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:10:33.115972 30537 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:10:33.117590 30547 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:10:33.121722 30536 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:10:33.075716 30494 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.123382 30522 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.105259 30402 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:10:33.129045 30473 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:33.129333 30553 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:33.129611 30473 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.130249 30553 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:33.131729 30473 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:33.133208 30067 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.134001 30550 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:33.134373 30550 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:33.134819 24594 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:33.135488 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:33.136224 24597 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:33.069145 30493 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.106539 24490 leader_election.cc:403] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:33.112521 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:33.105101 25210 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
W20260709 13:10:33.151427 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45591us
I20260709 13:10:33.113260 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:33.151445 24599 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:33.152841 24490 leader_election.cc:400] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
I20260709 13:10:33.153159 24490 leader_election.cc:403] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:33.149283 24591 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:33.154084 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:33.162732 24596 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:33.106091 30254 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.170466 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.097572 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:33.175791 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:33.183908 30111 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.722s	user 0.006s	sys 0.005s
I20260709 13:10:33.184525 30111 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15.
W20260709 13:10:33.187918 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 281253us
W20260709 13:10:33.188306 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 90831.3us
I20260709 13:10:33.163390 29954 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:33.165669 30348 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.172806 30254 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:33.198669 30297 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:33.199105 30297 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:33.199973 30297 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.192037 30111 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:10:33.202713 30409 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:33.203140 30409 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:33.203413 30109 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.203996 30409 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:33.205384 30528 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
I20260709 13:10:33.206501 30291 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.206651 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2059) took 1394 ms. Trace:
I20260709 13:10:33.206904 30348 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
W20260709 13:10:33.210212 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 1.0278e+06us
I20260709 13:10:33.211042 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:33.211653 30254 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.212296 24491 leader_election.cc:400] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
W20260709 13:10:33.172791 30462 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 13:10:33.213433 29954 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.213186 30462 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.192068 30551 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:10:33.214705 30508 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:33.214783 30551 consensus_queue.cc:1243] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:33.215335 30508 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.217391 30508 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.221309 30526 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:33.221815 30526 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:33.222213 30526 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:33.222849 30463 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:33.223258 30463 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:33.224076 30463 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.226478 30388 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:33.227644 30339 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.000s
I20260709 13:10:33.228045 30339 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.229156 25212 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:33.229313 24417 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 9 to 11, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 11 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:33.231346 24417 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 10 to 11, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 11 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:33.232553 30098 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.233153 30098 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.235287 30554 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:33.235677 30554 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:33.235978 30098 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.236954 30067 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:33.237260 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:33.237414 30067 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:33.237831 24665 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:33.238124 30297 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:33.238389 30067 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.240085 30493 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:33.240214 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:33.170516 30198 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:33.242159 30531 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:10:33.205020 30409 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.169831 30497 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:33.243691 30497 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:33.244618 30497 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.245319 30109 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:33.207073 24667 rpcz_store.cc:276] 0709 13:10:31.812246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.812544 (+   298us) service_pool.cc:224] Handling call
0709 13:10:31.834311 (+ 21767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.846576 (+ 12265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.846621 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.939934 (+ 93313us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.675642 (+735708us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:32.675724 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.675812 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:33.206413 (+530601us) raft_consensus.cc:1685] finished
0709 13:10:33.206431 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.206569 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11762,"raft.queue_time_us":34758,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":723146,"threads_started":1,"wal-append.queue_time_us":799733}
W20260709 13:10:33.247964 30403 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.003s
I20260709 13:10:33.248360 30403 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13.
I20260709 13:10:33.255962 30542 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.165838 30402 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:10:33.258371 30339 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:33.236533 30554 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:33.259433 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.054s	user 0.039s	sys 0.053s
I20260709 13:10:33.150388 30550 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.260463 30550 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.262475 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2065) took 1226 ms. Trace:
I20260709 13:10:33.262880 24670 rpcz_store.cc:276] 0709 13:10:32.036392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.036648 (+   256us) service_pool.cc:224] Handling call
0709 13:10:33.262256 (+1225608us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540017eb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:33.262392 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820536064}
I20260709 13:10:33.150954 30474 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:10:33.264463 30130 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.264340 30474 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:33.259773 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.055s	user 0.039s	sys 0.053s
W20260709 13:10:33.267228 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 2.07477e+06us
I20260709 13:10:33.251186 25218 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:33.268399 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:33.268558 24665 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:33.192540 24599 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:33.270742 30542 raft_consensus.cc:2764] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:33.266081 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:33.189062 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:33.189858 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:33.273404 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.274091 24523 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:33.275111 24671 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:10:33.275784 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:33.276371 24673 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
W20260709 13:10:33.274322 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85345.3us
I20260709 13:10:33.277246 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:33.277544 24639 leader_election.cc:400] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:33.277915 24639 leader_election.cc:403] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:33.279500 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.279846 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.280449 24517 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:33.280158 24519 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:33.282763 24665 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:10:33.283293 24665 pending_rounds.cc:85] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 10
I20260709 13:10:33.283550 24665 pending_rounds.cc:107] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:10:33.283826 24665 raft_consensus.cc:2889] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.285800 24524 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:33.288177 24639 leader_election.cc:400] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14.
I20260709 13:10:33.289467 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.290292 24520 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:33.291327 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.289556 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:33.294242 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:33.296023 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 106413us
I20260709 13:10:33.296265 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:33.296864 24524 raft_consensus.cc:2376] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16. Re-sending same reply.
I20260709 13:10:33.296978 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:33.225064 30463 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:33.298738 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:33.299003 24520 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:33.300027 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.299608 30526 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.302299 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:33.302776 24672 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:33.340189 24670 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:33.339303 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:33.340583 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 43703.3us
I20260709 13:10:33.341208 24519 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:33.342063 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.341696 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:33.304476 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:33.303964 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.344805 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.345835 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.346437 24516 raft_consensus.cc:2368] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:33.271270 30130 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:33.266789 30474 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:33.304814 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.403067 24518 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:33.366397 24519 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:33.388806 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.354023 24523 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:10:33.394516 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:33.343120 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44424.9us
W20260709 13:10:33.384994 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 81096us
W20260709 13:10:33.386793 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45223.5us
I20260709 13:10:33.409788 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:33.232926 24417 catalog_manager.cc:5697] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 6 to 9, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 9 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.191375 30527 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.394981 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:33.406844 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:33.407428 24521 raft_consensus.cc:2410] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:10:33.302999 30291 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:33.410472 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.413600 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:33.295331 30198 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.415091 30402 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:33.435225 24639 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.663s (SENT) [suppressed 22 similar messages]
I20260709 13:10:33.415833 30557 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:33.421352 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:33.425616 24524 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:33.430477 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.395107 30543 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:33.302536 30339 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.347692 30445 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.398365 30551 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.387502 30542 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:33.415709 30552 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:33.446090 25214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.029s	sys 0.026s
W20260709 13:10:33.460544 25214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.029s	sys 0.027s
I20260709 13:10:33.450525 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:33.451342 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:33.339326 30496 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:33.415689 30488 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
I20260709 13:10:33.434638 24491 leader_election.cc:400] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
I20260709 13:10:33.466866 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:33.467288 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.467731 25216 raft_consensus.cc:2368] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:33.467650 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.468086 24595 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:33.453212 24599 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
W20260709 13:10:33.453478 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 375743us
I20260709 13:10:33.466930 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:33.469228 25210 raft_consensus.cc:2376] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10. Re-sending same reply.
I20260709 13:10:33.339623 30098 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:33.403563 30260 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.295485 30352 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.477243 30497 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:33.477716 30352 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.477185 24417 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 7 to 12, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 12 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.463491 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:33.478925 25219 raft_consensus.cc:2376] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16. Re-sending same reply.
I20260709 13:10:33.460960 29955 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.456689 30462 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:33.456496 30520 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:33.460448 30291 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:33.404183 30130 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.473488 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:33.470945 30496 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.489058 30348 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:33.471845 30488 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.470224 30542 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.490885 30496 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.491426 30488 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:33.476984 30260 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.452102 30109 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.465523 24600 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:33.480337 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.494305 30260 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.495265 24592 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:33.496933 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:33.497560 24600 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:33.471189 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:33.482056 24565 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:33.489656 30348 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:33.497678 24599 raft_consensus.cc:2368] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:33.489199 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.498360 25210 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:33.461877 30402 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:33.516258 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.527070 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:33.528446 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:33.531497 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.578117 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 97221.4us
I20260709 13:10:33.579921 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:33.481936 30552 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:33.589226 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 108949us
I20260709 13:10:33.590034 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:33.591747 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:33.592140 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63785.6us
W20260709 13:10:33.594584 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.595373 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:33.590708 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.599617 24596 raft_consensus.cc:2376] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12. Re-sending same reply.
I20260709 13:10:33.601272 25210 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:10:33.601894 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 119910us
W20260709 13:10:33.602955 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.602625 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.596727 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:33.607154 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:33.608237 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.609402 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:33.498677 30520 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:33.616680 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.587347 30260 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:33.620574 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.621665 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:33.625985 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.487751 30409 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 13:10:33.602591 30109 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:33.643893 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:33.651741 24518 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:33.598975 30124 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:33.602778 30303 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:33.647862 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.648150 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:33.657888 25213 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 LEARNER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:33.648488 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:33.606148 30488 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.487609 29955 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.588186 30496 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:10:33.612012 30542 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:33.618945 30550 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:33.605356 30502 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:10:33.606040 30551 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.611430 30497 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.656898 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:33.634727 30260 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:33.664389 25219 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:33.639395 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:33.684737 25210 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:33.667100 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:33.631295 30445 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.632793 30493 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:33.638193 30198 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:33.676271 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:33.636598 30395 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:33.679556 24599 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:33.680573 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:33.469269 30474 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.690708 30566 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:33.686726 30291 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.694196 30550 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:33.694654 30109 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.695251 30488 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.654912 30543 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:33.701311 30563 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.660530 30529 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.664680 30303 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.655082 30124 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:33.669802 30542 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.768460 24600 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:33.729169 25213 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:33.675153 30526 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:33.735659 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 139005us
W20260709 13:10:33.751891 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 126008us
I20260709 13:10:33.770444 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.690316 30098 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:33.690150 30260 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:33.760551 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 84389.3us
I20260709 13:10:33.706938 30198 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.724623 30522 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.686893 30263 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:10:33.761583 30550 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:33.782130 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.781992 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.785969 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:33.823091 24600 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:33.766585 30462 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:33.706522 30445 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.787772 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.827853 24598 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:33.687768 30551 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.790887 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:33.828987 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:33.756103 30493 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:33.771709 30527 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:33.773350 30303 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.757570 30109 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.773594 30124 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:33.773666 30542 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:33.687146 30348 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.779492 30098 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.782459 30563 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:33.784062 30198 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:33.786796 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:33.821616 30297 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:33.748437 30552 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.850049 30554 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:33.879515 30570 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.880018 30570 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.850716 30445 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:33.778301 30520 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.882198 30570 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:33.852041 30565 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:33.832746 30549 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:33.852763 30534 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:33.813606 30526 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.813738 30476 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.854848 29955 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.855592 30550 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.857048 30557 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:33.702044 30402 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:33.889494 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 278569us
I20260709 13:10:33.902838 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:33.891278 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.813755 30395 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.904152 30395 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.906855 30395 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.761464 30488 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.864825 30067 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.887239 30534 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:33.834595 30569 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.872519 30532 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.871986 30098 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:33.883503 30527 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:33.914793 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:33.865710 30493 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.872476 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:10:33.948148 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 75748.2us
I20260709 13:10:33.950425 30557 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:33.950619 24591 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:33.950850 30557 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:33.951220 30557 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:33.952868 30493 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:33.953743 30459 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.884s	user 0.010s	sys 0.000s
I20260709 13:10:33.954054 24597 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:33.954121 30459 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.955430 30527 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:33.956261 30459 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.956377 30527 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.921379 24594 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:33.922528 30534 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.923002 30109 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.907670 30476 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.900238 30526 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.925637 24417 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 8 to 12, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 12 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:33.909616 29955 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:33.930069 30551 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:33.930394 30538 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.000s
I20260709 13:10:33.940119 30569 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:33.941248 30532 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.944312 30488 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.848850 30543 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:33.889712 30130 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:33.981866 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:33.949499 30573 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:33.918114 30409 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:34.006361 30534 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:33.985389 24518 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:33.996703 24597 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:10:34.016685 24597 pending_rounds.cc:85] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 10
I20260709 13:10:34.016978 24597 pending_rounds.cc:107] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:10:34.017227 24597 raft_consensus.cc:2889] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.960223 30493 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.983707 30502 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:33.995880 29955 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:34.034215 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52474.4us
I20260709 13:10:34.019761 30493 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:34.020797 30124 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:34.027827 30569 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.029313 24417 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 10 to 11, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 11 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:10:34.031339 30388 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.804s	user 0.007s	sys 0.002s
I20260709 13:10:34.037351 29955 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.035112 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:34.008924 30538 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.012060 30573 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:34.039230 30130 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:34.056862 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 227965us
I20260709 13:10:34.060585 24591 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:34.061939 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:34.064594 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:34.056281 30573 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:34.070475 30538 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.074765 30124 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.075493 30567 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.076246 30567 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.077904 24639 leader_election.cc:400] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:34.080535 24639 leader_election.cc:403] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.078115 30459 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:34.078037 24417 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 7 to 12, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 12 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:34.037516 30502 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:34.089035 24417 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 10 to 14, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 14 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.090375 30502 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.090989 30526 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:34.091640 30526 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:34.093331 30476 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.047266 24597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:34.095312 24597 raft_consensus.cc:606] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:34.096431 30532 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.096493 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.102305 30493 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.104027 30352 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.112576 30459 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:34.116456 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.119884 24591 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:34.119917 30532 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:34.043655 30542 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.127785 25210 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:34.118716 30554 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.122443 30260 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.129880 30554 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:34.090909 24417 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 7, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 7 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.131520 30260 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.131299 24417 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:34.131886 30554 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.141671 30303 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.114157 30459 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.146522 25214 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:10:34.146512 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.147068 25214 pending_rounds.cc:85] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 11
I20260709 13:10:34.147326 25214 pending_rounds.cc:107] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:10:34.147284 25211 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:34.147728 25214 raft_consensus.cc:2889] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.148789 30575 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:34.149353 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.149973 25214 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:10:34.150192 25215 raft_consensus.cc:2410] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:34.150315 25214 pending_rounds.cc:85] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 12
I20260709 13:10:34.150561 25214 pending_rounds.cc:107] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:10:34.150770 25214 raft_consensus.cc:2889] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.152544 25211 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:34.154130 24417 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 4 to 12. New cstate: current_term: 12 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.155645 29955 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:34.159020 30303 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.166342 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.172358 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.172976 25215 raft_consensus.cc:2376] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16. Re-sending same reply.
I20260709 13:10:34.122352 30532 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.183897 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.184729 24597 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:34.178793 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:34.176267 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.180780 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.187808 25216 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:34.187145 25214 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:34.189985 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.191537 24595 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:34.192502 30498 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:34.197371 30388 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:34.198213 29955 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:34.199271 30388 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:34.202131 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.202139 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:34.206089 24592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2164) took 1674 ms (client timeout 2020 ms). Trace:
W20260709 13:10:34.206590 24592 rpcz_store.cc:269] 0709 13:10:32.528152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.528291 (+   139us) service_pool.cc:224] Handling call
0709 13:10:34.202773 (+1674482us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54001ecdd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:34.202902 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152292096}
I20260709 13:10:34.206800 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:34.207861 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.208055 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:34.208820 25216 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:34.210070 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:34.210600 25216 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.208482 24592 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:34.120731 24637 leader_election.cc:400] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:34.217936 24637 leader_election.cc:403] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.204030 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:34.220242 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 99646.6us
I20260709 13:10:34.220929 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:34.224748 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.225456 24597 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:34.225526 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.231870 25216 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:34.233045 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.236585 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:34.204421 30497 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:34.240127 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:34.242187 30459 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:34.248641 30573 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.250247 24596 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:34.252691 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.255126 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.255954 24591 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:34.224428 30352 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:34.257050 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.260330 24597 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:34.245734 24592 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:34.224104 30567 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:34.257297 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.263470 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.241258 30303 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.274892 25216 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:34.243960 30130 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:34.269764 30542 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.271373 30532 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.273063 30254 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.242106 30497 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:34.290771 30497 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.293375 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.293972 24597 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.294350 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1657) took 1849 ms. Trace:
I20260709 13:10:34.282380 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.295269 24591 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:34.286582 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:34.295672 25214 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:10:34.296314 25217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1254) took 2056 ms (client timeout 2218 ms). Trace:
W20260709 13:10:34.296741 25217 rpcz_store.cc:269] 0709 13:10:32.239935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.240210 (+   275us) service_pool.cc:224] Handling call
0709 13:10:34.296104 (+2055894us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540060b3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:34.296235 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763479296}
I20260709 13:10:34.286485 30557 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.260787 29955 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:34.259598 30352 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:34.294759 25212 rpcz_store.cc:276] 0709 13:10:32.444757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.596638 (+151881us) service_pool.cc:224] Handling call
0709 13:10:32.596974 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.229576 (+632602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.294094 (+1064518us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003372d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:34.294288 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453284096}
I20260709 13:10:34.258968 30459 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.305976 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.313994 30352 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.318877 30098 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:34.319766 30568 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:34.320174 30568 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:34.314981 30459 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.316620 25214 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:34.323390 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.326370 24518 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:34.329252 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.331012 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.332042 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.363255 24524 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.363422 24591 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:34.301733 30130 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:34.333767 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.335935 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.321661 29955 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:34.343122 30124 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.381031 24524 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:34.343852 30263 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.345347 30352 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.350340 30557 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.356047 30497 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:34.358673 30562 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.921s	user 0.003s	sys 0.000s
I20260709 13:10:34.359664 24668 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.389119 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.389252 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.389489 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1285) took 1643 ms. Trace:
I20260709 13:10:34.371182 24520 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.327852 30098 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:34.374943 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.383353 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.383543 24594 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:34.391480 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.397339 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.398211 24673 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:34.384024 24597 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:34.388161 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.305584 30573 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.399911 24669 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:34.389894 25218 rpcz_store.cc:276] 0709 13:10:32.747609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.753466 (+  5857us) service_pool.cc:224] Handling call
0709 13:10:34.389331 (+1635865us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540066c954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:34.389437 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883388672}
I20260709 13:10:34.402681 24671 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:34.372646 30402 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.404968 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.407557 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.408468 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.411572 24665 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:34.414250 24667 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:34.417150 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:34.405136 30198 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:10:34.389920 30263 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.424038 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.424392 30130 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.320981 30568 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.440920 24520 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:34.441509 29955 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.455986 30348 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:34.470103 30497 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.470403 30348 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:34.471230 30352 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.412861 30402 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.472024 30263 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.458573 24665 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:34.385746 30124 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:34.471040 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.466511 24668 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:34.483562 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1333) took 1760 ms. Trace:
I20260709 13:10:34.486110 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.474501 30402 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.473313 30459 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.484555 24668 rpcz_store.cc:276] 0709 13:10:32.723587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.728783 (+  5196us) service_pool.cc:224] Handling call
0709 13:10:32.743605 (+ 14822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.359062 (+1615457us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540029f7a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebba1d 00007f17bbea21a4 00007f17bbf24447 00007f17bbf3cfe7 00007f17bbf3e7de 00007f17bbf48b49 00007f17bbf49416 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419
0709 13:10:34.483286 (+124224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.483504 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245374848}
I20260709 13:10:34.473058 30348 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:34.492520 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 74032.5us
I20260709 13:10:34.496853 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.497625 24599 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:34.497498 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.485792 30568 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.468183 30198 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.505885 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.508072 25210 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:34.506902 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:34.510535 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:34.510802 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.512436 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.513204 24599 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:34.511479 24667 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:34.514823 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.515635 25210 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:34.518191 30198 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.519014 24665 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:34.519043 24594 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:34.519789 24597 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:34.524183 30595 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:34.524572 24525 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:34.524874 30595 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.526567 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2169) took 1238 ms. Trace:
I20260709 13:10:34.526952 24525 rpcz_store.cc:276] 0709 13:10:33.288199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.288426 (+   227us) service_pool.cc:224] Handling call
0709 13:10:33.288710 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.524413 (+1235703us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b54001cc8a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebddc0 00007f17bbf481c0 00007f17bbf49231 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c
0709 13:10:34.525059 (+   646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.526328 (+  1269us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b540021dc54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:34.526504 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30834304}
I20260709 13:10:34.527561 30595 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.532575 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.533208 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.533456 30348 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:34.533615 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.533864 30348 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.534312 30348 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:34.534514 30356 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:34.534974 30356 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.535264 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.535883 24670 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:34.536033 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.536715 24668 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:34.536768 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.537521 24666 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.541489 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:34.542340 24673 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:34.544018 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:34.541501 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.544880 30453 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:34.545270 24671 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:34.545514 30453 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:34.545845 30476 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:34.535382 30356 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:34.533974 24667 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:34.548427 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.549428 24670 raft_consensus.cc:2410] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:34.554054 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.555001 29885 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:34.555656 29885 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:34.557850 30297 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:34.558386 30297 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.560451 30498 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.561098 30498 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
W20260709 13:10:34.563884 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.565948 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:34.566780 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.567975 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.568625 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.563817 30498 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.581635 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.587893 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.569200 24523 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:34.583438 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.591355 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.592221 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.592389 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.593073 24519 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:34.584255 24666 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:34.593319 25184 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.600705 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.602317 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.613885 24516 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:34.596796 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.614449 24599 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:34.614512 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.560928 30297 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.615095 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.583144 30474 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:34.599354 30476 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:34.626739 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.628254 25217 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:34.602524 30453 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:34.613729 30468 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:34.630119 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.632388 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:34.602239 30520 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:34.611874 30532 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:34.643656 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.637040 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.637631 24599 raft_consensus.cc:606] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:34.646059 24599 raft_consensus.cc:614] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:34.634382 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.648463 24666 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:34.648898 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.645499 24517 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:34.556740 29885 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.654326 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:34.627291 30459 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.636732 30453 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.671339 24666 pending_rounds.cc:85] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 7
I20260709 13:10:34.671759 24666 pending_rounds.cc:107] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:10:34.672061 24666 raft_consensus.cc:2889] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:34.658692 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.689275 24599 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:34.692380 24672 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:10:34.643760 30520 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:34.678701 24593 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:34.644003 30532 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.710986 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.712528 24593 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:34.715351 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.685714 30453 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.739933 24593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:34.740584 24593 raft_consensus.cc:606] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:34.741030 24593 raft_consensus.cc:614] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:34.739084 30124 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.713807 30532 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:34.669100 30356 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.695787 30520 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:34.727625 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 79812.9us
I20260709 13:10:34.753894 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.725821 30404 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.763855 30404 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:34.739179 30573 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:34.771101 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 177834us
I20260709 13:10:34.772207 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.779773 24517 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:34.747368 30462 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:34.757294 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.717430 30563 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:10:34.744208 30476 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:10:34.797031 30356 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:34.798818 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.799690 24674 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:34.803507 30404 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:34.775921 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.809895 24595 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:34.810278 24521 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.777423 24667 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:34.787179 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.787262 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.816010 25212 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:10:34.788288 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.780603 30462 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.793486 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.816373 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:34.793862 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.804184 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:34.807471 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.808159 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:34.819751 25218 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:34.820178 24600 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:34.818645 24599 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:34.805682 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.821982 24674 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:34.823962 24593 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:34.798842 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:34.837508 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:34.776911 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 153850us
I20260709 13:10:34.837939 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:34.838274 25218 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 12 LEARNER]: Advancing to term 14
I20260709 13:10:34.832643 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:34.852491 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.853945 24598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:34.854666 24598 raft_consensus.cc:606] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:34.855093 24598 raft_consensus.cc:614] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:34.855149 25219 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:34.862658 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.858337 25218 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 LEARNER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:34.864370 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:34.824697 30462 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:34.888722 24672 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:34.894533 24517 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
W20260709 13:10:34.853292 30561 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.416s	user 0.004s	sys 0.000s
I20260709 13:10:34.890682 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:34.783013 30573 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.901540 24672 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:34.848109 30468 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:34.892194 30356 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.864323 30254 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:34.888213 30404 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:34.919301 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:34.912331 30608 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.983599 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:34.965937 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46704.9us
W20260709 13:10:35.007753 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:34.965931 30559 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.524s	user 0.006s	sys 0.000s
W20260709 13:10:34.990207 30602 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:10:35.047854 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 399012us
I20260709 13:10:35.053028 24517 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:34.919416 30476 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:35.051309 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:34.978679 30610 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:35.053891 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.974388 30563 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.075448 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 239268us
I20260709 13:10:34.983080 24666 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:34.918150 30254 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:35.054236 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 237936us
I20260709 13:10:35.059154 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:35.060117 24637 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:34.982878 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:35.063724 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:35.065109 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.918221 29954 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.066846 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:34.917618 30504 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 13:10:35.090025 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:34.992278 24667 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:35.069151 24523 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:34.985375 30404 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:35.070225 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:34.985636 30508 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:35.070577 24598 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:35.014621 24521 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:35.093201 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:34.974759 30611 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:35.068481 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 206407us
I20260709 13:10:34.985697 30067 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:34.965049 30496 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
W20260709 13:10:35.075639 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 211407us
I20260709 13:10:35.079191 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:35.110669 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:35.111069 24599 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:34.991436 30402 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:10:35.084088 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:35.112782 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:34.974380 29885 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:10:35.087131 25218 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:35.118134 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:35.087987 24673 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:35.088439 24674 raft_consensus.cc:2368] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:34.963800 30356 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:34.964664 30124 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:10:35.067885 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:35.069607 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:35.121609 24525 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:34.984599 24665 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:35.099591 25219 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:35.099749 24516 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:35.068717 30476 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:35.087369 30573 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.105446 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:35.106813 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:35.074594 30532 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.086319 30254 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:35.078285 30453 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.136411 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:35.112166 30534 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:35.112036 30611 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:35.113960 24593 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:35.117410 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:35.068019 30502 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:10:35.114252 30566 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:35.120186 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:35.166368 24673 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:35.079945 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:35.088812 30568 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.062325 30608 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.108378 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:35.126030 30459 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.099457 30508 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:35.081810 30563 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:35.148154 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85254.5us
I20260709 13:10:35.123150 29954 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:34.981702 30468 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.126634 29955 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:35.129513 30476 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:35.152473 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:35.159003 24666 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
W20260709 13:10:35.167469 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 87615.3us
W20260709 13:10:35.168278 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61577.7us
I20260709 13:10:35.170271 25216 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 12. Ops: []
W20260709 13:10:35.170477 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 102667us
I20260709 13:10:35.177922 30568 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.173660 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3356) took 2250 ms. Trace:
I20260709 13:10:35.114188 30067 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.140829 30573 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.204449 24665 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:35.205463 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:35.189373 25210 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:35.169364 30619 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.240203 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 124534us
I20260709 13:10:35.169806 30297 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:35.202996 24522 rpcz_store.cc:276] 0709 13:10:32.914865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.914991 (+   126us) service_pool.cc:224] Handling call
0709 13:10:32.992252 (+ 77261us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:33.004190 (+ 11938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.004239 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:33.015318 (+ 11079us) log.cc:844] Serialized 52 byte log entry
0709 13:10:33.282348 (+267030us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:33.282398 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.282468 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:34.766077 (+1483609us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:35.154987 (+388910us) raft_consensus.cc:1685] finished
0709 13:10:35.155012 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.165433 (+ 10421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":766,"raft.queue_time_us":140,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":11996,"spinlock_wait_cycles":32154880,"thread_start_us":202452,"threads_started":1,"wal-append.queue_time_us":368992}
I20260709 13:10:35.180243 24673 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:35.195763 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:35.214478 24593 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:35.195600 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:35.281318 24600 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.191975 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:35.194564 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:35.283511 24520 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.283638 24599 raft_consensus.cc:606] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:35.284261 24599 raft_consensus.cc:614] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:35.228076 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 164438us
W20260709 13:10:35.182710 30474 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.001s
W20260709 13:10:35.184543 30616 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:10:35.139525 30617 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
W20260709 13:10:35.285228 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 79846.7us
I20260709 13:10:35.179661 30508 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:35.194434 30592 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.607s	user 0.006s	sys 0.004s
I20260709 13:10:35.199347 30461 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:35.190929 30608 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:35.293072 30598 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:10:35.183858 30453 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:35.307232 25210 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:35.174553 29885 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:10:35.198335 30568 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.194115 30404 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:35.185369 29955 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:35.183457 30631 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:35.301502 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 99984.1us
I20260709 13:10:35.240351 30620 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:35.195297 30532 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:35.278553 30260 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
I20260709 13:10:35.332588 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:35.276136 30573 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.307649 30251 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:35.340829 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:35.342177 25213 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:35.206610 30124 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260709 13:10:35.298652 30534 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:35.367583 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58803.5us
I20260709 13:10:35.201006 30520 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.369876 30621 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:35.373320 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:35.378142 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 254230us
I20260709 13:10:35.329625 25215 raft_consensus.cc:2410] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:35.421985 24593 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:35.300951 24520 raft_consensus.cc:2410] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:10:35.331992 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.368134 30348 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.002s
I20260709 13:10:35.201828 30459 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.331234 30461 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:35.385820 30597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.010s	sys 0.036s
I20260709 13:10:35.409981 24600 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:35.401227 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:35.416368 30631 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.423585 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.428043 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.282783 30619 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.434191 24593 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
W20260709 13:10:35.436198 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 244297us
I20260709 13:10:35.462059 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:35.462303 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:35.431391 29954 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:35.418303 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1308) took 1217 ms. Trace:
I20260709 13:10:35.454753 25212 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:35.415894 30629 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.435254 29885 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.451591 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 78970.2us
I20260709 13:10:35.407815 30620 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:35.456976 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 261267us
I20260709 13:10:35.442231 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:35.422173 30297 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.459645 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 184574us
W20260709 13:10:35.440028 30597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.010s	sys 0.036s
I20260709 13:10:35.440213 30633 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:35.464174 25214 rpcz_store.cc:276] 0709 13:10:34.201176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.322602 (+121426us) service_pool.cc:224] Handling call
0709 13:10:34.322963 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.323316 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.323345 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.323777 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:10:34.467318 (+143541us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:34.467378 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.467470 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.193907 (+726437us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:35.400453 (+206546us) raft_consensus.cc:1685] finished
0709 13:10:35.400474 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.418195 (+ 17721us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4216,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4902,"spinlock_wait_cycles":12156288,"thread_start_us":129067,"threads_started":1,"wal-append.queue_time_us":172599}
I20260709 13:10:35.551555 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:35.544597 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 212146us
I20260709 13:10:35.562844 24669 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:10:35.551806 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:35.563403 24667 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:35.564364 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 95757us
I20260709 13:10:35.547853 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:35.566362 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:35.570168 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:35.570930 24593 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:35.570999 25217 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:35.545200 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:35.572759 25217 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:35.609120 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:35.646744 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:35.604719 30459 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.572978 24667 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:35.629820 24519 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:35.643625 24522 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:35.584142 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:35.633314 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:35.614883 30553 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:35.618571 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1281) took 1061 ms. Trace:
I20260709 13:10:35.679039 25216 rpcz_store.cc:276] 0709 13:10:34.574463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.574613 (+   150us) service_pool.cc:224] Handling call
0709 13:10:34.611071 (+ 36458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.194762 (+583691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.618294 (+423532us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540066bf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:35.618509 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285571968}
I20260709 13:10:35.611928 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:35.680652 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 1339) took 1033 ms. Trace:
I20260709 13:10:35.680996 24674 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:35.642768 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:35.645299 24516 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:35.682632 24565 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:35.582572 30404 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:35.684033 30404 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:35.685295 30404 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.686929 30404 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:35.691817 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 127910us
I20260709 13:10:35.681195 24670 rpcz_store.cc:276] 0709 13:10:34.646927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.583799 (+936872us) service_pool.cc:224] Handling call
0709 13:10:35.680139 (+ 96340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:35.647553 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:35.616755 30612 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.460s	user 0.001s	sys 0.004s
I20260709 13:10:35.619217 30130 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.650249 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:35.561359 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:35.467147 30621 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.721801 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:35.722728 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:35.734305 24666 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.433526 30348 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.739007 30348 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.739955 24524 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:35.726469 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:35.729480 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:35.746414 30468 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:35.746860 30468 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:35.742167 30251 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:35.747761 30468 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.749150 30563 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.748976 30251 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.749679 30563 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.750262 30563 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.750561 30124 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.549611 30356 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.557814 29954 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:35.734158 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:35.754325 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 278642us
I20260709 13:10:35.690264 30629 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.678463 30553 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:35.690682 30633 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.785501 24639 leader_election.cc:400] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:35.777098 24591 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:35.785912 24639 leader_election.cc:403] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:35.811949 24666 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 12.
I20260709 13:10:35.838498 30459 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13.
I20260709 13:10:35.749629 30665 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:35.559058 30532 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.203s
I20260709 13:10:35.543807 30643 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.305s
I20260709 13:10:35.838570 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:35.879205 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49888.1us
I20260709 13:10:35.557997 29885 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.759737 30628 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.462100 30631 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.690062 30297 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.767623 30067 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.783494 30635 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.899482 30635 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.900988 30629 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.901206 30297 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:35.901612 30635 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:35.901945 30297 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:35.902429 30297 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:35.732935 30502 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:10:35.857409 30620 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:35.903309 30297 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.816676 30632 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:35.463804 29955 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:35.904865 30658 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:35.743647 30595 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 13:10:35.813612 30356 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:35.826012 30608 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:35.824389 30557 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.851266 30625 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.558s	user 0.001s	sys 0.000s
I20260709 13:10:35.815078 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:35.733676 30130 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.816341 30633 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:35.870592 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3361) took 1303 ms. Trace:
I20260709 13:10:35.937990 24524 rpcz_store.cc:276] 0709 13:10:34.567058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.587614 (+ 20556us) service_pool.cc:224] Handling call
0709 13:10:35.870341 (+1282727us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400442354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:35.870519 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2647260416}
I20260709 13:10:35.821403 30388 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:10:35.722477 30461 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.901638 30629 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:10:35.872987 25215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1275) took 1700 ms (client timeout 1571 ms). Trace:
W20260709 13:10:35.863888 30624 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.492s	user 0.000s	sys 0.001s
I20260709 13:10:35.821218 30124 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:10:35.834091 30098 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:10:35.892207 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.948348 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 133347us
I20260709 13:10:35.923128 30632 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:35.861740 30563 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.937686 30608 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:35.944702 30520 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:35.782896 30534 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:35.929690 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:35.929782 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:35.952522 30639 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.967698 25216 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:35.938546 30557 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.906525 29885 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:35.901249 30648 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:35.942775 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.941202 25215 rpcz_store.cc:269] 0709 13:10:34.172927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.201805 (+ 28878us) service_pool.cc:224] Handling call
0709 13:10:35.872745 (+1670940us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54004fa454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:35.872903 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589303296}
I20260709 13:10:35.892465 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:35.950664 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:35.932313 30618 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.882987 30496 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:10:35.943694 30658 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:35.946946 30573 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:35.906704 30628 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.953765 30356 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:35.883620 30498 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:35.958847 30461 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:35.926949 29954 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:35.979296 25218 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:35.980144 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:35.985435 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 440308us
I20260709 13:10:36.019654 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:35.917640 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 307249us
I20260709 13:10:36.001325 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1353) took 1166 ms. Trace:
I20260709 13:10:36.020821 24668 rpcz_store.cc:276] 0709 13:10:34.834729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.906206 (+ 71477us) service_pool.cc:224] Handling call
0709 13:10:34.906542 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:34.906875 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.906905 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:34.907368 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.091875 (+184507us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:35.091912 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.091971 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.001069 (+909098us) raft_consensus.cc:1685] finished
0709 13:10:36.001110 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.001261 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1072,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":86,"thread_start_us":184168,"threads_started":1,"wal-append.queue_time_us":337915}
W20260709 13:10:36.005120 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 452277us
I20260709 13:10:36.025022 30635 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:36.025650 30635 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.027770 30635 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:35.986431 30124 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:36.033484 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 53461.2us
I20260709 13:10:35.999958 30643 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:36.041046 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:36.042393 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.042855 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.043339 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:36.043735 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:36.012162 25216 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
W20260709 13:10:36.057440 24518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.000s	sys 0.015s
W20260709 13:10:36.057862 24518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.000s	sys 0.016s
I20260709 13:10:36.032949 30619 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.061697 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:36.039155 30639 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:36.035970 30124 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:36.045948 30573 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.066838 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:36.054629 30646 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:36.040258 30643 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:36.058046 30635 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:36.003835 30618 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:36.066030 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 415867us
I20260709 13:10:36.020022 30498 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:36.070993 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:36.059018 30566 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:36.059615 30595 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:36.122834 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51937.9us
I20260709 13:10:36.183878 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:35.999593 30648 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:36.088732 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.078927 30635 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:36.124912 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 69612.2us
I20260709 13:10:36.191552 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:36.072994 30643 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:36.070158 30388 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:36.233336 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.074200 29955 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:36.234041 25218 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:10:36.272729 30631 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.277153 30673 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:36.057200 30608 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.036166 30632 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.123116 30666 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.200515 30130 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.068552 30657 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:36.268440 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 70448.9us
I20260709 13:10:36.293463 30557 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:36.293853 30661 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 13:10:36.294627 30634 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:10:36.317770 30671 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:36.319326 30462 consensus_meta.cc:287] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.411s	user 0.011s	sys 0.002s
W20260709 13:10:36.304764 30254 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.158s	user 0.006s	sys 0.002s
I20260709 13:10:36.306318 30618 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.306420 30648 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.284282 30124 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.074103 30573 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:36.312623 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 121154us
I20260709 13:10:36.356735 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:36.068708 30459 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.154s
I20260709 13:10:36.185478 30620 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:36.281244 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 217503us
I20260709 13:10:36.365448 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:36.326988 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.263249 30652 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:36.330251 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.182667 30662 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.199496 30646 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:36.234911 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:36.122678 30664 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:36.260545 30650 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:36.079182 30639 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.241s
I20260709 13:10:36.346202 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.073839 30356 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.194506 30595 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.307758 30388 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.370455 25218 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
W20260709 13:10:36.361629 30476 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.176s	user 0.010s	sys 0.002s
W20260709 13:10:36.376852 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 141991us
W20260709 13:10:36.399467 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 53413.2us
I20260709 13:10:36.407459 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:36.408526 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:36.409319 30067 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:36.409526 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.410511 30348 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:36.410435 30687 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:36.411057 30348 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.411473 30348 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:36.411904 24491 leader_election.cc:400] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:36.412226 24491 leader_election.cc:403] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:36.412737 30687 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:36.414275 30687 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:36.414541 30566 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:36.415055 30566 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:36.416186 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:36.417418 30687 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.417954 30566 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:36.418962 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:36.419996 30687 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.422966 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.427173 30687 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:36.427960 30687 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:36.428704 30687 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:36.433804 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:36.389047 30650 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:36.478863 30670 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.278s	user 0.000s	sys 0.000s
W20260709 13:10:36.479000 30685 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:10:36.372234 30557 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:10:36.480584 30684 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:10:36.481719 30669 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:10:36.482402 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:36.483038 30628 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.483690 30651 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:36.484340 30651 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:36.485013 30573 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.485529 30532 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:36.485718 30260 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.486665 30635 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.366076 30498 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.123549 30658 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.480472 30650 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.489207 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.490087 25218 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:36.490476 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.370612 30124 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:36.352136 30462 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.354198 30254 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:36.494552 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.512580 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.523592 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:36.494148 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1308) took 1927 ms. Trace:
I20260709 13:10:36.499183 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.525516 25218 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:36.524645 24518 rpcz_store.cc:276] 0709 13:10:34.566603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.568880 (+  2277us) service_pool.cc:224] Handling call
0709 13:10:34.569276 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:34.586785 (+ 17509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.586827 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:34.587434 (+   607us) log.cc:844] Serialized 52 byte log entry
0709 13:10:35.467409 (+879975us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b18003ffac0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:36.058354 (+590945us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:36.058396 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.058477 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.491146 (+432669us) raft_consensus.cc:1685] finished
0709 13:10:36.491175 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.494070 (+  2895us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26835,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":14163,"spinlock_wait_cycles":5645056,"thread_start_us":590763,"threads_started":1,"wal-append.queue_time_us":1872180}
I20260709 13:10:36.529488 25211 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:36.337814 30673 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.546499 25213 raft_consensus.cc:2368] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17.
I20260709 13:10:36.546258 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.554970 24596 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:36.550968 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.555373 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.549024 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:36.556464 25217 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:36.518641 30650 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.573261 25217 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:10:36.573729 25217 pending_rounds.cc:85] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 12
I20260709 13:10:36.573961 25217 pending_rounds.cc:107] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:10:36.574199 25217 raft_consensus.cc:2889] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:36.575662 25217 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:36.492190 30476 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.581162 25211 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:36.492558 29955 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:10:36.491477 30130 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:10:36.374869 30652 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:36.567138 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:36.584671 25211 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:36.596665 30691 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:36.597851 25211 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:36.555991 30628 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.602035 25217 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:10:36.607452 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 171224us
I20260709 13:10:36.608752 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.619319 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.621568 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.626487 30636 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:36.628351 30636 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:36.583819 30650 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.632553 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.611788 30639 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:36.638943 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:36.614513 30498 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:36.642966 30636 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:36.605175 30628 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.642002 30639 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.631975 30534 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 13:10:36.684157 30568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.015s	sys 0.004s
W20260709 13:10:36.719842 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 78447.2us
I20260709 13:10:36.684465 30639 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:36.678642 30675 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:36.709343 30461 consensus_meta.cc:287] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.001s
W20260709 13:10:36.722796 30568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.015s	sys 0.004s
I20260709 13:10:36.732748 25210 raft_consensus.cc:2410] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:10:36.737954 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:36.718436 30595 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.677495 29955 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
W20260709 13:10:36.730266 30692 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:10:36.769325 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.758715 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:36.761684 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.759394 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:36.759865 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:36.846849 24521 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:36.734226 30462 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.716563 30348 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:36.759003 30686 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:10:36.683039 30701 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.725404 30566 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.136s
I20260709 13:10:36.727061 30388 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:36.767844 30404 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.079s	user 0.008s	sys 0.004s
W20260709 13:10:36.761278 30704 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:10:36.758358 30703 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:10:36.871255 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 149499us
W20260709 13:10:36.762249 30697 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:10:36.749338 30498 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:36.734107 30254 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.730865 30675 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.753724 30476 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.753460 30650 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:36.897933 30702 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:10:36.898837 30508 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.534s	user 0.009s	sys 0.006s
I20260709 13:10:36.737221 30568 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.151s
I20260709 13:10:36.903559 30675 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.900960 30687 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.905273 30498 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:36.906136 30712 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:10:36.907191 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2190) took 1854 ms. Trace:
I20260709 13:10:36.908679 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1282) took 1361 ms. Trace:
I20260709 13:10:36.909368 24523 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:36.911743 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.901669 30710 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:36.885489 30636 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:36.891703 30680 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.014s
I20260709 13:10:36.927526 24520 rpcz_store.cc:276] 0709 13:10:35.052844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.053673 (+   829us) service_pool.cc:224] Handling call
0709 13:10:36.906965 (+1853292us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003defd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:36.907129 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478562048}
I20260709 13:10:36.927632 25213 rpcz_store.cc:276] 0709 13:10:35.547103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.547239 (+   136us) service_pool.cc:224] Handling call
0709 13:10:36.908469 (+1361230us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54004272d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:36.908620 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872056064}
I20260709 13:10:36.932261 24525 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:36.884054 30701 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.939507 30652 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:36.940742 30713 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:36.941339 30713 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.941949 30701 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.942834 24522 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:36.943498 30713 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.923087 30508 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:36.935524 30678 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:10:36.930711 30710 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.961704 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1242) took 1589 ms. Trace:
I20260709 13:10:36.962733 30710 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.937404 30673 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.964946 30508 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:36.966254 30705 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:10:36.962083 24599 rpcz_store.cc:276] 0709 13:10:35.372074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.372212 (+   138us) service_pool.cc:224] Handling call
0709 13:10:35.372652 (+   440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:35.691391 (+318739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.691430 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:35.733774 (+ 42344us) log.cc:844] Serialized 52 byte log entry
0709 13:10:36.060228 (+326454us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:36.060287 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.060380 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:36.961458 (+901078us) raft_consensus.cc:1685] finished
0709 13:10:36.961477 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.961609 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21151,"raft.queue_time_us":376231,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":360429,"threads_started":2,"wal-append.queue_time_us":637323}
I20260709 13:10:36.968183 24599 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:10:36.968658 24596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2193) took 1902 ms (client timeout 1708 ms). Trace:
W20260709 13:10:36.969064 24596 rpcz_store.cc:269] 0709 13:10:35.066467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.066614 (+   147us) service_pool.cc:224] Handling call
0709 13:10:36.968473 (+1901859us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54001ca554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:36.968598 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3364837632}
I20260709 13:10:36.970698 30639 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.971807 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1284) took 1424 ms. Trace:
I20260709 13:10:36.972204 25210 rpcz_store.cc:276] 0709 13:10:35.547676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.566133 (+ 18457us) service_pool.cc:224] Handling call
0709 13:10:36.971587 (+1405454us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540007c454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:36.971745 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2680206592}
I20260709 13:10:36.949532 30636 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.930691 30680 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.000s	sys 0.015s
I20260709 13:10:36.978721 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.978891 30636 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.951136 30687 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.952651 30498 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:36.980477 24670 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:10:36.956180 30643 consensus_meta.cc:287] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.003s
W20260709 13:10:36.944528 30707 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:36.960650 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.977815 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.984874 30636 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.982841 30643 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:36.985522 30633 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.036s	user 0.012s	sys 0.000s
I20260709 13:10:36.987964 30633 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:36.989065 24592 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:36.990332 24518 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:36.990751 24668 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:36.991870 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:36.992895 24669 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:36.972903 30639 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:36.992863 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:36.996040 30701 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:36.996470 30701 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.996882 30701 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:37.002082 30348 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.005012 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.006055 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.006867 24669 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:37.008931 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.009392 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.010501 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.010581 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.011515 24667 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:37.011806 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:37.012610 24517 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:37.006127 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.014261 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.014545 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.015142 24673 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:37.015425 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:37.015848 30688 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.651s	user 0.001s	sys 0.000s
I20260709 13:10:37.016070 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.016238 30643 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.016485 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.016662 24672 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:37.017129 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2202) took 1378 ms. Trace:
I20260709 13:10:37.017575 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.017503 24595 rpcz_store.cc:276] 0709 13:10:35.642905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.644443 (+  1538us) service_pool.cc:224] Handling call
0709 13:10:35.644854 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.028328 (+383474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.028393 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.029384 (+   991us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.084650 (+ 55266us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:36.084700 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.084790 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.015143 (+930353us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:37.016863 (+  1720us) raft_consensus.cc:1685] finished
0709 13:10:37.016884 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.017055 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":212644,"spinlock_wait_cycles":24653824,"thread_start_us":437587,"threads_started":2,"wal-append.queue_time_us":320904}
I20260709 13:10:37.029630 24517 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
W20260709 13:10:37.037135 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 43918us
I20260709 13:10:37.037532 24669 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:37.043594 30534 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.044037 30701 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.044219 30534 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.045331 30459 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.045846 30459 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.046850 30534 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.047698 30348 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:37.050360 30633 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.053398 24673 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:37.057309 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:37.062180 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:36.993613 30494 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:37.088227 30701 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.061296 30459 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.084277 30566 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:10:37.090217 30566 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:37.090600 30566 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:37.091572 30566 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.093766 24521 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:37.096570 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1245) took 1327 ms. Trace:
I20260709 13:10:37.097281 30356 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:37.097949 30667 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:37.085494 30494 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.100593 30494 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:37.105995 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 749274us
I20260709 13:10:37.106743 24566 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:37.092932 30566 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:37.108825 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:37.110127 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 700610us
I20260709 13:10:37.110580 24519 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:37.113034 30665 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.114612 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2203) took 1073 ms. Trace:
I20260709 13:10:37.115141 24591 rpcz_store.cc:276] 0709 13:10:36.041258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.041442 (+   184us) service_pool.cc:224] Handling call
0709 13:10:36.061332 (+ 19890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.061536 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:36.197482 (+135946us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.114197 (+916715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.114262 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:37.114323 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.114403 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.114544 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":522341,"prepare.queue_time_us":240009,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":522855,"thread_start_us":523348,"threads_started":2,"wal-append.queue_time_us":427633}
I20260709 13:10:37.119513 24595 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:37.120653 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.121634 30633 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:37.121960 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.122649 24595 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:37.122387 30633 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.123498 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.124135 24595 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:37.125754 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2199) took 1539 ms. Trace:
I20260709 13:10:37.126534 30658 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.127292 30658 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.126181 24600 rpcz_store.cc:276] 0709 13:10:35.586810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.588139 (+  1329us) service_pool.cc:224] Handling call
0709 13:10:35.588592 (+   453us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:35.933865 (+345273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.933897 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:35.934439 (+   542us) log.cc:844] Serialized 52 byte log entry
0709 13:10:36.078237 (+143798us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:36.371430 (+293193us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.108371 (+736941us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.125432 (+ 17061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.125509 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.125552 (+    43us) raft_consensus.cc:1685] finished
0709 13:10:37.125565 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.125701 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":790507,"prepare.queue_time_us":182741,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1018484,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":17021,"thread_start_us":531479,"threads_started":3,"wal-append.queue_time_us":641088}
I20260709 13:10:37.129978 24596 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:37.131273 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.111636 30657 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:37.135797 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.146262 24599 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:37.096971 24594 rpcz_store.cc:276] 0709 13:10:35.769602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.770938 (+  1336us) service_pool.cc:224] Handling call
0709 13:10:35.836322 (+ 65384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.838959 (+  2637us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:36.038139 (+199180us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.320541 (+282402us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.954442 (+633901us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b180040ee20. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:37.096073 (+141631us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b180040ee20. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:10:37.096225 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.096274 (+    49us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:37.096329 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.096408 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.096515 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":763072,"prepare.queue_time_us":471270,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":104,"raft.queue_time_us":784407,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":4774,"spinlock_wait_cycles":32618624,"thread_start_us":461671,"threads_started":2,"wal-append.queue_time_us":453705}
I20260709 13:10:37.153192 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:37.153815 24521 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.109368 30356 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:37.154366 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 51494.1us
I20260709 13:10:37.150308 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:37.132412 30633 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.159392 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.160887 24517 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:37.168138 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.136518 30657 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.166411 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:37.171684 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:37.168398 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:37.181851 24521 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:37.187425 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:37.187840 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.155588 30648 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:37.153791 30639 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.188328 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:37.193537 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.195955 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:37.196965 30573 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:37.202860 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.199847 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:37.203886 24669 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:37.210079 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.211679 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.170104 30657 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.191124 30568 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.190579 30633 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:37.192325 30648 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.226444 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.196158 30563 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:37.153636 30620 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:37.194754 30662 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:37.206434 30725 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:10:37.200366 30665 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:37.175428 30650 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:10:37.189669 30646 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:10:37.227650 30568 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:37.191242 30632 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 13:10:37.246052 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 46287.5us
I20260709 13:10:37.244939 30648 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:37.246076 30662 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.240542 30711 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.242101 24669 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:37.258759 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:37.248710 30665 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.252635 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.201984 30639 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.241103 30563 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.249172 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.232977 30618 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.290378 24594 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:37.254263 30568 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.248963 30701 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:37.251806 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 63227us
I20260709 13:10:37.256996 24521 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:10:37.259284 30662 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.295931 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:37.291278 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.301987 24669 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:37.260092 30711 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:37.259537 30671 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:37.239766 30356 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:37.314251 30724 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:10:37.262339 30665 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:37.291692 30563 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:37.316865 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.290134 30658 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.254282 30573 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:10:37.326524 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.326857 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:37.327431 24669 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:37.319002 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.296569 30626 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.309579 30643 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:10:37.328709 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:37.330806 30734 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:37.331367 30728 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:10:37.331637 30468 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:37.298599 30618 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.333060 30737 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:37.337210 30737 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.337599 30737 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:37.339516 24521 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:37.310602 30675 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:37.304414 30701 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:37.310905 30711 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.350569 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:37.323685 30671 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.345703 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.348519 30130 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:10:37.358282 30726 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:10:37.358676 30723 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:37.359102 25218 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:37.335942 30618 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.340618 30658 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:37.363665 24591 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:37.350289 30734 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:37.394901 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:37.372232 30574 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:37.409536 30729 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:10:37.405985 30736 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:10:37.347505 30626 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.417459 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:37.418535 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.416765 30639 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.435164 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.439782 30711 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.398969 30734 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.444231 30734 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.446280 24671 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:37.449807 30671 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.461566 24665 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:37.425490 30563 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.417480 30701 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.482489 30553 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.492661 30553 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:37.499236 30626 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.507252 30665 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.517274 30648 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.525393 30628 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.526257 30648 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.490569 30657 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.534161 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.535383 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:37.520783 30665 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.535948 24522 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:37.537659 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.539443 24599 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:37.541709 30662 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.550208 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1312) took 2255 ms. Trace:
I20260709 13:10:37.550622 24523 rpcz_store.cc:276] 0709 13:10:35.294892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.295953 (+  1061us) service_pool.cc:224] Handling call
0709 13:10:36.909185 (+1613232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.928721 (+ 19536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.550007 (+621286us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54003defd0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:37.550146 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3619760896}
I20260709 13:10:37.557614 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.558373 24594 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:37.559185 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:37.560737 24592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2206) took 1518 ms (client timeout 1837 ms). Trace:
I20260709 13:10:37.561501 30711 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:37.561203 24592 rpcz_store.cc:269] 0709 13:10:36.042491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.043074 (+   583us) service_pool.cc:224] Handling call
0709 13:10:37.560556 (+1517482us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540013fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:37.560686 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173075328}
I20260709 13:10:37.561888 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2207) took 1301 ms. Trace:
I20260709 13:10:37.562392 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.562253 24597 rpcz_store.cc:276] 0709 13:10:36.260686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.483542 (+222856us) service_pool.cc:224] Handling call
0709 13:10:36.483850 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.115160 (+631310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.115206 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.115859 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.220126 (+104267us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:37.220184 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.415907 (+195723us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:10:37.561606 (+145699us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54001ecdd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:37.561655 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.561696 (+    41us) raft_consensus.cc:1685] finished
0709 13:10:37.561711 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.561836 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138896,"raft.queue_time_us":145074,"raft.run_cpu_time_us":2874,"raft.run_wall_time_us":294794,"spinlock_wait_cycles":1188053120,"thread_start_us":103786,"threads_started":1,"wal-append.queue_time_us":134996}
I20260709 13:10:37.564308 30657 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.564769 24597 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:37.565359 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2200) took 1963 ms. Trace:
W20260709 13:10:37.566648 30732 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.253s	user 0.003s	sys 0.000s
I20260709 13:10:37.565753 24598 rpcz_store.cc:276] 0709 13:10:35.601943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.604281 (+  2338us) service_pool.cc:224] Handling call
0709 13:10:35.604710 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.606490 (+  1780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.606538 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.607121 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.611709 (+  4588us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:35.611755 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.611843 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.895256 (+283413us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:10:37.560421 (+1665165us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18004810c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:37.565152 (+  4731us) raft_consensus.cc:1685] finished
0709 13:10:37.565174 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.565304 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43182,"raft.queue_time_us":249873,"raft.run_cpu_time_us":2383,"raft.run_wall_time_us":36983,"spinlock_wait_cycles":16276608,"thread_start_us":2463,"threads_started":2,"wal-append.queue_time_us":264703}
W20260709 13:10:37.568686 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 374287us
I20260709 13:10:37.569432 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:37.569839 30563 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.570459 30563 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:37.571460 24598 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:37.572599 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:37.573652 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:37.574180 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:37.564345 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.574772 24598 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.575100 24594 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:37.575296 24599 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:37.575985 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.576804 24522 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:37.563117 24592 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:37.577641 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:37.577914 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.578460 24592 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:37.523809 30737 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.583396 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2205) took 1541 ms. Trace:
I20260709 13:10:37.580214 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.580770 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.585268 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.585688 24599 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:37.586318 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.587489 24592 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:37.589295 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.589632 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.590548 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:37.590816 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:37.594357 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:37.594722 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:37.595186 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.597723 24600 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:37.598413 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:37.598500 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.595690 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:37.593801 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.584062 30737 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.602644 24599 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:37.603022 24519 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:37.583773 24593 rpcz_store.cc:276] 0709 13:10:36.042246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.279430 (+237184us) service_pool.cc:224] Handling call
0709 13:10:36.279743 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.312489 (+ 32746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.312520 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.319609 (+  7089us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.542166 (+222557us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:36.552662 (+ 10496us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.113836 (+561174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.113938 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.517456 (+403518us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800334a80. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:37.574597 (+ 57141us) raft_consensus.cc:1685] finished
0709 13:10:37.583234 (+  8637us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.583345 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1350816,"prepare.queue_time_us":12654,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":49,"raft.queue_time_us":595813,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16632,"spinlock_wait_cycles":67410176,"thread_start_us":189624,"threads_started":1,"wal-append.queue_time_us":219377}
W20260709 13:10:37.604485 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:37.602981 30563 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:37.606168 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:37.544345 30665 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.613759 24598 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:37.613994 24522 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:10:37.621011 30748 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:10:37.622179 30563 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:10:37.629555 30652 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:37.630029 30652 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:37.630939 30652 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.632256 30652 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:37.638386 30574 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:37.641580 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 246766us
I20260709 13:10:37.641937 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1294) took 1183 ms. Trace:
I20260709 13:10:37.642381 30124 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:37.643066 30124 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.648782 24598 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:37.648594 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:37.651190 24599 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:37.561060 30568 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.652628 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:37.652514 24597 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:37.642333 25211 rpcz_store.cc:276] 0709 13:10:36.516768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.601559 (+ 84791us) service_pool.cc:224] Handling call
0709 13:10:36.601899 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.602113 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:36.604862 (+  2749us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.641614 (+1036752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.641669 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:37.641714 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.641777 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.641884 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":990524,"prepare.queue_time_us":9858,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":991954,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":45859,"threads_started":1,"wal-append.queue_time_us":248447}
I20260709 13:10:37.643523 30124 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:37.662421 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1688) took 1144 ms. Trace:
I20260709 13:10:37.663005 25218 rpcz_store.cc:276] 0709 13:10:36.520211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.555118 (+ 34907us) service_pool.cc:224] Handling call
0709 13:10:37.662261 (+1107143us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400570dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:37.662359 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1846688512}
I20260709 13:10:37.659638 30611 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.660604 30532 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.667905 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:37.670288 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.671429 30474 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.671957 30474 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.673961 30474 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:37.678313 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:37.679412 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.680449 25217 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:37.680867 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:37.681419 25214 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:37.684468 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.685189 25218 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:37.685391 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:37.727375 25214 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:37.733938 25211 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:37.743000 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:37.743574 25219 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:37.670909 30611 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.690671 30532 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.659037 30665 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.746981 30611 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:37.747444 30532 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:37.747663 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.748268 25213 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:37.749042 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.750339 25219 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:37.752610 24591 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:37.752914 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:37.752307 30665 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.754702 30568 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.755492 30662 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:37.758203 30462 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.758373 30453 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.758808 30462 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.741828 30356 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:10:37.758917 30453 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:37.760906 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 80339.8us
I20260709 13:10:37.764379 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:37.764434 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 64159.4us
I20260709 13:10:37.675065 30626 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:37.768337 30679 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.768472 30647 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:37.768854 30679 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.770902 30679 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.771589 30453 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:37.741607 30297 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.772714 30297 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.774621 30297 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.765702 30520 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.775362 30520 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:37.777318 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 109482us
I20260709 13:10:37.779264 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:37.779990 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:37.741509 30461 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.781312 30637 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:37.781744 30637 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.781447 30461 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.782116 30637 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:37.783726 30461 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.784312 30461 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:37.786346 30549 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:37.786195 30619 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:37.786970 30549 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:37.787879 30549 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.789258 30635 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:37.789733 30635 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:37.790529 30635 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.791081 30619 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:37.791575 30619 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:37.792328 30619 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.764535 30606 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:37.793111 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.793409 30606 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.794075 30751 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:37.795440 30606 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.798364 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:37.799185 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:37.796384 30619 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:37.800957 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:37.811060 30679 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:37.812083 30595 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:37.812486 30595 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:37.809691 30496 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.813350 30496 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:37.813503 30626 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:37.813781 30496 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.813975 30626 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.814430 30626 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:37.816035 30388 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:37.816972 30388 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:37.817312 30388 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:37.818068 30388 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.819211 30388 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:37.821269 30520 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:37.821967 30595 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.822958 24597 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:37.823676 30595 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.825434 30752 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:37.809533 30751 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.827654 30751 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:37.828754 30751 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.828233 30462 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:37.809198 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:37.844218 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:37.855485 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 87750.8us
I20260709 13:10:37.854511 30461 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:37.862272 30711 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:37.863754 30673 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:37.864101 30673 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:37.864832 30673 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.820996 30637 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.865968 30673 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:37.867259 30637 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.874502 30666 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:37.876418 30502 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.889659 24670 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:37.890062 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.890638 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.892426 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.895824 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.896188 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.900408 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.901182 24669 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:37.902513 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:37.903100 24673 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:37.904512 24667 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:37.876495 30666 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.904569 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:37.913237 24673 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:10:37.913972 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:37.914357 24666 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:37.916285 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:37.836998 30124 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.921468 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:37.921728 24673 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:37.879276 30754 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.923349 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:37.922909 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.877306 30496 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.878489 30502 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:37.930011 25215 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:10:37.936213 30626 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.936789 24599 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:10:37.939687 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:37.941205 24666 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:37.920526 30461 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:37.923781 30608 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:37.907819 30619 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:10:37.942440 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:37.958101 24566 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:37.961007 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:37.962576 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:37.938985 30736 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:10:37.964442 25215 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:10:37.966058 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.968760 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.966598 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.967255 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.967918 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.943807 30461 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.974422 30553 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:37.974483 30658 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.974891 30461 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:37.970943 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:37.982746 30754 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:37.988989 25218 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:37.973678 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:37.978314 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.994443 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:37.994922 30665 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.995612 30665 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:37.996097 30665 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:37.992599 30461 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:37.998297 30662 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:37.999034 30751 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.000077 30461 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.971292 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:37.968205 30631 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:10:38.002619 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:37.991860 30502 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:37.990420 30496 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:38.012238 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:38.012486 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:38.013144 24598 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:38.014516 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:38.035363 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.015419 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:38.055029 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:38.056298 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.069703 30502 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.070248 30502 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.070616 30502 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.996937 30665 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.074648 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:38.075834 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.076431 25212 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:37.966277 30611 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.078675 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:38.084961 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.085696 24673 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:38.087082 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.088341 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.088894 24674 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:38.088912 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.091466 25212 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 LEARNER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:38.092569 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:38.095031 24673 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:38.088819 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:38.097880 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.010192 30631 consensus_queue.cc:1243] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:38.101073 25212 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:38.104405 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:38.114461 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:38.124305 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.057243 30754 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:38.134305 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.088001 30462 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.097539 30568 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.139871 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:38.144423 30636 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.144932 30636 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.100919 30553 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:38.152379 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.123174 30635 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:38.162107 24598 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:10:38.164196 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.132505 30751 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.165195 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:38.131641 30657 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:38.139807 30658 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:38.170610 24599 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:38.127676 30662 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:10:38.165499 24594 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:38.147126 30636 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.149953 30553 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:38.142706 30737 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:38.156859 30563 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:38.177786 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.173364 30632 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.180253 30658 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.199271 30608 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.202147 30635 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:38.205852 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3378) took 1198 ms. Trace:
I20260709 13:10:38.214186 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.214912 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.175419 30666 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.153757 30568 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.175124 30639 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.154452 30462 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.239789 24518 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:38.192394 30553 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:38.241353 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.238911 24520 rpcz_store.cc:276] 0709 13:10:37.007787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.020618 (+ 12831us) service_pool.cc:224] Handling call
0709 13:10:37.020997 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.101242 (+ 80245us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:37.101537 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.390783 (+289246us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.634938 (+244155us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b18004be320. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:10:37.653599 (+ 18661us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.653756 (+   157us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:37.653802 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.792692 (+138890us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b18004be320. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:38.205534 (+412842us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b54003ae3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:38.205600 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.205778 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":248674,"prepare.queue_time_us":2543,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":20287,"raft.queue_time_us":270524,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":17581,"spinlock_wait_cycles":207706496,"thread_start_us":291112,"threads_started":2,"wal-append.queue_time_us":273025}
W20260709 13:10:38.251806 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.224874 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:38.194643 30563 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.181120 30657 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.265403 30637 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.265949 30637 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.266960 30657 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.257624 30715 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:10:38.267781 30657 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:38.269423 30712 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:38.269883 30712 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:38.270750 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 183572us
I20260709 13:10:38.271452 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.225416 30658 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:38.241160 30635 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:38.238638 30652 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:38.284242 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.289472 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:38.290601 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.292037 25219 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 12.
I20260709 13:10:38.292943 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:38.291292 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:38.300904 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.247848 30666 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:38.289958 25214 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:38.246594 30626 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.272219 30563 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:38.225167 30632 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:38.362567 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 143976us
I20260709 13:10:38.351828 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:38.355988 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.240314 30608 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.367017 30608 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:38.248113 30534 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:10:38.367812 30534 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:38.368165 30534 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:38.368322 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.244565 30130 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:10:38.369632 30130 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:38.370048 30130 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:38.370893 30130 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.372191 30130 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:38.263840 30639 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.394636 30639 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.396291 30563 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.290980 30549 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.106s
I20260709 13:10:38.291087 30619 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:10:38.399032 30619 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:38.399362 30619 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:38.400296 30619 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.401580 30619 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.401724 30568 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.357884 30679 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:38.244262 30754 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:38.406762 30733 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.087s	user 0.006s	sys 0.016s
I20260709 13:10:38.359867 30712 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:38.311079 30297 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:10:38.408653 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1916) took 1275 ms. Trace:
I20260709 13:10:38.409034 24596 rpcz_store.cc:276] 0709 13:10:37.133003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.136862 (+  3859us) service_pool.cc:224] Handling call
0709 13:10:37.137289 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.150040 (+ 12751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.150069 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.159364 (+  9295us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.232568 (+ 73204us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.232617 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.232685 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.406228 (+1173543us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:38.408366 (+  2138us) raft_consensus.cc:1685] finished
0709 13:10:38.408384 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.408596 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14604,"raft.queue_time_us":14238,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":14467968,"thread_start_us":34560,"threads_started":1,"wal-append.queue_time_us":62905}
I20260709 13:10:38.412495 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:38.413005 24596 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:38.417446 24674 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:10:38.418236 30760 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:10:38.353823 30606 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:38.421877 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.319676 30520 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:10:38.361928 30502 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:38.363613 30124 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.383841 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:38.426257 25216 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:38.368997 30534 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.385458 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:38.390043 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:38.391386 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:38.392449 24598 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:38.429383 24599 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:10:38.392714 24600 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:38.319540 30468 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:10:38.418874 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2221) took 1113 ms. Trace:
I20260709 13:10:38.430112 24591 rpcz_store.cc:276] 0709 13:10:37.305244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.425296 (+120052us) service_pool.cc:224] Handling call
0709 13:10:38.418712 (+993416us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540025eed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:38.418823 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727947136}
I20260709 13:10:38.430558 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:38.431571 24600 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:38.418741 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:38.419241 24672 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:38.419678 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.408835 30297 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:38.375586 25219 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:38.425158 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:38.425323 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:38.426939 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:38.437296 24674 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:38.374538 30645 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:38.443586 24596 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:38.423810 30606 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.458523 24670 pending_rounds.cc:85] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 7
W20260709 13:10:38.445793 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48873.2us
W20260709 13:10:38.460659 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.460891 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:38.466874 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:38.427812 30630 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:38.470685 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:38.473047 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 235526us
W20260709 13:10:38.475723 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.476964 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.465770 30124 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:38.436856 30297 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:38.483009 24518 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:10:38.483788 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:38.484486 24524 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:38.442083 30737 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:38.480257 30673 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.493363 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.494375 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.501483 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:38.479097 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:38.487839 24516 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:38.504139 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.471154 30534 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:38.468677 30606 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.490088 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:38.461454 24670 pending_rounds.cc:107] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 10.8
I20260709 13:10:38.489192 24673 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:38.505640 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.562031 24516 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:38.510957 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.482191 30198 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.564404 24670 raft_consensus.cc:2917] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Aborting config change with OpId 10.8: Aborted: Op aborted by new leader
I20260709 13:10:38.565156 24670 raft_consensus.cc:2889] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:38.472582 30679 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
W20260709 13:10:38.559428 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80407.8us
I20260709 13:10:38.482290 30260 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:10:38.570292 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.567440 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:38.568674 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 78692.9us
I20260709 13:10:38.558796 24517 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:38.506846 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.506578 30639 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:38.577919 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.578375 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.466500 30645 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:38.617813 30741 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.113s	user 0.007s	sys 0.001s
I20260709 13:10:38.577569 30679 consensus_queue.cc:1243] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:10:38.619491 30645 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.577598 30608 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:38.621037 30608 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:38.621970 30608 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.624106 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.625507 30632 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.551118 30673 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.626441 30673 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.628580 30673 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.629621 30462 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:38.629446 30737 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.479651 30532 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:10:38.634213 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:38.634716 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.601096 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.617697 30637 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:38.632934 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1911) took 1513 ms. Trace:
I20260709 13:10:38.635910 24518 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:38.639796 24673 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:38.573798 24524 raft_consensus.cc:2368] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20.
W20260709 13:10:38.642374 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 490057us
I20260709 13:10:38.568579 30666 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.648306 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.654412 24525 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:38.649616 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:38.655741 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.655845 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:38.639251 24595 rpcz_store.cc:276] 0709 13:10:37.119841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.124744 (+  4903us) service_pool.cc:224] Handling call
0709 13:10:37.125044 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.129363 (+  4319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.129392 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.129903 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.370777 (+240874us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:37.465920 (+ 95143us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.466226 (+   306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.466294 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.672006 (+205712us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:10:38.617006 (+945000us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:38.632690 (+ 15684us) raft_consensus.cc:1685] finished
0709 13:10:38.632719 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.632866 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149412,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":196,"raft.run_cpu_time_us":2395,"raft.run_wall_time_us":545941,"spinlock_wait_cycles":28117888,"thread_start_us":309338,"threads_started":2,"wal-append.queue_time_us":338635}
I20260709 13:10:38.662323 24673 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:38.638782 30563 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.574183 30468 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:10:38.645327 30462 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:38.642864 30782 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:38.664383 30611 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 13:10:38.641638 30639 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.657244 30774 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:38.643985 30632 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:38.697978 24525 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:38.700518 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.701174 30771 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:10:38.673139 30198 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.703001 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:38.570875 30297 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.657121 30666 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:38.679347 30782 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.693813 30611 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:38.746556 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.756297 25212 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:38.704334 30665 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:38.712888 30645 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.702993 30494 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:38.808658 25218 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:38.803045 25212 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:38.804937 24525 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:10:38.722388 30502 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:38.702348 30563 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:10:38.745775 30782 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.837100 30691 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.837634 30691 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:38.839409 30635 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.000s
I20260709 13:10:38.839600 30691 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:38.840183 30691 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:38.839949 30635 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:38.841890 30772 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:10:38.842324 30782 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:38.843472 30647 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:38.843832 30639 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.844429 30782 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:38.845549 30779 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:10:38.846797 30770 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 13:10:38.848372 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1692) took 1170 ms. Trace:
I20260709 13:10:38.848863 25210 rpcz_store.cc:276] 0709 13:10:37.678243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.678360 (+   117us) service_pool.cc:224] Handling call
0709 13:10:37.678750 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.679107 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.679129 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.938537 (+259408us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b2c00047778. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:10:37.938885 (+   348us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.423197 (+484312us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:38.424271 (+  1074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.424370 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.848011 (+423641us) raft_consensus.cc:1685] finished
0709 13:10:38.848038 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.848297 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78255,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":126471040,"thread_start_us":484047,"threads_started":1,"wal-append.queue_time_us":745574}
I20260709 13:10:38.843870 30647 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:38.859550 30647 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.760313 30198 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.817278 24674 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:38.865926 30198 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.866271 24667 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:10:38.811269 30645 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.824828 30666 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:38.826179 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:38.868513 24516 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:38.831390 30712 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.832729 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:38.833019 30553 consensus_meta.cc:287] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.001s
I20260709 13:10:38.870352 30553 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.872324 30553 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:38.834800 30658 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.003s
I20260709 13:10:38.872927 30658 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.815786 30494 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.873639 30639 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.874147 30639 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:38.874913 30494 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.875165 30658 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.869299 30645 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.875504 30502 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.875633 30498 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:38.876196 30498 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:38.877589 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.878268 30498 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:38.879930 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.860973 30647 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:38.881348 30639 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:38.840653 30691 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.886011 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.811040 30665 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:38.888356 30751 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:38.890053 30775 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:38.890342 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.891074 30751 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.893218 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.876073 30502 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.888330 30665 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:38.916510 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.924546 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:38.886924 30691 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:38.702716 30774 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:38.930552 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 82017.6us
I20260709 13:10:38.940466 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:38.923419 30297 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.937970 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.942968 25218 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:38.943677 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 369640us
I20260709 13:10:38.943249 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:38.879988 30606 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:38.947048 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:38.949678 24668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.013s	sys 0.034s
W20260709 13:10:38.951838 24668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.013s	sys 0.034s
W20260709 13:10:38.985200 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.950628 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:38.946377 30067 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:38.942111 30496 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:39.001989 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 51458.7us
I20260709 13:10:39.002856 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:39.004539 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:39.005301 30639 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:39.005723 30639 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:39.006110 30639 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:39.007097 30534 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:39.008347 30534 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:39.009783 30635 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:39.010515 24595 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:10:39.011235 30712 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:39.011492 30774 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.012596 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:39.013198 24595 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:39.013967 30534 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:39.015290 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:39.016004 24595 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:39.017839 30712 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:39.017997 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:39.019734 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:39.021018 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.043412 25214 raft_consensus.cc:2368] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:39.059788 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:39.064746 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:38.998719 30658 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:39.001040 30574 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.070143 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:39.074760 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 127766us
I20260709 13:10:39.071595 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:39.075830 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:39.039384 30568 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:39.062258 30566 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.057780 30712 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:39.117193 24521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.002s	sys 0.017s
I20260709 13:10:39.063448 30496 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:39.068398 30658 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:39.128929 24521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.002s	sys 0.017s
W20260709 13:10:39.120558 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44832.7us
I20260709 13:10:39.081444 30348 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:39.134454 24490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.642s (SENT) [suppressed 10 similar messages]
I20260709 13:10:39.117748 30662 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:39.133915 30494 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:39.137658 30502 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:39.145383 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.140918 25211 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:39.121903 30751 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:39.130384 30534 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:39.172837 30712 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.173622 30534 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:39.174045 30534 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:39.174260 30712 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.174461 30534 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:39.134022 30752 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.146492 30658 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.114475 30574 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:10:39.129499 30566 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:39.199059 24637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.008s
I20260709 13:10:39.126861 30568 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:39.199446 25184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.005s	sys 0.009s
W20260709 13:10:39.201321 24593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.026s	sys 0.030s
W20260709 13:10:39.213809 24593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.026s	sys 0.031s
W20260709 13:10:39.226094 24637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.005s	sys 0.009s
I20260709 13:10:39.158432 30662 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:39.226431 25184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.005s	sys 0.009s
I20260709 13:10:39.229825 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.230332 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.234624 24517 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:39.231297 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.235764 24523 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
W20260709 13:10:39.237931 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.238427 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 662107us
I20260709 13:10:39.234653 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1379) took 1149 ms. Trace:
I20260709 13:10:39.177634 30639 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.210100 30776 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.197813 30496 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.242306 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:39.242502 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:39.245462 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.252954 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.240257 24665 rpcz_store.cc:276] 0709 13:10:38.084881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.101650 (+ 16769us) service_pool.cc:224] Handling call
0709 13:10:38.101992 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.102217 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:38.376038 (+273821us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.234349 (+858311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.234396 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:39.234438 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.234495 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.234602 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21557,"prepare.queue_time_us":465870,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":98713,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":1079791,"threads_started":3,"wal-append.queue_time_us":562804}
I20260709 13:10:39.246522 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.185756 30752 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.269157 24523 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 14: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:39.280671 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:39.281628 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:39.281772 24665 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:39.282809 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:39.285235 24665 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:39.285772 24592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.014s	sys 0.009s
W20260709 13:10:39.286123 24592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.014s	sys 0.009s
I20260709 13:10:39.244701 30662 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:39.293438 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:39.292779 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.022s
W20260709 13:10:39.298933 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.000s	sys 0.022s
I20260709 13:10:39.298661 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:39.302327 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 646515us
I20260709 13:10:39.307022 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:39.313254 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:39.276818 30606 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:39.322211 24594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.004s	sys 0.024s
W20260709 13:10:39.322639 24594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.004s	sys 0.024s
I20260709 13:10:39.314698 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:39.315958 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:39.296033 30774 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.317414 24598 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:39.270052 30776 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:39.324481 30737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.004s	sys 0.024s
W20260709 13:10:39.338683 30737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.004s	sys 0.025s
I20260709 13:10:39.324525 30553 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:39.329123 30657 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:39.324800 30754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.009s	sys 0.027s
W20260709 13:10:39.340306 30795 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:10:39.371433 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 299897us
I20260709 13:10:39.405894 30639 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.406953 30566 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.408247 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2224) took 1759 ms. Trace:
I20260709 13:10:39.408759 24593 rpcz_store.cc:276] 0709 13:10:37.648529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.648743 (+   214us) service_pool.cc:224] Handling call
0709 13:10:37.649031 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:37.649405 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.649431 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:37.649934 (+   503us) log.cc:844] Serialized 52 byte log entry
0709 13:10:38.659441 (+1009507us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b18003c1240. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:39.214422 (+554981us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:39.214493 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.214597 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.407811 (+193214us) raft_consensus.cc:1685] finished
0709 13:10:39.407841 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.408163 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3804,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3473,"spinlock_wait_cycles":4419328,"thread_start_us":554713,"threads_started":1,"wal-append.queue_time_us":1725202}
I20260709 13:10:39.341099 30752 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.360903 30665 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:39.411882 30665 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.413833 30534 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.416486 30534 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.429318 30665 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.330534 30774 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:39.430097 30665 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:39.430740 30665 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:39.431743 30774 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:39.432792 30780 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.733s	user 0.000s	sys 0.010s
I20260709 13:10:39.435721 30652 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:39.437057 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3394) took 1225 ms. Trace:
I20260709 13:10:39.437723 30639 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:39.438258 30639 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:39.437445 24522 rpcz_store.cc:276] 0709 13:10:38.212007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.212127 (+   120us) service_pool.cc:224] Handling call
0709 13:10:38.212512 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.212861 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.212897 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.213359 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.442851 (+229492us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:38.442903 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.442989 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.432067 (+989078us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:39.436740 (+  4673us) raft_consensus.cc:1685] finished
0709 13:10:39.436762 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.436974 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3482,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":17903872,"thread_start_us":229121,"threads_started":1,"wal-append.queue_time_us":444368}
I20260709 13:10:39.342459 30574 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:39.340514 30631 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:39.347038 30799 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:39.448843 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 47612.3us
I20260709 13:10:39.341483 30802 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:39.453765 30802 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.454473 30802 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:39.461241 30799 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:39.461954 30799 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.463019 30665 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:39.348163 30553 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:39.397955 30754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.009s	sys 0.028s
W20260709 13:10:39.399498 30790 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:10:39.339568 30737 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:39.474524 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.477244 25215 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:39.479751 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 1384) took 1111 ms. Trace:
I20260709 13:10:39.382969 30657 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.471722 30568 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:39.439411 30639 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:39.480163 24672 rpcz_store.cc:276] 0709 13:10:38.367919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.368073 (+   154us) service_pool.cc:224] Handling call
0709 13:10:39.479559 (+1111486us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b540044dc54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:39.479693 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115644800}
I20260709 13:10:39.481954 30776 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.474470 30553 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.508525 30799 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.471904 30631 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:39.578521 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.578073 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 443615us
W20260709 13:10:39.644214 24600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.042s
W20260709 13:10:39.644814 24600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.000s	sys 0.043s
I20260709 13:10:39.589558 30776 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:39.654441 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 371933us
I20260709 13:10:39.655627 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:39.657725 30803 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:39.661957 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1272) took 1265 ms. Trace:
I20260709 13:10:39.662334 24594 rpcz_store.cc:276] 0709 13:10:38.396064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.447796 (+ 51732us) service_pool.cc:224] Handling call
0709 13:10:38.448094 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.449855 (+  1761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.449898 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.466494 (+ 16596us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.323051 (+856557us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:39.323111 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.323207 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.661743 (+338536us) raft_consensus.cc:1685] finished
0709 13:10:39.661761 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.661902 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20908,"raft.queue_time_us":27111,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":7601,"thread_start_us":835594,"threads_started":1,"wal-append.queue_time_us":1106171}
W20260709 13:10:39.768416 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.820907 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 127666us
W20260709 13:10:39.825438 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 135755us
I20260709 13:10:39.826968 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:39.827924 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:39.666241 30563 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.663630 30811 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:39.838532 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.842705 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:39.839041 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.839561 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.824982 30737 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:39.666738 30568 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:39.849692 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:39.850505 24667 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:39.654666 30776 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:39.852471 24599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.019s	sys 0.024s
I20260709 13:10:39.853667 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:39.855108 24522 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:39.855542 24599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.019s	sys 0.024s
W20260709 13:10:39.858086 30762 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 1.617s	user 0.011s	sys 0.014s
W20260709 13:10:39.862985 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.851032 30794 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:10:39.872208 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.044s
W20260709 13:10:39.872618 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.006s	sys 0.044s
I20260709 13:10:39.875403 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.875612 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.877863 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.880052 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.827091 30553 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.832623 30566 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:10:39.856258 30657 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.891054 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:39.870229 30568 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:39.877990 30809 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:10:39.863888 30792 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.895570 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:39.883023 30534 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:39.852361 30737 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:39.850652 30811 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:39.891137 30665 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:39.897884 30568 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:39.900146 30799 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.900976 30631 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:39.904228 30534 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:39.904677 30712 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.727s	user 0.013s	sys 0.000s
I20260709 13:10:39.920403 30568 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:39.945864 24665 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:39.946720 24670 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.013s	sys 0.020s
W20260709 13:10:39.947319 24670 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.013s	sys 0.021s
W20260709 13:10:39.941610 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.013s	sys 0.020s
W20260709 13:10:39.923341 30807 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
W20260709 13:10:39.946488 30496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.010s	sys 0.022s
W20260709 13:10:39.941201 24673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.009s	sys 0.022s
I20260709 13:10:39.926429 30534 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:39.954706 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.014s	sys 0.020s
I20260709 13:10:39.951133 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:39.905396 30792 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:39.942075 29955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.006s	sys 0.025s
W20260709 13:10:39.951800 30781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.020s	sys 0.012s
W20260709 13:10:39.973210 24673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.010s	sys 0.022s
I20260709 13:10:39.956669 30715 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:39.916712 30802 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.931859 30817 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:40.002664 30817 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:40.004391 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1314) took 1653 ms. Trace:
I20260709 13:10:40.004905 25218 rpcz_store.cc:276] 0709 13:10:38.351451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.817682 (+466231us) service_pool.cc:224] Handling call
0709 13:10:38.817991 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.943380 (+125389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.004082 (+1060702us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400532354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:40.004318 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286934912}
I20260709 13:10:39.986265 30752 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.008553 30752 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.011148 30752 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:39.981747 30811 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:39.971529 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3520) took 1520 ms. Trace:
I20260709 13:10:39.920392 30665 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:39.991034 24665 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:39.969324 30496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.010s	sys 0.022s
W20260709 13:10:39.983089 30808 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:10:39.991863 29955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.007s	sys 0.025s
W20260709 13:10:40.001128 30805 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.315s	user 0.000s	sys 0.002s
I20260709 13:10:39.987696 30815 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.015590 30679 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.027964 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1391) took 1216 ms. Trace:
I20260709 13:10:40.031623 24665 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:40.043525 30658 consensus_meta.cc:287] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.003s
I20260709 13:10:40.050585 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1386) took 1640 ms. Trace:
I20260709 13:10:40.022158 30657 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:40.030242 30820 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.051335 24669 rpcz_store.cc:276] 0709 13:10:38.410461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.412191 (+  1730us) service_pool.cc:224] Handling call
0709 13:10:38.412604 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.423617 (+ 11013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.423649 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.424063 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.933716 (+509653us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:38.933761 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.043862 (+1110101us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b54001388d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:40.043928 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.043996 (+    68us) raft_consensus.cc:1685] finished
0709 13:10:40.044018 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.050505 (+  6487us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4712,"spinlock_wait_cycles":24497408,"thread_start_us":460848,"threads_started":1,"wal-append.queue_time_us":780116}
I20260709 13:10:40.050633 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:40.045986 24674 rpcz_store.cc:276] 0709 13:10:38.811948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.867227 (+ 55279us) service_pool.cc:224] Handling call
0709 13:10:38.867498 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.867823 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:38.873305 (+  5482us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.873763 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:10:39.318871 (+445108us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:39.319032 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.319122 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.027738 (+708616us) raft_consensus.cc:1685] finished
0709 13:10:40.027763 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.027906 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5698,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":69,"thread_start_us":443590,"threads_started":1,"wal-append.queue_time_us":715994}
I20260709 13:10:40.046941 30754 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.061659 30666 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.057250 30658 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.062273 30666 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.064121 30658 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.061399 30754 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.064177 30666 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.041321 30461 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:40.041669 30647 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.081686 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1308) took 2011 ms. Trace:
W20260709 13:10:40.066085 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.072453 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2126) took 1657 ms. Trace:
I20260709 13:10:40.082163 25215 rpcz_store.cc:276] 0709 13:10:38.070295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.089959 (+ 19664us) service_pool.cc:224] Handling call
0709 13:10:38.126426 (+ 36467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.477689 (+1351263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.081307 (+603618us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54007b6bd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:40.081581 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3106057984}
I20260709 13:10:40.082933 24671 rpcz_store.cc:276] 0709 13:10:38.414549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.414662 (+   113us) service_pool.cc:224] Handling call
0709 13:10:39.479702 (+1065040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.479917 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.479942 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.479983 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:39.480020 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.480098 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.072217 (+592119us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540044dc50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:40.072375 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448643456}
I20260709 13:10:40.042208 30783 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:40.048525 30631 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.045264 30822 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:40.056418 30776 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:40.079464 30766 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.717s	user 0.010s	sys 0.012s
I20260709 13:10:40.080261 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1312) took 1731 ms. Trace:
I20260709 13:10:40.081116 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1304) took 2080 ms. Trace:
I20260709 13:10:40.118358 25214 rpcz_store.cc:276] 0709 13:10:38.349405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.425109 (+ 75704us) service_pool.cc:224] Handling call
0709 13:10:40.080048 (+1654939us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540007c454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:40.080204 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393171712}
I20260709 13:10:40.119886 25211 rpcz_store.cc:276] 0709 13:10:38.002022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.002360 (+   338us) service_pool.cc:224] Handling call
0709 13:10:40.080945 (+2078585us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b5400478954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:40.081044 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803793664}
I20260709 13:10:40.055330 30815 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.054694 30679 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.060048 30657 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.082329 30553 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.003626 30817 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:39.998901 30781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.021s	sys 0.012s
I20260709 13:10:40.092374 30461 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:40.139578 30825 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:10:40.139777 30802 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:40.140519 30823 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:40.141460 30817 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.123821 30737 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.145743 30792 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:40.152452 30792 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:40.146301 30815 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.094785 30647 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.108263 30631 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.158689 30461 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.106303 30783 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.066922 30820 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.153017 30792 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:40.169689 30806 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.519s	user 0.003s	sys 0.002s
I20260709 13:10:40.164927 30639 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.123098 30822 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.170550 30679 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.172114 30657 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.178789 30461 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:40.183228 30833 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.304513 30833 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.218420 30783 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.304988 30631 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.256597 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.259975 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.260514 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:40.267277 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2236) took 2256 ms. Trace:
W20260709 13:10:40.268100 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.276768 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 226069us
W20260709 13:10:40.279458 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.023658 24670 rpcz_store.cc:276] 0709 13:10:38.457140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.457411 (+   271us) service_pool.cc:224] Handling call
0709 13:10:38.458077 (+   666us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:38.652140 (+194063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.652188 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:38.663072 (+ 10884us) log.cc:844] Serialized 624 byte log entry
0709 13:10:39.198475 (+535403us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:39.238095 (+ 39620us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.439555 (+201460us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b1800332740. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:10:39.953812 (+514257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.953920 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.953966 (+    46us) raft_consensus.cc:1685] finished
0709 13:10:39.971204 (+ 17238us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.971443 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13204,"prepare.queue_time_us":38742,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3691,"raft.queue_time_us":217452,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":5567,"spinlock_wait_cycles":5066624,"thread_start_us":1008783,"threads_started":2,"wal-append.queue_time_us":703299}
I20260709 13:10:40.285944 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:40.294507 30130 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.296720 30348 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.169021 30534 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.299283 30568 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.195029 30665 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:40.254211 24519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.050s	sys 0.087s
I20260709 13:10:40.215149 30822 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.221616 30820 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.216903 30792 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:40.346088 30647 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:40.347451 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:40.349293 30130 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.349880 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.350996 30792 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:40.315306 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:40.256402 24521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.019s	sys 0.051s
W20260709 13:10:40.352035 24521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.020s	sys 0.051s
I20260709 13:10:40.352147 30130 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.353366 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2227) took 1124 ms. Trace:
I20260709 13:10:40.329159 30796 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:40.356139 30796 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.352808 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:40.357364 30348 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.353853 24521 rpcz_store.cc:276] 0709 13:10:39.228486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.228641 (+   155us) service_pool.cc:224] Handling call
0709 13:10:39.229041 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.229312 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:39.583596 (+354284us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.352681 (+769085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.352790 (+   109us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:40.352870 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.353001 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.353255 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":663528,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":2478,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":317,"thread_start_us":1122449,"threads_started":2,"wal-append.queue_time_us":477656}
I20260709 13:10:40.358330 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.359463 24516 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:40.360147 30348 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.366384 30534 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:40.367308 24519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.050s	sys 0.087s
I20260709 13:10:40.370937 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3402) took 1203 ms. Trace:
I20260709 13:10:40.371376 24519 rpcz_store.cc:276] 0709 13:10:39.167195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.167456 (+   261us) service_pool.cc:224] Handling call
0709 13:10:39.168191 (+   735us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:39.234036 (+ 65845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.234162 (+   126us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:39.434368 (+200206us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b2c00000c88. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:10:39.435172 (+   804us) log.cc:844] Serialized 598 byte log entry
0709 13:10:40.368139 (+932967us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:40.368199 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.370481 (+  2282us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b54003dccd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:40.370542 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.370602 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:40.370618 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.370872 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":736,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":4102,"spinlock_wait_cycles":157433472,"thread_start_us":932285,"threads_started":1,"wal-append.queue_time_us":621560}
W20260709 13:10:40.342571 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.375032 30568 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:40.333818 24524 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:40.376295 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.378278 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.380221 25218 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:10:40.398597 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.385869 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.386945 30833 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:40.387676 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 102234us
I20260709 13:10:40.388845 30754 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.389071 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.393558 30348 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:40.401681 24669 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:40.402823 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.413555 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:40.413865 30784 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.081s	user 0.005s	sys 0.003s
I20260709 13:10:40.414357 24524 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.416811 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.417927 25213 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:40.417876 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1385) took 2007 ms. Trace:
I20260709 13:10:40.419327 24670 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:40.418398 24668 rpcz_store.cc:276] 0709 13:10:38.410134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.410307 (+   173us) service_pool.cc:224] Handling call
0709 13:10:38.410701 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.411101 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.411129 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.411617 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.953737 (+542120us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:38.953792 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.953877 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.412942 (+1459065us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:40.417231 (+  4289us) raft_consensus.cc:1685] finished
0709 13:10:40.417252 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.417641 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":4542208,"thread_start_us":541680,"threads_started":1,"wal-append.queue_time_us":865778}
I20260709 13:10:40.420447 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.403245 30348 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.421483 30348 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.399998 30631 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.426555 24518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 1333) took 1851 ms (client timeout 1599 ms). Trace:
W20260709 13:10:40.427153 24518 rpcz_store.cc:269] 0709 13:10:38.574751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.578084 (+  3333us) service_pool.cc:224] Handling call
0709 13:10:40.425981 (+1847897us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b54003defd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:40.426267 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117539712}
I20260709 13:10:40.406594 25211 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:40.405036 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:40.396791 30534 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:40.437955 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.325727 24597 rpcz_store.cc:276] 0709 13:10:38.010851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.010967 (+   116us) service_pool.cc:224] Handling call
0709 13:10:38.011290 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.011610 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:10:38.011863 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.426463 (+414600us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.426924 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.427059 (+   135us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:38.427089 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.427156 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.428199 (+  1043us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b180049cfc0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:40.078924 (+1650725us) spinlock_profiling.cc:243] Waited 9.67 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:40.266386 (+187462us) raft_consensus.cc:1685] finished
0709 13:10:40.266468 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.266899 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13391,"prepare.queue_time_us":38219,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":145509,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":26554,"spinlock_wait_cycles":39752704,"thread_start_us":414246,"threads_started":2,"wal-append.queue_time_us":299827}
I20260709 13:10:40.443143 30494 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:40.444211 30796 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:40.445190 30752 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:40.455216 30630 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.456338 30630 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.457724 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1270) took 2062 ms. Trace:
I20260709 13:10:40.459436 30630 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.458159 24600 rpcz_store.cc:276] 0709 13:10:38.395503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.441488 (+ 45985us) service_pool.cc:224] Handling call
0709 13:10:38.441826 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.621656 (+179830us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:38.621939 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.436769 (+814830us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b18004dc620. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:39.645359 (+208590us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.663563 (+ 18204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.663635 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:39.663694 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.457162 (+793468us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001cbe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:40.457259 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.457532 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30558,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":18475,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":27440,"spinlock_wait_cycles":451821312,"thread_start_us":1022591,"threads_started":2,"wal-append.queue_time_us":604110}
I20260709 13:10:40.460759 30754 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.461589 30754 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.467108 30496 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:40.447422 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.005s
I20260709 13:10:40.410913 30647 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:40.424772 30631 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:40.472415 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.008s	sys 0.006s
I20260709 13:10:40.473325 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:40.475788 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.464676 30754 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:40.479001 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 43557.3us
I20260709 13:10:40.487979 30838 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.489003 30838 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.492261 24599 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:40.493949 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:40.494545 24594 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:40.494807 24668 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.495879 24600 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:40.496770 30833 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.497500 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.497471 30833 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:40.498071 30461 raft_consensus.cc:670] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 13:10:40.498540 24525 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:40.498812 30792 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.499513 30792 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.500042 30833 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.502151 30792 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.506652 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1279) took 1229 ms. Trace:
I20260709 13:10:40.508876 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:40.511531 24595 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:40.485524 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 653615us
W20260709 13:10:40.514760 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 71634.7us
I20260709 13:10:40.518731 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.519059 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.520112 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.526199 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:40.522866 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:40.528155 25213 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:40.529692 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.531661 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.532742 24597 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:40.525732 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:40.510425 24592 rpcz_store.cc:276] 0709 13:10:39.277340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.300059 (+ 22719us) service_pool.cc:224] Handling call
0709 13:10:39.300405 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.349241 (+ 48836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.349286 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.349341 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:39.349400 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.506176 (+1156776us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54001caf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:40.506239 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.506443 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83136,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":111493376}
I20260709 13:10:40.540969 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.541225 24591 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:40.542135 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:40.545027 30821 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.545285 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.545794 30821 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.546334 24671 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:40.547264 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.548009 24671 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:40.548255 30821 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:40.548724 30563 consensus_meta.cc:287] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.700s	user 0.001s	sys 0.019s
I20260709 13:10:40.549078 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.514415 30534 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.549691 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:40.546094 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.545035 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.553797 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.554992 24600 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.549538 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.558888 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.560631 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.524518 30647 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.559508 24670 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:40.564210 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.571264 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.538959 30348 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.549324 30665 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.575752 30754 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:40.576030 30792 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:40.577554 30067 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:40.581291 24516 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:40.572970 24594 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 12.
I20260709 13:10:40.581576 24669 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.581609 25218 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:40.584257 24517 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:40.589763 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.596050 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:40.595580 24524 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:40.598328 24674 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:40.561122 30563 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:40.600735 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:40.601377 24519 pending_rounds.cc:85] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 12
I20260709 13:10:40.601730 24519 pending_rounds.cc:107] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:10:40.602000 24519 raft_consensus.cc:2889] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.605836 24525 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 14: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:40.603708 25219 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:40.609815 24666 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:40.610963 30665 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.600788 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.616055 25213 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:40.618321 24597 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:10:40.610173 24666 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:40.626220 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.617923 30631 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.625169 25211 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:40.595166 30067 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:40.631603 24668 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:40.624255 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:40.616689 30841 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:10:40.640470 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3526) took 1359 ms. Trace:
W20260709 13:10:40.646270 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 124117us
I20260709 13:10:40.641954 24673 rpcz_store.cc:276] 0709 13:10:39.280601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.281355 (+   754us) service_pool.cc:224] Handling call
0709 13:10:39.298011 (+ 16656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.992132 (+694121us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:40.000868 (+  8736us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.281257 (+280389us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.282337 (+  1080us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.282548 (+   211us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:40.282608 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.282721 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.637143 (+354422us) raft_consensus.cc:1685] finished
0709 13:10:40.637166 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.640256 (+  3090us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7776,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":151914,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":204,"thread_start_us":972830,"threads_started":2,"wal-append.queue_time_us":210792}
I20260709 13:10:40.637957 30754 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.656025 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.658694 30754 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.649784 30792 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.660287 30067 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.665665 30792 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.661031 24517 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:40.649561 30847 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:40.668219 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.669744 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.671084 25211 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
W20260709 13:10:40.671612 30846 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:10:40.670110 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.672186 30849 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:40.672703 24518 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:40.675582 24525 raft_consensus.cc:2410] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:10:40.678301 30496 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:40.666531 30067 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:40.662385 30665 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.690176 24669 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:40.669027 30847 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:40.698280 30847 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:40.699685 30847 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.702117 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:40.689786 24666 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.710701 24595 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:40.712996 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:40.726056 25213 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:40.721980 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.722486 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.721563 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.727346 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.727735 25216 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:40.728446 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.728557 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.728957 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.729206 25214 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:40.717921 30461 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:40.727397 25212 raft_consensus.cc:2393] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:40.731693 30838 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:40.732947 30832 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:40.733559 30832 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:40.734822 30832 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.729140 25217 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:40.741714 30534 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.755956 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.756649 25219 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
W20260709 13:10:40.767349 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.772631 24666 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:40.757184 30832 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.770185 30838 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:40.777669 30838 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.779424 30838 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:40.780891 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.781690 25213 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:40.782189 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 118513us
I20260709 13:10:40.783195 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:40.783419 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:40.784835 25182 leader_election.cc:400] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20.
I20260709 13:10:40.798653 25182 leader_election.cc:403] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:40.786250 30844 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:40.787396 30792 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:40.787818 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61013.9us
W20260709 13:10:40.789203 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 95187.5us
I20260709 13:10:40.789309 30752 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:10:40.771410 30647 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:40.796033 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.799028 25210 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:40.799796 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.804309 25218 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:40.809026 24600 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:40.819255 25211 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:40.821738 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:40.822569 24520 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:40.823789 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.827023 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:40.827984 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:40.770210 30348 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:40.829613 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.830004 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:40.830961 24671 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:40.841179 24520 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:10:40.845768 25213 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
W20260709 13:10:40.856093 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.856683 24666 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:10:40.858121 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:40.802469 30496 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:40.862337 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.863582 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.864648 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:40.865648 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:40.868012 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.852880 30348 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.870483 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:40.868839 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:40.877048 25212 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:40.856314 30792 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20.
I20260709 13:10:40.857153 24666 pending_rounds.cc:85] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 13
I20260709 13:10:40.881405 24666 pending_rounds.cc:107] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:10:40.882093 24666 raft_consensus.cc:2889] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.881302 25216 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:40.873660 30838 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:40.888411 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 103456us
I20260709 13:10:40.889590 25219 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.882699 30534 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:10:40.893366 24516 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:40.883217 30665 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:40.889556 25214 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:40.898054 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:40.899991 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:40.891901 30838 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:40.907995 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50695.9us
I20260709 13:10:40.905169 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:40.897364 30665 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:40.913237 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 128665us
I20260709 13:10:40.903846 30630 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:40.935174 30630 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.935675 30630 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:40.936196 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:40.913657 30647 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:10:40.932674 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:40.908021 30348 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:40.933665 30821 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.906034 30838 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:40.927273 30496 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:40.924762 30631 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:40.929818 30665 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:40.951789 30639 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.764s	user 0.006s	sys 0.010s
I20260709 13:10:40.957782 24667 raft_consensus.cc:2410] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:40.946660 30534 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:40.946206 30563 raft_consensus.cc:2955] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Committing config change with OpId 12.9: config changed from index 5 to 9, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:10:40.960722 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55214.9us
I20260709 13:10:40.971331 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:40.974999 30754 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:40.977038 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:40.979228 30754 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:40.980350 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44298.6us
I20260709 13:10:40.943697 30796 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:40.947260 30496 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:40.986763 25212 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
W20260709 13:10:40.991288 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61602.4us
I20260709 13:10:40.996989 30847 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.985004 30796 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:41.016650 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 84080.9us
I20260709 13:10:41.000167 30752 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.025206 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:41.025827 30861 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:41.026810 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:41.014204 30796 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.037720 30861 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:41.038187 30861 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.038518 30861 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.040407 30630 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.034583 30847 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.042769 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:41.046893 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2134) took 1193 ms. Trace:
I20260709 13:10:41.049391 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:41.047158 24420 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:41.053907 30752 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.052099 24667 rpcz_store.cc:276] 0709 13:10:39.853234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.853384 (+   150us) service_pool.cc:224] Handling call
0709 13:10:41.046617 (+1193233us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540040a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:41.046795 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534085504}
I20260709 13:10:41.060274 30858 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:41.060770 30858 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:41.061199 30858 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.064167 30348 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.065116 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:41.067049 30534 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:41.067440 30534 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.067817 30534 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:41.070887 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44202.8us
W20260709 13:10:41.074299 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56756us
I20260709 13:10:41.075243 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:41.081730 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 104842us
I20260709 13:10:41.077356 30647 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:41.093222 24600 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:41.094163 24595 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:10:41.095038 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.095903 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.100226 25212 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:41.100181 25219 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:41.079679 30752 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.116710 30873 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:41.116986 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:41.117422 30873 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.095739 30844 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:10:41.132001 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.132424 30630 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:41.133392 30630 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:41.133450 30858 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.135931 30858 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:41.097119 30631 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:41.132660 30864 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:41.137806 25210 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:41.140236 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:41.096643 30647 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:41.132351 30873 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.145886 25212 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:41.147332 25215 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:41.144587 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49634.7us
I20260709 13:10:41.124382 30844 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:41.120816 30783 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.132054 30833 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:41.149761 30647 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:41.143172 30864 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:41.161649 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 67362.9us
I20260709 13:10:41.162674 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:41.163836 24600 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:41.164300 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47408.8us
W20260709 13:10:41.156661 24490 connection.cc:256] RPC call timeout handler was delayed by -1.1311776469999586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:10:41.165828 24490 connection.cc:256] RPC call timeout handler was delayed by -1.0994443069998852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:10:41.166559 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.170531 24597 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:41.174154 30631 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.177678 30844 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.179698 30844 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.184021 30665 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.168042 30847 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:41.196393 24525 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:41.157474 30873 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:41.197489 30873 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.199604 30873 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.165329 30864 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:41.205274 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 43878.8us
I20260709 13:10:41.206071 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:41.206272 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.206473 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.207832 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:41.208050 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:41.208237 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:41.208750 24596 raft_consensus.cc:2368] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18.
I20260709 13:10:41.208379 24591 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:10:41.208669 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:41.214844 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48328.7us
I20260709 13:10:41.252077 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:41.266875 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51211.8us
I20260709 13:10:41.273713 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.264219 24600 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:41.216578 30639 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:41.276902 24594 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:41.218892 30873 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.303135 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.251497 30858 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:41.252970 30833 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:10:41.305876 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.305442 24599 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:41.305189 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47650.8us
I20260709 13:10:41.269604 30752 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.311887 24600 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
W20260709 13:10:41.317394 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.299494 30348 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:41.331000 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62094.8us
I20260709 13:10:41.300660 30870 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:41.307245 30639 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:41.344625 30849 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:41.345369 30849 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.347468 30849 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.352183 30838 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.354403 30838 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:41.355279 24597 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:41.358507 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:41.359359 24525 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:41.360422 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:41.361214 24519 raft_consensus.cc:2368] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22.
I20260709 13:10:41.361430 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:41.361477 30870 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:41.362015 30348 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.363642 30821 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.363334 30870 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.365867 30868 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:41.366479 30868 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.367937 30783 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.369007 30496 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.369309 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.329116 30752 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.368896 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.362038 24520 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:10:41.360070 30639 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.378774 24591 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:10:41.348474 30534 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:41.401763 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 128126us
I20260709 13:10:41.402249 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.404364 24594 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:41.404489 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:41.310143 30873 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.405360 24519 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.409206 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:41.411105 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.368917 30868 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.328470 30861 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.415851 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:41.461943 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 253760us
I20260709 13:10:41.467917 24592 raft_consensus.cc:2368] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
W20260709 13:10:41.467418 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 136415us
I20260709 13:10:41.453548 30833 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:41.459848 30868 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.459384 30752 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.466310 30665 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:41.466111 30348 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:41.512380 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 128168us
I20260709 13:10:41.508826 30754 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:10:41.514288 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.515189 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.516198 24667 raft_consensus.cc:2410] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:10:41.516993 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.517131 30874 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.517764 24670 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:41.517930 30874 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.515239 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.519922 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.521015 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.525738 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.509896 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.529867 24670 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18.
W20260709 13:10:41.531801 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 362577us
I20260709 13:10:41.536199 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.539393 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.542577 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:41.543879 30869 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.544180 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.544502 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.544919 24666 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:41.546399 25212 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:41.547479 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:41.548291 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 82637.5us
I20260709 13:10:41.548625 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.506898 24594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:41.549655 24594 raft_consensus.cc:606] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:41.550037 24594 raft_consensus.cc:614] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.550153 30861 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.550546 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.551115 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.551604 24669 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:41.552042 24594 raft_consensus.cc:2410] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:10:41.553115 25213 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:10:41.553541 25213 pending_rounds.cc:85] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 13
I20260709 13:10:41.553419 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.553892 25213 pending_rounds.cc:107] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:10:41.553980 24670 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:41.554302 25213 raft_consensus.cc:2889] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.540622 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.554656 25213 pending_rounds.cc:107] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:10:41.555012 25217 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:41.555860 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.552486 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.554957 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.557938 24598 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:41.554970 25213 raft_consensus.cc:2889] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.559254 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.537770 24593 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:41.556797 25216 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:41.557392 24667 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:41.565361 30874 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.566679 30534 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.567235 24598 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.570449 25217 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:41.570695 30878 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:10:41.571295 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.572379 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:41.573730 30563 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:10:41.544543 30869 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.578874 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.578776 30864 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:41.582913 30881 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:41.583432 24598 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:41.510144 30868 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.586889 30868 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.587532 24591 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:41.591930 30496 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:41.605306 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 111157us
I20260709 13:10:41.625288 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.596395 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.626194 25218 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:41.601670 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:41.626852 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:41.624789 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 85829us
I20260709 13:10:41.627472 25210 raft_consensus.cc:2376] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16. Re-sending same reply.
W20260709 13:10:41.633152 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.560204 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:41.632493 25215 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:41.636580 24599 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:41.576897 30869 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.641659 24592 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:41.642659 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54184.5us
W20260709 13:10:41.639997 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 96067.3us
I20260709 13:10:41.646708 30534 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:41.646035 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:41.640820 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:41.651885 25185 leader_election.cc:400] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18.
I20260709 13:10:41.652333 25185 leader_election.cc:403] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:41.601132 30873 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:41.655244 30883 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:41.678812 30865 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.656018 30461 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:41.679447 30461 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.656626 24639 leader_election.cc:400] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:41.605579 30752 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:10:41.651731 30874 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:41.661566 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.662854 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:41.663390 30872 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:41.665823 30847 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:41.666420 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.667618 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.671288 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:41.671697 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:41.674759 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:41.683583 30798 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:41.677749 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:41.678908 30883 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.655108 30534 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.705771 30534 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:41.709371 25219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:10:41.710012 25219 raft_consensus.cc:606] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:41.688355 30877 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:41.711246 30877 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:41.712256 30877 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:41.708258 24420 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 12 to 16, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 16 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:41.688767 30872 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.720858 24420 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 9 to 21, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:41.722851 30872 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.723053 24420 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:41.691323 30874 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.724934 24420 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.647841 30496 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:10:41.726619 24420 catalog_manager.cc:5697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 9 to 13, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 13 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.680043 24639 leader_election.cc:403] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:41.680444 24563 leader_election.cc:400] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22.
I20260709 13:10:41.682942 24596 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:41.735306 24563 leader_election.cc:403] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:41.685591 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:41.600245 30647 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.689615 24672 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:41.688592 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:41.679854 30461 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:41.693109 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.695312 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:41.689873 30869 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.696260 30833 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:41.697213 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.697922 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:41.759136 24666 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:41.703517 30884 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:10:41.736474 24525 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:41.738930 24517 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:10:41.690584 30796 consensus_meta.cc:287] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.001s
W20260709 13:10:41.741039 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63369.9us
I20260709 13:10:41.740046 24674 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:41.690366 30864 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:41.767836 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 73614.1us
I20260709 13:10:41.768682 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:41.760854 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 83920.7us
I20260709 13:10:41.770210 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:41.732940 30883 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:41.693861 30844 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:41.758865 24673 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:41.737622 30348 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:41.773120 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:41.774905 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 103304us
W20260709 13:10:41.775656 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 114239us
I20260709 13:10:41.737849 30849 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:41.774269 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.781876 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:41.778019 24420 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 11 to 13, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 13 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:41.764717 30496 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:41.798051 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.803696 25219 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:41.793433 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.793692 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:41.793220 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:41.805570 25215 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:41.806391 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 111180us
W20260709 13:10:41.808945 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.766405 30534 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15.
I20260709 13:10:41.832651 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:41.831943 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:41.782141 30868 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:41.830402 25210 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:41.766592 30872 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22.
I20260709 13:10:41.833526 24596 raft_consensus.cc:606] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:41.835502 24596 raft_consensus.cc:614] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.828248 24672 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:41.792497 30754 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:41.798427 30792 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:41.785002 30348 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:41.834618 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.844907 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:41.847579 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 74572.4us
I20260709 13:10:41.855918 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.786365 30882 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:41.855401 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.769227 30796 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.807792 30496 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.854271 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.797291 30888 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:41.866318 24666 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:41.797503 30849 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:41.861805 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:41.834980 30844 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:41.861564 24673 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:41.839749 30754 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:41.865823 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:41.873986 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:41.874605 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:41.875175 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 235813us
I20260709 13:10:41.883551 24670 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:10:41.884945 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:41.922843 24521 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:41.835153 30868 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:41.902726 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:41.906078 24518 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:41.904850 24525 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:41.865347 24523 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:41.852028 30792 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.851359 30874 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.924379 24671 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:41.926507 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:41.929256 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:41.865245 30496 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:41.863389 30882 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:41.922607 24670 pending_rounds.cc:85] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 11
I20260709 13:10:41.957150 24670 pending_rounds.cc:107] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:10:41.957500 24670 raft_consensus.cc:2889] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.930163 24420 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.952629 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:41.953846 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:41.960001 24596 raft_consensus.cc:606] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:41.960427 24596 raft_consensus.cc:614] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.920883 30798 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:41.931331 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:41.930028 30868 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:41.962847 30821 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:41.963058 30888 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:41.963253 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 104811us
I20260709 13:10:41.963798 30869 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:41.967463 30754 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.924714 30639 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:41.969170 30882 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.969954 24523 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:41.971277 30849 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.953327 30863 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:41.959399 24522 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:41.955278 30792 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.929508 30348 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.023085 30348 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.975257 30865 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18.
I20260709 13:10:41.977370 24524 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:41.980726 30496 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.007926 30639 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:42.028368 30496 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.992663 30888 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:42.030015 30639 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:42.031453 30796 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:41.986179 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.032904 30647 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:41.924165 30847 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:41.990857 24521 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
W20260709 13:10:41.991719 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 134955us
I20260709 13:10:41.975656 24420 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 18, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 18 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:41.967607 30883 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:41.994518 25215 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:42.007115 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:42.009480 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:42.048048 24596 raft_consensus.cc:606] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:42.048545 24596 raft_consensus.cc:614] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:42.013224 24417 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 349) took 27753 ms (client timeout 15000 ms). Trace:
W20260709 13:10:42.013927 30892 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:42.014801 30905 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:42.016027 30658 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:42.053368 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.015919 24525 raft_consensus.cc:2955] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 5 to 9, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:10:42.018164 30894 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:42.019301 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:42.020033 30754 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:42.004361 30844 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:42.004673 30821 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:42.021948 30882 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.026541 30865 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:41.984705 24519 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.000s
I20260709 13:10:42.040035 30847 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:41.976207 24666 raft_consensus.cc:2955] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 5 to 9, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:42.069999 24519 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:42.037416 24517 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
W20260709 13:10:42.070050 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 239917us
I20260709 13:10:42.085041 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:42.069437 24420 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 12 to 14, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 14 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:10:42.095669 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 76423.3us
I20260709 13:10:42.096990 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:42.067142 30844 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:42.077955 30847 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.101336 24420 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 11 to 12, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 12 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:10:42.120733 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.078331 30658 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:42.181497 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 306993us
I20260709 13:10:42.097851 30796 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:42.181183 24420 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:42.185988 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:42.187835 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 83398us
W20260709 13:10:42.188854 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 91954.8us
I20260709 13:10:42.189646 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:42.190382 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 305865us
I20260709 13:10:42.108752 30844 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:42.196803 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.186088 30894 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:10:42.102691 30563 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:10:42.181770 30869 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.206842 24420 catalog_manager.cc:5697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 5 to 14, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 14 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:10:42.208004 30913 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:10:42.208788 30821 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:42.209334 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.213713 30833 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:42.214290 30461 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.282943 30461 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:42.215708 30882 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:42.216704 30883 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:42.224079 30849 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.230176 30792 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.290639 30792 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:42.231384 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:42.206869 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 219630us
I20260709 13:10:42.291918 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:42.292013 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 88392us
I20260709 13:10:42.292883 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:42.293886 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:42.294054 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:42.295174 30877 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:42.295984 30877 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:42.296344 30877 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:42.296772 30877 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:42.298790 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:42.299710 30883 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:42.300127 30883 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:42.300572 30883 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:42.203161 30861 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:42.300344 30888 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:42.304984 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59245.8us
W20260709 13:10:42.305827 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 116255us
I20260709 13:10:42.309031 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:10:42.245785 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 360776us
I20260709 13:10:42.200268 30796 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:42.255937 24667 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:10:42.049517 24417 rpcz_store.cc:269] 0709 13:10:14.113289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.121346 (+  8057us) service_pool.cc:224] Handling call
0709 13:10:41.858448 (+27737102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:34.525140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:34.525783 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:34.525847 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:10:34.525865 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:34.527576 (+  1711us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:34.527679 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:34.527706 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:10:34.529616 (+  1910us) tablet.cc:701] Row locks acquired
0709 13:10:34.529665 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:10:34.529837 (+   172us) write_op.cc:270] Start()
0709 13:10:34.529991 (+   154us) write_op.cc:276] Timestamp: P: 1783602634529774 usec, L: 0
0709 13:10:34.530032 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:10:34.532986 (+  2954us) log.cc:844] Serialized 8306 byte log entry
0709 13:10:35.194785 (+661799us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17b8e3c0ac 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b
0709 13:10:36.342747 (+1147962us) op_driver.cc:464] REPLICATION: finished
0709 13:10:36.957642 (+614895us) write_op.cc:301] APPLY: starting
0709 13:10:36.957743 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:37.554987 (+597244us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:37.555033 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:37.937859 (+382826us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:37.938279 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:10:37.938340 (+    61us) write_op.cc:312] APPLY: finished
0709 13:10:37.938795 (+   455us) log.cc:844] Serialized 188 byte log entry
0709 13:10:38.100606 (+161811us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.138322 (+ 37716us) write_op.cc:454] Released schema lock
0709 13:10:38.157376 (+ 19054us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:38.232387 (+ 75011us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.238470 (+  6083us) write_op.cc:454] Released schema lock
0709 13:10:39.848315 (+1609845us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
Metrics: {"mutex_wait_us":274504,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":609239,"apply.run_cpu_time_us":43225,"apply.run_wall_time_us":1233669,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91907,"num_ops":21,"prepare.queue_time_us":101150,"prepare.run_cpu_time_us":52872,"prepare.run_wall_time_us":1207504,"raft.queue_time_us":296329,"raft.run_cpu_time_us":16928,"raft.run_wall_time_us":777689,"replication_time_us":1784547,"spinlock_wait_cycles":28509952,"thread_start_us":1880873,"threads_started":5,"wal-append.queue_time_us":1437967,"wal-append.run_cpu_time_us":37408,"wal-append.run_wall_time_us":4058755}]]}
W20260709 13:10:42.263470 30893 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:42.271775 30832 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.274080 30868 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.307888 30348 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:42.307562 30496 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:42.307389 30494 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:42.315721 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:42.322003 30915 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:10:42.322330 30911 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:42.334105 30911 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:42.334503 30911 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:42.326191 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.327997 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.323657 30832 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.339192 30832 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:42.339509 30844 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.341305 24599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:42.341915 24599 raft_consensus.cc:606] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:42.342242 24599 raft_consensus.cc:614] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:42.342150 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.342746 24670 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:42.345517 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.328140 30861 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:42.346143 24673 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:42.346204 30861 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:42.346774 30861 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:42.346872 24665 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:42.348639 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.332666 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:42.349221 24668 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.349718 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:42.350652 30844 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:42.325403 30847 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:42.352087 30665 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:42.352622 30665 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:42.353266 30658 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:42.353389 30847 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:42.353847 30658 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:42.354971 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:42.354781 30658 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:42.357771 30915 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:42.358016 24597 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:42.340818 30911 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.329445 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:42.361690 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:42.369274 24595 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:42.364079 24667 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:42.367476 24668 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:42.370522 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:42.358284 30915 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:42.375097 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:42.401736 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86603us
I20260709 13:10:42.401783 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.370788 30847 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.426661 30665 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.431028 24597 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: []
W20260709 13:10:42.431522 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56525.8us
I20260709 13:10:42.373450 30908 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.432399 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 107719us
I20260709 13:10:42.377568 30494 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:42.434113 24672 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:42.435621 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:42.436409 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:42.476369 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 169919us
I20260709 13:10:42.438686 30754 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:42.441474 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:42.374565 30913 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:10:42.442780 30915 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.445441 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:42.502666 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 187027us
I20260709 13:10:42.503686 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:42.446307 30883 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.446980 30888 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:42.448347 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:42.451224 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:42.507488 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56356.4us
I20260709 13:10:42.455461 30904 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:42.457376 30796 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.458752 30911 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.459167 30868 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:42.461028 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1950) took 1119 ms. Trace:
I20260709 13:10:42.462760 24673 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:42.462483 30861 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.542727 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:42.486294 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.487983 24595 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:42.478389 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:42.505988 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.401952 30647 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:10:42.517527 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:42.549533 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 71206.3us
I20260709 13:10:42.489161 30496 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:42.557485 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:42.551656 24600 rpcz_store.cc:276] 0709 13:10:41.342105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.377745 (+ 35640us) service_pool.cc:224] Handling call
0709 13:10:41.407146 (+ 29401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.447386 (+ 40240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.447433 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.493969 (+ 46536us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.783299 (+289330us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:41.791378 (+  8079us) log.cc:844] Serialized 14 byte log entry
0709 13:10:41.802806 (+ 11428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.802885 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.105798 (+302913us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18003458e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:42.460750 (+354952us) raft_consensus.cc:1685] finished
0709 13:10:42.460852 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.460974 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50707,"prepare.queue_time_us":9169,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":61695,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":69866,"spinlock_wait_cycles":2596096,"thread_start_us":250313,"threads_started":1,"wal-append.queue_time_us":311134}
I20260709 13:10:42.562497 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:42.567781 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:42.571717 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:42.577953 25214 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:42.580010 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.565850 30849 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:42.580732 24520 raft_consensus.cc:2368] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18.
I20260709 13:10:42.580915 24524 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:42.581007 30849 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.581521 30849 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.582051 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.582269 30883 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:42.582839 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.583003 30870 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:42.541190 30865 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.583794 30865 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.585530 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:42.586001 30865 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:42.561707 30798 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:42.587688 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 43875.8us
I20260709 13:10:42.588163 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:42.588408 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:42.588721 25216 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:42.589111 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:42.589702 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:42.590574 30630 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.590834 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:42.591269 30630 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:42.591656 30630 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:42.592028 30630 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:42.592692 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:42.593251 30872 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:42.616032 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:42.593515 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:42.494311 30908 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.594165 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:42.567816 30821 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:42.594187 30798 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:10:42.594820 30870 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:42.597642 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:42.618717 30870 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.619082 24673 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:10:42.619421 25182 leader_election.cc:400] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18.
I20260709 13:10:42.599455 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.601037 30849 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:42.589723 25215 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:42.516691 30882 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.584030 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.624974 24670 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:42.609434 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:42.511385 30904 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:42.542237 30639 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:42.513283 30348 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:42.567041 30917 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:42.514478 30658 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:10:42.566716 30832 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:10:42.611547 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.612164 30883 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:42.614789 30461 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:42.615707 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:42.617116 30865 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:42.617731 25217 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:42.619019 30908 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:42.514335 30847 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:42.621049 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:42.683329 24516 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:42.601214 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:42.684067 25210 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:42.601848 24517 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:42.621420 25216 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:42.621344 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:42.622234 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:42.622783 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:42.593670 30864 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:42.511977 30563 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:42.514674 30754 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:42.693199 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 100560us
W20260709 13:10:42.693704 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 71558.8us
I20260709 13:10:42.574025 30877 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.561509 30496 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.637630 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:42.645313 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.697204 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 102421us
I20260709 13:10:42.627902 30534 raft_consensus.cc:2764] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:42.694931 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:42.627609 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.680337 30862 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:42.670266 30863 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:42.697942 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:42.638520 30882 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.673870 30915 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.679838 30868 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:42.703495 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 82223.9us
I20260709 13:10:42.700948 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:42.686414 30847 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:42.711069 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 88372.9us
I20260709 13:10:42.695770 30844 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:42.711954 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:42.718394 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:42.733587 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:42.727542 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.697989 30496 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.700752 30913 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:10:42.735033 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.734957 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:42.719094 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:42.737699 24670 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:42.752205 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:42.748423 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:42.753486 24519 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:42.751391 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:42.754899 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.714658 30865 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:10:42.748028 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50160.3us
I20260709 13:10:42.759356 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:42.720847 30752 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:42.748628 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.748404 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:42.628072 30911 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.131s
I20260709 13:10:42.750811 30647 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:42.719545 30888 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:42.777988 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:42.770263 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 97260.9us
I20260709 13:10:42.687296 30494 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:42.775832 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.779057 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:42.791024 24517 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:10:42.735810 30847 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:42.735654 30913 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:42.747838 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 118471us
I20260709 13:10:42.785450 24518 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:10:42.786448 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 68148.4us
I20260709 13:10:42.756142 30905 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:42.787431 24672 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
W20260709 13:10:42.759753 30920 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:10:42.749769 30912 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:42.774958 30821 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:42.775111 30639 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:42.804215 30639 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:42.804286 30821 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:42.804077 30912 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.805325 30639 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.805501 30821 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.806629 30639 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:42.782586 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45230.1us
W20260709 13:10:42.820926 24490 connection.cc:256] RPC call timeout handler was delayed by -1.0001956930000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 13:10:42.755566 30833 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:10:42.754770 30868 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:42.854873 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 53039.3us
I20260709 13:10:42.725252 30863 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.756381 30630 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.830018 24525 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:10:42.787119 30865 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:42.787051 30931 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:42.779700 30754 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.724390 30904 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.823487 30913 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:42.823082 30924 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.907378 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:42.864048 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:42.912830 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 135066us
I20260709 13:10:42.829746 30888 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:42.951272 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:42.952054 30888 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:42.954610 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.915144 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 126808us
I20260709 13:10:42.765322 30348 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.951277 30863 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:42.956221 30863 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:42.942868 24519 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:10:42.864549 30861 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:42.956208 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:42.896270 30647 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:42.959138 24520 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:42.914086 30849 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:42.960249 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:42.944169 30792 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.970330 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 108063us
I20260709 13:10:42.971606 30792 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:42.977169 30938 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:42.977677 30938 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.978116 30938 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:42.981968 30927 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:10:42.983273 30931 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:42.958467 30908 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:42.988025 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.989394 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.991030 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.992105 24522 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:42.960819 30865 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:42.999097 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:42.999950 24519 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:42.965821 30877 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:42.967547 30658 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:43.021894 30461 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:43.022456 30461 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:43.023725 30461 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.026170 30461 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:10:43.031721 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.031975 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 156958us
I20260709 13:10:43.032917 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:43.034526 30792 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:43.038226 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.038811 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.039606 25210 raft_consensus.cc:2368] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:10:43.040670 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:43.042119 24516 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:10:42.988175 30912 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:42.989415 30908 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:42.957011 30863 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 13:10:43.054978 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 335944us
I20260709 13:10:43.058802 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.059823 24595 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:43.058809 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.045681 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:42.994123 30932 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:43.050000 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:43.044448 24490 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:43.067055 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.064976 25217 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:10:43.069372 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.069918 25217 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.053131 25215 raft_consensus.cc:2955] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 5 to 9, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:42.961335 30924 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:43.071586 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 210140us
I20260709 13:10:43.072045 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.073685 24591 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:10:43.074597 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.075201 24598 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:43.075314 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.077625 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.078488 24600 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:43.054747 30908 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.055104 30882 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:43.089748 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:43.090323 30918 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
I20260709 13:10:43.134855 30534 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:43.135932 30534 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:43.135732 30496 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.136334 30534 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:43.136909 24524 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 14: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:43.137929 30934 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:10:43.077711 30563 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.090885 30925 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.055912 30658 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:43.144608 24565 leader_election.cc:400] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:10:43.145005 24565 leader_election.cc:403] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.098073 30630 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:43.107234 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:43.081189 30858 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.090366 30865 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.091385 30935 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.083839 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.109179 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.108894 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:43.089208 30926 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:10:43.132166 30868 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:43.139637 25217 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:43.146823 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.089200 30939 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.140123 30869 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.002s
I20260709 13:10:43.084283 30932 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:43.166371 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:43.363281 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 196977us
W20260709 13:10:43.170740 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61910.3us
I20260709 13:10:43.143594 30905 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:43.172729 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 101946us
W20260709 13:10:43.225147 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.365952 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.253304 24598 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:43.268759 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3444) took 1213 ms. Trace:
I20260709 13:10:43.256500 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:43.367208 24593 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.366858 24521 rpcz_store.cc:276] 0709 13:10:42.055568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.055849 (+   281us) service_pool.cc:224] Handling call
0709 13:10:42.056239 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.067948 (+ 11709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.067975 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.070969 (+  2994us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.231139 (+160170us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b18004be680. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:42.504675 (+273536us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:42.504733 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.504835 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.258169 (+753334us) raft_consensus.cc:1685] finished
0709 13:10:43.258188 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.268697 (+ 10509us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7533,"raft.queue_time_us":13048,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6322,"spinlock_wait_cycles":2715392,"thread_start_us":269841,"threads_started":1,"wal-append.queue_time_us":594539}
W20260709 13:10:43.389539 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.153914 30563 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:43.428664 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.256359 25210 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:43.261336 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:43.400070 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:43.316425 24591 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:43.410748 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46299us
I20260709 13:10:43.169852 30862 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:10:43.169953 30935 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:43.357798 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 214268us
I20260709 13:10:43.453548 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:43.356770 30883 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:43.399876 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:43.303707 30945 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:10:43.358603 30934 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:10:43.265661 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 282137us
I20260709 13:10:43.462738 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:43.359174 30821 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.367770 30905 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:43.264225 30630 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.417862 30869 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.440994 30870 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:43.155767 30534 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.458451 30935 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.472530 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:43.446811 30912 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.252580 30847 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:43.507894 24596 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:43.476707 24518 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:43.399991 30925 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.461709 30883 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.484120 30862 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:43.172984 30858 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.508910 24518 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:43.473608 30821 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:43.524668 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 71125.2us
I20260709 13:10:43.511726 25210 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:43.500519 30926 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.305598 30658 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.483815 30348 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:43.483337 30870 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:43.399381 30939 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:43.545622 30883 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.252207 30931 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:43.556366 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 93731.6us
I20260709 13:10:43.499315 30630 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.563380 24592 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:43.552384 30933 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:43.514380 30912 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.549237 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:43.558775 24518 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.559070 30870 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.548214 30957 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:43.595293 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 46143us
I20260709 13:10:43.613883 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:43.604656 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:43.605844 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:43.615090 25210 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:43.615262 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.615577 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.616006 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:43.559587 30792 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.607374 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.559448 30496 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:43.612396 24518 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.612690 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.616637 25210 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:43.525301 30925 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:43.557044 30926 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:43.554266 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 188985us
I20260709 13:10:43.611464 30832 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.627978 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.632052 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.632614 24599 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:43.581911 30348 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:43.614854 30933 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:43.636449 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.660578 24672 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:43.622953 30957 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:43.664014 24600 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
W20260709 13:10:43.627007 30915 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.902s	user 0.010s	sys 0.000s
I20260709 13:10:43.618261 30965 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.681846 30904 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:43.682708 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 68893.1us
I20260709 13:10:43.683401 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:43.621425 30792 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.670169 24521 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:43.634469 30888 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.626636 30954 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:43.674728 30946 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
W20260709 13:10:43.675534 30959 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:43.676350 30847 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:43.677856 30912 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:43.678994 30953 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:43.679503 30911 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:43.680787 30630 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:43.688012 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:43.684446 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:43.770591 24591 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:10:43.771031 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 404710us
I20260709 13:10:43.673795 30926 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:43.693122 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:43.738514 25217 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:43.581732 30905 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.758247 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.758908 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.559043 30932 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.760289 24666 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:43.764196 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:43.765763 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:43.691740 25212 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:43.634353 30832 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:43.771116 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 86739.7us
I20260709 13:10:43.694550 30965 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:43.694959 30563 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:43.781739 30941 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 13:10:43.777442 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 84425.1us
I20260709 13:10:43.785966 30832 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:43.787055 30965 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:43.788138 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:43.790040 30972 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:43.790532 30972 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.790962 30972 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:43.799870 30905 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.775676 30954 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.801692 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.803439 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:43.776489 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:43.811324 24524 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:43.816556 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:43.821512 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.823637 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:43.824776 25210 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:43.815058 30832 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.825968 30832 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.826057 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.826386 30832 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.826730 24594 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:43.827854 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1296) took 1501 ms. Trace:
I20260709 13:10:43.828239 24596 rpcz_store.cc:276] 0709 13:10:42.326020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.326188 (+   168us) service_pool.cc:224] Handling call
0709 13:10:42.333385 (+  7197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.514643 (+1181258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.827625 (+312982us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540025f3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:43.827799 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2700628224}
I20260709 13:10:43.829334 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:43.829911 24600 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.830561 30957 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:43.833549 30955 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 13:10:43.833799 30963 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.215s	user 0.003s	sys 0.000s
I20260709 13:10:43.834103 30925 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:43.835604 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.836256 25218 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:43.837239 30858 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:43.838328 30821 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:43.760107 30888 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.839272 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.840332 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:43.841166 30944 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:43.813244 30933 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.842352 30944 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:43.842751 30944 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:43.802191 30869 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:43.757428 30849 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:10:43.840834 25214 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
W20260709 13:10:43.860709 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 191679us
I20260709 13:10:43.849922 24600 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:43.805028 30926 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:43.822892 30951 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 13:10:43.851455 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:43.855453 25217 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:43.857118 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:43.878293 24674 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:43.878799 24517 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:43.788363 30965 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.857857 30973 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.828073 30964 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:43.858318 30348 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:43.848469 24670 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:43.885918 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:43.861546 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:43.862895 24639 connection.cc:256] RPC call timeout handler was delayed by -2.3924191349999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
I20260709 13:10:43.845628 24520 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:43.886988 24639 connection.cc:256] RPC call timeout handler was delayed by -2.3870191349999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:10:43.875602 24518 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:10:43.876812 24667 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:43.887701 24667 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:43.887856 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:43.817119 30941 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:10:43.862457 24490 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.642s (SENT)
I20260709 13:10:43.890406 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:43.880172 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.880048 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:43.880671 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:43.881368 24595 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:43.844810 30847 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:43.893378 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:43.888868 24518 pending_rounds.cc:85] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 11
I20260709 13:10:43.889643 25217 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:43.886812 25214 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:43.892215 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:43.895152 24600 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.841199 30888 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:43.887363 24639 connection.cc:256] RPC call timeout handler was delayed by -2.3510191350000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 13:10:43.893998 24517 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
W20260709 13:10:43.900209 24639 connection.cc:256] RPC call timeout handler was delayed by -2.3348191349999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
I20260709 13:10:43.886122 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:43.896123 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:43.900539 24639 connection.cc:256] RPC call timeout handler was delayed by -2.2574191349999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
I20260709 13:10:43.896672 24518 pending_rounds.cc:107] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 16.12
W20260709 13:10:43.897188 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.897435 25218 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:43.888681 24667 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:43.875404 30926 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:43.900874 24639 connection.cc:256] RPC call timeout handler was delayed by -2.22411913499991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
I20260709 13:10:43.902925 24667 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:43.898998 24520 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:43.908123 25214 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:43.903885 24518 raft_consensus.cc:2889] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:43.884069 30905 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.885049 30869 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:43.921047 24593 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.000s
I20260709 13:10:43.921442 24593 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:43.922468 24518 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:10:43.925597 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63165.4us
I20260709 13:10:43.927371 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:43.910249 30926 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.947304 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:43.905313 30847 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:43.946221 25217 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:43.939178 24600 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:43.954737 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:43.955542 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 109566us
W20260709 13:10:43.931088 30956 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:10:43.960676 24667 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:10:43.964188 24667 pending_rounds.cc:85] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 11
I20260709 13:10:43.964514 24667 pending_rounds.cc:107] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:10:43.964843 24667 raft_consensus.cc:2889] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:43.966588 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:43.922328 30970 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:43.929024 30949 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.965905 30494 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:10:44.021687 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60825.5us
I20260709 13:10:43.973524 30847 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:43.975273 30976 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:10:43.975760 30961 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.311s	user 0.003s	sys 0.003s
I20260709 13:10:43.982208 30954 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:43.985383 30792 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:43.986560 30913 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.026s	user 0.004s	sys 0.006s
W20260709 13:10:43.989216 30461 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.962s	user 0.011s	sys 0.001s
I20260709 13:10:43.891247 30973 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:43.991251 30908 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.905s	user 0.009s	sys 0.000s
I20260709 13:10:43.923830 30905 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.931682 30979 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.926740 30972 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:43.996333 30925 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:43.998498 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:44.044010 24673 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:44.000057 30911 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:43.931023 30869 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.007649 30944 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:44.008816 30938 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.030s	user 0.008s	sys 0.005s
I20260709 13:10:44.013721 30883 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.011408 30935 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.016535 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:43.968093 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:43.951713 30639 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.144s	user 0.007s	sys 0.011s
I20260709 13:10:44.023699 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:44.029351 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.961565 30864 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.035600 30913 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:44.040073 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.004267 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 742578us
I20260709 13:10:44.065261 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.028847 30941 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:44.046679 30974 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:10:44.047551 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.067943 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:44.068603 24673 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:44.048468 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1385) took 1482 ms. Trace:
I20260709 13:10:44.049682 24674 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
W20260709 13:10:44.060789 24639 connection.cc:256] RPC call timeout handler was delayed by -2.072019135000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2308s for a response
W20260709 13:10:44.062260 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 94243.5us
I20260709 13:10:44.049383 30911 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:44.063625 25215 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:44.062949 30975 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:44.067477 24672 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:44.073554 24673 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:44.069587 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:44.072381 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:44.045130 30979 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.074944 24673 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:44.069473 25219 rpcz_store.cc:276] 0709 13:10:42.566234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.566707 (+   473us) service_pool.cc:224] Handling call
0709 13:10:44.048263 (+1481556us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54006e3a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:44.048390 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3048977152}
I20260709 13:10:44.043591 30925 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.049357 30973 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:44.078001 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 54466.6us
I20260709 13:10:44.081596 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:44.084524 24668 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:44.086807 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:44.087512 24595 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:44.087980 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:44.088654 24598 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:44.067279 30821 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:44.090297 24673 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:44.041821 30908 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.093458 24667 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:44.030619 30949 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.078299 30911 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.095366 30863 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.078445 30915 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:44.137495 30913 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.162142 24519 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:44.073508 30864 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.137806 30883 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:44.095590 24597 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:44.139681 30935 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:44.139312 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45136.3us
I20260709 13:10:44.142221 30905 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.139597 30971 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:44.078989 30461 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:44.080601 30665 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:10:44.165979 30461 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.167191 25214 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:44.167474 30461 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:44.040215 30832 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.171592 30832 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.144492 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:44.164777 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:44.135324 30941 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.073256 30865 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:44.078753 30630 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:44.147357 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.133788 30948 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:44.164896 30863 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.178762 30908 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.179926 30863 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.179997 30630 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.180666 30630 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.157124 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:44.183794 25218 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:44.184743 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:44.166972 30971 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.185873 30971 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:44.188383 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.190088 30995 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:44.191299 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2258) took 1117 ms. Trace:
I20260709 13:10:44.191891 30972 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.193512 30979 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:44.194229 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.158360 25217 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:44.201695 24671 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:44.162446 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:44.058104 30938 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.161971 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1364) took 1196 ms. Trace:
I20260709 13:10:44.075739 30875 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:10:44.093616 30939 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:44.174199 24518 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:44.172655 24594 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:44.177963 30948 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:44.157899 25210 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:44.191674 24592 rpcz_store.cc:276] 0709 13:10:43.073991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.074115 (+   124us) service_pool.cc:224] Handling call
0709 13:10:44.191116 (+1117001us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54001cbe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:44.191220 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903884032}
I20260709 13:10:44.194720 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1739) took 1145 ms. Trace:
I20260709 13:10:44.195789 30949 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.196300 30821 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.218873 25210 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:44.196808 30925 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.197726 30665 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:44.198515 30658 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:44.160784 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:44.158394 25211 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:10:44.160298 25215 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:10:44.160233 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:44.165665 30996 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.204875 24523 rpcz_store.cc:276] 0709 13:10:42.965937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.966093 (+   156us) service_pool.cc:224] Handling call
0709 13:10:42.984466 (+ 18373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:43.046771 (+ 62305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.046816 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:43.069942 (+ 23126us) log.cc:844] Serialized 52 byte log entry
0709 13:10:43.452477 (+382535us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:43.613785 (+161308us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.620482 (+  6697us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.620897 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.623449 (+  2552us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.928449 (+305000us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:44.161690 (+233241us) raft_consensus.cc:1685] finished
0709 13:10:44.161731 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.161909 (+   178us) inbound_call.cc:177] Queueing success response
0709 13:10:44.170916 (+  9007us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b18001d75e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
Metrics: {"mutex_wait_us":60764,"prepare.queue_time_us":20197,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":1658,"raft.queue_time_us":94245,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":31371,"spinlock_wait_cycles":16198656,"thread_start_us":459491,"threads_started":2,"wal-append.queue_time_us":465587}
I20260709 13:10:44.209136 25213 rpcz_store.cc:276] 0709 13:10:43.049217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.049663 (+   446us) service_pool.cc:224] Handling call
0709 13:10:43.069317 (+ 19654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.107430 (+ 38113us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:43.562224 (+454794us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.628319 (+ 66095us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.686035 (+ 57716us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.699138 (+ 13103us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:43.699191 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.699276 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.194475 (+495199us) raft_consensus.cc:1685] finished
0709 13:10:44.194497 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.194625 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6085,"prepare.queue_time_us":506893,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":14699,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":4966,"thread_start_us":491251,"threads_started":2,"wal-append.queue_time_us":213787}
I20260709 13:10:44.223222 24598 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:44.223752 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:44.227735 24666 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:44.227758 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:44.229561 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:44.232338 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:44.233754 24668 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.238530 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:44.245559 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:44.208271 30908 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:44.246057 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:44.246773 24594 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:44.247368 24521 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:44.174753 30915 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.250749 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.248129 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:44.248653 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 101389us
I20260709 13:10:44.252667 24639 leader_election.cc:400] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18.
I20260709 13:10:44.233314 30935 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.248911 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:44.255333 25217 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:44.249831 30908 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.255978 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:44.219957 30883 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.253474 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:44.254242 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.213938 30948 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:44.259037 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:44.251168 30972 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:44.262001 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:44.276895 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.262655 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.263401 25217 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:44.242924 30832 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:10:44.235762 30821 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.276779 30909 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:44.259588 30865 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:44.284883 24668 raft_consensus.cc:2410] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:44.242422 30665 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.286514 30972 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.261523 30925 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.278023 30863 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:44.276969 30979 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:44.296280 30991 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 13:10:44.296460 30979 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:44.297421 30979 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:44.301293 31001 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:10:44.290879 30904 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.000s
I20260709 13:10:44.303151 25216 raft_consensus.cc:2410] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:44.295095 30863 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.304180 30863 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.248289 30461 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.291707 30849 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:10:44.306058 30849 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:44.306389 30849 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.306663 30461 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:44.307220 30849 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.307900 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1740) took 1258 ms. Trace:
I20260709 13:10:44.308421 30849 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.308677 25218 raft_consensus.cc:2368] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:10:44.310153 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:44.310388 30665 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.310706 25218 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.308270 25211 rpcz_store.cc:276] 0709 13:10:43.049526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.050775 (+  1249us) service_pool.cc:224] Handling call
0709 13:10:44.307739 (+1256964us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b5400084b54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:44.307846 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244564224}
I20260709 13:10:44.316576 30938 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.318441 30915 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.256832 30996 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.320945 25219 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.322165 30996 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.259835 30935 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.323364 30915 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.323835 30915 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.324327 30935 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.325435 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:44.281369 30954 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:44.370761 30954 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.371302 30954 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.292212 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.276822 30993 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:10:44.372354 30925 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:44.372638 30993 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:44.291525 30348 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:10:44.373222 30993 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.373629 30993 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.288481 30865 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.374646 30865 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:44.375066 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.376233 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.260715 30882 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
W20260709 13:10:44.378722 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 86565.7us
I20260709 13:10:44.346441 30872 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:44.388510 25218 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:44.295666 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:44.407939 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 112324us
I20260709 13:10:44.408151 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:44.409227 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:44.326860 30950 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:44.315663 30630 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.295076 30909 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.349728 24594 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:44.349936 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.416229 24592 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:44.416375 24670 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:44.350224 30972 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.351467 30821 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.345002 30754 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.331290 30908 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.353574 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.428254 24667 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:44.355053 30944 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.346463 25210 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:44.345849 30915 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.362896 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.353641 30971 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:44.364538 25212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1387) took 1793 ms (client timeout 2254 ms). Trace:
I20260709 13:10:44.295889 30942 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:44.294270 24668 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:44.414106 30938 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:44.437305 24668 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:44.346997 30926 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.391974 25185 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:44.372745 30925 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.416188 30949 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:44.397912 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:44.399456 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:44.403048 24490 leader_election.cc:400] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:10:44.414765 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:44.350152 30870 consensus_meta.cc:287] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.000s
W20260709 13:10:44.451285 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 48369.5us
I20260709 13:10:44.417358 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:44.452459 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.450879 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:44.418797 25219 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:44.289172 30941 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:10:44.430109 30348 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:44.421034 24599 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:44.396091 30872 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:44.425487 24592 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:44.433368 24596 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:44.433128 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.448553 24668 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.456969 24524 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:44.457260 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.458725 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.436301 30832 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.491668 30832 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.493795 30832 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:44.495242 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.436547 25212 rpcz_store.cc:269] 0709 13:10:42.571297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.571478 (+   181us) service_pool.cc:224] Handling call
0709 13:10:44.364357 (+1792879us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540007bcd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:44.364477 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2574221184}
W20260709 13:10:44.440918 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49069.2us
I20260709 13:10:44.496802 30348 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:44.497835 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.498939 30348 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.446476 30904 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:44.424180 30973 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:44.499815 30904 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.500123 30973 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:44.500844 30973 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.441099 30938 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:44.501457 30938 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.397059 30948 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.506129 30864 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.411446 30752 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:10:44.508069 30752 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:10:44.508354 30998 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.156s	user 0.000s	sys 0.003s
I20260709 13:10:44.508472 30752 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.509471 30924 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.509649 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:44.510056 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:44.511178 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:44.511363 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:44.511762 30869 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:44.410377 30861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.000s	sys 0.017s
W20260709 13:10:44.512588 30861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.000s	sys 0.018s
I20260709 13:10:44.513127 30861 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:44.438174 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.513998 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:44.514530 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 76430.4us
I20260709 13:10:44.516096 25218 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:44.516793 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:44.517474 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:44.459847 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.512606 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:44.518313 24670 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:44.511762 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1309) took 1453 ms. Trace:
I20260709 13:10:44.453795 24593 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:10:44.464493 30941 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:44.428143 30950 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.468633 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:44.522257 25214 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 13: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:44.469463 30975 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:44.469676 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:44.470283 30909 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.430686 30754 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.477444 30925 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.482106 24668 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:44.483278 30993 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.500211 30904 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.485615 30971 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:44.487309 30926 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.459159 30870 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.449302 30942 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.511885 25213 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:44.463394 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:44.565490 25211 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:44.514605 24522 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:10:44.519196 24597 rpcz_store.cc:276] 0709 13:10:43.058043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.060742 (+  2699us) service_pool.cc:224] Handling call
0709 13:10:43.080159 (+ 19417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.162986 (+1082827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.511534 (+348548us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540025b054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:44.511702 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2334813056}
I20260709 13:10:44.463317 30987 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:44.517544 24667 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:44.526551 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.542693 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 90683.5us
I20260709 13:10:44.545563 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.569901 24521 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:44.549825 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.554404 30647 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:44.560279 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.529543 30639 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:44.530601 30665 raft_consensus.cc:2764] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:44.521479 30941 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:44.590381 30941 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.591560 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:44.591981 30941 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.592324 24520 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:44.529400 30875 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:44.571473 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:44.529644 30975 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.593752 30875 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.593851 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.594245 30875 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:44.594635 24520 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:44.594363 30975 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.595759 30975 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.596395 24520 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:44.597443 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.598064 24516 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:44.575138 24523 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:44.601827 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.601794 25217 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:44.509418 30752 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.572742 30942 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.643397 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3452) took 1384 ms. Trace:
I20260709 13:10:44.546015 30965 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
W20260709 13:10:44.648962 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 115248us
W20260709 13:10:44.660691 25216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1732) took 1623 ms (client timeout 1855 ms). Trace:
I20260709 13:10:44.660984 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.661255 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:44.660449 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.666373 24519 rpcz_store.cc:276] 0709 13:10:43.258803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.259607 (+   804us) service_pool.cc:224] Handling call
0709 13:10:43.357486 (+ 97879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.162923 (+805437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.643096 (+480173us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b540030f554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:44.643321 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850066304}
I20260709 13:10:44.701728 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:44.702059 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.702531 24599 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:44.583148 30957 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:44.668536 30496 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:44.692539 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:44.709049 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:44.584478 30979 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:44.713441 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52356.5us
I20260709 13:10:44.714279 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:44.699810 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:44.561503 30883 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
W20260709 13:10:44.671379 25216 rpcz_store.cc:269] 0709 13:10:43.037849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.037983 (+   134us) service_pool.cc:224] Handling call
0709 13:10:44.642653 (+1604670us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54007b6bd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:44.660634 (+ 17981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2907073792}
I20260709 13:10:44.584301 30647 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.704490 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:44.642261 24668 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:44.639842 30925 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.669191 30971 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:44.716288 30931 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:44.716998 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:44.641000 30915 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:44.584430 30348 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:10:44.578822 30862 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:10:44.719740 24522 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:10:44.788770 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 74568us
I20260709 13:10:44.726691 24669 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:44.718290 30957 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.728293 30534 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.730257 30870 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:44.719022 30868 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:44.703999 30933 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.719669 30796 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:44.735404 25212 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:44.739300 30630 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.696283 30911 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:44.712414 30496 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.703840 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.749575 24667 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
W20260709 13:10:44.755446 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.693785 30665 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:44.785730 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:44.790361 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.753512 30987 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:44.751555 30752 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.797665 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:44.800731 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.782375 30944 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:44.790292 30847 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:44.811107 30863 consensus_meta.cc:287] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.001s
I20260709 13:10:44.812017 30993 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.814571 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:44.815212 24668 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:44.816627 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:44.823872 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.825933 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:44.833793 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:44.835484 25214 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:44.838577 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:44.808825 30496 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:44.852674 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.846351 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.854002 25213 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:44.854748 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.859843 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:44.794001 30931 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.798951 30915 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.807060 30971 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:10:44.871763 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.836144 30965 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:44.879745 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.860939 30494 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:44.881990 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:44.844919 30630 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:44.838909 30665 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.883361 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:44.885003 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 68441.9us
I20260709 13:10:44.857970 30863 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.882330 30993 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:44.889961 24522 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:44.883893 30965 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:44.893226 31022 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:10:44.893471 30865 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.001s
I20260709 13:10:44.894177 30971 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:44.894950 30973 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.896317 30875 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.899832 30938 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.884361 30883 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:44.901415 24525 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:44.854894 30796 raft_consensus.cc:2764] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:44.805929 30933 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.862107 30912 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.862190 30974 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.915323 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:44.902168 31011 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:10:44.804234 30868 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.842643 30944 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:44.838766 30997 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 13:10:44.865895 30995 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:10:44.874181 30926 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:10:44.909680 30954 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:10:44.866146 30869 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:10:44.945750 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.876385 30864 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:10:44.893635 31020 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.108s
I20260709 13:10:44.905928 30911 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.949672 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:44.917482 30630 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.994511 31012 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.001041 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:45.012279 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:44.987840 31008 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:10:44.943737 30950 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.968762 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.017428 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:44.972337 24665 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:44.962782 30949 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.962915 30993 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:44.991159 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:44.962414 30971 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:45.001588 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52019.8us
I20260709 13:10:45.041491 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:44.956435 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 110289us
I20260709 13:10:44.977339 30647 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.002943 30883 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:45.017915 24522 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:44.964843 30865 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.056986 30915 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:45.003443 31015 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:10:45.001245 30926 consensus_queue.cc:1243] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:45.057564 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:45.001807 30630 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:45.002661 30944 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.016583 30870 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:45.000919 30911 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:44.997525 30954 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.078439 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:45.019920 30957 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:44.995370 30912 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.005882 30496 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.095146 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:45.062530 30932 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:45.062745 30647 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:45.104451 30932 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:45.104943 30858 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:45.103482 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:45.107959 24520 raft_consensus.cc:2393] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:45.109436 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:45.112322 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 100161us
I20260709 13:10:45.019754 30965 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.063964 30950 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:10:45.062456 30979 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:45.097885 31021 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:45.118141 30864 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.118687 24598 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:45.115125 30904 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 13:10:45.119042 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.119537 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:45.119666 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.119927 24519 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:45.132755 24591 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.133325 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.114979 31020 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.120225 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.135830 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.136315 24595 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:45.117199 30997 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.122378 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:45.123492 31006 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:10:45.108196 30858 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.118796 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.082734 30944 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:10:45.120183 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:45.111133 30931 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.048211 30949 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.139994 24598 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:45.172224 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.172796 24598 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:45.176559 24516 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:45.130667 30965 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:45.144385 24597 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:45.182859 24597 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.130576 30665 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.144901 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.144572 30932 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.146018 30911 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:45.146222 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.146425 31033 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.140105 30904 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.191203 30904 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.191672 30975 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:45.192065 25212 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:45.138700 30993 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.147686 30496 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.148103 30973 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:45.148799 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:45.149215 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:45.135825 31020 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.136744 30883 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:45.150862 24591 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:45.151249 30877 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:45.153509 30858 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:45.161425 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.163054 30868 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.163616 30875 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.165562 30942 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.168848 30933 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.138950 30863 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.124284 30915 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:10:45.174170 30865 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.136266 30938 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.142112 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:45.134179 30864 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:45.272554 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:45.303100 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:45.340520 25211 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.312569 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:45.325510 25218 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:10:45.305164 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:45.269709 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3459) took 1454 ms. Trace:
I20260709 13:10:45.274648 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:45.221817 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80126.3us
I20260709 13:10:45.265537 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1312) took 1183 ms. Trace:
W20260709 13:10:45.278393 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.343720 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:45.241024 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:45.344566 24671 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.344851 25219 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.232857 24672 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:45.342980 24524 rpcz_store.cc:276] 0709 13:10:43.815773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.815903 (+   130us) service_pool.cc:224] Handling call
0709 13:10:43.816187 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.464932 (+648745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.269409 (+804477us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b54003dccd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:45.269636 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1473218816}
I20260709 13:10:45.351029 24521 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:45.324918 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:45.351231 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:45.351953 25216 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:10:45.354122 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:45.343621 24600 rpcz_store.cc:276] 0709 13:10:44.082623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.082795 (+   172us) service_pool.cc:224] Handling call
0709 13:10:44.138308 (+ 55513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.175334 (+ 37026us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:44.563394 (+388060us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.807931 (+244537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.808198 (+   267us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:44.833242 (+ 25044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.265300 (+432058us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b540025c954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:45.265349 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.265477 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3522,"prepare.queue_time_us":194903,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":39,"raft.queue_time_us":18537,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":14034,"spinlock_wait_cycles":84624256,"thread_start_us":580741,"threads_started":2,"wal-append.queue_time_us":335507}
I20260709 13:10:45.358125 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:45.358402 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 216339us
I20260709 13:10:45.358698 24669 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:45.361374 24521 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:45.241600 31002 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.882s	user 0.002s	sys 0.002s
W20260709 13:10:45.264880 30941 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.672s	user 0.013s	sys 0.000s
I20260709 13:10:45.362509 24524 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:45.381539 24524 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:45.367004 24521 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:45.221583 30949 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:45.360751 30863 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:45.192070 30975 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:45.256747 30974 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.322395 30833 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.238502 30954 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.234427 30987 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:45.350775 31020 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.369761 30496 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:45.370088 24563 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.522s (SENT) [suppressed 8 similar messages]
I20260709 13:10:45.371155 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:45.372303 30865 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:45.372702 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.374408 31033 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.374943 30872 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.375517 30925 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:45.375090 30883 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.326575 30970 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.350445 31025 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.384703 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:45.386786 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:45.386936 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.428663 24668 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
W20260709 13:10:45.387908 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.264609 30912 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:45.430366 31016 log.cc:927] Time spent T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.476s	user 0.000s	sys 0.001s
I20260709 13:10:45.430425 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:45.432219 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:45.339218 30877 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:45.421718 30496 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:45.433444 30877 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:45.434463 30877 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.434878 30496 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.428097 31037 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.391486 25210 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:45.437978 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:45.438673 25210 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:45.439370 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:45.441423 30987 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:45.441813 30987 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.442142 30987 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:45.440881 31020 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.444705 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.445289 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:45.445968 24667 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.445616 30970 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.446190 31021 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.446671 31021 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.447711 30970 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.448534 31021 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.448240 31025 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.449319 30563 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.403746 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:45.450477 25216 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:45.361725 30933 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:45.405227 25214 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:45.407733 25218 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:45.408778 25217 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:45.453264 24565 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:45.396610 24521 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:10:45.453577 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.453687 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.415422 24523 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:45.225793 31035 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.177s
I20260709 13:10:45.263931 30630 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.421965 24520 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:45.426994 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55909.2us
I20260709 13:10:45.391824 30973 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:10:45.391554 30847 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.029s
I20260709 13:10:45.445363 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.438689 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1450) took 1059 ms. Trace:
I20260709 13:10:45.411839 25219 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:45.414865 25211 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:45.455025 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:45.455560 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.458067 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:45.424988 24669 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:45.461850 24667 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
W20260709 13:10:45.428555 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43928.8us
I20260709 13:10:45.389274 25215 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:10:45.464682 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 77949.4us
I20260709 13:10:45.469555 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.470705 24521 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:45.464972 24670 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:45.471904 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:45.467705 24665 rpcz_store.cc:276] 0709 13:10:44.379120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.672416 (+293296us) service_pool.cc:224] Handling call
0709 13:10:44.720274 (+ 47858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.022770 (+302496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.438482 (+415712us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54000ee2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:45.438635 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579137920}
I20260709 13:10:45.468117 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:45.473685 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:45.425810 30754 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.480798 30942 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.481590 30872 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:45.428165 30925 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:45.483619 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.484247 24519 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:45.416036 30833 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.471822 30752 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:10:45.456202 31038 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.276s	user 0.003s	sys 0.000s
W20260709 13:10:45.477833 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.478507 30904 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.479415 30864 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.486858 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:45.488619 24594 raft_consensus.cc:2410] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:45.505932 25219 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:45.506832 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:45.490743 31027 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:45.486263 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:45.494951 25213 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:45.449043 31021 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:45.499598 24592 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:45.474888 30563 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:45.486680 31035 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:45.502846 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:45.507404 25217 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:45.466213 30912 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:45.507827 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:45.508744 25211 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:45.536415 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 59826.5us
I20260709 13:10:45.509404 25218 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:45.537060 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 50883.6us
I20260709 13:10:45.513998 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:45.510464 24671 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:45.538350 24523 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:45.535619 25215 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:45.491120 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:45.485281 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.498914 30865 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:45.494114 31037 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:45.491340 30752 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:45.539997 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:45.487001 30932 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:45.490676 30833 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.485057 30925 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.542233 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:45.542893 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 51859.6us
W20260709 13:10:45.540012 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 169944us
I20260709 13:10:45.578199 30798 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 13:10:45.628160 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 85972.4us
I20260709 13:10:45.578991 24519 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:45.578293 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:45.501065 30974 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.629443 30974 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.583333 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.631558 24667 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:45.490657 30950 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:45.513052 30941 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.618991 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:45.629887 31042 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:45.501767 31030 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.541788 30882 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:45.634032 30882 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.537372 31035 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:45.634431 30882 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.512569 31020 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.586300 30752 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:45.641294 31038 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:10:45.614563 30534 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.642776 30665 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:45.595726 30883 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:45.644083 30883 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:45.644598 30883 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:45.646783 31017 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.810s	user 0.001s	sys 0.003s
I20260709 13:10:45.650189 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3580) took 1301 ms. Trace:
I20260709 13:10:45.650540 24674 rpcz_store.cc:276] 0709 13:10:44.348973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.376975 (+ 28002us) service_pool.cc:224] Handling call
0709 13:10:44.377312 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.377627 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.377656 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.378067 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.544385 (+166318us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:44.783071 (+238686us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.783259 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.783332 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.646513 (+863181us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b2400437f78. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8cdf9c4 00007f17b8cddacb 00007f17b8e98dc9 00007f17b8e98a55 00007f17b8e9809d 00007f17bbaca10e 00007f17bbae188c 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221
0709 13:10:45.649918 (+  3405us) raft_consensus.cc:1685] finished
0709 13:10:45.650010 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.650137 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":331754,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":37,"raft.queue_time_us":1378,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":11342,"spinlock_wait_cycles":8300288,"thread_start_us":381485,"threads_started":2,"wal-append.queue_time_us":404692}
W20260709 13:10:45.652665 24518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3466) took 1693 ms (client timeout 1522 ms). Trace:
W20260709 13:10:45.653040 24518 rpcz_store.cc:269] 0709 13:10:43.959118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.966253 (+  7135us) service_pool.cc:224] Handling call
0709 13:10:45.652474 (+1686221us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54002783d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:45.652594 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475519232}
I20260709 13:10:45.653628 30796 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:45.654063 30948 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:45.654119 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.654590 30796 consensus_queue.cc:1243] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:45.542440 30912 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.655236 30796 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:45.656208 30796 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:45.656627 30912 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.657284 30950 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:45.657795 30950 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:45.658761 30950 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:45.659899 30940 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:45.660132 30950 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:45.541843 30868 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.120s
W20260709 13:10:45.663074 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.663363 30931 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:45.663893 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:45.664141 30932 consensus_queue.cc:1243] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:45.664048 30931 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:45.666072 31025 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.666504 31039 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:45.666889 31039 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:45.667060 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.667114 30973 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:45.667847 24519 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:45.490804 30933 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:10:45.488102 30875 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:10:45.660310 30940 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:45.651582 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:45.669070 24519 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:45.682881 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.683804 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.685158 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:45.685434 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 107214us
I20260709 13:10:45.654842 24518 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:45.680106 24593 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:10:45.679548 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:45.671748 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:45.679865 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:45.713836 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50031.4us
I20260709 13:10:45.717585 24592 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:45.687137 24673 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:45.718142 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:45.719554 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.679311 24591 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:45.724248 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:45.724444 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:45.726677 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47215.4us
I20260709 13:10:45.727757 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:45.675853 30858 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:45.614725 30865 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:45.725687 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:45.729489 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:45.729658 24518 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:45.578902 31037 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.758006 31037 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.758473 24598 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:10:45.730813 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.642817 30877 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.733194 31034 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:45.733521 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:45.673144 30940 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.671895 30496 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:45.723703 30933 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:45.673766 30939 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:45.734798 30639 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:10:45.722599 30875 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:45.675601 30971 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.656980 30796 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:10:45.737676 31030 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.732658 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:45.740195 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.739391 25219 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:10:45.738807 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 67142.3us
I20260709 13:10:45.756121 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:45.757513 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.713275 30862 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.670428 30974 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.615085 31033 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.123s
I20260709 13:10:45.760895 24674 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:45.767163 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:45.767793 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.727430 30904 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:45.772369 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 229955us
I20260709 13:10:45.727655 30630 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.793111 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:45.729280 30864 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:45.727903 30931 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.809098 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.818742 30949 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.820775 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:45.820973 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:45.853551 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60546.1us
I20260709 13:10:45.854534 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:45.759446 30970 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:45.823262 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:45.860771 24593 raft_consensus.cc:2368] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14.
I20260709 13:10:45.756667 30869 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:45.760668 30833 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:45.738268 30932 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.865353 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1345) took 1062 ms. Trace:
I20260709 13:10:45.865789 25212 rpcz_store.cc:276] 0709 13:10:44.804961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.805131 (+   170us) service_pool.cc:224] Handling call
0709 13:10:45.865182 (+1060051us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54004e6954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:45.865302 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792269056}
I20260709 13:10:45.834498 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:45.771432 31021 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.852056 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:45.738263 31020 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
W20260709 13:10:45.862174 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.802318 30563 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:45.795553 30933 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:45.795944 30939 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:45.793797 30965 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:10:45.864581 30904 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:45.839327 30942 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.853003 30864 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.792735 30979 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:10:45.871667 30971 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.864923 30833 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.894446 30868 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:45.858204 30970 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:45.933735 30970 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.821417 30987 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.937469 30563 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.938851 30987 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.939728 24668 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:45.914276 30864 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.873445 30798 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:10:45.881511 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 155463us
I20260709 13:10:45.894312 30647 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:45.867017 30630 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:45.900242 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:45.887049 30933 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:45.829950 30496 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:45.822261 30883 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:46.006880 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.917901 30858 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.869593 30949 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.896826 31033 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:45.840457 30875 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.912379 30942 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.947270 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:45.855944 30862 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.887414 30863 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:45.950917 24594 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:45.958489 30948 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.961014 30904 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.961458 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:46.013958 30965 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:45.933367 30833 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:45.963941 30630 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.077186 30630 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:45.965498 30997 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:45.966364 30752 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:46.077943 30997 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:46.079102 30997 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.080016 30752 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:45.967070 30534 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.969139 24670 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:46.080725 30997 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.948019 30647 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.978968 30975 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:45.982777 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:45.983600 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2264) took 1102 ms. Trace:
I20260709 13:10:45.997612 30939 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:45.895190 30865 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:46.000423 31051 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:10:46.002146 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:46.092734 30975 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.093281 24600 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:46.094276 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:46.094790 24600 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:46.053815 30863 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.082226 30965 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:46.003116 24672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 1448) took 1640 ms (client timeout 1886 ms). Trace:
I20260709 13:10:46.003511 24669 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:10:46.097239 24672 rpcz_store.cc:269] 0709 13:10:44.362276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.362610 (+   334us) service_pool.cc:224] Handling call
0709 13:10:46.002897 (+1640287us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54000492d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:46.003046 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836744960}
I20260709 13:10:46.097854 30965 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:46.005915 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 118582us
I20260709 13:10:46.098475 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:46.099146 24672 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:46.051157 31020 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:46.007759 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:46.018874 24523 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:46.023394 24592 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:46.034071 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:46.106215 24519 raft_consensus.cc:2376] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19. Re-sending same reply.
W20260709 13:10:46.034898 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.043795 24665 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:46.007417 30348 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.047268 24667 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:46.007205 30868 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:45.963294 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:46.060953 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:46.066895 30949 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:46.074756 30942 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:46.081954 24516 rpcz_store.cc:276] 0709 13:10:44.881620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.881736 (+   116us) service_pool.cc:224] Handling call
0709 13:10:45.983383 (+1101647us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540021dc54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:45.983525 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644904192}
I20260709 13:10:46.082787 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:46.084215 24599 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:46.081266 30647 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:46.111856 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 104188us
I20260709 13:10:46.117424 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:46.137931 24592 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:46.138012 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 286024us
I20260709 13:10:46.137113 24600 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:46.177222 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:46.056330 30948 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.100257 30883 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:46.183339 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:46.184237 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45708.4us
I20260709 13:10:46.113391 30752 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:46.184595 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:46.190831 25184 leader_election.cc:400] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14.
I20260709 13:10:46.115764 30869 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:46.100309 31020 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.119827 30348 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.139770 30939 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:46.221483 30925 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:46.222824 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:46.223446 24599 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.225435 30752 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:46.225893 30752 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:46.225555 30868 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:46.226401 24674 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:46.226691 30752 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.228693 30993 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:46.229113 30993 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:46.230000 30993 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.230670 30348 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:46.231017 30993 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:46.232671 30948 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:46.234788 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2268) took 1333 ms. Trace:
I20260709 13:10:46.235203 24520 rpcz_store.cc:276] 0709 13:10:44.901810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.275972 (+374162us) service_pool.cc:224] Handling call
0709 13:10:45.276253 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.463355 (+187102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.234557 (+771202us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54000bd1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:46.234730 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330387200}
I20260709 13:10:46.206490 31030 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:46.239200 30869 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:46.240875 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 474452us
W20260709 13:10:46.239205 31028 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.179s	user 0.005s	sys 0.004s
W20260709 13:10:46.242759 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.243261 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.244416 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:46.245239 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:46.245430 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1382) took 1583 ms. Trace:
I20260709 13:10:46.232153 31037 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.213862 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:46.246413 24517 rpcz_store.cc:276] 0709 13:10:44.662106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.720624 (+ 58518us) service_pool.cc:224] Handling call
0709 13:10:44.743198 (+ 22574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.743539 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.743576 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.744131 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.949402 (+205271us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:44.949443 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.949507 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.238558 (+1289051us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:46.245153 (+  6595us) raft_consensus.cc:1685] finished
0709 13:10:46.245176 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.245364 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43111,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":12227,"spinlock_wait_cycles":6748416,"thread_start_us":204873,"threads_started":1,"wal-append.queue_time_us":243576}
I20260709 13:10:46.248543 24591 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:46.207010 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:46.195999 24592 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:46.112257 31053 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:46.197554 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.250593 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:46.271492 24600 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
W20260709 13:10:46.264690 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 430247us
I20260709 13:10:46.206236 30942 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.187254 30949 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:46.290912 30864 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:46.293417 30639 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:46.297209 30932 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:46.297819 30931 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:46.303472 24592 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:46.254346 31030 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.175616 30974 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260709 13:10:46.300503 31033 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.328323 24600 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:46.317606 24599 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:46.306187 30877 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:10:46.333153 31030 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.352744 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:46.334275 30932 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:46.329427 30931 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:46.337996 24597 raft_consensus.cc:2368] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
W20260709 13:10:46.320554 30882 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.002s
W20260709 13:10:46.344869 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 654490us
I20260709 13:10:46.332176 25182 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:46.348279 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.359488 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:46.360477 24670 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:46.372427 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:46.337498 30949 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.382097 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:46.382759 24666 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:46.350170 24599 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:10:46.386300 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54267.1us
I20260709 13:10:46.387043 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:46.389055 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:46.389480 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:46.391990 24670 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 14: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:46.343708 30957 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:46.390064 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:46.409055 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 221057us
I20260709 13:10:46.410908 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:46.415493 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:46.352794 30863 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:46.418303 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:46.413172 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:46.453985 24599 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.454326 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:46.455590 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:46.369910 30563 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.459517 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 1970) took 1324 ms. Trace:
I20260709 13:10:46.459929 24598 rpcz_store.cc:276] 0709 13:10:45.134943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.173363 (+ 38420us) service_pool.cc:224] Handling call
0709 13:10:45.173633 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.758868 (+585235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.459252 (+700384us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54001caa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:46.459451 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344358784}
I20260709 13:10:46.386317 30496 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:46.412264 30949 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.504338 30496 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:46.504865 30496 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:46.505820 30496 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.506716 30949 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:46.368849 31025 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.095s
I20260709 13:10:46.474576 30534 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:46.482355 31067 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:46.483330 30872 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:46.349803 31033 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.488135 30931 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:46.416554 30954 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.490317 30864 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:46.491334 30973 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:46.464133 30970 consensus_meta.cc:287] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 13:10:46.457369 30974 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:10:46.498749 31037 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:46.499532 30833 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.502054 30939 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:46.379631 30882 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.368362 30647 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.458757 30957 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.478405 30754 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:46.509034 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:46.514635 24599 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:46.463116 30563 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.496855 30993 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:46.549935 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:46.648370 30954 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:46.511166 30863 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:46.654484 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 265506us
W20260709 13:10:46.763717 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.519577 30872 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.675388 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:46.678663 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:46.679232 31030 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:46.648396 30970 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:46.679998 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:46.682652 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:46.778204 24517 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.682268 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:46.779218 24519 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:46.511762 30933 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:10:46.690696 24599 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:46.785518 24599 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:10:46.787272 24599 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:46.692848 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 320468us
I20260709 13:10:46.696030 24598 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:46.710016 24594 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:46.742798 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:46.766979 24516 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:46.681202 30754 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.775362 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:46.655666 30931 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:46.686040 30563 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:46.782810 24672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.016s
I20260709 13:10:46.782703 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:46.783716 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:46.792106 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:46.794356 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:46.817996 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 409227us
I20260709 13:10:46.820844 25210 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:46.822554 24672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.016s
W20260709 13:10:46.823820 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 433790us
I20260709 13:10:46.824066 24522 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:46.678009 30939 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:46.826648 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:46.828387 24665 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.691471 30954 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.873997 31033 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:46.775890 30872 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:46.886722 31059 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.646s	user 0.003s	sys 0.008s
I20260709 13:10:46.985594 30954 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:46.987284 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1390) took 1508 ms. Trace:
I20260709 13:10:46.987702 24521 rpcz_store.cc:276] 0709 13:10:45.479020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.805192 (+326172us) service_pool.cc:224] Handling call
0709 13:10:45.805619 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.806021 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.806058 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.806615 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.869743 (+ 63128us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:45.890470 (+ 20727us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.890781 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.890876 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.240357 (+349481us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18004c1b60. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:46.886076 (+645719us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:46.987016 (+100940us) raft_consensus.cc:1685] finished
0709 13:10:46.987044 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.987216 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20076,"prepare.run_cpu_time_us":846,"prepare.run_wall_time_us":39485,"raft.queue_time_us":4478,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":12724,"spinlock_wait_cycles":35414528,"thread_start_us":62644,"threads_started":1,"wal-append.queue_time_us":149193}
I20260709 13:10:46.837180 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:46.993597 25216 raft_consensus.cc:2368] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:10:46.994588 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:46.826032 30965 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.995961 30965 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:46.841017 30974 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:46.874724 30939 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:46.833994 30534 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:46.783353 31063 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.878067 30833 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:46.833611 31030 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:10:46.846589 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:47.019451 25219 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:46.815698 30754 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.833988 30931 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:46.838915 30904 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:46.775924 30993 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:46.854615 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2181) took 1152 ms. Trace:
I20260709 13:10:46.811776 30863 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:46.809847 30933 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:46.969663 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.833191 31034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.028s
I20260709 13:10:46.837262 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:46.848598 24525 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:47.033026 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.007s	sys 0.006s
I20260709 13:10:46.872839 30973 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.833545 31079 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:46.982008 24640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.000s	sys 0.011s
W20260709 13:10:46.983022 30868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:10:46.967549 24517 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:46.884750 30957 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:46.995266 25216 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:47.006664 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:47.015810 30534 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:47.026300 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 187582us
I20260709 13:10:47.024042 24669 rpcz_store.cc:276] 0709 13:10:45.701937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.702065 (+   128us) service_pool.cc:224] Handling call
0709 13:10:46.003069 (+301004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.097660 (+ 94591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.854344 (+756684us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54000492d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:46.854542 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620414336}
W20260709 13:10:47.034052 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.006s
I20260709 13:10:46.995103 30563 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:47.045217 24640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.000s	sys 0.012s
W20260709 13:10:47.080955 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 625428us
W20260709 13:10:47.081502 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.046433 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:47.043519 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:47.083221 24670 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:47.023794 30932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.009s
I20260709 13:10:46.997822 30974 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.021292 30833 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:47.052771 24672 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:47.014845 30872 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:47.041743 31034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.010s	sys 0.031s
I20260709 13:10:47.088474 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:47.088594 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 185426us
I20260709 13:10:47.089862 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.090142 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:47.091729 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.124996 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:47.051419 30647 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:47.051638 30868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.012s	sys 0.000s
I20260709 13:10:47.116192 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:47.124382 24594 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 13.
I20260709 13:10:47.131526 24669 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:47.132192 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:47.132582 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:47.058316 30865 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.006s	sys 0.006s
I20260709 13:10:47.041473 30882 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:47.179544 24665 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:47.041632 30975 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.044509 30904 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:47.130493 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 48768us
I20260709 13:10:47.133227 24669 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.181217 24525 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:10:47.113224 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:47.081277 30970 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:47.105436 30932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.003s	sys 0.010s
I20260709 13:10:47.136539 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.137823 24565 leader_election.cc:400] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:10:47.017724 31063 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.102376 31053 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.124382 30942 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.816s	user 0.009s	sys 0.001s
I20260709 13:10:47.156769 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:47.053584 30973 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.162647 24594 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:47.198330 24671 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:47.133863 30870 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:47.154150 30911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.009s	sys 0.032s
I20260709 13:10:47.137044 31034 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:47.170660 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:47.216758 24517 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.051724 31035 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:47.223268 24490 connection.cc:256] RPC call timeout handler was delayed by -1.1060344379999378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 13:10:47.125769 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.055877 31079 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.122939 30833 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.157405 30496 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:47.167485 30868 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.190526 24598 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:47.240737 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.190760 24565 leader_election.cc:403] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.189020 24669 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:47.167315 30993 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.225101 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:47.224478 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:47.183658 31099 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:47.254329 24517 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:47.166558 24670 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
W20260709 13:10:47.204943 30911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.009s	sys 0.032s
I20260709 13:10:47.235386 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:47.180186 30865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.006s	sys 0.013s
I20260709 13:10:47.245864 24600 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:47.205392 30942 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:47.244787 24591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1324) took 1478 ms (client timeout 1594 ms). Trace:
I20260709 13:10:47.266918 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:47.267791 24599 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:47.267937 24669 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:10:47.248746 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:47.189167 30975 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:47.258977 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 128777us
I20260709 13:10:47.273536 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:47.267145 24591 rpcz_store.cc:269] 0709 13:10:45.766776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.766909 (+   133us) service_pool.cc:224] Handling call
0709 13:10:47.244605 (+1477696us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54001dfe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:47.244728 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937447296}
I20260709 13:10:47.274737 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.275277 25212 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:47.257861 31081 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:10:47.275911 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:47.261838 24670 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:47.242731 31035 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.170481 30863 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.281010 24591 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:47.285809 25216 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:10:47.202330 31053 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.290956 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:47.289316 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 132616us
I20260709 13:10:47.298154 25216 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:47.282548 30931 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.263679 31096 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.302608 25216 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:10:47.250224 30868 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.316560 31114 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:47.290578 30496 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:47.319904 24599 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:47.234764 31034 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.323761 30974 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:47.330408 31100 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:10:47.324975 30973 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:47.331687 31098 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:10:47.331801 31090 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:10:47.297197 30970 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:47.336634 31105 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:47.263387 31099 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:47.338312 31091 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:47.340139 31034 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.300172 30534 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.266788 30904 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.346971 24591 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22. Ops: []
W20260709 13:10:47.333931 31092 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:10:47.325156 30932 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.326517 31114 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:47.333508 31103 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:10:47.325374 31111 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:47.341796 30872 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:47.370646 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 59695.1us
I20260709 13:10:47.358601 31114 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:47.347031 31063 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:47.376380 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:47.348789 30973 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:10:47.399714 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:47.402927 30833 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:47.405164 31109 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:10:47.410621 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.380906 31108 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:47.365820 30932 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.345721 31105 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.431912 30975 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.434476 30932 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.413973 30973 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:47.414830 31109 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:47.448554 30954 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.415122 30939 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.456372 30939 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.430373 31108 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:47.461934 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 188219us
I20260709 13:10:47.450580 31030 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.460052 31077 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:47.451848 31109 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.466015 31053 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:47.468621 30868 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.466281 31030 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.505838 30939 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.504776 31111 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:47.539985 30754 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.007s
W20260709 13:10:47.622848 31060 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.401s	user 0.000s	sys 0.007s
W20260709 13:10:47.624074 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.624706 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.624846 31071 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.797s	user 0.001s	sys 0.000s
I20260709 13:10:47.627516 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.628396 24594 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:47.629544 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2282) took 1597 ms. Trace:
I20260709 13:10:47.630076 24524 rpcz_store.cc:276] 0709 13:10:46.031695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.031900 (+   205us) service_pool.cc:224] Handling call
0709 13:10:46.032322 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:46.045945 (+ 13623us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:46.045989 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:46.046715 (+   726us) log.cc:844] Serialized 52 byte log entry
0709 13:10:46.390301 (+343586us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:46.390342 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.390408 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.624296 (+1233888us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:47.629149 (+  4853us) raft_consensus.cc:1685] finished
0709 13:10:47.629177 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.629472 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4893,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5811,"spinlock_wait_cycles":23951744,"thread_start_us":324900,"threads_started":1,"wal-append.queue_time_us":627093}
W20260709 13:10:47.633343 31066 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.412s	user 0.006s	sys 0.000s
I20260709 13:10:47.636440 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2185) took 1933 ms. Trace:
I20260709 13:10:47.639479 31079 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.641858 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1360) took 1953 ms. Trace:
I20260709 13:10:47.642354 25211 rpcz_store.cc:276] 0709 13:10:45.688664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.689379 (+   715us) service_pool.cc:224] Handling call
0709 13:10:45.738911 (+ 49532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.739252 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:45.739280 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.760725 (+ 21445us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.024174 (+263449us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:46.024223 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.024315 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.622112 (+1597797us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:47.641483 (+ 19371us) raft_consensus.cc:1685] finished
0709 13:10:47.641513 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.641785 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19550,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":32273,"spinlock_wait_cycles":69647744,"thread_start_us":176049,"threads_started":1,"wal-append.queue_time_us":371871}
I20260709 13:10:47.547221 31105 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.674507 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.636943 24671 rpcz_store.cc:276] 0709 13:10:45.703066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.838253 (+135187us) service_pool.cc:224] Handling call
0709 13:10:45.838611 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:47.198773 (+1360162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.636125 (+437352us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540040a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:47.636370 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3126411008}
I20260709 13:10:47.644371 30754 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.679926 30754 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:47.681026 25219 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:47.682129 30940 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:47.676532 31079 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.684689 31079 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:47.685361 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.686048 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.686451 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.686955 31079 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.687462 31079 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.687901 31079 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.689368 30975 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:47.689904 30975 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.692723 30970 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:47.693292 30970 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.695585 30970 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.696075 30970 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.696471 30970 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.697216 30496 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.697722 30496 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.700054 30950 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:47.700438 30950 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:47.700691 31079 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.701323 30950 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.702390 30950 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:47.476321 31077 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:47.706187 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 239760us
W20260709 13:10:47.708779 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.709239 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.714342 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:47.722118 30965 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:47.713260 30974 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:47.728848 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:47.736954 31129 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:10:47.646751 31099 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.747560 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.746824 30821 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:47.755026 24666 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:10:47.755420 24666 pending_rounds.cc:85] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 11
W20260709 13:10:47.755618 31065 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.454s	user 0.001s	sys 0.005s
I20260709 13:10:47.755862 30954 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.724964 30974 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.755645 24666 pending_rounds.cc:107] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:10:47.759357 24666 raft_consensus.cc:2889] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:47.608256 31108 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.760896 30974 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.746981 30872 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:47.762058 31124 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:10:47.761857 30872 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.763974 30872 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.765411 31077 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.765916 30944 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:47.772608 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2293) took 1918 ms. Trace:
I20260709 13:10:47.773176 24600 rpcz_store.cc:276] 0709 13:10:45.854219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.347781 (+493562us) service_pool.cc:224] Handling call
0709 13:10:47.245612 (+897831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.263912 (+ 18300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.772338 (+508426us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54001dfe50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:47.772530 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976514944}
I20260709 13:10:47.775735 30971 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:47.776259 30971 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:46.633879 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:47.766822 30957 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.789863 30957 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.750613 30821 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:47.792208 30821 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.793620 30821 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.766439 30944 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.798300 30944 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.807979 31077 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.812619 31077 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.815542 31077 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.816583 30563 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:47.766439 31109 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.832825 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:47.831593 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:47.833873 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:47.834789 24524 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:10:47.612263 31111 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.833784 24521 raft_consensus.cc:2376] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14. Re-sending same reply.
I20260709 13:10:47.839880 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:47.840432 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.842582 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.843246 24600 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
W20260709 13:10:47.845033 31096 consensus_meta.cc:287] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.002s
I20260709 13:10:47.845479 31096 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:10:47.818296 30971 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.855427 30975 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:47.856278 31126 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 13:10:47.857380 30950 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.857694 24673 raft_consensus.cc:2410] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:47.857942 30950 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.858434 31089 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.858879 31089 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.860044 30950 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:47.860780 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:47.861805 24522 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.862360 31089 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.865365 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:47.866142 24517 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:47.867268 31030 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:47.841120 30941 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.867805 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.868563 30941 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.870394 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.870728 30941 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:47.871574 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.872164 30970 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:47.873251 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:47.873951 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2287) took 2036 ms. Trace:
I20260709 13:10:47.874457 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:47.875070 24594 raft_consensus.cc:2376] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15. Re-sending same reply.
I20260709 13:10:47.875160 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1470) took 1242 ms. Trace:
I20260709 13:10:47.875974 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.877458 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.878165 24594 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:10:47.878711 31111 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:47.878899 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:47.879371 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.880155 24594 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:47.881994 24594 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
W20260709 13:10:47.882483 31114 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.005s
I20260709 13:10:47.883123 24594 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:10:47.882858 31114 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.884436 24594 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:10:47.894033 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56626.1us
I20260709 13:10:47.874332 24592 rpcz_store.cc:276] 0709 13:10:45.837221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.254935 (+417714us) service_pool.cc:224] Handling call
0709 13:10:46.287431 (+ 32496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.321292 (+ 33861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.873744 (+1552452us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b54001ca554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:47.873900 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36328192}
I20260709 13:10:47.872203 24599 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:47.875605 24668 rpcz_store.cc:276] 0709 13:10:46.632425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.632792 (+   367us) service_pool.cc:224] Handling call
0709 13:10:46.633146 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.789473 (+156327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.789523 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.789583 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:46.789642 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.874964 (+1085322us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400276854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:47.875008 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.875112 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358512000}
I20260709 13:10:47.888337 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:47.912525 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1776) took 1129 ms. Trace:
I20260709 13:10:47.913039 25214 rpcz_store.cc:276] 0709 13:10:46.782787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.793796 (+ 11009us) service_pool.cc:224] Handling call
0709 13:10:47.888170 (+1094374us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800036098. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:10:47.912458 (+ 24288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4005632}
I20260709 13:10:47.915517 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:47.921310 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.917631 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:47.932780 24522 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:47.884788 31114 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.889895 31020 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:47.958799 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.938402 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:47.944892 30940 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:47.899793 30941 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:47.964558 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:47.934217 31089 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:47.916682 31127 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:47.916478 31109 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:47.944962 30993 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:47.917164 30950 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:47.931823 30665 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.975478 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:47.971443 30940 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.964955 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:47.965039 31077 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:10:47.968519 31120 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:10:47.965704 30938 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:10:47.918501 30975 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:10:47.977589 31089 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.978349 30970 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:47.965364 31105 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:10:47.985986 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.987818 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.994973 24592 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:47.988744 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:47.996271 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:47.983913 30940 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:47.984714 31135 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:48.023362 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.037814 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.978129 30941 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.999370 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:48.075922 24594 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:10:48.076332 31138 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:10:47.985411 31114 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:48.076983 31114 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:47.986636 30939 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.077543 31114 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.077849 30939 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.080411 30939 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:48.082530 31141 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:48.088429 31020 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.089120 31020 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.986068 31111 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:10:47.981833 30665 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.993547 31089 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:48.098887 30665 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.997213 30954 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.101608 30954 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.104120 30954 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:47.981446 30950 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.092128 31020 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:48.107115 30950 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:48.002100 31099 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:48.112886 30941 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:48.113018 31099 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.113353 30796 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:48.113656 31099 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.113902 30796 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:48.114976 30796 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:47.993382 30974 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 13:10:48.118709 30974 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:48.119156 30974 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:48.120065 30974 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:47.981468 31109 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.122694 30796 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.123139 31109 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:48.136679 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.128662 30862 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:48.131371 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.133386 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.137936 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.138341 30974 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.134330 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:48.139532 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:48.139911 24591 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:48.140755 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:48.141041 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:48.137447 24524 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:48.147746 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:48.157919 31109 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:48.158789 31109 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.185469 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1365) took 1338 ms. Trace:
I20260709 13:10:48.185765 24595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:48.186412 24595 raft_consensus.cc:606] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:48.186000 25219 rpcz_store.cc:276] 0709 13:10:46.847465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.021629 (+174164us) service_pool.cc:224] Handling call
0709 13:10:48.185200 (+1163571us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54007b6bd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:48.185391 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362277248}
I20260709 13:10:48.189193 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1770) took 1496 ms. Trace:
I20260709 13:10:48.189679 25212 rpcz_store.cc:276] 0709 13:10:46.692387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.693055 (+   668us) service_pool.cc:224] Handling call
0709 13:10:46.693406 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.275699 (+582293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.188874 (+913175us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54003903d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:48.189120 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337690496}
I20260709 13:10:48.198817 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1769) took 1506 ms. Trace:
I20260709 13:10:48.159183 31109 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.199417 25217 rpcz_store.cc:276] 0709 13:10:46.692074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.692257 (+   183us) service_pool.cc:224] Handling call
0709 13:10:46.692605 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.692856 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:47.035252 (+342396us) log.cc:844] Serialized 14 byte log entry
0709 13:10:47.185904 (+150652us) log.cc:844] Serialized 14 byte log entry
0709 13:10:47.858115 (+672211us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b18004f9840. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1
0709 13:10:47.858913 (+   798us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b18004f9840. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:48.198165 (+339252us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b18004f9840. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:10:48.198377 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.198449 (+    72us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:48.198511 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.198607 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.198738 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":999556,"prepare.queue_time_us":39354,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":7374,"raft.queue_time_us":1021083,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":8880,"spinlock_wait_cycles":43776384,"thread_start_us":394297,"threads_started":2,"wal-append.queue_time_us":318058}
I20260709 13:10:48.203799 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3489) took 1529 ms. Trace:
I20260709 13:10:48.204223 24520 rpcz_store.cc:276] 0709 13:10:46.674851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.675045 (+   194us) service_pool.cc:224] Handling call
0709 13:10:48.203600 (+1528555us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540030f054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:48.203741 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2639346560}
I20260709 13:10:48.205858 31021 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:48.206235 31021 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:48.207067 31021 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.211004 30833 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:48.211750 30904 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.211524 30833 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.212222 30904 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.213596 30833 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:48.213371 31039 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.214219 30904 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:48.214733 31039 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:48.217653 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 959797us
I20260709 13:10:48.220574 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1467) took 1707 ms. Trace:
I20260709 13:10:48.221138 24674 rpcz_store.cc:276] 0709 13:10:46.513335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.548847 (+ 35512us) service_pool.cc:224] Handling call
0709 13:10:46.659567 (+110720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.045133 (+385566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.045164 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.045202 (+    38us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:47.045232 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.220257 (+1175025us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400046fd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:48.220321 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.220497 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886239488}
I20260709 13:10:48.228394 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.224277 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3607) took 1396 ms. Trace:
I20260709 13:10:48.232890 24666 rpcz_store.cc:276] 0709 13:10:46.828277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.829068 (+   791us) service_pool.cc:224] Handling call
0709 13:10:46.829448 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.759803 (+930355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.224079 (+464276us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54002ebb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:48.224224 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2127724288}
I20260709 13:10:48.237015 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.238113 24669 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:48.240945 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:48.239979 24673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2183) took 2533 ms (client timeout 1989 ms). Trace:
W20260709 13:10:48.242535 24673 rpcz_store.cc:269] 0709 13:10:45.702581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.732273 (+ 29692us) service_pool.cc:224] Handling call
0709 13:10:48.227491 (+2495218us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54000483d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:48.236305 (+  8814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4657563520}
I20260709 13:10:48.241370 24595 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:48.245687 24520 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:48.254529 24595 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:10:48.245867 30954 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.261041 30950 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:48.264787 31089 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.266911 30940 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.268144 31089 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:48.277783 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.239081 31143 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:10:48.286104 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:48.286168 31109 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.239403 31114 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.289259 31114 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:48.273180 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.290144 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.290501 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.292311 31099 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.283430 30954 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.288893 31109 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:48.270315 30986 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.847s	user 0.031s	sys 0.059s
I20260709 13:10:48.295658 30954 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:48.296003 30950 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:10:48.296849 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:48.295753 30986 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.023s	user 0.031s	sys 0.060s
I20260709 13:10:48.298851 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:48.280445 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.301477 24524 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:48.301682 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:48.302242 24595 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.304870 25217 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:10:48.307646 24522 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:10:48.308404 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.311936 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.312783 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.313673 25218 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:10:48.313828 30954 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:48.312696 25217 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:48.314896 31135 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:48.312371 30987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.013s	user 0.010s	sys 0.024s
W20260709 13:10:48.316689 30987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.017s	user 0.010s	sys 0.024s
I20260709 13:10:48.316669 31099 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:48.317577 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:48.318014 30987 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:48.318418 30987 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:48.319413 25211 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:48.321316 30882 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:48.321996 30882 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.325320 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:48.326462 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:48.327152 24593 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:48.326416 30882 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:48.333432 25214 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:48.338094 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.339787 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.341462 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.269013 30940 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:48.342092 25212 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:48.342456 24593 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:48.343704 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.344974 24524 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:48.343801 24595 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:48.346418 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.348179 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.319164 30987 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.343819 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:48.344521 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.351518 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:48.351603 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:48.352094 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.357216 24525 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:48.357678 24672 raft_consensus.cc:2410] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:48.355971 24523 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:48.357259 24520 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:48.352756 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:48.358347 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.357151 25219 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:48.358322 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:48.360646 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.361688 30950 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:48.361254 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.367492 24524 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:48.362216 30950 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:48.341483 31114 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:48.375773 31114 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.376029 30950 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.377774 30875 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:48.378226 31114 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:48.378890 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3596) took 2429 ms. Trace:
I20260709 13:10:48.379233 24667 rpcz_store.cc:276] 0709 13:10:45.952038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.982659 (+ 30621us) service_pool.cc:224] Handling call
0709 13:10:45.982928 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.111812 (+128884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.378636 (+2266824us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b540017f554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:48.378812 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147421568}
I20260709 13:10:48.380448 24517 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:48.383924 24520 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:48.387281 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.390762 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.392625 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:48.309162 30924 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:48.393450 24520 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:10:48.417904 24524 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:48.419895 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:48.424721 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.425364 25214 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:48.428977 30496 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:48.437124 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.439225 31130 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.913s	user 0.004s	sys 0.000s
I20260709 13:10:48.440436 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:48.441362 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.389797 30938 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:48.463840 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.490185 30658 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:48.490790 30658 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:48.491940 30658 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.506475 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:48.511392 31030 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:48.514878 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:48.528339 24525 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:48.558167 25210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cf920647a7842d49c08b2453da44143"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:10:48.559010 25210 raft_consensus.cc:606] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:48.559530 25210 raft_consensus.cc:614] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:48.561305 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:48.562363 25217 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18.
I20260709 13:10:48.511591 30658 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:48.571394 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.568265 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:48.576757 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:48.581609 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:48.517817 31142 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:10:48.588840 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.537402 30865 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.589617 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.556305 31082 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.556536 30882 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.556471 30868 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:48.563598 30997 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.613914 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.615114 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 226773us
I20260709 13:10:48.616290 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:48.518115 30938 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:48.619447 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.622803 30950 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.623636 25210 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:10:48.623342 30950 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.625576 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.627046 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.629974 30971 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:48.630304 25217 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:10:48.631881 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.629943 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.637650 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:48.638180 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.638546 25218 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:48.639030 25212 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:48.645140 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.646485 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:48.618815 30798 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:48.652930 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:48.653752 25215 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:48.618770 31114 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:48.657835 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:48.640780 30868 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:48.651108 30938 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.667769 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.612733 31082 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.606976 30865 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.652390 30798 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.681191 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.612973 30882 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.655139 30796 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:48.634248 30997 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.702284 24672 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:48.661752 31106 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:48.687917 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:48.703761 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:48.704900 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:48.689605 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.706018 24665 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:48.706924 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.708182 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.701591 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:48.710636 24673 raft_consensus.cc:2368] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:48.711061 25218 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:48.708825 24665 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:48.712446 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:48.720196 31082 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:48.699966 30939 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:48.721645 31148 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:10:48.721403 30939 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.722649 31021 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.723738 30939 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:48.702298 30796 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:48.725428 30796 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.725554 30868 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.726528 30997 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:48.727245 25210 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:10:48.730758 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.731379 24673 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:48.732244 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.733560 24522 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:10:48.739671 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.741130 30971 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:48.741675 30971 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:48.742672 24665 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:48.744050 30971 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:48.744223 24665 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:10:48.744756 24665 pending_rounds.cc:85] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 12
I20260709 13:10:48.745117 24665 pending_rounds.cc:107] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:10:48.745425 24665 raft_consensus.cc:2889] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:48.684197 31039 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.088s
W20260709 13:10:48.762017 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.700126 30798 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:48.685518 30940 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.763139 25211 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:48.736811 30957 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:48.740620 24673 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:48.782961 25215 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:48.787993 24673 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:48.788120 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:48.665407 31114 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:48.763128 31150 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:48.738790 30869 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:48.785017 31146 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:10:48.788167 31060 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:48.803092 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.804108 24673 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 13.
I20260709 13:10:48.781978 30971 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.812045 24667 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:48.811782 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.823840 24665 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:48.825459 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3507) took 1524 ms. Trace:
I20260709 13:10:48.825838 24518 rpcz_store.cc:276] 0709 13:10:47.301513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.301661 (+   148us) service_pool.cc:224] Handling call
0709 13:10:47.302032 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.352836 (+ 50804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.352882 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.352936 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:47.352972 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.825223 (+1472251us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b5400442854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:48.825272 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.825404 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116229888}
I20260709 13:10:48.828557 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1369) took 1946 ms. Trace:
I20260709 13:10:48.829036 25216 rpcz_store.cc:276] 0709 13:10:46.882654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.324424 (+441770us) service_pool.cc:224] Handling call
0709 13:10:47.328488 (+  4064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.199905 (+871417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.199935 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.200408 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:10:48.561331 (+360923us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:48.561389 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.561475 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:48.828344 (+266869us) raft_consensus.cc:1685] finished
0709 13:10:48.828367 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.828487 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":870314,"raft.queue_time_us":871406,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":360538,"threads_started":1,"wal-append.queue_time_us":500650}
I20260709 13:10:48.832544 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.791489 30940 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:48.833956 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.836409 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.823271 30496 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:48.850399 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 264670us
I20260709 13:10:48.855533 24666 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:48.825217 30971 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:48.859061 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.854990 31099 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.882828 30975 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.894240 30975 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:48.897572 31154 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:10:48.897280 31099 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:48.923121 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.854765 30496 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:48.926293 31152 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:10:48.940805 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:48.928483 30865 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:48.939715 30975 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:48.947542 24673 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:48.938351 30882 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:48.953225 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:48.963316 24673 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:48.952267 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 384093us
I20260709 13:10:48.965764 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:48.967880 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:48.961894 31158 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 13:10:48.968958 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:48.962208 31114 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:48.990383 30869 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:49.002424 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.002578 30869 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:48.972472 30658 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:49.005281 24597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2291) took 3142 ms (client timeout 1847 ms). Trace:
W20260709 13:10:49.005846 24597 rpcz_store.cc:269] 0709 13:10:45.853763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.060608 (+206845us) service_pool.cc:224] Handling call
0709 13:10:48.993803 (+2933195us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400192dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:48.996229 (+  2426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512910080}
I20260709 13:10:48.984262 31021 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:49.003851 30869 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.019861 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.018142 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:49.013427 31088 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.910s	user 0.013s	sys 0.001s
I20260709 13:10:49.037915 24673 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
W20260709 13:10:49.038240 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.020949 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.012270 30658 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:49.015882 30752 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:49.029482 31162 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:10:49.044196 24667 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:49.015357 30975 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:49.049746 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:49.050042 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.050621 24516 raft_consensus.cc:2368] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18.
I20260709 13:10:49.052063 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.052825 24525 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:49.054382 24525 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:49.045002 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.055708 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.057672 24525 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:49.059106 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.059648 24525 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
W20260709 13:10:49.061108 31167 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:49.061515 30658 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.064559 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.029363 31087 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.065382 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:49.068177 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.067101 24596 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:49.068413 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.067191 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.069597 24517 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:49.070313 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:49.071165 24516 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:49.069665 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.071847 24524 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:49.072897 24592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:10:49.073449 24592 raft_consensus.cc:606] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:49.073755 24592 raft_consensus.cc:614] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:49.074880 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:49.076366 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.077920 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:49.080371 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:49.080974 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.081619 24519 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:49.083477 24597 raft_consensus.cc:2410] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:10:49.086038 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.090095 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:49.090338 31075 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.091173 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.092686 30933 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.092891 31168 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.093393 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:49.094326 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.094887 24667 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:10:49.094976 24523 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:49.096288 24523 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:49.097185 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.097770 24517 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:49.086622 24519 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:10:49.065804 31099 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.105175 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.090865 31075 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.092775 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:49.098474 30821 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.100548 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.107976 24525 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:49.108255 24520 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:49.102859 31181 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:49.105574 24517 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:10:49.110575 24672 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:49.111279 31099 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:49.111660 31099 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:49.111635 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:49.112290 31099 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:49.112627 31178 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:49.112989 31178 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.113345 31178 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.119647 30940 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.120023 31099 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.120937 31178 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.122195 31099 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.123027 31178 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.124773 24491 leader_election.cc:400] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:49.125146 24491 leader_election.cc:403] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.126328 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.127199 31179 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:49.128877 31179 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:49.129659 31179 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.130072 31179 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:49.130553 31179 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.132438 30950 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:49.139706 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.140710 31035 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.141248 31035 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.142043 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:49.143069 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.143571 31035 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.145022 31099 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.145843 31099 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:49.149547 31178 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:49.151198 31025 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:49.151597 31025 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:49.156395 30971 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.156950 30971 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:49.155447 31099 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:49.158557 24670 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:49.187644 31099 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:49.188648 31099 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:49.158156 31178 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:10:49.152443 31025 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:49.168977 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 486828us
I20260709 13:10:49.190802 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:49.172835 30987 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:49.193195 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.193806 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.195386 31025 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:49.186503 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.130237 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:49.197891 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.157284 30971 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:49.206185 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 252285us
W20260709 13:10:49.203441 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 73307.3us
W20260709 13:10:49.212677 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.071507 30798 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.071708 30796 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.076488 30975 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.160945 31179 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.098507 30496 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.093552 31168 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.248518 30971 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:49.328171 31095 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 2.172s	user 0.003s	sys 0.019s
I20260709 13:10:49.329586 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1771) took 2636 ms. Trace:
I20260709 13:10:49.329993 25213 rpcz_store.cc:276] 0709 13:10:46.692679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.693320 (+   641us) service_pool.cc:224] Handling call
0709 13:10:46.792723 (+ 99403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.816999 (+ 24276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.817042 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.827356 (+ 10314us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.933274 (+105918us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:46.933313 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.933395 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.327425 (+2394030us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:49.329249 (+  1824us) raft_consensus.cc:1685] finished
0709 13:10:49.329272 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.329501 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13123,"raft.queue_time_us":8572,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13218,"spinlock_wait_cycles":8290688,"thread_start_us":88747,"threads_started":1,"wal-append.queue_time_us":243546}
I20260709 13:10:49.247097 31021 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:49.277025 25184 connection.cc:256] RPC call timeout handler was delayed by -2.073921119999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:10:49.276965 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86234.4us
I20260709 13:10:49.334753 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:49.278246 30942 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:49.278753 30904 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.291122 31075 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.205811 30821 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.293046 31179 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:49.294101 31175 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:10:49.295413 31168 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.370338 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.295912 31052 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:49.375782 31052 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:49.274071 31030 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:10:49.376137 31052 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:49.376458 30796 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.269436 31108 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.338203 30942 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:49.377550 30942 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:49.377321 31108 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.379628 31108 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.300161 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:49.301280 31067 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:49.380625 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 80565.4us
I20260709 13:10:49.381093 31067 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.381497 31067 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:49.381951 31067 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.322947 31099 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.338153 31021 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.386612 31021 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:49.387195 31099 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.269120 30941 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.256006 31063 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:10:49.389664 31063 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:49.390152 31063 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:49.391002 31063 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.392514 31063 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.332185 24669 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:49.339543 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:49.338299 25184 connection.cc:256] RPC call timeout handler was delayed by -1.45472938599994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260709 13:10:49.372562 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.393518 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 54069.6us
I20260709 13:10:49.295729 30975 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.366372 31082 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:49.374097 30821 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.370031 30904 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:49.410545 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 266049us
I20260709 13:10:49.381743 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:49.393512 25184 connection.cc:256] RPC call timeout handler was delayed by -1.3728293860000349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 13:10:49.411564 25184 connection.cc:256] RPC call timeout handler was delayed by -1.2966368639999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 13:10:49.388235 30941 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.373428 30798 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.437706 24637 leader_election.cc:400] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18.
I20260709 13:10:49.438035 24637 leader_election.cc:403] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.394532 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:49.298337 24521 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:49.415983 25214 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:49.439631 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.417598 25218 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:10:49.419902 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.440660 24666 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:49.423503 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:49.432119 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.441576 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47152.2us
I20260709 13:10:49.433961 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.436925 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:49.433478 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51837us
I20260709 13:10:49.445705 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:49.442610 25210 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:49.398344 31064 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:49.449406 24670 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:10:49.456568 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:49.462749 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:49.463516 24670 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:49.466475 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.467167 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:49.398411 31168 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:49.450524 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:49.478160 24671 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.452394 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.455060 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.458015 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.458756 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.481788 24672 raft_consensus.cc:2410] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:10:49.469956 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:49.482410 25214 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:49.470034 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:49.449942 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:49.483275 24666 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:49.484216 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.473598 25211 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:49.412869 31099 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.439438 30348 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.475935 25212 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:10:49.487298 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 803053us
I20260709 13:10:49.488598 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:49.489549 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:49.492063 24523 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:49.493031 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.493863 24524 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:10:49.495885 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:49.447650 30821 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:49.441140 31082 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:49.497099 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:49.497516 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:49.506246 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.507673 24668 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:49.509146 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.510738 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.511476 24524 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:49.512316 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.514024 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.515058 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.460417 30915 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:49.516832 24519 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:49.461763 31064 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:49.471002 30987 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:49.467149 31108 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18.
I20260709 13:10:49.520211 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:49.458062 30993 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:49.486338 30665 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.476001 30798 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:49.522696 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.521229 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.376960 31052 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.486110 31186 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 13:10:49.492002 31168 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.501946 24670 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:49.502653 31089 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:10:49.620632 31108 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.702569 31168 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.576195 24666 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:49.538417 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:49.714179 24525 raft_consensus.cc:2410] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:10:49.519022 30912 raft_consensus.cc:2764] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:10:49.716194 30912 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:49.538780 31039 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:49.701049 31120 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:49.701871 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 180704us
I20260709 13:10:49.719439 31039 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.529978 31064 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:49.700033 30798 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:49.720800 30798 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.539734 30993 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.724753 30993 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:49.523428 30924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.027s	sys 0.049s
W20260709 13:10:49.725495 30924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.030s	sys 0.056s
I20260709 13:10:49.725582 31052 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:49.727753 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.517522 30933 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:49.728639 31120 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:49.728945 30933 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.729050 31120 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:49.729537 30933 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:49.729750 31120 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.566425 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:49.738533 24520 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.011s	sys 0.044s
W20260709 13:10:49.738883 24520 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.011s	sys 0.044s
I20260709 13:10:49.740321 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.496452 30865 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:49.539009 30987 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.504479 30348 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.703773 31108 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.579334 31179 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.495303 30950 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.516822 31085 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.193s
I20260709 13:10:49.626824 30971 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.522178 30997 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.191s
W20260709 13:10:49.810802 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 378663us
I20260709 13:10:49.537185 24671 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:49.720043 31039 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.709916 31089 consensus_queue.cc:1243] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:49.753854 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.603790 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:49.808379 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.812368 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.814108 31075 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.859429 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 47151.4us
I20260709 13:10:49.860460 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.892992 25215 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:49.739212 31021 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.891723 31089 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:49.740038 31053 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.888348 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 134592us
I20260709 13:10:49.820353 30924 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.910007 30924 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.912480 30924 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.773811 31030 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.913244 31030 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:49.882727 31025 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.684s	user 0.014s	sys 0.001s
I20260709 13:10:49.915518 31030 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.865031 30993 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:49.916097 30993 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:49.810559 31179 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.917441 30941 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:49.893997 30796 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:49.919037 31179 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:49.920734 31067 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.001s
I20260709 13:10:49.940713 24674 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:49.869366 30940 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:49.923456 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.950887 25212 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:10:49.923612 31108 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:49.924069 31039 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.904733 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.925366 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:49.953627 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48986.2us
I20260709 13:10:49.953913 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.926087 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.954396 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:49.817564 31114 raft_consensus.cc:2764] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:49.932786 31120 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.961329 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:49.961925 25216 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.926801 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.900226 31089 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:49.891916 31075 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:49.969362 31075 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:49.935339 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1389) took 1272 ms. Trace:
I20260709 13:10:49.917906 31053 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.796332 30865 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:49.917026 30993 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:49.960551 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 364486us
I20260709 13:10:49.922098 30971 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:49.922772 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.944573 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.944751 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.940796 30987 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:49.948302 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 440339us
W20260709 13:10:49.943655 30942 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.002s
I20260709 13:10:49.946533 30869 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:49.925840 30798 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.954926 25210 raft_consensus.cc:2410] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:10:49.751900 31082 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.956707 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:50.014858 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58211.2us
I20260709 13:10:49.958366 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:49.997264 30993 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:49.963136 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:49.964406 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:49.964848 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:49.965981 24421 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:49.966722 31039 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:49.964171 30796 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:50.043143 30796 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:50.043725 30796 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:49.967157 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:50.045708 30665 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
I20260709 13:10:49.970600 25217 rpcz_store.cc:276] 0709 13:10:48.663357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.663504 (+   147us) service_pool.cc:224] Handling call
0709 13:10:48.683140 (+ 19636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.173839 (+490699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.184965 (+ 11126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.185491 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.400429 (+214938us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:49.400484 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.400575 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.935136 (+534561us) raft_consensus.cc:1685] finished
0709 13:10:49.935156 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.935284 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":490329,"raft.queue_time_us":567415,"spinlock_wait_cycles":5966464,"thread_start_us":214613,"threads_started":1,"wal-append.queue_time_us":748177}
I20260709 13:10:50.046129 30665 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.943722 31067 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.047374 24421 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.048573 31067 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:50.057966 30821 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
I20260709 13:10:49.953392 30940 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:49.941167 30904 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.058496 30821 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:49.976109 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.017477 31037 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:49.961501 31108 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:50.059492 31053 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:50.060101 31063 consensus_meta.cc:287] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.667s	user 0.014s	sys 0.000s
I20260709 13:10:50.021025 30987 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:50.060997 30987 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:50.061426 30987 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:49.995961 24420 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 348) took 15186 ms (client timeout 15000 ms). Trace:
W20260709 13:10:49.997684 24565 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.853s (SENT)
I20260709 13:10:50.062757 30940 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:50.063021 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 65375.8us
I20260709 13:10:50.015756 30869 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:49.999651 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 54987.1us
I20260709 13:10:50.065528 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:50.066208 30869 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.067166 25184 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:50.068486 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:50.001641 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.069974 31135 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.070516 31135 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.069547 30796 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.073180 31135 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.076030 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.077256 30796 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.013165 25216 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:50.016139 24592 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:50.079403 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:49.994202 31189 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.015803 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:49.962486 25214 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:10:50.080546 31189 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.034085 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.081795 25212 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:50.034782 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.082612 30348 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.037551 30798 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.005394 30942 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.086747 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:50.087327 24523 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:10:50.087446 30942 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.087973 30754 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:50.088563 30754 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:50.088821 31120 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:50.089001 25215 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:10:50.089751 31194 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:10:50.090345 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:50.041625 30865 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.092370 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1794) took 1660 ms. Trace:
I20260709 13:10:49.973999 30997 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:50.058145 31021 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.078315 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.082787 25210 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:50.082789 31189 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:50.080963 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65272.5us
I20260709 13:10:50.077878 24597 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:49.997215 30915 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:50.083604 30796 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:50.036126 31187 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:10:50.088048 30942 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:50.088967 30754 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.091040 30911 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:50.083921 30950 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.084162 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.158767 24594 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:10:50.092723 25219 rpcz_store.cc:276] 0709 13:10:48.433340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.433462 (+   122us) service_pool.cc:224] Handling call
0709 13:10:48.435147 (+  1685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.435359 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:10:48.747859 (+312500us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.269633 (+521774us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.269967 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.946371 (+676404us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b1800387be0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:50.091725 (+145354us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b1800387be0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf 00007f17bbf60038
0709 13:10:50.091895 (+   170us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.092058 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.092100 (+    42us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:50.092142 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.092209 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.092320 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1124098,"prepare.queue_time_us":1734836,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":130,"raft.queue_time_us":319617,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":26554,"spinlock_wait_cycles":53842176,"thread_start_us":525786,"threads_started":2,"wal-append.queue_time_us":323516}
I20260709 13:10:50.121459 30882 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:50.160179 30942 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.160602 30942 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:50.129217 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:50.161161 31178 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:50.162278 31178 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:50.162328 31075 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:10:50.168128 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.167860 30915 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.095363 24596 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:50.129995 24524 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:50.170900 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:50.130705 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.171769 24524 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:50.171852 24525 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:50.173313 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:50.161717 24519 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:50.130241 24517 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:50.162156 30971 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:10:50.121409 31064 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.131700 24520 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:50.178036 30957 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:50.135695 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.178376 31064 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:50.095640 30948 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:50.178845 30957 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:50.101490 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2311) took 1010 ms. Trace:
W20260709 13:10:50.111228 24521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3517) took 1980 ms (client timeout 1950 ms). Trace:
I20260709 13:10:50.180397 30948 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:10:50.180951 24521 rpcz_store.cc:269] 0709 13:10:48.130527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.133160 (+  2633us) service_pool.cc:224] Handling call
0709 13:10:50.110981 (+1977821us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000bccd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:50.111127 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668095360}
I20260709 13:10:50.111896 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2197) took 1431 ms. Trace:
I20260709 13:10:50.182334 24669 rpcz_store.cc:276] 0709 13:10:48.680696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.680826 (+   130us) service_pool.cc:224] Handling call
0709 13:10:50.111666 (+1430840us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b5400276854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:50.111830 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484231936}
I20260709 13:10:50.179600 24516 rpcz_store.cc:276] 0709 13:10:49.090564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.091939 (+  1375us) service_pool.cc:224] Handling call
0709 13:10:49.092261 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.296498 (+204237us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:49.296884 (+   386us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.737510 (+440626us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.737853 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.737988 (+   135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.738027 (+    39us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:49.738067 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.913561 (+175494us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b48001a04d8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:10:50.101284 (+187723us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54000dc5d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:50.101326 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.101437 (+   111us) inbound_call.cc:177] Queueing success response
0709 13:10:50.125836 (+ 24399us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b1800370ea0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
Metrics: {"mutex_wait_us":18531,"prepare.queue_time_us":391830,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":92,"raft.queue_time_us":137775,"raft.run_cpu_time_us":2332,"raft.run_wall_time_us":244325,"spinlock_wait_cycles":562452608,"thread_start_us":330428,"threads_started":1,"wal-append.queue_time_us":633400}
I20260709 13:10:50.179602 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:50.153831 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:50.185420 30957 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:50.185817 30957 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:50.186177 30957 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:50.133539 24522 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:50.156232 31089 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.188428 31089 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.175467 24519 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:50.191004 30987 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.193033 30987 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:50.193188 24674 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:50.198580 31068 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:50.198904 30997 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.172587 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:50.199563 30965 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:50.199934 24524 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:50.048964 24421 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 11 to 13, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 13 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.200961 30997 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.202225 24421 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 8 to 17. New cstate: current_term: 17 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:50.167737 31178 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:50.087987 30933 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:50.197177 24420 rpcz_store.cc:269] 0709 13:10:34.808703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.812104 (+  3401us) service_pool.cc:224] Handling call
0709 13:10:36.634432 (+1822328us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:10:49.979029 (+13344597us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:42.665980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:42.666645 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:42.666702 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:10:42.666721 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:42.667963 (+  1242us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:42.668071 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:42.668097 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:10:42.781552 (+113455us) tablet.cc:701] Row locks acquired
0709 13:10:42.796497 (+ 14945us) write_op.cc:260] PREPARE: finished
0709 13:10:42.885940 (+ 89443us) write_op.cc:270] Start()
0709 13:10:42.942497 (+ 56557us) write_op.cc:276] Timestamp: P: 1783602642859998 usec, L: 0
0709 13:10:42.947856 (+  5359us) op_driver.cc:348] REPLICATION: starting
0709 13:10:42.972076 (+ 24220us) log.cc:844] Serialized 5198 byte log entry
0709 13:10:44.142787 (+1170711us) op_driver.cc:464] REPLICATION: finished
0709 13:10:44.297484 (+154697us) write_op.cc:301] APPLY: starting
0709 13:10:44.297590 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:44.366512 (+ 68922us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:44.366643 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:44.739089 (+372446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:44.739425 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:10:44.739492 (+    67us) write_op.cc:312] APPLY: finished
0709 13:10:44.739916 (+   424us) log.cc:844] Serialized 121 byte log entry
0709 13:10:44.740115 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:44.740260 (+   145us) write_op.cc:454] Released schema lock
0709 13:10:44.740339 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:44.740789 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:44.740819 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":765790,"reported_tablets":42,"spinlock_wait_cycles":1514955008,"child_traces":[["op",{"apply.queue_time_us":147541,"apply.run_cpu_time_us":20417,"apply.run_wall_time_us":443291,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":219511,"prepare.run_cpu_time_us":38080,"prepare.run_wall_time_us":465472,"raft.queue_time_us":139984,"raft.run_cpu_time_us":16766,"raft.run_wall_time_us":180145,"replication_time_us":1134703,"thread_start_us":466881,"threads_started":4,"wal-append.queue_time_us":282812,"wal-append.run_cpu_time_us":9212,"wal-append.run_wall_time_us":2496309}]]}
I20260709 13:10:50.203890 31068 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:50.204025 31178 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.195665 31063 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:50.196827 31021 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.205307 31178 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.205440 31021 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.182745 30942 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.207497 31021 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.197520 30796 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:50.193748 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.199966 30965 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:50.197387 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.195467 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.208693 30965 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:50.209347 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.209463 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.209898 30965 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.210472 24595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
W20260709 13:10:50.210973 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.211689 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.212492 24592 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 14: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:50.211040 24595 raft_consensus.cc:606] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:50.212757 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.213377 24593 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:50.214509 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.215160 24597 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:50.216300 24596 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:50.216583 24594 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:10:50.181536 30948 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:50.227033 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.022s	sys 0.065s
I20260709 13:10:50.226816 24525 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:10:50.217963 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.235483 24599 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:10:50.232653 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:50.228039 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.022s	sys 0.065s
W20260709 13:10:50.237056 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 610758us
I20260709 13:10:50.239643 24519 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:50.240160 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.243036 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:50.243292 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.245327 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.238802 24421 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 11 to 14, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 14 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.247577 24599 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:50.249039 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:50.246439 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.163087 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.217687 30933 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.252488 24596 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:50.228931 30796 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:50.263132 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 100133us
I20260709 13:10:50.258198 24669 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:50.261165 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.245393 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:50.264586 24519 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:50.266029 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.267508 24596 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:50.268947 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.269601 24669 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:10:50.269963 24669 pending_rounds.cc:85] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 15
I20260709 13:10:50.270198 24669 pending_rounds.cc:107] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:10:50.270514 24669 raft_consensus.cc:2889] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.252467 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:50.273643 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.275213 24665 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:50.274345 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.277684 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.278415 25214 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:50.274350 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:50.276402 24421 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:50.281188 24596 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:50.281260 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.282068 24669 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:50.288013 24669 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:50.247040 31203 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:50.297654 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.251667 31086 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:50.289642 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.300670 25210 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:10:50.291678 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:50.292119 24669 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:10:50.301846 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.291334 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:50.302419 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.302860 24523 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:50.302989 25216 raft_consensus.cc:2376] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17. Re-sending same reply.
I20260709 13:10:50.292371 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.293689 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.293953 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.292991 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.294317 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.294886 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.295356 24522 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:10:50.302419 24525 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:50.296094 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.292037 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.305773 25216 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:10:50.296909 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.307415 25214 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 10.
I20260709 13:10:50.246690 30971 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:50.235838 30993 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:10:50.296669 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.299374 24421 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d reported cstate change: leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 15 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:50.299621 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.310688 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:50.311190 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:50.317425 25211 raft_consensus.cc:2410] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:10:50.273906 31135 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:50.309484 25212 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:50.320355 25215 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:50.320542 24598 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:50.321944 24665 raft_consensus.cc:2410] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 17 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:50.281879 31075 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:50.323549 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:50.282958 30974 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.282783 31185 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:50.334244 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:50.330168 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:50.331584 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:50.289145 30933 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:10:50.297431 31099 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:50.297960 31203 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.334916 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.329528 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.335690 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:50.335668 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:50.350832 24671 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:50.348641 30882 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.331852 30950 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.340576 24666 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:10:50.343233 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.333814 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:50.332038 30869 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.348192 24668 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:50.352198 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.356637 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:50.399195 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.399499 24671 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:50.399807 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.340308 24525 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:10:50.400586 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.401594 25212 raft_consensus.cc:2410] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 18 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:50.402750 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.403505 25210 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:50.333273 31183 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
W20260709 13:10:50.407480 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55345.4us
I20260709 13:10:50.407680 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:50.408752 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:50.409495 24666 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.343935 31135 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:50.412045 24421 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 13 to 16, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 16 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:50.361148 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.329291 31188 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:50.333784 30940 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.356669 24672 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:50.336704 30997 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:50.331355 30847 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:10:50.344384 31108 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:50.414192 25215 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:50.414376 24671 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:50.446859 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.374521 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.420138 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.345156 31189 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:50.448519 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.449312 25214 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:50.449554 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.450241 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.451331 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.350832 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:50.337947 30974 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:50.452481 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 101731us
I20260709 13:10:50.422199 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.454361 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:50.352308 30833 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:50.336585 31186 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:10:50.453578 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:50.464329 25210 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
W20260709 13:10:50.415346 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 81606.6us
I20260709 13:10:50.465348 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.465445 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.466197 25210 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:50.466893 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.456751 24671 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:50.349390 31185 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:50.458386 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.458873 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.468569 25218 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.412493 31052 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:50.444239 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:50.353482 31203 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.469429 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.362187 30798 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:50.467089 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.459625 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.471946 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.473021 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.509554 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.513396 24671 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:50.468518 30348 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:50.502398 31052 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:50.514328 30348 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:50.514721 31052 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:50.514834 24671 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:50.515275 30348 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.516485 30348 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.489042 24666 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:50.468072 25212 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:50.518181 30942 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.518661 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.519913 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.502071 30863 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:50.521409 30863 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.521795 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.362483 31099 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:50.433683 31188 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.506763 24421 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 9 to 15, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 15 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:50.539690 25218 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:50.468184 30912 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:50.409502 30869 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.521533 31185 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.508176 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.521554 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.505815 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:50.549168 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.550529 24674 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:50.512456 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.511948 30665 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:50.551254 25217 raft_consensus.cc:2376] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23. Re-sending same reply.
I20260709 13:10:50.448555 31189 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.529469 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.398561 30754 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.557104 25185 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:50.557525 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.528825 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:50.512282 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.559558 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.398669 30882 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:50.537581 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.538722 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.434705 30971 raft_consensus.cc:2764] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:10:50.542646 24671 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:10:50.575528 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:50.572768 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 43994.2us
I20260709 13:10:50.576643 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.577003 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.577343 24671 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:50.546299 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.578094 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.578549 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.461828 30997 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.469094 31108 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.568331 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.521837 30863 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:50.579133 25215 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:10:50.522806 30798 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:50.588442 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.591346 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.522763 30957 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.553140 30665 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.452664 30940 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.595073 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.583150 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:50.596320 24674 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:50.508728 30847 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:50.506794 31030 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:10:50.598949 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.523527 31205 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:10:50.584501 25211 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:50.579471 31021 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:50.586468 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.410310 30950 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.553320 31075 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:50.569823 31067 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.569572 30979 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:50.580376 30942 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.579492 30864 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:50.574949 31183 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:50.542466 31188 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:50.590205 30798 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:50.588501 31076 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.598080 30665 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.579903 31200 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:10:50.586866 31063 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:10:50.589519 30904 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:10:50.609505 31021 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:50.567641 31135 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.636185 30864 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.773581 30864 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:50.636574 31067 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.778436 30869 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.780428 30882 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.781378 31067 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.686142 31108 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:50.786670 30940 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:50.790107 31185 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:50.791136 31185 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.793614 24525 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:50.653812 31021 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:50.730494 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.565944 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:50.796082 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 230118us
I20260709 13:10:50.797988 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:50.732312 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.800438 31089 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:10:50.612651 31099 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:50.802320 24639 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 2.026s (SENT) [suppressed 50 similar messages]
I20260709 13:10:50.587179 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:50.580837 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:50.804868 31108 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:50.805022 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 224162us
I20260709 13:10:50.805481 31108 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.806046 31108 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:50.808188 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:50.740439 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.740775 24669 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:50.540980 24421 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 14 to 15, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 15 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:50.811471 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.743726 24670 raft_consensus.cc:2410] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:10:50.743336 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.812439 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:50.812811 31063 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:50.813505 30940 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:50.749440 30496 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:50.750654 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.813917 31063 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:50.620777 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:50.758703 30754 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.759373 30847 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:50.815551 25219 raft_consensus.cc:2376] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18. Re-sending same reply.
I20260709 13:10:50.815630 24668 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:50.816094 30847 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:50.817481 31037 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:50.818743 30847 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.573179 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.815665 30754 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:10:50.813921 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.813943 30940 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:50.820611 30754 consensus_queue.cc:1243] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:10:50.820947 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 247806us
I20260709 13:10:50.766655 30957 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:50.821301 30940 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:50.767597 30974 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.769488 30997 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.770234 31052 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.823452 25215 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:10:50.823766 25215 pending_rounds.cc:85] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 12
I20260709 13:10:50.823992 25215 pending_rounds.cc:107] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:10:50.824360 31052 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.824589 25215 raft_consensus.cc:2889] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.814477 31185 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.827924 30957 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:50.828188 25215 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:50.751430 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.606797 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:50.830128 31063 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:50.830938 31063 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:50.832136 25211 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:50.833420 31063 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.674440 31189 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:50.562492 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.828635 30957 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:50.697878 31210 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:50.563442 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:50.814841 25210 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:50.767318 30950 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.829185 25215 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:50.736579 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:50.890003 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.892997 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2222) took 1441 ms. Trace:
I20260709 13:10:50.895653 31076 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:10:50.895186 31030 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:50.812446 24421 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 8 to 10, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 10 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:50.918416 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 110399us
I20260709 13:10:50.922719 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2220) took 1472 ms. Trace:
I20260709 13:10:50.928306 30912 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:50.964912 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1436) took 1042 ms. Trace:
I20260709 13:10:50.965575 25213 rpcz_store.cc:276] 0709 13:10:49.922160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.922524 (+   364us) service_pool.cc:224] Handling call
0709 13:10:50.964504 (+1041980us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540004c4d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:50.964699 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376373632}
I20260709 13:10:50.966588 24421 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 11 to 14, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 14 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:10:50.969144 31063 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:50.931979 25211 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:50.932888 30348 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.935051 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:50.936084 31222 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:50.980208 31108 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:50.946854 30965 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.736s	user 0.004s	sys 0.015s
I20260709 13:10:50.937966 30821 raft_consensus.cc:993] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:10:50.944480 30798 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:50.928687 31178 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.005s
I20260709 13:10:50.969177 30912 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:50.986894 30821 raft_consensus.cc:1081] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:10:50.987425 31205 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:50.987926 31205 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:50.987624 30912 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:50.974790 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 411330us
I20260709 13:10:50.975287 31135 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:50.968139 30957 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.976358 25215 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:50.977699 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 241487us
I20260709 13:10:50.994110 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:50.978317 31030 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:50.996284 30950 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.997364 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:50.997190 30950 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.978698 30496 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:50.978935 30348 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.980006 30863 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:50.982846 30924 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:50.915820 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 113623us
W20260709 13:10:50.974701 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 412146us
W20260709 13:10:51.011204 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.963774 24673 rpcz_store.cc:276] 0709 13:10:49.449788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.450342 (+   554us) service_pool.cc:224] Handling call
0709 13:10:49.450607 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.460084 (+  9477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.460129 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:50.127977 (+667848us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b2c00173798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:10:50.128454 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.567245 (+438791us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:50.921428 (+354183us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.921841 (+   413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.921981 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.922072 (+    91us) raft_consensus.cc:1685] finished
0709 13:10:50.922226 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.922475 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18374,"raft.queue_time_us":10874,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":16729,"spinlock_wait_cycles":31310208,"thread_start_us":765368,"threads_started":2,"wal-append.queue_time_us":559910}
I20260709 13:10:51.001561 30496 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:51.011137 30924 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:51.029014 30348 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:50.960161 24667 rpcz_store.cc:276] 0709 13:10:49.451565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.457183 (+  5618us) service_pool.cc:224] Handling call
0709 13:10:49.942868 (+485685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.943222 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.943251 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.945029 (+  1778us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.416258 (+471229us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:50.416317 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.416418 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.736783 (+320365us) raft_consensus.cc:1685] finished
0709 13:10:50.736817 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.892465 (+155648us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54000483d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:50.892784 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4018,"spinlock_wait_cycles":1048298752,"thread_start_us":470806,"threads_started":1,"wal-append.queue_time_us":648384}
I20260709 13:10:51.022109 30912 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.023999 30496 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.034718 31086 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:51.035324 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:51.028926 31030 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:51.025640 31135 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:51.049008 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 536371us
I20260709 13:10:51.051229 30665 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.052206 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:51.053439 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 118592us
I20260709 13:10:51.053793 30665 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.048033 24421 catalog_manager.cc:5697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 16 to 17, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 17 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.075696 31135 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.077410 25212 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:51.024085 31205 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.065305 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.092025 30950 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.092974 30665 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:51.094280 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.094442 30665 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:51.096210 31222 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:51.096758 30869 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:51.093326 30821 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.097278 30869 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.097347 31076 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:10:51.121558 25217 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:10:51.107446 24670 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:51.121968 25217 pending_rounds.cc:85] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 12
I20260709 13:10:51.122269 25217 pending_rounds.cc:107] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:10:51.122578 25217 raft_consensus.cc:2889] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.122650 30924 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.109838 30863 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.063269 31030 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.121616 31205 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.097014 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:51.125277 31030 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.125946 30965 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:51.126479 30965 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.124153 30924 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.127452 30965 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.129216 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:51.130686 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 66487.6us
I20260709 13:10:51.117983 30869 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.131731 30869 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.132329 30348 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.132696 30348 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.133020 30348 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.121016 31076 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:51.134267 31076 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.134642 24421 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 11 to 15, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 15 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.135365 31076 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.102530 25215 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:51.138906 24516 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:10:51.139487 24670 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:51.145190 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48327.6us
I20260709 13:10:51.122179 30798 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.147017 30864 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.147974 30798 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:51.154165 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:51.154500 30798 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:51.155386 31052 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:51.155694 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.156620 31052 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:51.156798 31053 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:51.157055 31052 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.157239 31053 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.157648 31053 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:51.158072 31052 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.159425 31052 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.161798 31076 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.167047 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.167842 24673 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:10:51.169023 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.169652 30821 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:51.170064 24668 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:51.171321 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:51.172099 31067 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:51.172469 31067 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.173494 31067 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.174990 31067 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:51.174921 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:51.179217 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.179749 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.131649 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.168123 24667 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:10:51.062296 31086 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.206979 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.136466 24421 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 7 to 8, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 8 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.211757 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:51.212620 30942 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.003s
W20260709 13:10:51.221665 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 108339us
I20260709 13:10:51.095641 30665 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:51.223286 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.215436 30940 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.226801 30940 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:51.227787 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.228394 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:51.229627 30833 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.007s
I20260709 13:10:51.229768 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.230103 30833 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:51.230487 24665 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:51.230997 25214 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:51.233433 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.213140 30942 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:51.211783 31188 consensus_meta.cc:287] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.003s
I20260709 13:10:51.246821 30348 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:51.248898 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 205034us
I20260709 13:10:51.213339 30798 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.251721 24665 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:10:51.224687 30665 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.253790 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.255805 24668 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:51.258701 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 206580us
I20260709 13:10:51.256778 24669 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:10:51.239743 30864 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.254676 30798 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:51.274449 30798 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.277345 24665 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:10:51.277527 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 76362.6us
I20260709 13:10:51.281833 30348 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.282534 24667 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:10:51.285563 25218 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:51.292532 25215 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:51.292974 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.257382 31178 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.254882 31030 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:10:51.281242 30796 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.007s
I20260709 13:10:51.299624 24666 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:51.258468 31188 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.309530 31188 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.312011 30965 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:51.314530 24669 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:51.319725 31082 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.320350 31082 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:51.322384 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 190846us
I20260709 13:10:51.324402 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:10:51.325848 31235 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:51.301846 30821 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:10:51.330085 31178 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.330413 31185 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:51.331539 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:51.332470 31185 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:51.332852 31185 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.333814 31185 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:51.336575 31021 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.002s
I20260709 13:10:51.337023 31108 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:51.339843 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:51.340628 31178 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:51.341244 31188 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:51.341607 31178 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:51.341679 31188 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:51.342046 30957 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.342204 31188 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:51.342474 31086 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.343950 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:51.344939 31085 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:51.345322 31085 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.345623 31085 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:10:51.356505 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.358477 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.342715 30957 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.342090 31178 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:51.347692 31135 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.322979 31082 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:51.367456 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.366608 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.372794 30348 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.342156 30665 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.371287 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.374135 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:51.376619 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 91573.1us
I20260709 13:10:51.336992 31021 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.346103 30796 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:51.378376 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.380355 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.380565 31178 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.368322 30942 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.388592 31030 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:51.389062 31030 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.388813 31229 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:51.390753 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.371878 30924 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.389444 31030 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:51.397228 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:51.400663 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 59591.2us
I20260709 13:10:51.400863 24672 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:51.403278 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:51.391544 30821 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:10:51.405316 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46568.1us
I20260709 13:10:51.405503 24520 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:51.406383 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:51.411286 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.398758 30864 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:51.421181 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.421234 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.412734 30940 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:51.425056 24525 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:10:51.393741 30942 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.418520 30864 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.432327 30348 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:51.434538 31082 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:51.435165 31082 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.436208 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3637) took 1091 ms. Trace:
I20260709 13:10:51.434552 30348 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:51.437518 30348 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:51.438701 25215 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:51.439110 24524 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:51.419793 30821 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.436551 24672 rpcz_store.cc:276] 0709 13:10:50.345269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.462492 (+117223us) service_pool.cc:224] Handling call
0709 13:10:50.512008 (+ 49516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.418509 (+906501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.435929 (+ 17420us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540044e654. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:51.436139 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037992320}
I20260709 13:10:51.419374 30924 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.431555 31052 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.457113 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:51.457455 24518 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:51.422329 30798 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:51.459183 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47347.6us
I20260709 13:10:51.445068 31178 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:51.464416 31229 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:51.468159 31229 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.468578 30942 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.468966 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:51.464780 31203 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.858s	user 0.011s	sys 0.004s
W20260709 13:10:51.472458 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 70532.9us
I20260709 13:10:51.473459 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.475246 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.471801 25215 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:51.476363 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:51.481283 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.477600 24525 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:51.477483 31135 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.466128 31053 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.469614 31052 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.500415 31229 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.504597 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:51.487088 31082 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:51.514426 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.512324 24518 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:51.491380 30796 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:51.517670 31247 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:10:51.526674 31135 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:51.536048 31135 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.538159 31135 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.538885 30796 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.539424 30796 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.497615 30940 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.527531 30957 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.527784 30798 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.541373 31185 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.497097 30864 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.543110 30924 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.531684 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.531772 31183 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.542253 30796 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:51.531376 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.481958 31203 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.543342 30864 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:51.545293 31183 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.545562 24672 raft_consensus.cc:2368] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15.
I20260709 13:10:51.545756 30924 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:51.495054 30821 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.547014 31203 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:51.545564 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50926.2us
I20260709 13:10:51.547633 31021 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:51.543900 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 78937.2us
I20260709 13:10:51.531211 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:51.496636 31068 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:51.551460 30496 consensus_meta.cc:287] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.003s
I20260709 13:10:51.551280 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.552388 24671 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:10:51.552259 30798 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:51.556077 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.556268 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.556694 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:51.544507 31246 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:10:51.561326 25185 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:51.573745 30942 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:51.553107 31222 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:51.553668 31183 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.580610 24566 leader_election.cc:400] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15.
I20260709 13:10:51.582893 24566 leader_election.cc:403] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:51.543931 31185 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.582373 24591 raft_consensus.cc:2410] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:10:51.585547 30940 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:51.586066 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.561043 31135 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:51.590770 30348 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.564674 31068 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.574609 30798 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.602109 30348 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.602435 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.602687 30665 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.603165 30798 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.603816 31242 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:10:51.594534 31021 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.606053 31052 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.590494 31188 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.572436 30496 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.610699 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.616675 30348 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.600724 31185 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.608651 31030 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.620378 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.619292 30912 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 13:10:51.629462 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 72853.9us
I20260709 13:10:51.631450 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.631461 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:10:51.632701 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.633240 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:51.633342 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.634212 24591 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:51.634915 31203 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:51.635531 31135 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:51.635684 31203 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:51.635987 31135 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.636147 31203 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.636654 31203 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:51.635701 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.637804 24670 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.638422 24672 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:51.639183 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.639936 24673 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:51.640062 31068 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.636137 31183 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.642030 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.645061 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:51.642483 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:51.650842 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:51.651495 30863 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:51.651899 31183 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.652439 30863 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:51.652882 30863 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.653352 30863 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:51.653515 31068 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:51.655305 31203 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.656867 31202 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:51.657248 31205 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:51.658758 30912 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:51.659196 30912 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:51.660290 30912 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.644441 24600 raft_consensus.cc:2368] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19.
I20260709 13:10:51.615428 31053 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.642614 31030 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.643097 30942 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:51.634369 24639 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.665517 24674 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:51.636445 31135 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:51.636559 31085 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.673693 24673 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:51.673661 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.670732 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:51.715898 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45279.2us
I20260709 13:10:51.716466 31085 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:51.717264 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.718116 31183 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:51.718374 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44879.1us
I20260709 13:10:51.718590 30864 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:51.719215 30864 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:51.720278 30864 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.718058 24673 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:51.673597 30798 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.677412 30912 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.677541 31203 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.680935 30863 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.691740 24670 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:51.695087 24599 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:51.695562 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.727202 24594 raft_consensus.cc:2410] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:51.695959 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.696338 24597 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:51.696817 24598 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:51.696919 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.697628 30940 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.647465 31178 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.730141 31030 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:51.730427 31178 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.731074 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.731961 24595 raft_consensus.cc:2410] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:10:51.698751 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:51.698805 30942 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:51.701469 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.702042 30924 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:51.703962 31202 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:51.713217 30496 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.671808 31082 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:10:51.649207 31188 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.715415 24671 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:51.652659 30833 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:10:51.750150 30833 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:51.737775 24600 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:10:51.750581 30833 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:51.751940 30833 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.729298 24596 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:10:51.732852 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 98608.5us
I20260709 13:10:51.760430 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.761755 30863 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.763433 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:51.747197 31205 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.767902 31205 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.768298 31205 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.772130 24597 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:51.772409 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.748375 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:51.773542 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.732769 31178 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.774240 24600 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:10:51.764410 30940 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:51.776728 31068 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:51.777061 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.777251 31068 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.777657 31068 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.778357 24597 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:51.777681 24593 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.779990 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:51.780633 25215 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:10:51.781455 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.782092 24598 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:51.783042 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.783661 24599 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:10:51.784879 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.785156 31202 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:51.785194 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.785595 24599 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:51.785930 24591 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:51.786473 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.786158 31202 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.786972 24598 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.787453 31202 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:51.787743 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.788040 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.789559 25214 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.789479 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.792050 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.792650 24596 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:51.765714 30833 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:51.748246 24594 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: [16.12-18.13]
I20260709 13:10:51.793433 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.794057 24597 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:10:51.795469 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.796090 25213 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.799448 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.800170 24599 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:51.800990 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.801571 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:51.803316 30864 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.803880 30864 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.805197 24671 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:51.805744 31021 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15.
I20260709 13:10:51.806279 30864 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.806861 30864 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:51.807207 25214 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:51.807564 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.816020 24671 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:51.792459 31205 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.808334 24670 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:51.810139 24672 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:51.810747 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:51.811069 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.729235 30798 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.817576 24666 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:51.818167 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:51.811885 25213 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:51.819240 30798 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.812637 31068 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.813295 24598 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:51.815063 24593 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:51.823638 31068 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:51.819103 31205 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:51.824806 31205 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:51.825313 31205 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:51.825728 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62425.9us
I20260709 13:10:51.827085 24593 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:51.827999 24595 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:51.827939 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.828809 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.840117 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.829828 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.841030 24599 raft_consensus.cc:2368] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19.
I20260709 13:10:51.841063 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.830571 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.842163 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.842728 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:51.843451 24520 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:51.843801 24516 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:51.844532 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.845156 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:51.845901 24525 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:51.845188 24517 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:51.847059 24522 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:10:51.831295 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.832463 31185 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.737399 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.837221 25215 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:51.851101 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.851718 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:51.851951 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:51.852738 24523 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 14: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:51.842806 24518 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:10:51.853330 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.840440 24594 raft_consensus.cc:2410] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:51.851171 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:51.852039 25211 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:51.856277 25217 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:10:51.828998 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.831995 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:51.866807 24591 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:51.871495 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.880399 24596 raft_consensus.cc:2368] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16.
I20260709 13:10:51.887290 24595 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:51.891974 25212 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:51.894286 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:51.897881 25215 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:10:51.899622 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:51.912020 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.913364 24518 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:51.913503 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.913228 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.913285 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.915993 24517 raft_consensus.cc:2410] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:51.895874 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.916749 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.919162 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:51.919458 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.920428 24524 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:51.921283 31256 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:10:51.923316 24519 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:51.926625 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.927860 31257 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.928385 31257 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:51.929446 30940 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:51.930119 30940 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:51.930927 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.931247 30940 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.893888 30864 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:51.933308 30864 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.933642 30864 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:51.936934 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.937383 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.937621 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:51.939922 31205 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:51.941711 25219 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:51.942553 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.943343 24521 raft_consensus.cc:2410] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 13:10:51.943354 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.947002 31085 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:51.948282 30796 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:51.948757 30796 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:51.950071 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:51.950424 30796 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:51.949311 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:51.952066 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:51.953680 25217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc"
dest_uuid: "983693721af6486c97ece1410a90cf30"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:58502
I20260709 13:10:51.954152 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:51.954634 25217 raft_consensus.cc:606] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:51.955096 25217 raft_consensus.cc:614] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:51.960372 25215 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:51.963981 24516 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:51.964123 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:51.964672 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:51.967311 24520 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:51.969544 24523 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
W20260709 13:10:51.971496 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 236483us
I20260709 13:10:51.969899 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:51.974846 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:51.975749 30348 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.976449 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:51.976687 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:51.901137 31135 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.005649 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:52.007622 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:52.010432 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.006138 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:52.014614 24523 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:52.015027 24518 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:10:52.014832 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:52.019301 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:52.020020 24525 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:52.020079 25215 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:52.021277 24670 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:52.016144 30348 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:52.024065 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.024549 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.024969 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.026439 25214 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:10:52.031453 31135 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.033109 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:52.034927 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:51.983635 24516 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50164
I20260709 13:10:52.036087 24516 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.036520 24516 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:52.010360 31205 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:10:52.039640 31264 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:52.040004 31264 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:52.011397 30950 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:52.040798 31264 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.041360 30950 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.041657 25217 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:52.041833 30950 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:52.042084 31264 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:52.050961 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:52.051746 25215 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:52.052356 31205 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:52.027943 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:52.054762 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:52.055238 30348 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:52.055490 31205 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:52.057766 31257 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.056835 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:51.974908 30957 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:10:52.067145 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:52.069873 24516 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.015466 31178 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.016852 31203 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:52.073699 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:52.073237 24518 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:10:52.076033 24520 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 20. Ops: []
I20260709 13:10:52.020038 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:52.016983 31185 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:10:52.079663 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:52.090437 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:52.080515 31076 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:52.074482 31082 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:10:52.120159 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:52.120674 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:52.121019 24594 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:52.062778 31188 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:52.085947 30957 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:52.117055 24523 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:52.088670 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:52.080346 25214 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:52.089012 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:52.127408 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.128340 24516 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:52.126516 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:52.130232 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:52.130692 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 110689us
I20260709 13:10:52.131789 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:52.133052 24518 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:52.133291 30924 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:52.134758 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:52.136086 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:52.136685 24518 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:52.137283 31259 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:52.137672 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:52.138291 24518 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:52.138151 31259 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.074076 30979 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:10:52.134166 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:52.141930 24524 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 24: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:52.142936 30665 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.143056 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:52.143831 24524 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:52.143633 30665 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.146394 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:52.136996 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:52.148095 24593 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:10:52.077787 31178 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:52.116665 31185 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.153470 25212 raft_consensus.cc:2410] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:10:52.156780 30348 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.153745 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:52.198390 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 66734.8us
I20260709 13:10:52.146970 30665 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.159809 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:52.199489 24524 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:52.159613 30950 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.160440 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:52.161000 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:52.167413 24518 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:52.169520 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:52.123750 31188 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:52.178884 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 89930.1us
I20260709 13:10:52.182762 31068 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:52.204455 24594 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
W20260709 13:10:52.186842 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 201349us
I20260709 13:10:52.147535 30863 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:10:52.155769 31259 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.178238 30833 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:52.222501 30833 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:52.222983 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:52.223497 30665 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:52.200107 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:52.224577 31021 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:52.194913 24595 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:52.203498 24525 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:52.225206 31076 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:52.225986 31256 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:52.197728 30348 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.225016 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:52.214119 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:52.215327 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:52.203533 31185 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:52.228156 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:52.220643 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:52.221516 30863 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:10:52.223860 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.224982 31021 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:52.205955 24592 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:52.226178 31076 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:52.227229 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:52.210644 31188 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.229130 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:52.197674 31178 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.245667 24674 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:52.226331 30796 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:52.254246 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:52.254343 24523 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:10:52.255722 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:52.226431 31030 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:52.203784 31257 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:52.259068 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:52.230450 30924 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:52.226615 31256 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:52.213454 30864 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.243721 31135 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:52.276073 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:52.246120 31264 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:52.243983 30665 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:52.243883 31076 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:52.254142 30798 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:52.281723 24671 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:52.288040 30348 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.297514 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:52.298452 24667 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:52.302618 30864 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.303390 30864 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:52.304085 30864 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:10:52.280754 31183 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:10:52.269647 31257 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:52.318332 30950 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:52.319630 31076 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.321260 31076 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.325736 30863 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:10:52.325598 31256 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.260015 31085 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:10:52.331152 31135 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.283334 31264 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.308800 24672 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:52.285821 30665 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.289100 31082 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:52.340123 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:52.311429 31257 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:52.344805 24669 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:52.311775 30798 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:52.341660 31265 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:52.361913 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:52.364368 24672 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:52.336047 30950 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:52.338512 31264 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:52.363363 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:52.368212 24671 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:10:52.339691 30665 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:52.369292 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 353481us
I20260709 13:10:52.359918 31082 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:52.389230 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:52.339439 31135 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.395728 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:52.396602 24520 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:52.329713 31021 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.399696 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:52.403360 30348 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.403728 30348 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.404078 30348 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.405110 24671 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:10:52.427719 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 281428us
I20260709 13:10:52.390566 30950 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:52.401959 31183 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:52.438045 31183 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:52.453722 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 226554us
I20260709 13:10:52.454543 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:52.462133 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 203174us
I20260709 13:10:52.463267 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:52.469113 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 211288us
I20260709 13:10:52.435801 30979 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:10:52.461237 31183 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:52.462622 31205 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:52.498852 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:52.513273 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44935.8us
I20260709 13:10:52.515844 24591 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:52.513854 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:52.518823 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 263164us
I20260709 13:10:52.521836 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:52.523758 24592 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:52.516186 24591 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:52.536032 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:52.536175 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:52.536770 24594 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:52.541569 24600 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:52.444242 30798 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.582075 24591 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.536077 31030 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:52.619220 31256 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.510809 30863 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
W20260709 13:10:52.656515 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.649925 31265 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:10:52.585564 30912 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:52.542506 30950 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.636485 31273 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:52.619812 31202 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.511370 31082 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.704563 30348 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:52.681126 31271 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 13:10:52.699930 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 181853us
W20260709 13:10:52.633423 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 133795us
I20260709 13:10:52.708669 24591 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:52.700984 31021 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:52.731137 24520 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:52.702046 31273 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:52.674678 31185 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.640430 31256 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.728873 31281 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:52.706540 31202 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.747736 31202 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.750233 31288 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:52.751696 31288 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:52.753754 31274 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:52.762279 24525 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:10:52.762734 24525 pending_rounds.cc:85] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 13
I20260709 13:10:52.763005 24525 pending_rounds.cc:107] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:10:52.762387 31188 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.763239 24525 raft_consensus.cc:2889] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:52.765977 31266 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.586s	user 0.007s	sys 0.003s
I20260709 13:10:52.766142 31178 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.743602 31283 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:52.769562 31295 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:52.769979 31295 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:52.770756 31185 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:52.770751 31295 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.774173 31256 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:52.781222 24591 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:52.734541 30912 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:52.797654 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 362514us
I20260709 13:10:52.807644 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:52.735358 31135 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.716260 31259 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:10:52.815855 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.768989 31178 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.795850 30940 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:52.774806 31030 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:52.830660 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 314411us
W20260709 13:10:52.811946 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 150579us
W20260709 13:10:52.835536 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 127504us
W20260709 13:10:52.835800 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 103715us
I20260709 13:10:52.838619 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:52.838882 31279 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.244s	user 0.007s	sys 0.001s
I20260709 13:10:52.839282 24671 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:52.842101 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:52.842968 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:52.843341 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:52.843750 24667 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:52.844053 31135 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:52.836776 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:52.844527 30940 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:52.845099 30940 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:52.845703 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:52.846882 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:52.847599 30864 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:52.848232 30864 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:52.848605 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:52.845094 31284 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:52.850157 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:52.851377 31284 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:52.851749 31284 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.852393 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:52.856642 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.857460 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.845597 31276 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:52.844576 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:52.864696 24665 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:52.868474 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:52.869226 24671 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.812563 30912 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.776172 31281 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:52.815243 31183 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:52.881253 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 138518us
W20260709 13:10:52.864563 30796 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.001s
I20260709 13:10:52.852110 31284 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:52.885601 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:52.857825 30833 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:52.872758 31286 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.896179 24594 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:10:52.896888 30796 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:52.894098 30833 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:52.888855 31286 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:52.915292 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.939790 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 54294.6us
W20260709 13:10:53.018730 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 86738.6us
W20260709 13:10:53.018786 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 78195.9us
W20260709 13:10:52.917562 31257 consensus_meta.cc:287] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.002s
W20260709 13:10:52.919953 31277 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:10:52.911484 31185 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.895615 31188 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:52.913976 30863 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:53.022461 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 71954.3us
I20260709 13:10:52.901859 31295 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.898002 30864 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:53.024806 31021 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:52.919139 31183 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:53.051630 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 208340us
I20260709 13:10:52.988795 31296 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:52.910629 31286 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:53.046286 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:53.044669 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:53.043275 31085 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:53.042125 31185 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:53.035141 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 191913us
I20260709 13:10:53.070766 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:53.073553 24671 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:52.900519 30833 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:53.071609 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 156633us
W20260709 13:10:53.073868 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 191694us
W20260709 13:10:53.078212 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 235809us
I20260709 13:10:53.035979 31257 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:52.898523 31273 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.066151 31085 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:53.074309 31185 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.134277 24671 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:53.134888 31257 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.129783 31135 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.135728 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:53.272241 24665 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:53.273478 31299 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.274142 31299 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.135828 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:53.275661 24667 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:53.045358 30863 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:53.141620 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 71006us
I20260709 13:10:53.285145 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:53.285575 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:53.079099 31276 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.146520 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:53.297593 24521 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:53.147683 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:53.191627 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:53.127156 31203 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:53.285769 24673 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:53.146092 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 70016us
I20260709 13:10:53.294268 24525 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:10:53.300917 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.307709 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.309708 31305 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 13:10:53.334571 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 304412us
W20260709 13:10:53.336426 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50933.3us
I20260709 13:10:53.270607 31286 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.271023 31076 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.339819 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:53.340709 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 193066us
I20260709 13:10:53.302297 31203 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.349579 25184 leader_election.cc:400] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19.
W20260709 13:10:53.312330 24639 connection.cc:256] RPC call timeout handler was delayed by -2.2318847069999492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 13:10:53.352285 24639 connection.cc:256] RPC call timeout handler was delayed by -2.161071278999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:10:53.352823 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.310932 31021 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:53.360359 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:53.192492 31278 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.206s
I20260709 13:10:53.351426 31257 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:53.381238 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45854.6us
I20260709 13:10:53.353660 31281 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:53.306414 31276 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.352383 31203 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:53.386077 31256 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:10:53.393718 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.348924 31076 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.348809 31286 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.357872 31311 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:10:53.364733 31183 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:10:53.395788 30924 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:53.395993 30496 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.364588 31021 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:53.415890 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50617.3us
I20260709 13:10:53.418040 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:53.402032 31188 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:53.389528 31301 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:10:53.358969 31085 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.432230 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:53.438104 31188 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.447527 31312 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:53.454336 31312 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:53.455590 31021 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:53.456183 31328 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:53.459206 30940 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.000s
I20260709 13:10:53.459703 30940 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:53.461400 31306 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:10:53.461761 30348 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.421204 31302 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.463131 31302 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.465155 31310 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:53.451288 31188 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:53.453583 31316 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:10:53.467084 31280 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.811s	user 0.012s	sys 0.009s
I20260709 13:10:53.455590 31312 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.475942 24521 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:53.476984 24673 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:53.487509 31082 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:53.488446 31082 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:53.501446 31205 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:53.502622 31303 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:10:53.502231 31205 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.504160 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:53.504832 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:53.505019 31205 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:53.507392 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 75211.5us
I20260709 13:10:53.504871 24525 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:10:53.508584 25184 leader_election.cc:400] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 15. Current term is 16.
W20260709 13:10:53.511479 24639 connection.cc:256] RPC call timeout handler was delayed by -1.8233218389999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:10:53.513249 24639 connection.cc:256] RPC call timeout handler was delayed by -1.7315218390000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:10:53.514000 24639 connection.cc:256] RPC call timeout handler was delayed by -1.6748218390000602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 13:10:53.514250 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:53.515069 24639 connection.cc:256] RPC call timeout handler was delayed by -1.6348929019999332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 13:10:53.435235 31325 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.437500 31257 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:10:53.518514 24639 connection.cc:256] RPC call timeout handler was delayed by -1.474984706999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2909s for a response
W20260709 13:10:53.520988 24639 connection.cc:256] RPC call timeout handler was delayed by -1.2590218389999563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
W20260709 13:10:53.521431 24639 connection.cc:256] RPC call timeout handler was delayed by -1.1449702799999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 13:10:53.515440 31281 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:53.471630 31331 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:53.522444 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90593.4us
I20260709 13:10:53.525316 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:53.531322 24525 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:10:53.534911 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:53.535805 24665 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:53.538144 31296 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:53.539402 31296 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.542492 31205 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:10:53.421416 30924 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.522279 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:53.545473 30924 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:53.542876 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:53.554452 31068 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.555593 24525 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:10:53.555192 31068 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.558015 31068 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.558334 24525 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:53.562461 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.570531 24667 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:53.448606 30496 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.580085 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:53.580749 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.575623 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:53.582134 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.529489 31281 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:53.583755 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.578812 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:53.584635 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.588336 24598 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:53.584967 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:53.588985 24594 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:53.559293 30863 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.553175 31259 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:53.590736 24596 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:10:53.592691 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:53.595130 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.598982 24591 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:53.600047 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.600096 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.604954 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.573712 31188 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:53.651616 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.591372 31281 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:53.651619 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:53.589970 31310 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:53.653901 31313 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:10:53.592861 31283 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:10:53.654893 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 146499us
I20260709 13:10:53.650336 24591 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:53.563467 31331 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.671864 24592 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 14.
I20260709 13:10:53.626120 30942 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:53.664335 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 142173us
I20260709 13:10:53.527017 31325 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.663213 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:53.678714 24593 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:53.681494 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:53.684425 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:53.687011 24598 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:10:53.688323 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:53.600064 31288 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:10:53.649783 31302 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:53.731163 31326 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:53.768733 31256 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.629567 31338 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:53.755386 30942 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.681154 31030 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:10:53.730669 31283 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:53.906782 24600 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:53.907591 31283 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.908398 24599 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:53.750675 30950 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:53.712683 30863 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:10:53.809995 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.711930 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:53.894655 31288 consensus_queue.cc:1243] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:10:53.735553 31264 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.347s	user 0.013s	sys 0.000s
W20260709 13:10:53.762714 30665 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.372s	user 0.013s	sys 0.000s
I20260709 13:10:53.770823 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:53.681114 31257 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.757756 24518 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:53.753784 30496 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.648972 31259 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.723577 24594 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:53.752131 31185 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.768113 31135 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:53.742657 31325 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.664544 31076 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.758917 30979 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.727540 31276 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:53.741242 31294 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.671939 30940 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:53.868788 24516 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:53.746254 31286 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.662874 31188 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.777354 31343 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:53.740504 31307 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.578s	user 0.000s	sys 0.002s
I20260709 13:10:53.738633 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:53.745182 31348 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.094s
W20260709 13:10:53.901880 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.752161 31331 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.915482 24598 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:10:53.917361 24517 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.010s
I20260709 13:10:53.689687 31310 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:53.918717 24523 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
W20260709 13:10:53.927874 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 257743us
W20260709 13:10:53.996780 24517 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.003s	sys 0.010s
I20260709 13:10:53.997891 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:53.934165 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:53.928467 31284 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.010s	user 0.012s	sys 0.000s
I20260709 13:10:53.925320 31264 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.940773 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:53.902771 31256 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:53.936419 31295 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.885s	user 0.006s	sys 0.005s
I20260709 13:10:53.986268 24521 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:53.997567 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60764us
I20260709 13:10:54.002528 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:53.940429 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.006s	sys 0.013s
I20260709 13:10:53.921713 30863 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.012411 24673 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:54.024899 24671 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:54.025756 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:53.924265 31338 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:53.911712 31326 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.939719 30979 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.943073 31294 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.047422 31294 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.050628 30942 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.052350 31259 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.038307 31321 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.053750 31321 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.054939 31338 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:54.056254 31321 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:54.019342 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:54.024857 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.007s	sys 0.013s
W20260709 13:10:54.058073 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 654403us
I20260709 13:10:54.059068 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:54.059204 24667 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:53.926797 30665 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.060729 30979 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.060856 31264 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.061188 30665 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.027117 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.061604 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.001950 31322 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:54.062417 24671 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:54.015861 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:53.986510 31302 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:10:54.032096 31353 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:54.039621 31340 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:54.064522 30833 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.031924 31337 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.064931 31340 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:54.065443 31340 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:54.015434 31076 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.066735 30863 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:53.935766 30950 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.067497 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:54.068087 24523 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:54.028523 31327 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:54.069159 30950 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.069022 31327 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.010178 31284 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.041249 31323 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:54.070171 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:54.070576 31323 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.071069 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2370) took 1573 ms. Trace:
I20260709 13:10:54.071594 31284 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.039784 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.072160 30798 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:54.072376 31284 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.074409 24595 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:10:54.028296 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 294185us
I20260709 13:10:54.059419 31185 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.066354 31076 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.069767 30665 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:54.040557 31310 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.058108 31188 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.043737 31326 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:54.038919 31354 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:10:54.115993 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.116423 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:54.117136 24523 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:54.071457 24597 rpcz_store.cc:276] 0709 13:10:52.498133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.498264 (+   131us) service_pool.cc:224] Handling call
0709 13:10:52.520919 (+ 22655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:52.521175 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:10:52.829767 (+308592us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.070550 (+1240783us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b1800498b80. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a
0709 13:10:54.070732 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.070779 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:54.070819 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.070889 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.070992 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":524220,"prepare.run_wall_time_us":40,"raft.queue_time_us":2991,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":86,"spinlock_wait_cycles":13942912,"thread_start_us":374813,"threads_started":2,"wal-append.queue_time_us":436980}
I20260709 13:10:54.019016 30940 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.090533 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:54.118778 24670 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:54.092644 24673 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:54.095571 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.112540 24519 pending_rounds.cc:85] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 8
I20260709 13:10:54.119818 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:54.120138 24519 pending_rounds.cc:107] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:10:54.120405 24519 raft_consensus.cc:2889] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:54.089666 24566 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.079133 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.113715 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:54.121891 24671 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:54.122080 24525 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:54.122505 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:54.114547 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:54.080263 24593 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
W20260709 13:10:54.118577 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 119770us
I20260709 13:10:54.123680 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:54.123757 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:54.043756 31299 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.116883 24672 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:54.091735 30665 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:10:54.086745 31203 consensus_meta.cc:287] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.000s
I20260709 13:10:54.091743 31294 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.116376 30496 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:54.153121 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:54.155623 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.072981 31284 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:53.993219 31343 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.151847 31030 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:54.156281 31185 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:10:54.156587 30863 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.152024 31188 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:54.157202 31178 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:54.180480 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:54.181372 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:54.173473 31203 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.160745 31259 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:54.184161 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60484.2us
W20260709 13:10:54.172031 31281 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260709 13:10:54.191284 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:54.178803 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.193550 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:54.196317 24523 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:54.115494 31337 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.179338 31030 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.192876 31323 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.154383 30940 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.171897 31353 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:54.195003 24596 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:54.263530 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:54.287443 31178 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:54.289691 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2269) took 1158 ms. Trace:
I20260709 13:10:54.163017 31312 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:10:54.191253 31342 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:54.166879 31294 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.193303 31185 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:54.309142 24598 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:54.282613 31283 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:54.325019 31188 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:54.265486 31259 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:54.348711 31321 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:54.183482 31326 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:10:54.267688 30665 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.350109 31382 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.291172 31030 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.309208 24666 rpcz_store.cc:276] 0709 13:10:53.131575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.131756 (+   181us) service_pool.cc:224] Handling call
0709 13:10:53.132166 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.486357 (+354191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.487086 (+   729us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.499125 (+ 12039us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.659550 (+160425us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:53.659616 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.052561 (+392945us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54001135d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:54.052617 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.263831 (+211214us) raft_consensus.cc:1685] finished
0709 13:10:54.263855 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.289611 (+ 25756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87262,"raft.queue_time_us":169853,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":18349,"spinlock_wait_cycles":629037440,"thread_start_us":234655,"threads_started":2,"wal-append.queue_time_us":397378}
I20260709 13:10:54.307900 31288 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.325865 31264 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.308367 31353 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:54.193246 30863 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.368216 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.406611 25212 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:54.325707 31322 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.331282 31342 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.327504 31323 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.264047 31281 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.331422 30942 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:54.330794 31344 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:54.350868 31367 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.252s
I20260709 13:10:54.348340 31296 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.397511 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.354120 31334 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.352866 31283 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.367686 31321 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.416594 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:54.305953 31345 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.339s
I20260709 13:10:54.405999 31353 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:54.429270 31334 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:54.430074 31371 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 13:10:54.481251 24599 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:10:54.481467 31281 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:54.482365 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2351) took 1349 ms. Trace:
I20260709 13:10:54.483139 31337 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.420104 31323 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:54.430714 31373 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
W20260709 13:10:54.431293 31368 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:10:54.405900 31339 raft_consensus.cc:2764] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:10:54.432663 31296 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:54.433692 31370 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:10:54.434213 31360 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.434367 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:54.437508 31185 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.432390 30912 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.416544 31342 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:54.518893 31360 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:54.519421 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85132.4us
I20260709 13:10:54.520246 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:54.439821 31294 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.429294 31372 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.419037 31322 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.521780 31290 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:54.522562 31329 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:54.522691 30863 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:54.523020 31322 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.470706 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:54.396044 31338 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:10:54.523741 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:54.523990 25214 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:54.524893 31338 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:54.525018 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:54.449584 31178 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.527136 31337 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:54.426944 30942 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.479245 31318 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.407936 31382 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.528383 31318 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.529220 30942 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:54.529604 31382 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.480396 31334 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.407908 31264 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.531069 31318 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.531706 31264 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.402107 31288 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.533174 30940 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.533814 31288 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.535451 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:54.445406 31283 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:54.449944 31256 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.499650 31295 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.537601 31295 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.537941 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:54.540059 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.540691 31295 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.541167 31337 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:54.482753 24517 rpcz_store.cc:276] 0709 13:10:53.133336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.189301 (+ 55965us) service_pool.cc:224] Handling call
0709 13:10:53.300703 (+111402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.345679 (+ 44976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.345726 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.361861 (+ 16135us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.997242 (+635381us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:53.997297 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.997389 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.482152 (+484763us) raft_consensus.cc:1685] finished
0709 13:10:54.482174 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.482291 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48945,"raft.queue_time_us":48144,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10825,"thread_start_us":592624,"threads_started":1,"wal-append.queue_time_us":628637}
I20260709 13:10:54.541741 31337 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:54.542763 31338 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:54.542697 31337 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.543558 31338 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:54.544569 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1836) took 1395 ms. Trace:
I20260709 13:10:54.487191 31299 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:54.545948 31299 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.544766 31338 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:54.509945 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.511559 31030 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.548195 31299 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.548422 24594 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:54.386628 31259 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.549448 31030 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.521474 31372 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.408214 30665 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:54.527282 31342 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.505403 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.551258 25210 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:10:54.536823 30940 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:54.551981 25212 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:10:54.428495 31272 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:10:54.562633 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:54.543406 31323 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.575889 25210 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:10:54.576189 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 246603us
I20260709 13:10:54.577450 25214 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:10:54.545012 25218 rpcz_store.cc:276] 0709 13:10:53.148768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.148916 (+   148us) service_pool.cc:224] Handling call
0709 13:10:53.270946 (+122030us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.479819 (+208873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.479851 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.480341 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.938186 (+457845us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:10:53.938236 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.938333 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.544331 (+605998us) raft_consensus.cc:1685] finished
0709 13:10:54.544351 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.544488 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16639,"raft.queue_time_us":117983,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5048,"thread_start_us":554478,"threads_started":2,"wal-append.queue_time_us":557970}
I20260709 13:10:54.555573 30940 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:54.441812 31344 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.560792 31360 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.585963 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:54.586180 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.588586 24598 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:54.572741 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:54.588960 25214 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 23: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:54.560113 31284 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.578650 31290 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:54.591707 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.585832 30940 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.624752 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:54.589162 31203 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.560241 31188 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.593828 31329 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:54.625176 31360 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:54.624658 30863 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.630434 31290 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:54.640386 31076 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.664008 30496 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:54.661597 31329 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:54.660521 30863 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.802177 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.666437 31290 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:54.667735 31360 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.707338 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1455) took 1105 ms. Trace:
I20260709 13:10:54.655280 31203 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:54.791018 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 70638.6us
I20260709 13:10:54.651614 31323 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.797267 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3570) took 1130 ms. Trace:
I20260709 13:10:54.800292 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.805341 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.817418 25215 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:54.803889 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.809401 25212 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:54.811244 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.818749 24673 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:54.819185 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.814309 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:54.803536 31385 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.143s	user 0.000s	sys 0.006s
W20260709 13:10:54.804730 31387 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.150s	user 0.002s	sys 0.004s
W20260709 13:10:54.796646 30833 consensus_meta.cc:287] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.732s	user 0.015s	sys 0.006s
W20260709 13:10:54.814975 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 190296us
I20260709 13:10:54.817229 24521 rpcz_store.cc:276] 0709 13:10:53.661936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.662062 (+   126us) service_pool.cc:224] Handling call
0709 13:10:54.718664 (+1056602us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b540030eb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:54.792598 (+ 73934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174810880}
I20260709 13:10:54.821623 24674 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:54.823688 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:54.816041 31340 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.748s	user 0.015s	sys 0.003s
I20260709 13:10:54.828210 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.815448 31321 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.811717 24522 rpcz_store.cc:276] 0709 13:10:53.601441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.601788 (+   347us) service_pool.cc:224] Handling call
0709 13:10:53.603173 (+  1385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.014026 (+410853us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:10:54.021848 (+  7822us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.263393 (+241545us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.598677 (+335284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.598716 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:54.598746 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.707007 (+108261us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b5400441954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:54.707073 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.707253 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24751,"prepare.queue_time_us":12479,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":48255,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":22823,"spinlock_wait_cycles":945042560,"thread_start_us":452974,"threads_started":3,"wal-append.queue_time_us":139642}
W20260709 13:10:54.848171 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.011s
W20260709 13:10:54.851233 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.011s
I20260709 13:10:54.851644 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.854405 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.855089 25217 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:54.835963 31296 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.849346 31340 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.822037 31342 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.864025 31340 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.862188 25210 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:54.865865 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.867043 31329 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.876698 24673 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:54.802663 31353 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.880223 31290 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.821983 31323 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.884119 30833 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:54.909459 30833 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.904808 31344 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.911767 30833 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:54.913715 31323 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.915119 31353 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.917968 30940 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.919596 31360 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.921876 30940 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:54.918115 31283 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.892869 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.922137 31273 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:54.928709 30665 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:54.929188 30665 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.929576 30665 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:54.934055 31135 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:54.934264 31283 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.881510 30863 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:54.934715 31135 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.935648 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.960537 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3575) took 1050 ms. Trace:
I20260709 13:10:54.961031 24518 rpcz_store.cc:276] 0709 13:10:53.910296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.930694 (+ 20398us) service_pool.cc:224] Handling call
0709 13:10:53.937500 (+  6806us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:53.937864 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.937897 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:53.944286 (+  6389us) log.cc:844] Serialized 52 byte log entry
0709 13:10:54.445881 (+501595us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:54.496605 (+ 50724us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.960172 (+463567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.960261 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.960309 (+    48us) raft_consensus.cc:1685] finished
0709 13:10:54.960324 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.960468 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":485295,"prepare.queue_time_us":43704,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2469,"raft.queue_time_us":3502,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":43179,"thread_start_us":421801,"threads_started":1,"wal-append.queue_time_us":635571}
I20260709 13:10:54.964910 31343 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.965272 30863 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.965847 30863 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:54.967926 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:54.968611 30863 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:54.972899 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.973606 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:54.974162 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.974807 24668 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:10:54.975450 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:54.976157 24673 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:54.976094 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.976938 24671 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:54.977517 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:54.978014 24668 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:54.978806 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:54.979339 24669 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:54.982323 31183 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:54.982743 31183 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.983083 31183 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:54.985298 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:54.993319 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:54.995958 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:54.998721 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:54.999065 31386 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:54.999640 31386 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.000077 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.000285 31135 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.001194 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.001963 31386 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:54.971939 31283 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:10:55.002305 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.002835 25215 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.005519 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.006141 25214 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:10:55.005967 30665 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:54.991937 31312 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:55.008071 31312 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:55.008415 31342 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:55.008970 31342 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:55.009047 31312 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.009991 31342 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.001995 25211 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:55.015942 24673 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:55.020993 25215 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:55.023103 24669 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:55.025243 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:55.020771 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:54.997610 31185 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:55.040518 31076 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:55.041015 31389 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.041172 31076 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:55.041561 31389 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.042297 31076 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.038717 31178 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:55.043792 31389 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.043855 31178 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.044379 31178 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:55.045622 31388 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:55.046241 31388 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.047240 31372 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.038975 31256 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:55.049454 31398 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:55.049605 31256 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:55.050005 31398 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.051107 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 2042) took 1469 ms. Trace:
I20260709 13:10:55.050012 31256 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:55.042689 31310 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:55.051512 24595 rpcz_store.cc:276] 0709 13:10:53.581365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.581500 (+   135us) service_pool.cc:224] Handling call
0709 13:10:55.050882 (+1469382us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540025b554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:55.051019 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104334720}
I20260709 13:10:55.055995 31359 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.056553 31359 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.057178 31398 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.057938 31350 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.058406 31350 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.059386 31359 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.060417 31350 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.061677 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:55.065301 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.065543 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.067492 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.068209 24521 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:55.066332 24522 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
W20260709 13:10:55.070119 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49414.9us
I20260709 13:10:55.071921 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.066170 24519 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:55.074647 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:55.067544 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.076020 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:54.998131 31343 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:10:55.077919 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.082540 24516 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:55.078745 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.086059 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.087514 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.088296 24599 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:55.088750 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:55.067922 31359 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:55.095382 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:55.095930 24597 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:55.105033 24595 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:10:55.105587 24595 pending_rounds.cc:85] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 8
I20260709 13:10:55.105868 24595 pending_rounds.cc:107] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:10:55.106151 24595 raft_consensus.cc:2889] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:55.091065 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:55.107616 24594 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.091704 24517 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:55.033253 31203 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:55.091936 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.108908 24598 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:55.110720 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:55.117542 31388 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.120028 31178 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.123557 31178 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.135865 24594 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:55.141952 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.142858 24599 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
W20260709 13:10:55.147032 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.149753 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.150898 25214 raft_consensus.cc:2410] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:55.157423 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.157748 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.158304 25213 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:55.162094 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.162706 25210 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:55.171890 25213 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:55.175463 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3674) took 1132 ms. Trace:
I20260709 13:10:55.179052 24594 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:55.179755 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:55.196913 24667 rpcz_store.cc:276] 0709 13:10:54.014907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.015057 (+   150us) service_pool.cc:224] Handling call
0709 13:10:55.147417 (+1132360us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54000497d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:55.147547 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75650816}
I20260709 13:10:55.197840 24599 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:55.180696 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.178247 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.144721 31350 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.182114 25214 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:55.141945 31359 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:55.208366 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.212344 24594 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:10:55.165509 31328 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.211772 25219 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:55.215808 30665 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:55.219730 31185 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:55.220459 31203 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.222018 31327 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:55.223011 31404 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:10:55.225421 31359 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.268780 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:55.231186 31183 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.233006 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.233932 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.296612 24597 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:10:55.298612 24599 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:55.242919 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:55.300011 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57180.3us
I20260709 13:10:55.300256 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.301292 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:55.301383 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.246094 24521 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:55.301532 24599 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:55.302103 24593 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:55.235790 31256 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.247869 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.282290 31283 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:55.253810 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:55.271932 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:55.310320 24522 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:55.310468 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 56772.4us
I20260709 13:10:55.272856 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.213907 31350 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.311261 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:55.285203 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:55.286712 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 249734us
I20260709 13:10:55.297794 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.246258 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.306075 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.305539 25214 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:55.251538 25210 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:10:55.284339 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:55.315910 24667 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:55.316591 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:55.317353 24593 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.318069 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:55.270818 31063 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:10:55.313426 25211 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:10:55.271149 31328 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.322499 24599 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22.
I20260709 13:10:55.327839 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.326200 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.305472 31284 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.307206 31329 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:55.322925 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:55.336913 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.313659 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:55.338020 24594 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:10:55.309701 31283 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.343542 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:55.344503 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:55.346300 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.395016 24597 raft_consensus.cc:2368] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20.
W20260709 13:10:55.395032 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55770.6us
W20260709 13:10:55.396417 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.398726 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.399590 25212 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:55.399904 24593 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:55.379455 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.404083 25211 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:55.319087 31361 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:55.382035 31328 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:55.435698 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.386077 31256 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.319384 31295 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:55.387904 31394 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.527s	user 0.002s	sys 0.000s
I20260709 13:10:55.388190 31183 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:55.388688 24592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2374) took 1809 ms (client timeout 1850 ms). Trace:
I20260709 13:10:55.344650 31284 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.325275 30863 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.392498 31302 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:55.407330 31283 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:55.400874 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 99631.3us
I20260709 13:10:55.405450 24667 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:55.354380 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:55.407924 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 64487.9us
I20260709 13:10:55.465787 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.468998 25211 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:55.446192 24597 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:55.474704 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:55.449502 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.459558 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:55.477118 24524 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.342300 31329 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:10:55.447679 24592 rpcz_store.cc:269] 0709 13:10:53.579632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.579843 (+   211us) service_pool.cc:224] Handling call
0709 13:10:55.388466 (+1808623us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b54001932d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:55.388606 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209596800}
I20260709 13:10:55.462612 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:55.462806 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.392607 31359 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.435045 31185 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:55.471271 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:55.448781 31063 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.507066 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.503357 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:55.438345 31188 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:55.464754 31302 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.464676 31402 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.507186 31185 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.512144 31359 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:55.466763 30665 raft_consensus.cc:2764] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:55.521734 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:55.524158 24639 leader_election.cc:336] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 2.026s (SENT)
I20260709 13:10:55.481272 31329 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.485324 31076 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:55.517096 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.539088 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:55.540817 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.470168 30863 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.526021 31302 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.482203 31398 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:10:55.529052 31406 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:55.572607 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.537539 31185 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:55.517721 31063 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.590587 25214 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:10:55.551726 31272 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:55.598184 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.600178 25212 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 10.
I20260709 13:10:55.562197 31359 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:55.534984 31290 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:10:55.589831 30665 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:55.536034 31402 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.661250 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.662091 24517 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:55.665308 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:55.667558 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.594489 31350 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.676903 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.677742 24519 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:10:55.695814 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.696926 25212 raft_consensus.cc:2376] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22. Re-sending same reply.
I20260709 13:10:55.682209 31350 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.706188 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 229855us
I20260709 13:10:55.708495 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.682551 31076 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.583897 31406 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:55.656028 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 131918us
W20260709 13:10:55.656390 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 162816us
W20260709 13:10:55.515465 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 477753us
W20260709 13:10:55.721458 24639 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 2.101s (SENT)
I20260709 13:10:55.722215 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:55.645901 24594 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:55.687740 30665 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:55.733834 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:55.734843 31312 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:10:55.734047 30912 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:55.735996 30912 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:55.736661 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:55.736939 30912 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.737529 31312 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.744519 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.729302 31272 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:55.745976 31272 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:55.747985 31414 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:10:55.750768 31272 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.744686 31063 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:55.702625 31350 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.754142 24524 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:55.761976 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.756675 24519 raft_consensus.cc:2368] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:10:55.757265 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.738035 30912 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.730016 31406 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.787727 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.765478 24522 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:55.730191 31076 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.792251 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.793233 24522 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:55.768689 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.794222 25218 raft_consensus.cc:2410] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:10:55.769315 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.796126 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:55.767000 24524 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 11.
W20260709 13:10:55.772058 31416 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:10:55.781698 30665 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.782771 31283 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.802965 31402 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:55.804229 31283 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:55.784564 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.784837 30863 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:55.792364 31076 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:55.806313 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.763979 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.807811 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.808673 24519 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:55.808676 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.768851 31284 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:55.810362 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:55.771281 31418 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:10:55.821637 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:55.757372 31188 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.811877 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.827795 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:55.769271 31412 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:10:55.830734 24522 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:55.835640 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.842262 24520 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:10:55.842422 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:55.844640 24637 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.908s (SENT) [suppressed 21 similar messages]
I20260709 13:10:55.848939 25211 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
W20260709 13:10:55.829109 25217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.002s	sys 0.025s
W20260709 13:10:55.852700 25217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.003s	sys 0.025s
I20260709 13:10:55.853927 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.854401 24520 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:55.856803 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.857904 24522 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:55.858650 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 115071us
I20260709 13:10:55.859544 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:55.863191 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.865293 24518 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:55.868054 24518 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:55.827775 31272 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:55.874025 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:55.890988 24667 raft_consensus.cc:2410] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 25 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:10:55.874413 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:55.829273 31284 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.894693 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:55.891894 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:55.892856 31203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.047s	sys 0.066s
I20260709 13:10:55.877794 31310 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:10:55.905860 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46438.5us
I20260709 13:10:55.912732 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:55.901482 31203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.047s	sys 0.066s
I20260709 13:10:55.914732 31178 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:55.915357 31178 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.915549 31085 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:55.915740 31178 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.921901 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:55.922533 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:55.923382 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.924464 25218 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:55.926803 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:55.921864 31310 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:55.934578 31422 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:55.936203 31310 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:55.936502 31427 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:10:55.937196 31434 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:10:55.937646 31421 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:10:55.937832 31434 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:55.931708 31256 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:55.938644 31256 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:55.938853 31434 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.939647 31256 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.941946 31350 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:55.942847 31350 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.943308 31350 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.944355 31329 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:55.929482 31419 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:55.945261 31183 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:55.922746 31295 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:55.923345 31343 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:55.860948 31359 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.912518 31272 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.901750 31284 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:55.949677 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.954264 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.949018 31419 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:55.969921 31183 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:55.979916 25218 raft_consensus.cc:2368] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:10:55.980232 24668 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:55.978927 25211 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:55.985483 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:55.990427 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:55.996747 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:55.996755 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.000031 24669 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:56.001228 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.004554 25211 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:56.002159 24639 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:55.962458 31188 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.023041 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.039208 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.041738 24669 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:55.988212 31183 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:56.046166 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:56.046592 24517 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:56.046936 25218 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.047251 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.050153 25211 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:56.050287 24672 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:56.054849 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:55.972311 31185 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.001034 31290 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:55.989338 31419 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:56.022620 31362 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:56.005121 31341 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:56.017557 31317 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:56.017308 31345 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:56.056680 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.110574 24669 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:56.088899 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:55.998575 31398 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:10:56.127411 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.130085 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.130913 24674 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 11.
I20260709 13:10:56.128933 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.134490 25211 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
W20260709 13:10:56.117898 24673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.015s	sys 0.021s
W20260709 13:10:56.138803 24673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.015s	sys 0.022s
I20260709 13:10:56.140419 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.142031 25211 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:56.143751 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:56.144471 25211 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:56.147082 24516 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:56.109565 31312 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.107867 31362 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.122447 31435 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.109771 31341 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.153641 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:56.161504 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.162796 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.163406 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.163879 31318 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.164490 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.165957 31361 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:56.211105 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.171599 31325 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.109992 31350 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.173607 24668 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:56.173939 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.227617 24674 raft_consensus.cc:2410] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
W20260709 13:10:56.146377 31390 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.293s	user 0.004s	sys 0.001s
I20260709 13:10:56.145710 31183 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.183151 31318 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.183763 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.183945 24669 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:56.184484 31259 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:56.164767 31178 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.185626 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.189848 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:56.243199 25219 raft_consensus.cc:2376] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15. Re-sending same reply.
I20260709 13:10:56.182099 31341 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:10:56.191862 31430 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:10:56.193380 30950 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:56.197857 31284 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.201866 31287 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:56.202198 31272 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.202322 31343 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.203464 24519 raft_consensus.cc:2410] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:56.204443 31367 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.138128 31317 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.137915 31345 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.181237 31435 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.235059 31325 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.171509 31329 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:56.214522 25218 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:56.275297 31203 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:56.275704 31203 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.276027 31203 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:56.276337 25218 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:56.277931 25218 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:10:56.278903 25216 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:56.279117 25218 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:56.280557 25216 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:10:56.265713 31183 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:56.108407 31290 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:56.237993 25211 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:10:56.287873 25211 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:56.177944 31362 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:56.240638 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.015s	sys 0.044s
I20260709 13:10:56.243877 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.280941 25216 pending_rounds.cc:85] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 15
I20260709 13:10:56.246714 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.211449 31361 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:10:56.239920 31302 consensus_meta.cc:287] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.001s
I20260709 13:10:56.251219 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.252862 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.254379 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.256088 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.300194 25210 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:56.258038 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:56.255868 31287 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:56.261111 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:56.256623 24591 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.019s	sys 0.043s
I20260709 13:10:56.253388 30950 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.193419 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.272892 31318 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:56.313764 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 120462us
I20260709 13:10:56.289517 25211 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:56.290549 25218 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:56.293583 25216 pending_rounds.cc:107] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 19.16
W20260709 13:10:56.292119 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.015s	sys 0.044s
I20260709 13:10:56.318764 25216 raft_consensus.cc:2889] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:56.304304 24591 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.020s	sys 0.043s
I20260709 13:10:56.291611 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.264186 31406 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.245791 31259 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.329988 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.309631 25214 raft_consensus.cc:2410] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:10:56.310271 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.302821 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1433) took 1088 ms. Trace:
I20260709 13:10:56.330994 31259 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.321162 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.292395 31329 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.267671 31367 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.332240 24666 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:56.331768 31329 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.332435 31183 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:56.333323 31183 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.331144 25217 rpcz_store.cc:276] 0709 13:10:55.241947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.244988 (+  3041us) service_pool.cc:224] Handling call
0709 13:10:55.246864 (+  1876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.247288 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:55.247913 (+   625us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.855491 (+607578us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.892334 (+ 36843us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.892471 (+   137us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:55.892500 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.892559 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.191268 (+298709us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:56.296394 (+105126us) raft_consensus.cc:1685] finished
0709 13:10:56.302561 (+  6167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.302749 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":40,"raft.queue_time_us":9805,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":28404,"spinlock_wait_cycles":19361664,"thread_start_us":604768,"threads_started":1,"wal-append.queue_time_us":775007}
I20260709 13:10:56.314617 30950 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:56.334307 31329 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:56.334405 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2054) took 1254 ms. Trace:
I20260709 13:10:56.335278 31434 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:56.336131 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.334908 24600 rpcz_store.cc:276] 0709 13:10:55.080385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.080502 (+   117us) service_pool.cc:224] Handling call
0709 13:10:55.080815 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:55.081228 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.081257 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:55.085534 (+  4277us) log.cc:844] Serialized 52 byte log entry
0709 13:10:55.660646 (+575112us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b1800416920. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:56.046277 (+385631us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:56.107136 (+ 60859us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.136729 (+ 29593us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.136877 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.136964 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.334189 (+197225us) raft_consensus.cc:1685] finished
0709 13:10:56.334214 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.334348 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66676,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":5094,"spinlock_wait_cycles":35384192,"thread_start_us":385423,"threads_started":1,"wal-append.queue_time_us":1183980}
I20260709 13:10:56.331409 24667 raft_consensus.cc:2410] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:10:56.337571 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.337953 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.338896 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.339764 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.337091 24565 leader_election.cc:400] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:10:56.333801 31183 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:56.341390 31434 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:56.341897 31434 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.342317 31434 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.346630 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.266023 31343 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.324327 25212 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:56.335031 31310 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:56.325451 31178 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:56.326336 31325 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:56.330261 31317 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:56.293638 25182 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.060s	sys 0.049s
I20260709 13:10:56.348728 24520 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:56.358505 25182 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.060s	sys 0.049s
I20260709 13:10:56.289971 31290 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:56.340044 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.350533 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:56.359216 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 675190us
I20260709 13:10:56.323221 25210 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:10:56.351838 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.362008 30665 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:56.362407 30665 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.362771 30665 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:56.363386 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.297070 31415 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:10:56.323184 31374 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.374009 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.302407 31302 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.352866 31323 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:56.390995 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:56.391607 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.331404 31287 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.422772 24669 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:56.423030 31287 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.423527 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.424350 25210 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:56.373855 31310 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:56.425217 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.425297 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.425980 31310 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.426695 25217 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:10:56.426805 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.422240 31434 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.427623 25218 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:10:56.364811 31259 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:10:56.374476 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.398064 30665 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.368873 31202 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:10:56.430821 31202 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:56.430896 31434 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.409965 31345 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:56.410238 31342 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:56.397426 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.418270 31406 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.419777 31343 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:56.421865 31302 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:56.431237 31202 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:56.367962 30798 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.045s
I20260709 13:10:56.433810 31202 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.435268 31202 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.431488 30665 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.440300 31367 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:56.441738 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48718.2us
I20260709 13:10:56.441831 31347 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:56.442739 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.443131 31185 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.443697 31347 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:56.444222 31347 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:56.445176 31347 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.391741 31317 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.391481 31350 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:10:56.453404 31419 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.454979 31419 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.455706 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.459292 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2053) took 1379 ms. Trace:
I20260709 13:10:56.459651 24591 rpcz_store.cc:276] 0709 13:10:55.080077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.080184 (+   107us) service_pool.cc:224] Handling call
0709 13:10:55.095403 (+ 15219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.441827 (+346424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.441878 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.452220 (+ 10342us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.319674 (+867454us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:56.319727 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.319899 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.459076 (+139177us) raft_consensus.cc:1685] finished
0709 13:10:56.459096 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.459236 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21903,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":1109822,"threads_started":2,"wal-append.queue_time_us":939971}
I20260709 13:10:56.367327 31318 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:56.462038 31318 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.462512 31318 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:56.390736 31325 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:56.465451 31325 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:56.465830 31325 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:56.469926 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.471511 24674 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:10:56.473282 31438 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:10:56.475128 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2052) took 1395 ms. Trace:
I20260709 13:10:56.475476 24596 rpcz_store.cc:276] 0709 13:10:55.079758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.079858 (+   100us) service_pool.cc:224] Handling call
0709 13:10:55.092779 (+ 12921us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:55.477005 (+384226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.477038 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:55.514163 (+ 37125us) log.cc:844] Serialized 52 byte log entry
0709 13:10:55.956125 (+441962us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:55.980668 (+ 24543us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.980992 (+   324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.981066 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.195717 (+214651us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b1800137500. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:56.474859 (+279142us) raft_consensus.cc:1685] finished
0709 13:10:56.474947 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.475072 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31983,"raft.queue_time_us":24358,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":10017,"spinlock_wait_cycles":32475136,"thread_start_us":780605,"threads_started":2,"wal-append.queue_time_us":730866}
W20260709 13:10:56.481271 31443 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:10:56.422360 31323 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.486564 31323 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:56.489029 24666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3682) took 1689 ms (client timeout 1965 ms). Trace:
I20260709 13:10:56.489353 24669 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:56.489425 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 95358.7us
W20260709 13:10:56.493120 24670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3689) took 1669 ms (client timeout 2029 ms). Trace:
W20260709 13:10:56.489450 24666 rpcz_store.cc:269] 0709 13:10:54.799872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.800009 (+   137us) service_pool.cc:224] Handling call
0709 13:10:56.488858 (+1688849us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001388d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:56.488973 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484306176}
W20260709 13:10:56.493582 24670 rpcz_store.cc:269] 0709 13:10:54.823321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.823437 (+   116us) service_pool.cc:224] Handling call
0709 13:10:56.492890 (+1669453us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540044e654. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:56.493043 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3363984768}
I20260709 13:10:56.501463 30665 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:56.508004 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 133636us
I20260709 13:10:56.508400 24674 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:56.514907 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.026s
W20260709 13:10:56.516382 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.001s	sys 0.026s
W20260709 13:10:56.517746 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 810529us
W20260709 13:10:56.519559 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 517429us
I20260709 13:10:56.519974 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.522425 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.526783 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:56.535400 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.031s
I20260709 13:10:56.534850 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3694) took 1506 ms. Trace:
W20260709 13:10:56.532454 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 378868us
W20260709 13:10:56.541208 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.588133 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.596110 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.011s	sys 0.034s
W20260709 13:10:56.605643 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 85773.8us
I20260709 13:10:56.607615 24519 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:56.603243 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.612478 24522 raft_consensus.cc:2410] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:10:56.611501 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 89228us
I20260709 13:10:56.614342 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.614178 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.616361 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.523422 31439 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.087s
I20260709 13:10:56.534710 31341 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.523097 31442 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:10:56.524799 31290 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.552986 31276 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:56.526898 30950 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.597007 24673 rpcz_store.cc:276] 0709 13:10:55.018529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.018702 (+   173us) service_pool.cc:224] Handling call
0709 13:10:55.019108 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:55.063364 (+ 44256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.063399 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:55.077562 (+ 14163us) log.cc:844] Serialized 52 byte log entry
0709 13:10:55.444094 (+366532us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:56.139221 (+695127us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.512489 (+373268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.512584 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.512630 (+    46us) raft_consensus.cc:1685] finished
0709 13:10:56.512644 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.524992 (+ 12348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34353,"prepare.queue_time_us":138316,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":141865,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":28882,"thread_start_us":1294270,"threads_started":3,"wal-append.queue_time_us":638966}
I20260709 13:10:56.654816 30665 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:56.618119 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.617028 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.621068 25185 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:56.690938 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 164242us
W20260709 13:10:56.694084 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 77118.2us
W20260709 13:10:56.689976 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90667.2us
I20260709 13:10:56.612334 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.696051 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.696455 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.524072 31362 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.611307 30798 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:10:56.696524 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 75528.1us
I20260709 13:10:56.691694 30665 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:56.724202 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:56.697599 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:56.618693 31452 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:10:56.637717 31424 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.936s	user 0.006s	sys 0.000s
W20260709 13:10:56.618222 31450 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:10:56.729715 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:56.750519 25219 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:10:56.730343 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:10:56.751241 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.738941 25212 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:56.742884 24520 raft_consensus.cc:2376] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19. Re-sending same reply.
W20260709 13:10:56.723536 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 111303us
I20260709 13:10:56.752790 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.618884 31444 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:56.721516 31076 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:56.747462 24673 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:10:56.748411 24525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.010s	sys 0.048s
I20260709 13:10:56.694178 31398 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.749095 24667 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:56.621316 31374 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.751114 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.762373 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.769358 24516 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:56.732411 24671 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:56.765595 24525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.010s	sys 0.049s
I20260709 13:10:56.768304 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.770583 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.770955 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2354) took 1330 ms. Trace:
I20260709 13:10:56.771137 24522 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:56.728230 31350 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.779537 24672 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:56.779698 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.639806 31435 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:56.762471 30665 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.761906 24600 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:10:56.616247 31302 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:56.754647 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.768443 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.739600 31283 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:56.767531 24673 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:10:56.745571 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 49176.4us
I20260709 13:10:56.776969 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:56.787634 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.788199 24521 raft_consensus.cc:2410] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:56.788435 24520 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:10:56.777500 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.789320 24522 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:10:56.781949 24591 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:56.782912 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:56.731817 30798 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.739362 31445 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:56.692806 31325 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.631307 31318 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.697276 31085 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:10:56.791729 31350 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.792305 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.768069 31259 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:56.768065 31338 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.824468 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.794543 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.760965 31203 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.761296 31202 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.795472 31283 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.796633 30665 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:56.834237 24597 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:56.797245 31453 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:56.797178 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.797763 24674 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:56.721822 31276 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.771392 24525 rpcz_store.cc:276] 0709 13:10:55.440876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.441123 (+   247us) service_pool.cc:224] Handling call
0709 13:10:55.441431 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.441633 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:10:55.710389 (+268756us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.050303 (+339914us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.770579 (+720276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.770628 (+    49us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:56.770747 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.770812 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.770907 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":477025,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":148177,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":25618,"thread_start_us":1305866,"threads_started":3,"wal-append.queue_time_us":612348}
I20260709 13:10:56.830946 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.801944 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2273) took 3261 ms. Trace:
I20260709 13:10:56.802815 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.805665 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:56.778822 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.807258 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:56.808179 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:56.841617 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 62907us
I20260709 13:10:56.790638 24594 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:56.810725 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:56.762603 31284 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.816901 24596 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:56.765329 31076 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.819660 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.851207 24597 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:56.851727 24519 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:56.766134 31444 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.820636 24523 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:56.852289 24594 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:56.817713 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:56.826781 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:56.853058 24520 raft_consensus.cc:2368] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:10:56.754690 31328 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 13:10:56.824492 31259 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.809809 30798 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:56.825120 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.830626 24517 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:56.762291 31345 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:10:56.830890 25217 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:56.809501 31445 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.764645 31454 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:10:56.914009 24594 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:56.844540 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:56.844671 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.838920 24672 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
W20260709 13:10:56.847195 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44442us
I20260709 13:10:56.847214 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:56.842787 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:56.846308 31343 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 13:10:56.654060 31361 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.839248 24665 rpcz_store.cc:276] 0709 13:10:53.540130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.540538 (+   408us) service_pool.cc:224] Handling call
0709 13:10:53.540885 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.895510 (+354625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.895634 (+   124us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.062348 (+1166714us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b2c00173798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:10:55.062800 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.559855 (+497055us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:55.559900 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.559972 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.637123 (+1077151us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:56.801699 (+164576us) raft_consensus.cc:1685] finished
0709 13:10:56.801725 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.801866 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51818,"raft.queue_time_us":197492,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":48,"spinlock_wait_cycles":18407680,"thread_start_us":762182,"threads_started":2,"wal-append.queue_time_us":617284}
I20260709 13:10:56.828220 31459 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.854606 30665 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:56.854923 24592 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:56.898501 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:56.927213 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:56.905618 24516 raft_consensus.cc:2368] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:10:56.927893 24673 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:56.854621 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:56.928756 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74215.1us
I20260709 13:10:56.836741 31419 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:56.910910 31445 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:56.849402 31285 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:56.854436 31076 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:10:56.910465 31183 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 13:10:56.899554 31444 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:56.821897 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:10:56.924610 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81906.8us
I20260709 13:10:56.925060 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.923226 24666 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 14.
I20260709 13:10:56.942039 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.927400 30665 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.905624 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.942991 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:56.943471 24674 raft_consensus.cc:2410] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:10:56.930042 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.943014 30665 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:56.942059 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:56.947639 24669 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:56.925848 31344 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:10:56.927176 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 82692.4us
I20260709 13:10:56.837738 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.850489 31338 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.071s
W20260709 13:10:56.932857 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 178273us
I20260709 13:10:56.953614 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:56.974474 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 136864us
I20260709 13:10:56.933869 24594 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:56.975178 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:56.841236 31453 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:56.935880 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 188283us
I20260709 13:10:56.937752 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:56.966565 24666 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:56.966791 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:56.931564 31419 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:56.931242 31347 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:56.931368 31398 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.939374 31442 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:56.982052 24674 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:56.979633 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:57.030066 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.981361 31338 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:10:56.964229 31183 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.964743 31085 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.976480 31285 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:56.973590 31367 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:56.926115 31323 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:56.995193 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:57.086622 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 106288us
W20260709 13:10:56.986876 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.985805 24666 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:56.983688 30665 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.937711 31341 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.008157 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.977656 31310 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.014496 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:56.973377 31415 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.944826 30950 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.987861 31419 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:56.995107 31347 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.012399 31203 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:56.981562 31287 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.020726 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.024299 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:56.985780 31188 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:10:56.983253 31457 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:56.983327 31359 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:56.978256 31362 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.025058 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.025418 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:56.983390 31374 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:10:57.105178 31347 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:57.044723 24667 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:57.046401 24594 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:57.143013 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 176269us
I20260709 13:10:56.977552 31178 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.032269 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.150547 24522 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20. Ops: []
W20260709 13:10:57.027330 31460 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:10:57.029686 31465 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:10:57.030923 31462 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:10:56.939450 31459 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:56.980641 24637 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:57.088038 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.157153 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.157249 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 176671us
I20260709 13:10:57.158339 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.088501 24516 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:57.092217 30665 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.098343 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.034855 31202 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:10:57.033983 31276 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:57.040881 31318 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.040529 31283 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.039201 31453 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.109823 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.069271 31325 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.105859 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:57.113960 24595 raft_consensus.cc:2368] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
W20260709 13:10:57.124125 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 170570us
I20260709 13:10:57.124408 24523 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:57.181700 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.182389 24674 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:57.114972 31463 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:10:57.148384 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:57.091939 31367 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.191797 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.193032 25217 raft_consensus.cc:2410] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:57.152786 24594 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:57.103207 31415 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.089862 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:57.101022 31310 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.171701 31338 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:57.164350 24637 leader_election.cc:400] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:10:57.206544 24637 leader_election.cc:403] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:10:57.165436 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.165729 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.166030 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:57.171118 30665 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.207828 30665 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.168244 31362 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:57.173134 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.213205 24600 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:57.179335 24593 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:10:56.995455 31302 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:10:57.184824 24668 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:57.186344 31442 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:57.217198 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.217860 24593 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:57.196030 24591 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:10:57.161067 31439 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:57.232142 30665 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.200688 24669 raft_consensus.cc:2368] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12.
I20260709 13:10:57.139286 31359 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:57.210121 24597 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:57.236276 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:57.211572 24639 connection.cc:256] RPC call timeout handler was delayed by -1.02199180599996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:10:57.212798 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52138 (request call id 1534) took 1053 ms. Trace:
I20260709 13:10:57.186978 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.224452 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.196487 31350 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.194141 31428 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.241498 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1502) took 1420 ms. Trace:
W20260709 13:10:57.218209 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53988.7us
I20260709 13:10:57.237566 24671 rpcz_store.cc:276] 0709 13:10:56.159010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.161180 (+  2170us) service_pool.cc:224] Handling call
0709 13:10:57.212609 (+1051429us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54001135d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:10:57.212739 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271791488}
I20260709 13:10:57.225266 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.225482 24524 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:57.239863 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 91575.5us
W20260709 13:10:57.240973 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 75015.2us
I20260709 13:10:57.211347 31398 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:10:57.247888 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.247643 31442 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.248565 31475 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:57.248759 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.249574 31350 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.250276 31183 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.252317 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:57.242069 25215 rpcz_store.cc:276] 0709 13:10:55.820781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.292883 (+472102us) service_pool.cc:224] Handling call
0709 13:10:56.293281 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.293768 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.293812 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.301542 (+  7730us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.700438 (+398896us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:56.700494 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.700578 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.241218 (+540640us) raft_consensus.cc:1685] finished
0709 13:10:57.241261 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.241423 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7914,"raft.queue_time_us":3259,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11428,"thread_start_us":344547,"threads_started":1,"wal-append.queue_time_us":526824}
I20260709 13:10:57.261792 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1504) took 1055 ms. Trace:
I20260709 13:10:57.261919 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.262543 24597 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:10:57.262208 25213 rpcz_store.cc:276] 0709 13:10:56.206580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.312673 (+106093us) service_pool.cc:224] Handling call
0709 13:10:56.313031 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.350787 (+ 37756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.350817 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.355831 (+  5014us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.754759 (+398928us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:56.754828 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.754921 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.261598 (+506677us) raft_consensus.cc:1685] finished
0709 13:10:57.261617 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.261739 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8610,"raft.queue_time_us":17294,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":85,"thread_start_us":351887,"threads_started":1,"wal-append.queue_time_us":533022}
I20260709 13:10:57.263844 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.265266 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.267463 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.269650 25185 leader_election.cc:400] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12.
I20260709 13:10:57.270120 25185 leader_election.cc:403] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:57.271996 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.275538 24519 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 11: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:57.205732 31276 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:10:57.210668 31341 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:10:57.275621 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.276516 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.275494 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.279088 24523 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:57.279381 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.277954 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:57.226565 31458 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:10:57.240701 31338 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:57.313295 25214 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:57.297896 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.310765 30665 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.292126 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.321332 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.257285 31362 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.323946 31362 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.275636 31374 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.253147 31439 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.326826 31439 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.256747 31428 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.328428 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.329243 24595 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:10:57.329360 31428 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.330188 31459 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:57.324533 31479 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:57.330998 31359 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.331699 31259 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.325052 31374 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.333213 25217 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.322248 24521 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:57.278282 31203 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:57.276382 31423 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:57.274153 31202 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.343284 24524 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:57.317237 31318 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:57.347046 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 93510.4us
I20260709 13:10:57.314410 31323 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:57.349167 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 79897.4us
I20260709 13:10:57.348824 24637 leader_election.cc:400] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:10:57.350759 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.356971 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.361951 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.362864 24597 raft_consensus.cc:2410] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:10:57.365670 31367 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.366117 31362 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.373899 31202 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 11. Current term is 12.
I20260709 13:10:57.374246 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.374945 24595 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 15: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:57.375679 31076 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.375967 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.374850 24596 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:57.376725 24593 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:57.377596 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:57.378856 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:57.383841 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.392444 24595 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:10:57.386263 31456 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:57.388424 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.380085 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.390691 24592 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:10:57.402693 24594 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:10:57.337217 30798 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.442915 30798 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.447569 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:57.391333 31338 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.291932 31473 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:10:57.377966 24600 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:57.470861 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:57.472424 24597 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 21. Ops: []
I20260709 13:10:57.395164 24566 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:57.407456 24595 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:57.407169 31347 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.408793 31419 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.478060 24521 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:57.478425 24521 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:57.479076 24521 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.479496 31419 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.479974 24521 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:57.481434 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.455595 31456 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:57.483377 31456 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.484457 31456 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.485710 24523 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:57.410890 31272 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:57.486758 31473 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:57.487037 31272 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:57.487150 31473 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:57.410940 31203 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:57.487984 31473 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:57.489241 31445 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:10:57.489923 24522 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:57.489711 31445 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.490069 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:57.417286 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 66929.6us
I20260709 13:10:57.491173 24520 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:57.414726 31290 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.425729 24671 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:57.425953 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:57.427135 31287 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:57.427727 24670 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:57.432163 31423 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.432047 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:57.506198 24667 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.495862 31323 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.507844 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:57.508041 31423 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.508538 31423 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.432101 31361 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:57.500927 31287 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:57.509236 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.509984 25215 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:57.510802 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:10:57.511233 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.511338 25215 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:57.512214 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.512667 25215 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.513816 31445 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.503484 31473 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:57.433709 31374 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.452123 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:57.519354 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.521020 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.448990 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:57.465492 31474 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.526818 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.527555 24517 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.528955 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.529505 24522 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.529767 24524 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: [17.9-17.9]
W20260709 13:10:57.475757 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 80669.8us
I20260709 13:10:57.488814 31203 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.436969 31444 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.543573 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.543804 24599 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:57.544391 24520 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:10:57.420030 31350 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.553910 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:57.423776 31415 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.481490 31285 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:57.480134 31347 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:57.487984 31272 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.562592 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:57.562945 31272 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:57.563235 24520 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:10:57.561832 31285 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:57.566256 31076 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.501945 24591 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:57.502660 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:57.567766 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:57.495426 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:57.519394 24673 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:57.554093 31474 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:57.569010 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73684.3us
I20260709 13:10:57.569242 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:57.569715 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:57.570779 31290 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.455025 25217 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:57.570982 31474 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:57.541816 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.571482 31290 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.571599 31276 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:57.571931 31290 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:57.572315 31290 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.572796 31344 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:57.541998 24667 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:10:57.573213 31344 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:57.573549 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:57.574337 24667 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:10:57.550889 31444 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.551074 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.575279 24524 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.556180 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:57.576612 24668 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:57.574054 31344 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.578368 31344 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:57.575400 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.581028 31341 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:57.581967 31341 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:57.582196 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:57.583374 31341 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:57.583767 31341 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:57.510012 31287 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.549588 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:57.592890 24516 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:10:57.593993 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:57.594352 31347 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:10:57.592424 25182 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:57.596736 25215 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:57.597225 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:57.597415 24522 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:57.597759 24524 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:57.590945 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:57.609661 24670 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:57.611058 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:57.614291 24522 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:57.618112 25212 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 12.
I20260709 13:10:57.620456 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.623236 24521 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:10:57.636171 24521 pending_rounds.cc:85] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 10
I20260709 13:10:57.684269 24521 pending_rounds.cc:107] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:10:57.626688 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.631989 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.558818 30798 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:10:57.604650 31202 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.616420 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:57.629070 31310 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:57.625628 31444 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:10:57.626129 24491 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.639408 31287 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.612195 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:57.697142 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:57.697769 24522 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:10:57.697880 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 85768.7us
I20260709 13:10:57.616032 31318 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:57.625435 31323 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.686463 24521 raft_consensus.cc:2889] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:57.691215 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.716922 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.634157 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.717736 25211 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
W20260709 13:10:57.718474 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 84426.7us
I20260709 13:10:57.718781 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.719184 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.719542 25211 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:57.720556 24522 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:10:57.555334 31445 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:10:57.626194 31434 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:57.692500 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:57.721637 24524 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
W20260709 13:10:57.695050 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 69004us
I20260709 13:10:57.695719 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:57.722816 25215 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:57.685007 24670 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:10:57.635927 31419 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:10:57.639559 31325 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:10:57.723292 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:10:57.683068 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 62700.6us
W20260709 13:10:57.726225 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.687140 31470 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:57.636730 31341 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.734746 25211 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:57.742767 25215 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:10:57.745486 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.712745 31323 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.737090 31085 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:57.694460 31076 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.769671 31076 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.772397 31076 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.773571 31323 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.777801 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:57.778591 31480 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:57.779091 31480 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:57.566588 31285 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.781581 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:57.782164 24670 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:57.780357 31480 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.733487 31434 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.785310 31434 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:57.785775 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:57.786504 25213 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:10:57.790652 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:10:57.791692 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.791785 24667 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:57.734882 31361 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.712877 31310 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:57.764312 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:57.764789 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.755944 31451 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.784981 31423 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.780982 31285 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:57.733228 31435 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:57.767804 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.768450 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:57.769069 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:10:57.796043 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.797819 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:57.798650 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.800140 24666 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:57.737349 31362 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.800434 25214 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:57.809007 31341 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:57.757211 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:10:57.815915 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:10:57.829545 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 84159.2us
W20260709 13:10:57.829414 25210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.005s	sys 0.026s
I20260709 13:10:57.822973 24596 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:57.788973 25213 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 13:10:57.822897 25219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.017s
W20260709 13:10:57.832989 25219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.016s	sys 0.017s
W20260709 13:10:57.831806 25210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.006s	sys 0.026s
W20260709 13:10:57.834962 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.836331 24517 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:57.755591 31444 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:10:57.765062 25215 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:10:57.841233 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:57.839907 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 82821.2us
I20260709 13:10:57.807544 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:10:57.848487 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.848973 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.849460 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:10:57.850787 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:57.855321 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.834909 31301 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:57.855414 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3704) took 1023 ms. Trace:
I20260709 13:10:57.835070 31435 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:57.873615 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:57.835386 31423 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:57.836665 31284 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:57.877543 31076 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:57.887143 31076 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:57.887552 31076 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:57.891472 31350 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:10:57.892256 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.852644 31469 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:57.873065 24672 rpcz_store.cc:276] 0709 13:10:56.831681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.985329 (+153648us) service_pool.cc:224] Handling call
0709 13:10:56.985600 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.059306 (+ 73706us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:57.226801 (+167495us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.268775 (+ 41974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.268852 (+    77us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:57.268922 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.406061 (+137139us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18004d5420. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17bfe1a58f 00007f17b8e59571 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd
0709 13:10:57.855152 (+449091us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b540040a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:57.855224 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.855357 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20237,"prepare.queue_time_us":254137,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":21629,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":15086,"spinlock_wait_cycles":175398528,"thread_start_us":161305,"threads_started":2,"wal-append.queue_time_us":127299}
I20260709 13:10:57.854452 31359 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:57.827432 31362 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:57.908610 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.916334 30798 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.918036 25215 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:57.918397 31076 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.920984 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1511) took 1226 ms. Trace:
W20260709 13:10:57.925403 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.941099 24673 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:10:57.927142 31435 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.877004 31301 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:57.935609 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2405) took 1095 ms. Trace:
I20260709 13:10:57.901525 31344 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:10:57.904611 31444 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:57.942924 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.941345 25218 rpcz_store.cc:276] 0709 13:10:56.694890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.695022 (+   132us) service_pool.cc:224] Handling call
0709 13:10:56.695367 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:56.697961 (+  2594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.698003 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:56.723915 (+ 25912us) log.cc:844] Serialized 52 byte log entry
0709 13:10:57.324032 (+600117us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b48001b06d8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:10:57.337269 (+ 13237us) spinlock_profiling.cc:243] Waited 989 us on lock 0x7b1800460d80. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:10:57.830511 (+493242us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:10:57.852433 (+ 21922us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.853195 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.853278 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.920759 (+ 67481us) raft_consensus.cc:1685] finished
0709 13:10:57.920779 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.920926 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27742,"prepare.queue_time_us":53592,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":29649,"raft.run_cpu_time_us":4677,"raft.run_wall_time_us":614167,"spinlock_wait_cycles":27276928,"thread_start_us":493030,"threads_started":1,"wal-append.queue_time_us":1190565}
I20260709 13:10:57.948801 24599 rpcz_store.cc:276] 0709 13:10:56.840637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.840764 (+   127us) service_pool.cc:224] Handling call
0709 13:10:56.854984 (+ 14220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.544224 (+689240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.935402 (+391178us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540033cf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:10:57.935554 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583730560}
I20260709 13:10:57.905359 31469 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.966688 31325 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:57.967469 31325 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:10:57.985649 31470 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:57.986238 31470 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:57.987233 31470 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.993126 31470 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.019150 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:57.936578 31359 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:58.027055 31359 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.030103 31362 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:58.016484 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:58.023267 31290 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.035048 31290 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:58.035656 24674 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:58.035426 31434 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:57.951171 31301 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:57.950922 31338 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:10:58.014360 31469 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.039898 31323 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:58.019197 31444 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:58.041996 31323 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:58.041895 31444 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:57.938395 30798 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:58.056727 25215 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:58.057348 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:58.061483 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:58.062070 24674 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.088248 31338 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:58.094565 24669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.021s	sys 0.026s
W20260709 13:10:58.095537 24669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.021s	sys 0.026s
I20260709 13:10:58.096772 31367 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:10:58.111477 31469 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.117169 31469 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:58.117826 31434 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:58.119109 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:58.119724 24669 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.120107 31325 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.121253 31076 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:58.050329 31317 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:10:58.121794 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:58.123682 30798 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:58.124635 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:58.131965 31361 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.132968 24670 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:58.081169 31318 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.134649 31318 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.080957 31362 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:58.137166 31362 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:58.138221 31362 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.154765 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:58.157956 24674 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:58.159513 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:58.162400 30798 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.160544 31318 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:58.177891 25184 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.010s	sys 0.017s
W20260709 13:10:58.196758 25184 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.010s	sys 0.017s
W20260709 13:10:58.197183 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 678957us
I20260709 13:10:58.208451 24669 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:10:58.216115 31301 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.218349 31301 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:58.220333 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.220242 31367 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:58.221339 31367 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:10:58.229192 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.234344 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 403693us
I20260709 13:10:58.210968 30798 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:58.211068 31317 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:58.254449 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 412192us
I20260709 13:10:58.260368 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:10:58.306845 24518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.008s	sys 0.029s
I20260709 13:10:58.245361 31317 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.321883 31202 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:58.322516 31202 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.323468 31317 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:58.324044 31317 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:10:58.324472 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.325023 31202 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:58.235394 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:58.325721 31317 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:58.317269 24566 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:10:58.347440 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 112194us
I20260709 13:10:58.348271 31076 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:58.348949 31076 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:58.350425 31076 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:58.327375 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.334826 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 450604us
I20260709 13:10:58.354854 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:58.356247 31323 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:58.356150 31350 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:58.356765 31323 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:58.357239 31469 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:58.358035 31423 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:58.356843 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:58.357728 31323 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:58.317113 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60992.8us
I20260709 13:10:58.358457 31423 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:58.358886 31434 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:58.359313 31423 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.360534 31423 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:58.347644 31317 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:58.363540 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:58.366194 31469 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:58.366699 31469 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.367102 31469 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:58.379568 24523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.004s	sys 0.036s
W20260709 13:10:58.381538 24518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.011s	sys 0.029s
W20260709 13:10:58.384833 24523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.004s	sys 0.036s
I20260709 13:10:58.386282 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:58.389225 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:58.392189 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:10:58.401503 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.401835 31509 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:58.402439 31325 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:58.383906 31350 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:10:58.412474 31504 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:10:58.416702 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:58.417866 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:58.419293 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:58.420250 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:58.420814 24522 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.421810 24669 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:58.423130 31259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.021s	sys 0.021s
W20260709 13:10:58.456670 31259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.022s	sys 0.021s
I20260709 13:10:58.457471 31259 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.456017 24522 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:10:58.452085 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:58.459604 31325 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:58.473206 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.483433 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.484268 25219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.012s
W20260709 13:10:58.484843 25219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.008s	sys 0.012s
I20260709 13:10:58.480253 31480 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:58.486095 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1868) took 1322 ms. Trace:
W20260709 13:10:58.482488 31185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.003s	sys 0.017s
I20260709 13:10:58.422566 31361 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:10:58.496354 25219 rpcz_store.cc:276] 0709 13:10:57.163979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.165387 (+  1408us) service_pool.cc:224] Handling call
0709 13:10:57.178680 (+ 13293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.228693 (+ 50013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.228737 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.229358 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.835892 (+606534us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:10:58.485306 (+649414us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.485677 (+   371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.485803 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.485859 (+    56us) raft_consensus.cc:1685] finished
0709 13:10:58.485878 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.486027 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95837,"prepare.queue_time_us":99788,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":53247,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":23328,"thread_start_us":1086204,"threads_started":2,"wal-append.queue_time_us":664522}
I20260709 13:10:58.450474 31301 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:10:58.418597 30798 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:58.495194 31344 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:58.527431 24671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.039s
W20260709 13:10:58.544178 24671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.000s	sys 0.040s
W20260709 13:10:58.529654 25216 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.012s	sys 0.033s
W20260709 13:10:58.482896 31466 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.009s
W20260709 13:10:58.539767 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.006s	sys 0.014s
W20260709 13:10:58.532228 31435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.033s
I20260709 13:10:58.498274 31480 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:58.560500 25216 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.013s	sys 0.033s
W20260709 13:10:58.560652 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.006s	sys 0.014s
W20260709 13:10:58.579566 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 695785us
W20260709 13:10:58.544827 31185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.003s	sys 0.017s
I20260709 13:10:58.581092 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:58.582317 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1871) took 1324 ms. Trace:
W20260709 13:10:58.567150 31310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.005s	sys 0.045s
W20260709 13:10:58.560421 31466 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.011s	sys 0.009s
W20260709 13:10:58.579627 31435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.033s
W20260709 13:10:58.606817 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.545003 31444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.006s	sys 0.017s
W20260709 13:10:58.623330 31444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.007s	sys 0.017s
I20260709 13:10:58.531590 31518 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:10:58.496892 31469 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:58.584311 25216 rpcz_store.cc:276] 0709 13:10:57.257671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.337773 (+ 80102us) service_pool.cc:224] Handling call
0709 13:10:57.346902 (+  9129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.352090 (+  5188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.352152 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.359894 (+  7742us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.882077 (+522183us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:10:58.581729 (+699652us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.581958 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.582028 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.582065 (+    37us) raft_consensus.cc:1685] finished
0709 13:10:58.582076 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.582250 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57307,"prepare.queue_time_us":57797,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":79,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":11641,"thread_start_us":1046606,"threads_started":2,"wal-append.queue_time_us":969608}
W20260709 13:10:58.588366 31310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.005s	sys 0.045s
W20260709 13:10:58.646811 24421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 348) took 37497 ms (client timeout 15000 ms). Trace:
W20260709 13:10:58.619473 31359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.025s	sys 0.042s
I20260709 13:10:58.579793 31344 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.657434 31310 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:58.658262 31344 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:58.623413 31272 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:58.658226 31310 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.659204 31272 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:58.661314 31272 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:58.662112 31310 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:58.655953 31367 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:58.666580 31367 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:58.667433 31466 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:58.667809 31466 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:58.670032 31317 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:58.673461 31511 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:10:58.679101 31480 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:58.682693 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2387) took 1153 ms. Trace:
I20260709 13:10:58.685348 31456 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:10:58.686200 31359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.025s	sys 0.042s
I20260709 13:10:58.695120 24523 rpcz_store.cc:276] 0709 13:10:57.529166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.543010 (+ 13844us) service_pool.cc:224] Handling call
0709 13:10:57.543739 (+   729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.544058 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.544084 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.544523 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.385464 (+840941us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:58.385521 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.385827 (+   306us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.682456 (+296629us) raft_consensus.cc:1685] finished
0709 13:10:58.682476 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.682626 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":968,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":840559,"threads_started":1,"wal-append.queue_time_us":1082644}
I20260709 13:10:58.696533 31350 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:58.696614 31456 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:58.702723 31272 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:10:58.720769 25218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.011s	sys 0.009s
W20260709 13:10:58.722162 25218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.011s	sys 0.009s
W20260709 13:10:58.744339 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 394872us
I20260709 13:10:58.715509 31350 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.744277 31272 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:10:58.748615 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 488326us
I20260709 13:10:58.760619 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:58.762629 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:58.771994 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.753386 31350 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:58.783668 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.784837 31359 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:58.785131 31317 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:58.756431 31287 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:58.792397 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:58.800597 24665 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:10:58.647235 24421 rpcz_store.cc:269] 0709 13:10:21.133723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.134016 (+   293us) service_pool.cc:224] Handling call
0709 13:10:58.631116 (+37497100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:51.593850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:51.685621 (+ 91771us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:51.685676 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:10:51.685713 (+    37us) tablet.cc:662] Decoding operations
0709 13:10:51.687293 (+  1580us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:51.687408 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:51.687439 (+    31us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:10:51.688841 (+  1402us) tablet.cc:701] Row locks acquired
0709 13:10:51.688893 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:10:51.689059 (+   166us) write_op.cc:270] Start()
0709 13:10:51.713333 (+ 24274us) write_op.cc:276] Timestamp: P: 1783602651688986 usec, L: 0
0709 13:10:51.713380 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:10:51.714148 (+   768us) log.cc:844] Serialized 6023 byte log entry
0709 13:10:52.741705 (+1027557us) op_driver.cc:464] REPLICATION: finished
0709 13:10:53.273212 (+531507us) write_op.cc:301] APPLY: starting
0709 13:10:53.273329 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:53.765319 (+491990us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:53.765429 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:54.530997 (+765568us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:54.531342 (+   345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:10:54.531403 (+    61us) write_op.cc:312] APPLY: finished
0709 13:10:54.531816 (+   413us) log.cc:844] Serialized 139 byte log entry
0709 13:10:54.823031 (+291215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:54.863290 (+ 40259us) write_op.cc:454] Released schema lock
0709 13:10:54.863396 (+   106us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:54.863870 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:54.863904 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":235036,"reported_tablets":46,"spinlock_wait_cycles":10624,"child_traces":[["op",{"apply.queue_time_us":476702,"apply.run_cpu_time_us":71521,"apply.run_wall_time_us":1590636,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66827,"num_ops":15,"prepare.queue_time_us":49894,"prepare.run_cpu_time_us":30289,"prepare.run_wall_time_us":487796,"raft.queue_time_us":516165,"raft.run_cpu_time_us":24532,"raft.run_wall_time_us":554122,"replication_time_us":1015359,"spinlock_wait_cycles":3456,"thread_start_us":1139431,"threads_started":5,"wal-append.queue_time_us":898028,"wal-append.run_cpu_time_us":41055,"wal-append.run_wall_time_us":2262051}]]}
I20260709 13:10:58.791292 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.800551 24669 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:10:58.795603 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.793761 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:58.803484 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.805797 31285 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:58.807894 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:58.809567 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:58.810338 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:58.810374 31547 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:58.811949 31547 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.762357 31456 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:58.809651 31480 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.814677 31456 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.815445 31480 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.817651 31480 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:58.814824 31547 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:58.782460 31318 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.819459 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.824559 24591 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:58.757604 31419 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:10:58.863073 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:58.848551 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:58.864738 24599 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:58.863730 24637 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.863963 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:58.823424 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.862772 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:58.867506 24593 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 15: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:58.857458 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:58.834964 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:58.869508 24594 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 23.
I20260709 13:10:58.870762 24670 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:58.829456 24591 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:58.874138 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:58.874396 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:58.875079 24599 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:10:58.875967 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52619.1us
I20260709 13:10:58.873944 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:58.877887 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:58.878574 24524 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.879310 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:58.880366 24595 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:10:58.881549 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.883178 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.883728 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:58.827175 31318 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:58.885088 31451 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:10:58.887629 31537 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:58.889727 31539 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:10:58.890900 31469 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:58.890796 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:58.893527 31535 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.134s	user 0.000s	sys 0.002s
W20260709 13:10:58.894984 31533 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:58.897152 31543 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:10:58.901357 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:58.902079 24669 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.827574 31359 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:58.872783 31494 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:58.885828 31454 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.865625 31344 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:58.907126 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.026s
W20260709 13:10:58.927829 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.002s	sys 0.026s
W20260709 13:10:58.905285 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 317725us
I20260709 13:10:58.886440 24594 raft_consensus.cc:2368] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 21.
I20260709 13:10:58.808462 31325 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:58.823144 31287 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:58.916203 31537 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:58.898892 31480 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:58.862885 31185 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:10:58.877996 31361 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:58.878229 31317 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:58.808756 31367 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:58.933998 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:10:58.936924 24524 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:10:58.937381 24669 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:10:58.939447 24600 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
W20260709 13:10:58.928228 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 569181us
I20260709 13:10:58.908659 31359 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:58.918081 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:58.950860 31494 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.967900 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49879.1us
I20260709 13:10:58.966002 24591 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:10:58.950687 31344 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:58.966938 24565 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:58.970672 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:58.969679 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 93130.3us
I20260709 13:10:58.996116 31367 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.961002 31419 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.004511 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 70625.7us
I20260709 13:10:59.004563 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.006202 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:58.941238 31454 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.000794 31325 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:59.008175 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:59.008476 31325 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.009503 31547 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:10:59.010154 31547 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.010738 31325 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:59.011102 31542 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:58.946894 31362 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:10:59.014981 31362 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:59.015439 31362 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:10:58.969750 31359 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:59.011551 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44719.1us
I20260709 13:10:59.019639 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:58.971014 31317 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:59.011065 31553 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:59.002177 31361 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.030334 31553 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:59.031291 31553 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.031881 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.032510 31553 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.028306 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:59.032987 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.035126 31318 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:59.040874 25215 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:59.039726 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:59.044307 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:59.044977 31550 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:59.045015 25215 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:59.045823 31550 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:59.010766 31547 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.013018 31272 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:59.019824 31528 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:10:59.017263 30798 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:10:59.050866 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:59.005530 31344 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.007143 31367 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.064515 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.066777 24524 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:10:59.055130 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:59.057287 24519 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:59.067706 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:59.020360 31325 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.001678 31494 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.052881 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:59.028724 31284 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:59.061270 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:59.040578 31318 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.053279 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:10:59.012346 31419 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.068326 25213 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:59.058416 25216 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:10:59.074536 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:59.078981 31547 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.079835 31545 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:10:59.080550 31531 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
I20260709 13:10:59.081694 31367 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:59.083021 31454 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.087738 31456 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:10:59.159327 31419 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.160877 31494 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:59.070127 31538 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:10:59.163877 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:10:59.164477 25210 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:59.166906 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3729) took 1185 ms. Trace:
I20260709 13:10:59.167726 31359 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.167284 24673 rpcz_store.cc:276] 0709 13:10:57.981870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.989259 (+  7389us) service_pool.cc:224] Handling call
0709 13:10:57.989690 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:58.086930 (+ 97240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.086975 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:58.087656 (+   681us) log.cc:844] Serialized 52 byte log entry
0709 13:10:58.567441 (+479785us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:58.802640 (+235199us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.803891 (+  1251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.803959 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.079988 (+276029us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:59.166629 (+ 86641us) raft_consensus.cc:1685] finished
0709 13:10:59.166710 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.166848 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114254,"prepare.queue_time_us":326299,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":97709,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":2677,"spinlock_wait_cycles":4936576,"thread_start_us":693241,"threads_started":2,"wal-append.queue_time_us":660188}
W20260709 13:10:59.170570 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 118354us
I20260709 13:10:59.171767 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:59.087921 25184 leader_election.cc:400] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 23.
W20260709 13:10:59.090492 31552 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:59.090536 31344 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.074872 31560 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.056816 31537 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.094235 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3730) took 1112 ms. Trace:
I20260709 13:10:59.075328 30798 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:10:59.059796 31317 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.095068 31550 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.096959 25218 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:59.053903 31301 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.098186 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 133207us
I20260709 13:10:59.100148 25219 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:10:59.016463 31362 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.046864 31361 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.098815 31284 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:59.057921 31272 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:59.139623 24519 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:59.178089 25184 leader_election.cc:403] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:10:59.181159 25213 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
W20260709 13:10:59.169863 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 62258.4us
I20260709 13:10:59.184092 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.184273 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.184473 24517 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
I20260709 13:10:59.248474 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:59.249605 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.250499 24521 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:10:59.251003 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:59.251425 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.252135 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.252568 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:10:59.253381 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 167841us
I20260709 13:10:59.253940 24522 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:59.254402 25184 leader_election.cc:400] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 21.
I20260709 13:10:59.254743 25184 leader_election.cc:403] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:59.257239 31325 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 23.
I20260709 13:10:59.257949 31325 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:59.259650 30798 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.265661 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3616) took 1680 ms. Trace:
I20260709 13:10:59.266491 31359 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:10:59.270053 31272 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.270697 24416 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 9 to 21, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 21 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.276571 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:59.190421 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.266062 24518 rpcz_store.cc:276] 0709 13:10:57.585188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.585315 (+   127us) service_pool.cc:224] Handling call
0709 13:10:57.585613 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.585919 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.585948 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.589936 (+  3988us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.384380 (+794444us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:58.414937 (+ 30557us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.705254 (+290317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.705337 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.258411 (+553074us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b18003d6ba0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:10:59.265354 (+  6943us) raft_consensus.cc:1685] finished
0709 13:10:59.265469 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.265604 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1161,"prepare.queue_time_us":30126,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1600,"raft.queue_time_us":160885,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":26251,"spinlock_wait_cycles":73342592,"thread_start_us":1078622,"threads_started":2,"wal-append.queue_time_us":979884}
W20260709 13:10:59.278038 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 87681.3us
I20260709 13:10:59.182770 24671 rpcz_store.cc:276] 0709 13:10:57.982229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.982356 (+   127us) service_pool.cc:224] Handling call
0709 13:10:57.982694 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:58.020644 (+ 37950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.020684 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.021267 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.544640 (+523373us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:58.544690 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.544751 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.094019 (+549268us) raft_consensus.cc:1685] finished
0709 13:10:59.094044 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.094176 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71441,"raft.queue_time_us":38988,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3131,"thread_start_us":523056,"threads_started":1,"wal-append.queue_time_us":690883}
I20260709 13:10:59.240809 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.245076 25214 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:10:59.249671 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:59.272459 31272 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.154700 31554 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:59.246135 31284 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:59.155087 31547 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.240425 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:10:59.319798 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 79442.1us
I20260709 13:10:59.201687 31344 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.185232 31546 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.289480 31359 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.291311 24416 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.292387 31563 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.292455 31350 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.293488 31554 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.294323 31361 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.246959 31301 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.283208 31423 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.297492 31203 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:59.309338 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.217835 31317 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.180994 31557 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.143s
I20260709 13:10:59.188752 31480 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:59.190330 31323 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:59.190928 31318 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.317251 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 75150.8us
I20260709 13:10:59.358763 24524 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:59.290153 31537 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.191533 31560 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.326365 31310 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:10:59.343847 31570 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:59.320925 31547 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:59.357311 31521 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.330646 31568 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:10:59.324975 31553 raft_consensus.cc:2764] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:10:59.355259 24592 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:59.362793 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:59.325065 25210 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:10:59.330829 31259 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:59.329052 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:10:59.401544 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 72594.5us
I20260709 13:10:59.367228 25217 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:10:59.370494 31554 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:59.370651 31532 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.621s	user 0.003s	sys 0.000s
I20260709 13:10:59.332728 31563 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.370488 31317 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:59.363519 31480 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.409641 24490 leader_election.cc:400] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:59.410112 24490 leader_election.cc:403] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:59.411324 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:59.325958 31546 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:59.339933 31514 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.721s	user 0.002s	sys 0.002s
I20260709 13:10:59.387180 24522 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:59.388988 31310 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:59.389448 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.389842 31568 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:59.401623 31573 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:59.391729 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:59.390002 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.392473 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.393296 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.363988 31318 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.405267 31517 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:59.394738 31521 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.346544 31423 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.364936 31543 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:59.366371 31538 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:59.363814 31323 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.400450 31325 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 21.
I20260709 13:10:59.417609 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.420928 31568 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:59.390451 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.442899 24669 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:59.404027 31537 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:59.425431 24525 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
W20260709 13:10:59.394325 31536 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.608s	user 0.000s	sys 0.003s
I20260709 13:10:59.383399 31570 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.415937 31566 raft_consensus.cc:2764] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:10:59.409957 31284 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.367537 31285 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:10:59.437757 24671 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [17.9-19.10]
I20260709 13:10:59.439415 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:59.442011 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.424146 31573 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:59.443322 24519 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:10:59.416090 31554 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:10:59.429378 31557 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.452108 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.453053 31323 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.470446 31557 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.453831 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.454882 24672 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
I20260709 13:10:59.457209 31570 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:59.457857 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.458367 24523 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:10:59.431025 31361 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:10:59.461781 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:59.423691 31310 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.440634 31574 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.472968 31557 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:10:59.475368 31580 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:59.474113 24666 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:10:59.468392 31419 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:59.486011 24666 pending_rounds.cc:85] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 8
I20260709 13:10:59.481383 31568 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.486788 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:59.487389 24596 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:59.488057 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:59.488270 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:59.488448 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:59.488795 24600 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:10:59.489190 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:59.489872 24598 raft_consensus.cc:2368] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19.
I20260709 13:10:59.490641 24599 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:10:59.491586 31285 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:10:59.491982 31285 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:10:59.492118 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:59.492525 31521 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.492676 24594 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:10:59.492838 31285 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.489707 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:10:59.493463 31574 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.494549 31423 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.494967 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:10:59.495713 24596 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:59.495896 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1465) took 1919 ms. Trace:
I20260709 13:10:59.495609 31361 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.487462 31568 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:59.496361 25211 rpcz_store.cc:276] 0709 13:10:57.576381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.739121 (+162740us) service_pool.cc:224] Handling call
0709 13:10:57.739461 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.739803 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.739831 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.746451 (+  6620us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.244302 (+497851us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:58.244344 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.244412 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.339324 (+1094912us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:59.495569 (+156245us) raft_consensus.cc:1685] finished
0709 13:10:59.495593 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.495835 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4029,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":11804032,"thread_start_us":497401,"threads_started":1,"wal-append.queue_time_us":788690}
I20260709 13:10:59.498144 31361 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:59.496382 31530 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.754s	user 0.000s	sys 0.002s
I20260709 13:10:59.419014 24416 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 12 to 15, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 15 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:59.486372 24666 pending_rounds.cc:107] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:10:59.501708 24666 raft_consensus.cc:2889] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.489205 24591 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:10:59.472918 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.469776 24670 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:10:59.515142 24525 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:59.518180 24517 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:10:59.532243 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 59428.9us
W20260709 13:10:59.515461 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 113069us
I20260709 13:10:59.533576 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.535884 24517 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:59.536293 24517 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:59.537232 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:59.538455 24519 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:10:59.538880 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.539633 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.540447 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:59.541317 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:59.541391 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.575363 24518 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:10:59.575881 24518 pending_rounds.cc:85] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 9
I20260709 13:10:59.576128 24518 pending_rounds.cc:107] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:10:59.576385 24518 raft_consensus.cc:2889] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.576648 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.577265 24521 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:10:59.554873 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:10:59.578013 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.578219 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.579042 24521 raft_consensus.cc:2410] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:59.565781 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.577430 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.466506 31522 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.581682 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:10:59.551802 24516 raft_consensus.cc:2393] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:10:59.581524 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:10:59.536974 24517 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.589538 24517 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:59.582574 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.580459 31415 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:59.593856 31573 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.595647 31573 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:59.597417 31301 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:10:59.597869 31581 log.cc:927] Time spent T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:10:59.599905 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.473520 31554 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:59.602000 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 157083us
I20260709 13:10:59.603101 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.480316 31560 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:10:59.605050 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50275.9us
I20260709 13:10:59.604223 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:10:59.575402 31444 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:59.603760 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.549635 31287 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:59.607568 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:10:59.477741 31563 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:59.607997 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:59.530587 31419 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.599114 31310 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.611631 24667 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:59.611953 31435 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.495625 31574 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.575959 31259 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.479317 31318 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:10:59.616386 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.606110 24519 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:10:59.619381 24517 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:10:59.635492 24517 pending_rounds.cc:85] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 9
I20260709 13:10:59.635727 24517 pending_rounds.cc:107] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:10:59.635942 24517 raft_consensus.cc:2889] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.620123 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.621049 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.500763 31470 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.131s
I20260709 13:10:59.580304 31323 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.629015 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.601131 31350 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:10:59.635377 24668 raft_consensus.cc:2410] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:10:59.642925 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.612972 31572 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:59.599462 31543 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:10:59.623351 31444 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:59.549755 31570 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260709 13:10:59.499775 31466 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.630028 31287 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.649281 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.634279 31301 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.668177 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:59.669869 24667 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:10:59.638190 31563 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:59.646467 31318 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:10:59.649071 31310 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:59.647924 31423 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.668602 31444 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.638841 31549 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.043s
I20260709 13:10:59.634725 31419 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:10:59.638648 31554 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:10:59.696835 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.697928 24670 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:10:59.689258 31537 consensus_queue.cc:1175] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "148dc963cec64232ad3b248abad6f36d" responder_term: 15 status { last_received { term: 14 index: 12 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:59.643101 31435 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.651432 31561 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:59.695046 24668 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:59.675750 31563 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:59.729928 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:10:59.694885 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:10:59.736138 24667 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:59.736364 31466 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:59.746047 24667 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:10:59.677767 31584 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:10:59.729039 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:59.753327 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.753932 24525 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:10:59.757366 31561 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:59.716737 31318 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.759737 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 220971us
I20260709 13:10:59.678455 31287 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.717025 31310 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:10:59.749778 31563 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:10:59.788774 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 180873us
I20260709 13:10:59.748819 31323 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:59.753314 31584 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:10:59.784701 31301 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.783941 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:10:59.789647 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:59.788384 31456 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:59.762480 31359 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:59.802745 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.748790 31547 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:10:59.829564 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:10:59.788852 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 207260us
W20260709 13:10:59.833146 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 43602.1us
W20260709 13:10:59.790445 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 165360us
W20260709 13:10:59.833622 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49920.5us
I20260709 13:10:59.779661 31550 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:10:59.863142 31561 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:10:59.866817 31587 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:10:59.833509 31543 consensus_queue.cc:1243] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:10:59.868526 31534 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.109s	user 0.003s	sys 0.000s
I20260709 13:10:59.833487 31571 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.785022 31557 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
W20260709 13:10:59.886478 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.886968 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44029us
I20260709 13:10:59.890749 25184 leader_election.cc:400] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19.
I20260709 13:10:59.893556 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.831992 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:10:59.828531 31584 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:10:59.892217 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:10:59.894681 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1481) took 1804 ms. Trace:
W20260709 13:10:59.886991 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56757.7us
I20260709 13:10:59.896457 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:10:59.787832 31318 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.840189 31570 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:59.840534 31434 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:59.895246 25212 rpcz_store.cc:276] 0709 13:10:58.090686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.090891 (+   205us) service_pool.cc:224] Handling call
0709 13:10:58.091319 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:58.091749 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.091785 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:58.097347 (+  5562us) log.cc:844] Serialized 52 byte log entry
0709 13:10:58.582505 (+485158us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:58.582543 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.582607 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.843782 (+1261175us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:10:59.870152 (+ 26370us) raft_consensus.cc:1685] finished
0709 13:10:59.870172 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.894609 (+ 24437us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2992,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"spinlock_wait_cycles":11681664,"thread_start_us":484780,"threads_started":1,"wal-append.queue_time_us":619952}
W20260709 13:10:59.914449 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 82543.1us
I20260709 13:10:59.839388 31359 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:10:59.922284 31538 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:10:59.923141 31590 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:10:59.923900 31591 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:10:59.927805 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.007339 24522 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:10:59.831614 31301 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:10:59.918864 31570 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:10:59.972249 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.028496 24524 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:10:59.973969 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.907471 31594 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:59.975548 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 105862us
I20260709 13:10:59.888240 31350 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:10:59.756035 24416 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 11 to 15, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 15 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:59.978116 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:00.035861 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58509.5us
I20260709 13:10:59.917914 31572 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:10:59.969632 31553 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.011461 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 117922us
I20260709 13:11:00.017757 31517 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:00.020474 31480 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.025635 31451 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:59.989826 31359 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.959662 31547 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:11:00.050395 31547 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:00.051770 31547 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:59.897733 31571 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.050428 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:10:59.953251 31310 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.066143 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.068084 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.075201 24597 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:00.075496 24593 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:11:00.032284 31434 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:00.041249 31435 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.032611 31570 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.036592 31557 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:00.033777 31419 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.040598 31517 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:00.068536 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.069861 24595 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:00.055634 31451 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:00.083264 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.062021 31594 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:00.062319 31571 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.087097 24595 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:11:00.088263 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.073791 31325 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:00.089334 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:00.091104 24600 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:00.091497 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:00.084861 24596 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
W20260709 13:11:00.102960 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 210786us
I20260709 13:11:00.095476 24592 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
W20260709 13:11:00.108321 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.116840 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:00.055881 31553 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.083873 31557 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.080933 31287 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.093154 31272 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:00.130496 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 234067us
I20260709 13:11:00.133304 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:00.123088 31419 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:00.122663 31594 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:00.132565 31557 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:00.137715 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.133944 31272 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:00.154078 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 62689.1us
I20260709 13:11:00.141626 31419 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.158622 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.134359 31480 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:11:00.154353 31272 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.171203 31608 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:00.180166 31285 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:00.162045 31604 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.131770 24416 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 13 to 16, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 16 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:00.216082 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.221863 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.167399 31287 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.213760 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.137776 31434 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:00.163286 31419 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:00.210676 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 77450.6us
I20260709 13:11:00.227067 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:00.165867 31601 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:00.213469 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:00.215502 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.235532 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:00.236008 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:00.237409 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:00.219177 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.215802 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.158901 31350 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.240453 31350 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.171254 31621 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:00.139082 31451 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.225200 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.227679 24597 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:00.227686 25185 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:00.171701 31613 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:00.171643 31367 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 13:11:00.229861 31606 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:11:00.229530 24416 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 15 to 18, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 18 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.216467 31618 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:00.287006 24416 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 13 to 14, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 14 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.244993 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:00.171005 31599 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:00.209609 31284 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.171279 31620 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.171535 31596 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:00.285710 31626 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:11:00.226395 31597 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:11:00.268909 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.271519 25212 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:00.149776 31594 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.171271 31612 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:00.274914 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:00.274907 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47293.9us
I20260709 13:11:00.281838 31605 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.142335 31517 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:00.240911 31350 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.317179 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:00.289291 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44374.5us
I20260709 13:11:00.317906 25218 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:00.319157 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:00.319568 24521 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:00.320528 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:00.291719 25211 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:00.295450 31367 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:00.298601 25217 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:00.209164 31608 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:00.278877 31317 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:00.292048 31451 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:00.315166 25213 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:00.233812 31287 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.315313 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:00.171243 31586 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.315709 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.227800 31301 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.295948 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:00.324292 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.306900 31596 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.222435 31604 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:00.343405 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.348151 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:00.352573 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 316056us
I20260709 13:11:00.360849 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:00.362962 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.365862 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:00.367906 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.368860 25217 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:00.303567 31599 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:00.335454 31553 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.330303 31480 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:11:00.340672 31517 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:00.432142 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.416607 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.395226 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:00.395255 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47179.6us
I20260709 13:11:00.441401 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.325886 31624 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:00.386270 31613 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.388314 31605 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:00.387243 31621 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:00.445026 31629 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:00.446597 31604 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:00.288427 31618 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.307909 31620 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:00.366106 31596 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:00.417748 31568 consensus_meta.cc:287] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.921s	user 0.008s	sys 0.004s
I20260709 13:11:00.528792 24516 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
W20260709 13:11:00.505211 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 177723us
I20260709 13:11:00.385666 31317 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:00.515405 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.516336 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.409510 31612 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:00.535372 25216 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:00.536118 25210 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:00.485682 31605 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.482100 31456 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:11:00.485253 25217 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:00.521373 31624 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:00.527598 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 160448us
I20260709 13:11:00.546039 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.546669 25210 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:11:00.390765 31586 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.547417 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:00.549149 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.554914 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.505558 31608 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:00.555639 25217 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:00.555927 31608 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:00.556555 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:00.556555 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.540655 31612 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.559439 31612 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.566578 31618 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.568310 31638 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.511910 31613 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.579214 31613 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.576972 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:00.579901 25217 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:00.582444 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.583343 25210 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:11:00.586581 24672 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:11:00.542783 31605 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.588689 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:00.589564 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.590376 25210 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:00.592821 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:00.595420 31359 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
I20260709 13:11:00.595814 31359 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:00.598737 24669 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:00.545176 31624 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.600761 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:00.603359 24669 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:00.607921 31599 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.538081 31317 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.610160 24673 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:00.610970 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.618165 24593 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:11:00.618800 24670 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:11:00.619240 24670 pending_rounds.cc:85] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 14
I20260709 13:11:00.619527 24670 pending_rounds.cc:107] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:11:00.619837 24670 raft_consensus.cc:2889] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:00.622414 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.626402 31317 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:00.640478 31563 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.842s	user 0.003s	sys 0.006s
I20260709 13:11:00.602929 31624 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:00.645119 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.520370 31629 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.660027 24665 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:11:00.611343 31584 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.000s
I20260709 13:11:00.483031 24416 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.603256 31367 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:00.568835 31638 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:00.673209 31563 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:00.678179 31557 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:11:00.688046 24670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:45838
I20260709 13:11:00.693091 24670 raft_consensus.cc:606] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:00.698472 25214 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:00.701954 31285 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:00.703351 31285 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.706068 31285 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.719197 31568 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:00.720106 31557 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.719980 31568 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.723131 31568 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.728380 31568 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.728991 31568 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.731331 31568 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.752453 31563 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.753494 31259 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:00.753955 31259 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:00.754781 31259 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.755815 31259 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:00.757272 25216 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:00.761420 31563 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:00.762169 31563 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.764499 24522 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:11:00.764917 24522 pending_rounds.cc:85] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 8
I20260709 13:11:00.765216 24522 pending_rounds.cc:107] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:11:00.765451 24522 raft_consensus.cc:2889] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:00.764493 31287 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:00.768651 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.771492 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:00.772125 25217 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:00.771958 31605 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.773150 24671 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:00.773816 31563 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.773981 31586 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:00.688849 31444 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.933s	user 0.003s	sys 0.008s
I20260709 13:11:00.669857 31594 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:00.680869 31367 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.779258 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:00.780036 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.780052 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:00.784132 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.786123 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:00.779484 31570 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.004s
I20260709 13:11:00.841208 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.842679 24521 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:00.843549 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.848165 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:00.840637 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:00.850178 24665 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:00.855801 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.785666 31367 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:00.689240 31584 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.866739 24665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:45838
I20260709 13:11:00.867537 24665 raft_consensus.cc:606] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:00.856408 24521 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:11:00.869320 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:00.869971 24521 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:00.862788 24519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.005s	sys 0.018s
W20260709 13:11:00.870927 24519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.006s	sys 0.019s
I20260709 13:11:00.862210 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.782287 31444 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.893349 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:00.892484 31419 consensus_meta.cc:287] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.001s
I20260709 13:11:00.903702 25212 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 23: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:00.904165 31419 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.907366 31419 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:00.892800 31466 consensus_meta.cc:287] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.154s	user 0.005s	sys 0.008s
I20260709 13:11:00.921891 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:00.923085 31398 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:00.923627 31398 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.924137 31398 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:00.926891 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:00.928468 31640 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:00.932576 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:00.933861 31344 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.934394 31344 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.934839 31344 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.937647 31640 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:00.938421 31640 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.939435 31203 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:00.940210 31203 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:00.940810 31640 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:00.941628 31203 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.885504 31359 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:00.853438 31570 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.958025 24594 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:00.952586 24521 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:00.960785 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:00.962271 31609 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:00.962986 31609 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:00.960261 31203 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.964511 31609 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.967825 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.957527 31640 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:00.974406 31640 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:00.979054 24416 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.985468 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:00.987536 31602 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.944s	user 0.007s	sys 0.000s
I20260709 13:11:00.987449 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:00.989398 31561 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:00.989880 31561 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:00.990945 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:00.991506 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:00.991739 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.992105 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:00.993372 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:00.993503 24670 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
W20260709 13:11:00.946911 31451 consensus_meta.cc:287] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 13:11:00.995586 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:00.992413 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:00.997222 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:00.946084 31641 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:01.000517 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:01.003854 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.004266 31466 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.004801 31466 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.006917 31466 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.007910 31615 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:11:01.009130 31644 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:11:01.011101 31651 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:11:01.012666 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:01.022279 31584 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.025367 31549 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:01.025481 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:01.025990 31549 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:01.026579 31549 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:01.028034 30798 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:01.028484 30798 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.028826 30798 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.030009 31638 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.030790 31434 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:01.031500 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.032168 24524 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:01.033239 31594 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:01.033735 31594 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.035687 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:00.886484 31566 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:11:00.949630 31419 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:01.036494 31574 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:01.036585 31419 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.037122 31419 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:01.038542 31466 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:01.012917 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.039144 31466 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.039740 24523 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:01.035719 31594 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.041484 31605 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.041589 31466 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.042619 25185 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:01.043283 31466 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:01.043062 31612 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.043751 31466 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.044994 31318 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.047452 31318 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.050280 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.051414 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.053220 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.053889 24523 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
W20260709 13:11:01.054447 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.055575 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.059015 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.059770 24523 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:01.060145 25211 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:01.060642 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.061120 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:01.061645 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.062273 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:01.063730 25215 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:01.064206 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.068439 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.069500 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.071324 31362 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.070827 24524 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:11:01.070935 24416 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 17 to 19, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 19 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.072680 31522 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:11:01.074740 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.075253 31272 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.853s	user 0.006s	sys 0.004s
I20260709 13:11:01.075688 31272 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.076978 31522 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:01.077955 31522 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.079198 31599 raft_consensus.cc:3055] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:01.078790 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:00.990816 31561 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.080355 31561 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:01.082688 31272 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.083199 31605 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.083549 25217 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:01.079006 31522 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:01.085319 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:00.972859 31596 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.063262 31573 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.089184 31558 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.089612 31350 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.000s
I20260709 13:11:01.129618 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:01.090170 31640 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.036967 31574 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.093232 31362 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.093847 31549 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.079559 31599 raft_consensus.cc:740] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:11:01.093186 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.099220 25182 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:01.143838 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44707.7us
I20260709 13:11:01.100566 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.104784 24596 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:11:01.105139 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 62608.5us
W20260709 13:11:01.148150 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.149751 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:01.122239 31593 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:01.122562 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:01.123456 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:01.127990 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:01.070750 31444 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.110821 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:01.152148 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:01.110136 31612 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.180892 24599 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:01.181422 24597 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:01.180977 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57619.2us
I20260709 13:11:01.183970 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:01.184250 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:01.182682 24593 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:01.184945 25218 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:01.189778 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:01.191197 25218 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:01.191596 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:01.143290 31624 consensus_meta.cc:287] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.005s
I20260709 13:11:01.144484 31574 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:01.197340 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47694.3us
I20260709 13:11:01.199569 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.200276 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:01.152606 31608 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.153286 31593 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.129235 31415 consensus_queue.cc:1059] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:11:01.203922 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:01.204123 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:01.211782 25217 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:01.204449 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.178375 31594 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:01.205106 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.213990 24597 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:01.208765 31608 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.217618 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:01.203804 25218 raft_consensus.cc:1275] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:11:01.218313 25218 pending_rounds.cc:85] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 14
I20260709 13:11:01.218662 25218 pending_rounds.cc:107] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:11:01.219004 25218 raft_consensus.cc:2889] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:01.141285 31573 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.193598 31272 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:01.196732 31548 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:01.143321 31350 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.151589 31362 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.196741 31553 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:01.124167 31605 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.205344 31285 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:01.227897 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:01.208608 31593 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:01.212098 31444 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:01.226871 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:01.244952 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:01.214125 31594 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.143141 31558 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.215123 31612 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.255859 31362 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.256057 31629 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.214645 31367 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.243089 31553 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.229766 31548 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:01.225893 31546 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.242693 31584 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:01.249382 31549 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.206024 31624 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.280061 31553 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:01.271327 31594 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:01.279336 31548 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:01.276851 31612 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.297237 31596 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:01.302323 31654 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:11:01.307063 31624 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.307576 31612 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.336058 24416 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 15 to 16, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 16 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:01.343889 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.350660 24523 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:01.353744 24416 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 12 to 15, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 15 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.363881 24665 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:11:01.364630 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.365986 24524 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:01.366427 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.367741 24521 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:01.358402 24416 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 11 to 14, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 14 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.257467 24670 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:01.389416 24672 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:11:01.249378 24674 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:11:01.380129 24416 catalog_manager.cc:5697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 9 to 13, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 13 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.397264 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.398278 24673 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:01.399657 24524 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:01.400712 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:01.395588 24416 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 16 to 18, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 18 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:01.403855 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.265865 25218 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:01.406227 25216 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:11:01.407140 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:01.418380 31259 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.239387 31272 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.432413 31367 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.267630 31287 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.419584 31310 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.308228 31605 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:01.440428 31344 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.001s
I20260709 13:11:01.432824 31272 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.445358 31259 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.293754 31466 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.447806 31612 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:01.448442 25210 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:01.451725 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.461678 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.462445 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:01.463467 25218 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:01.439421 31537 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:01.464289 31537 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.468353 31537 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.433409 31549 consensus_queue.cc:1048] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:11:01.471287 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.473630 31573 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:01.477732 31398 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.001s
I20260709 13:11:01.478510 31398 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.480273 24671 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:01.482486 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.485927 31350 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.490111 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.457594 31612 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:01.498114 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:01.499562 31612 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:01.512502 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.518779 31344 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.511796 31398 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.521620 31344 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.526158 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.518762 30798 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.528311 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3646) took 1925 ms. Trace:
I20260709 13:11:01.529668 24516 rpcz_store.cc:276] 0709 13:10:59.602721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.602840 (+   119us) service_pool.cc:224] Handling call
0709 13:11:01.527880 (+1925040us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54003ae3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:01.528113 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126954368}
I20260709 13:11:01.531253 31259 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:01.529281 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.533179 30798 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:01.543154 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.547284 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:01.549211 31537 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:01.553548 24673 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:01.554337 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:01.554585 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:01.555210 24669 raft_consensus.cc:2368] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20.
I20260709 13:11:01.555281 24673 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:01.562506 25210 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:01.563076 24668 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:01.567155 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.545387 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 301115us
I20260709 13:11:01.575054 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:01.578504 31537 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.578722 31419 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.006s
I20260709 13:11:01.579252 31419 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.579278 31537 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.580768 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:01.581146 25212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1532) took 1266 ms (client timeout 1595 ms). Trace:
I20260709 13:11:01.581590 24517 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:01.581797 31350 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:01.582777 31549 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.583458 31444 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:01.585130 31350 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:01.587080 25219 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:01.582773 25213 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:01.587358 31350 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.593014 31537 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:01.596671 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.581666 25212 rpcz_store.cc:269] 0709 13:11:00.315104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.315444 (+   340us) service_pool.cc:224] Handling call
0709 13:11:01.580702 (+1265258us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54005d02d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:01.580944 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285479808}
I20260709 13:11:01.534896 24416 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.618948 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:01.620028 25210 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:01.622947 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 50403.9us
I20260709 13:11:01.627050 31521 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:01.632396 31549 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:01.632767 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:01.633153 31594 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.636268 31543 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:01.638347 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:01.639410 24672 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:01.642678 31570 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:01.648689 31522 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.011s
I20260709 13:11:01.651183 31599 consensus_queue.cc:260] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.657991 31419 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.658815 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:01.664199 31607 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.664494 31620 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.665050 31607 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.667933 31607 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:01.672013 31628 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.262s	user 0.003s	sys 0.000s
I20260709 13:11:01.656767 31608 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:01.674937 31645 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.926s	user 0.000s	sys 0.010s
I20260709 13:11:01.677446 31599 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:01.680500 31310 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:01.681012 31310 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.688756 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:01.690043 31594 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.691112 31594 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:01.691560 31594 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:01.692063 31594 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:01.694317 31538 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:01.694777 31538 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.695114 31538 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.699725 31559 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:01.700402 31559 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.702569 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.702808 31415 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:01.703976 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.703639 31415 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.704823 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.717280 24672 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
W20260709 13:11:01.720108 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 57419.2us
I20260709 13:11:01.722604 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:01.736577 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:01.755499 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2323) took 1169 ms. Trace:
I20260709 13:11:01.756026 24667 rpcz_store.cc:276] 0709 13:11:00.586230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.586438 (+   208us) service_pool.cc:224] Handling call
0709 13:11:00.586710 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.678986 (+ 92276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.679019 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.679060 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:00.679092 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.754810 (+1075718us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b5400404f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:01.754895 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.755148 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211744128}
I20260709 13:11:01.756868 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:01.757972 25211 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:11:01.758826 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:01.757978 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2425) took 1690 ms. Trace:
I20260709 13:11:01.759796 24594 rpcz_store.cc:276] 0709 13:11:00.066950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.067082 (+   132us) service_pool.cc:224] Handling call
0709 13:11:00.067350 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.958746 (+891396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.757505 (+798759us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b540025f3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:01.757775 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047890688}
I20260709 13:11:01.761323 31344 raft_consensus.cc:993] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:11:01.761341 25211 raft_consensus.cc:2410] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:11:01.762233 31344 raft_consensus.cc:1081] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:11:01.764032 31568 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:01.766467 31415 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.767943 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1536) took 1427 ms. Trace:
I20260709 13:11:01.777449 25215 rpcz_store.cc:276] 0709 13:11:00.340596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.340751 (+   155us) service_pool.cc:224] Handling call
0709 13:11:00.341062 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.064105 (+723043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.767298 (+703193us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54003c7b54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:01.767698 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661536512}
I20260709 13:11:01.761533 31517 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:01.779587 31517 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:01.779956 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:01.781399 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3655) took 1561 ms. Trace:
I20260709 13:11:01.781533 31325 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:01.780802 31517 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.781929 31325 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:01.782429 31325 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:01.794709 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56834.4us
W20260709 13:11:01.807263 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.737391 31593 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:01.833384 31553 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.002s
I20260709 13:11:01.834210 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.793146 31558 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.835016 31592 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:01.834972 31522 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:01.792301 31350 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:01.781845 24525 rpcz_store.cc:276] 0709 13:11:00.166777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.167739 (+   962us) service_pool.cc:224] Handling call
0709 13:11:00.168036 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.168358 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.168377 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.168689 (+   312us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.293953 (+125264us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:00.294007 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.294096 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:00.759526 (+465430us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b48001a04d8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:11:01.671066 (+911540us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:01.710285 (+ 39219us) raft_consensus.cc:1685] finished
0709 13:11:01.710308 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.728163 (+ 17855us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":638,"raft.run_cpu_time_us":10975,"raft.run_wall_time_us":587260,"spinlock_wait_cycles":127416576,"thread_start_us":81939,"threads_started":1,"wal-append.queue_time_us":172938}
I20260709 13:11:01.834566 31361 raft_consensus.cc:993] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:11:01.845230 31559 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.845485 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3647) took 1689 ms. Trace:
I20260709 13:11:01.845711 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:01.846057 24674 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:01.853996 24670 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:01.846720 25214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1527) took 1572 ms (client timeout 2074 ms). Trace:
W20260709 13:11:01.847169 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.854729 25214 rpcz_store.cc:269] 0709 13:11:00.273781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.273982 (+   201us) service_pool.cc:224] Handling call
0709 13:11:01.837362 (+1563380us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54005780d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:01.846545 (+  9183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693558528}
I20260709 13:11:01.847445 31287 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:01.852983 24522 rpcz_store.cc:276] 0709 13:11:00.155773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.156436 (+   663us) service_pool.cc:224] Handling call
0709 13:11:00.156700 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.765916 (+609216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.845025 (+1079109us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400278dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:01.845326 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396997376}
I20260709 13:11:01.856050 31287 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:01.846314 31553 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.856915 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1489) took 1508 ms. Trace:
W20260709 13:11:01.830456 31574 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.013s
I20260709 13:11:01.867033 25213 rpcz_store.cc:276] 0709 13:11:00.348867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.349262 (+   395us) service_pool.cc:224] Handling call
0709 13:11:01.582341 (+1233079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.587785 (+  5444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.856713 (+268928us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54005d02d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:01.856858 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834787712}
I20260709 13:11:01.875072 25210 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:01.879312 31350 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.885238 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:01.885675 31287 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.886409 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:01.887686 31310 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.888890 24516 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:01.890230 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51483.8us
I20260709 13:11:01.890358 31350 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.856071 24520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50178
I20260709 13:11:01.891626 24520 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:01.891983 31610 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:01.869377 31592 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.895795 31310 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.865387 31617 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:01.892431 24566 leader_election.cc:400] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20.
I20260709 13:11:01.865049 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:01.898208 24566 leader_election.cc:403] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:01.864984 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:01.892040 24520 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:01.865233 31318 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.011s
W20260709 13:11:01.902163 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 141464us
I20260709 13:11:01.904564 24521 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:01.905704 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.912622 31398 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:01.916479 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.917246 24672 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:01.740264 24416 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:01.913540 31398 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.866293 31557 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:01.918393 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:01.897759 31617 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.903574 31586 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:01.929328 31323 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.930089 31323 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.930433 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:01.932401 31323 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.933918 31549 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:01.920831 31361 raft_consensus.cc:1081] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Signalling peer 0131806e3b9647128f32db1ab8d314fc to start an election
I20260709 13:11:01.918421 31547 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:01.935490 31547 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.943074 24416 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 11 to 15, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 15 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.945147 31415 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:01.950722 31553 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:01.951428 31553 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:01.952147 31466 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:01.952014 31553 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.958452 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:01.960223 31538 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.962230 31325 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.963165 31612 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.964457 31325 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.965354 31586 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:01.967442 31586 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.904264 31574 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:01.970639 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 105783us
I20260709 13:11:01.972018 31574 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:01.975033 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:01.975625 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:01.976186 24591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:11:01.976387 24593 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:01.978062 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:01.980401 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:01.981216 31558 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:01.981787 31558 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:01.982931 31558 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:01.919389 31318 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:01.985374 25216 raft_consensus.cc:2368] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20.
I20260709 13:11:01.986845 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:01.987676 24672 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:01.989801 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:01.990576 24596 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:11:01.976905 24591 raft_consensus.cc:606] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Received request to transfer leadership to TS 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:01.992869 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:01.932993 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:02.003162 24522 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.003391 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:02.004107 25218 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:11:01.976830 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.007570 31466 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:02.008209 24597 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:02.008729 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.009575 24672 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:02.013451 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:02.014859 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.015542 24598 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
W20260709 13:11:02.016922 31675 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:11:02.034740 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:02.037596 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.976224 31548 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.682s	user 0.006s	sys 0.006s
I20260709 13:11:02.041219 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:02.046523 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.033507 24520 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.049830 24522 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:02.054903 24518 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:02.073812 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:02.095309 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.040200 31586 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:02.095867 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:02.105667 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:02.107465 25215 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:02.109107 24416 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:02.110173 31592 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.110608 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.114333 31310 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:02.114946 31547 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.114912 31310 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.117866 24520 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.112977 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:02.120322 25217 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:11:02.121589 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 66656.9us
I20260709 13:11:02.102630 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:02.048429 31517 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:02.045706 31318 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:02.107158 30798 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:02.130339 31522 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:02.132135 31318 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.132642 30798 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:02.133358 31398 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:02.132570 31522 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:02.136960 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.133237 25214 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:02.046137 31610 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:11:02.133742 30798 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:02.121717 31310 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.112483 31301 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:02.124342 31612 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.126235 31466 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:02.126277 31592 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:02.159350 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 226531us
I20260709 13:11:02.161573 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:02.121358 31586 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.074291 31548 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.168233 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.149106 31301 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:02.174716 24674 raft_consensus.cc:2410] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:11:02.175874 24598 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.177481 24525 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:02.154495 31592 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:02.179075 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 53991.8us
I20260709 13:11:02.176822 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:02.154934 31609 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:02.184993 24524 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:02.183663 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.173416 31553 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.173710 31612 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:02.174214 31610 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:02.175680 31301 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.180553 31593 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.181411 31592 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.183276 31609 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.194259 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.199976 30798 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.164836 31517 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.205475 24666 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:02.209448 24522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
 from {username='slave'} at 127.0.0.1:50178
I20260709 13:11:02.205056 25214 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:02.169507 31466 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.214394 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:02.212471 24597 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.212651 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:02.179612 31594 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.218282 24522 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:02.196319 31553 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.204882 31586 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.221457 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:02.222349 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.224148 31435 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.227387 24522 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:02.195616 31617 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.217185 24591 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:02.211189 31609 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.234853 24669 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:02.219487 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:02.227144 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:02.228833 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.237545 24667 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:02.228031 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:02.247247 24517 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:02.248039 24520 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:11:02.250506 31318 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.251155 31076 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:11:02.252132 31076 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:02.252522 31076 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:02.253547 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.249594 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.259967 24669 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:02.261229 31549 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20.
I20260709 13:11:02.261852 30798 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.262180 31548 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.220427 31574 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:02.229246 31553 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.260895 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.206794 31612 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.272979 31076 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.274084 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.274397 31076 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:02.274799 24519 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
W20260709 13:11:02.278488 31678 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:11:02.280107 25184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.573s (SENT) [suppressed 19 similar messages]
I20260709 13:11:02.283659 31594 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.283880 24669 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 25: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:02.249801 31617 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:02.288762 31617 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:02.290899 31617 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.292627 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.293483 31574 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.295680 31574 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.289868 31466 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:02.297413 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 51889.3us
I20260709 13:11:02.267267 31553 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.297665 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.293833 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:02.325363 25212 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:02.340507 24517 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.344852 24673 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:02.358517 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:02.249944 31610 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.366550 24522 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.423719 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:02.344944 31350 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:02.364732 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:02.431506 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 151528us
I20260709 13:11:02.429946 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:02.349933 31574 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.343333 31272 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:02.435032 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.439199 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.437757 24520 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:02.441388 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.448984 24597 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:02.451582 24592 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:02.455403 31543 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:02.457170 24522 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.460005 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:02.464231 31517 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.367947 31558 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 13:11:02.480051 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.434383 31350 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:02.480544 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.481256 24565 leader_election.cc:400] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20.
I20260709 13:11:02.471650 31521 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:02.449973 31574 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.494809 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:02.495649 25210 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
W20260709 13:11:02.489985 31415 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.005s
W20260709 13:11:02.500701 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 150556us
I20260709 13:11:02.511497 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:02.496639 31680 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.396s	user 0.002s	sys 0.000s
I20260709 13:11:02.513948 24597 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.512367 24591 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 15.
I20260709 13:11:02.517338 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.499413 31612 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.519227 31323 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:11:02.510994 31415 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:02.541982 31610 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.542588 31610 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:02.542976 31610 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:02.543200 31538 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.543799 31610 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:02.545722 31654 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:02.542622 31350 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.550061 31574 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:02.551084 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:02.550943 31301 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.556782 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.565703 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.557165 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.556017 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.554252 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:02.564217 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.556448 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.552255 24517 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:02.553982 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:02.578394 24599 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:02.565253 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.566059 24594 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.566469 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1517) took 1163 ms. Trace:
I20260709 13:11:02.584314 24593 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:02.555636 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.558055 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.585572 24524 rpcz_store.cc:276] 0709 13:11:01.402932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.404508 (+  1576us) service_pool.cc:224] Handling call
0709 13:11:01.404947 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.185519 (+780572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.566259 (+380740us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54000dcad4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:02.566420 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793515264}
I20260709 13:11:02.588562 24591 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:02.557695 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.510807 31605 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.144s
I20260709 13:11:02.587170 24525 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:02.587088 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:02.592098 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.594274 24596 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:02.595155 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:02.586191 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 91920.9us
W20260709 13:11:02.665714 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.620011 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.602108 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:02.553522 31592 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.595733 24599 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:11:02.594211 31612 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:02.601502 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:02.699554 24597 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.630466 24598 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.552989 31301 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.628278 31259 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:02.664851 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:02.694047 31698 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:02.560518 31466 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.667325 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.714509 24670 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:02.714347 31466 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.715373 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.715994 24670 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:02.716825 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.669389 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:02.670176 24593 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.670087 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:02.672519 24521 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:02.674118 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:02.680685 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:02.680807 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:02.674561 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:02.721537 24665 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:02.683995 31617 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.684417 31609 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.685482 31522 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:02.673863 31687 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.503s	user 0.000s	sys 0.003s
W20260709 13:11:02.679543 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.674124 25212 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:02.729349 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:02.679692 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 138923us
I20260709 13:11:02.732944 31318 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:02.679399 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:02.696202 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.696302 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:02.690513 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 496462us
I20260709 13:11:02.697062 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:02.692695 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.693219 24517 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:02.735736 24522 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:11:02.692090 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:02.621641 24600 raft_consensus.cc:2393] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.701035 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:02.692391 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:02.629586 31521 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:02.707402 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:02.689044 31553 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.668543 30798 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.740207 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.681372 24666 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:02.740974 24517 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:02.741515 24671 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:02.727890 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53853.9us
I20260709 13:11:02.698526 24594 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:02.726198 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.721920 24665 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:02.740676 24520 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:02.724258 31361 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:02.745898 25185 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:02.744304 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.740875 24666 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:02.746384 30798 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.748584 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.749552 24521 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 24: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:02.747884 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:02.755208 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:02.757735 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:02.758534 24522 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:02.759727 24516 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:02.771464 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.742653 31594 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:02.737071 31318 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:02.772740 30798 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.779237 31617 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.752199 31574 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:02.754815 31607 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:02.746479 31361 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:02.787051 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.789412 31521 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.789582 24665 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.830480 24665 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:02.771569 31702 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:11:02.781091 24666 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.763248 31466 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:02.793953 31700 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:02.795374 31609 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.798055 24521 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:02.792580 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:02.811846 31586 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:02.812677 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 131981us
I20260709 13:11:02.838793 24521 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:02.726020 31612 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:02.845009 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 165730us
I20260709 13:11:02.816002 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:02.817201 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:02.818297 31548 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:02.781733 31318 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:02.783670 31435 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:02.821537 31592 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.822557 31574 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:02.827667 24668 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:02.753544 31605 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:11:02.792841 31553 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.813370 31594 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:02.828334 31361 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:02.847028 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 101214us
I20260709 13:11:02.860883 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:02.849469 31710 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:02.839620 31466 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:02.867583 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:02.865434 24566 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:02.871744 30798 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.873041 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:02.857532 31617 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:02.873742 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:02.874509 31522 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:02.874938 31522 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.875236 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:02.875809 24670 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.875274 31522 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.879069 30798 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.879680 30798 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:02.881523 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 120945us
I20260709 13:11:02.883481 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:02.885838 31558 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.886096 31547 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:02.886312 31558 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:02.886591 31547 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:02.886813 31558 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.887534 31547 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.887544 31522 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:02.890224 31557 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.890722 31557 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.891161 31522 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:02.893747 31557 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:02.862794 24521 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.894783 24521 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:02.898618 31703 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:02.899355 31703 consensus_queue.cc:1243] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:02.899425 31610 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.899909 31703 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:02.900326 31703 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:02.901852 31605 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:02.906914 24525 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:02.907071 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:02.908210 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 155470us
W20260709 13:11:02.913262 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.915076 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:02.908864 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:02.863065 31609 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:02.884846 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:02.888942 31547 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.938606 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:03.008870 24671 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:02.917464 31682 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:11:03.010322 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 194493us
W20260709 13:11:02.987596 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.020102 24667 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:11:03.031405 31549 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.032163 31549 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.049749 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.050254 31549 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.045400 24666 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:03.051537 31557 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:03.051985 31557 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:03.052417 31557 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:03.056273 24525 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:03.057605 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:03.058535 24524 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:03.062305 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.063303 24524 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:11:03.064826 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.069419 31594 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:02.935834 31609 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:03.078619 24666 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:11:03.084491 24670 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:11:03.087327 24521 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:11:03.088828 31344 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:11:03.089257 31548 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:03.012261 31586 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:03.090142 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 183234us
I20260709 13:11:03.104566 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:03.105756 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:03.083333 31707 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:11:03.113616 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 252968us
I20260709 13:11:03.086828 31710 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:03.121003 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 212205us
W20260709 13:11:03.115489 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.116912 31711 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:11:03.125360 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 246636us
I20260709 13:11:03.098654 31617 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:02.938282 31703 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:03.131582 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 246838us
I20260709 13:11:03.117887 31707 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:03.140085 31361 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.132787 24671 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:03.016361 31574 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.140831 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:03.153404 24673 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:03.173249 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:03.174903 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.174927 31710 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:03.176113 31715 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:03.176823 31715 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.176925 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:03.165433 31716 consensus_queue.cc:1175] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0131806e3b9647128f32db1ab8d314fc" responder_term: 21 status { last_received { term: 17 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:03.178177 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.178472 31547 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:03.178933 31701 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:03.179329 31701 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:03.179685 31701 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:03.179694 31718 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:03.154712 31361 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:03.129009 31586 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:03.156431 31609 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.157747 31703 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:03.161831 31557 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.145431 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.168882 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.181950 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.135022 31711 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:03.165242 31612 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.198391 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.199745 24521 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:03.183916 24665 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
W20260709 13:11:03.187520 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 81855.2us
I20260709 13:11:03.202181 30798 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.203047 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.205773 24592 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:03.170241 31318 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.211455 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:03.212024 24524 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:03.212913 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.213781 24518 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:03.201678 31361 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:03.216770 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 187403us
I20260709 13:11:03.217989 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:03.219681 25210 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:03.206842 31549 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:03.219954 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.227093 30798 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:03.212468 31609 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.212049 31553 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:03.230950 24517 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:11:03.232367 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.210103 31415 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:03.220788 31605 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:03.238907 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:03.209373 31076 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:11:03.239617 30798 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.243191 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 111669us
I20260709 13:11:03.245966 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.221408 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:03.242604 31595 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:03.247109 24668 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:03.245663 31553 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:03.237985 31361 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:11:03.248309 31557 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.245833 31697 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:11:03.243034 31415 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.251423 31715 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.233307 31707 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.303468 31617 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:03.304497 31415 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.304739 31617 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:03.305235 31617 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:03.260835 24524 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
W20260709 13:11:03.273648 31709 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.001s
I20260709 13:11:03.267127 31605 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:03.299598 31718 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:03.239871 31710 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:03.301576 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.256654 31701 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.302973 31720 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:03.303364 31344 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:03.243084 31076 consensus_queue.cc:1243] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:11:03.268332 31549 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:03.307153 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:03.315726 31617 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.332723 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.243556 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:03.317412 31586 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:03.341343 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.320775 31720 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.344439 31720 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:03.347869 31701 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.349439 31710 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.350003 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 183252us
I20260709 13:11:03.334700 31610 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:03.354955 31722 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:11:03.358333 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 122334us
I20260709 13:11:03.359045 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.268982 31711 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.360992 31718 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.320963 31605 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.361997 31726 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:03.340968 31318 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.364596 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:03.367363 24524 pending_rounds.cc:85] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 12
I20260709 13:11:03.356038 31592 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.368119 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 125757us
W20260709 13:11:03.370297 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 101747us
I20260709 13:11:03.371435 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3774) took 1247 ms. Trace:
W20260709 13:11:03.378895 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.372440 24524 pending_rounds.cc:107] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:11:03.385996 24524 raft_consensus.cc:2889] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:03.374176 24672 rpcz_store.cc:276] 0709 13:11:02.123682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.136998 (+ 13316us) service_pool.cc:224] Handling call
0709 13:11:02.159624 (+ 22626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.190560 (+ 30936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.190592 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.694293 (+503701us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b18004bd780. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a
0709 13:11:02.695360 (+  1067us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b2c00173798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:11:02.702617 (+  7257us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.856710 (+154093us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:02.856732 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.856776 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.371217 (+514441us) raft_consensus.cc:1685] finished
0709 13:11:03.371242 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.371374 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"raft.queue_time_us":6769,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5099,"spinlock_wait_cycles":6187008,"thread_start_us":111615,"threads_started":1,"wal-append.queue_time_us":390427}
I20260709 13:11:03.386896 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:03.366032 31610 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:03.353034 31553 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.370187 31726 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:03.376822 31592 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.393326 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 149860us
I20260709 13:11:03.394765 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:03.402998 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:03.398854 24516 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:03.372231 31617 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:03.402756 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.398216 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:03.414237 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.416640 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.421409 31733 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:03.421835 24595 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:03.421934 31733 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:03.394440 31558 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.001s
I20260709 13:11:03.394932 31723 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:03.417564 24594 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:03.392976 31547 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:03.389442 31259 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:03.425581 24600 raft_consensus.cc:1240] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:11:03.393580 31727 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:03.387796 31586 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.441941 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.399350 31344 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:11:03.443532 31610 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.442590 24594 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:03.428794 31733 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:03.446393 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.446939 31725 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.447896 31715 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:03.422781 31318 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:03.429352 31723 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:03.465354 31725 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.470279 31723 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:03.472069 31725 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.475085 31318 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.476949 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.477415 31318 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:03.457976 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63297.6us
I20260709 13:11:03.478469 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:03.480185 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:03.435449 31727 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.481218 31727 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:03.429370 31558 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.483229 31707 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:03.453356 31726 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.459941 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 61890.3us
I20260709 13:11:03.460822 31592 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.431167 31259 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:11:03.464655 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.433727 31605 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:03.497148 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:03.469408 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:03.465706 31715 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:03.497262 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.469266 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.452611 31720 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.508827 24600 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:03.509987 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.511466 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.517202 24523 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:03.519327 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:03.520241 31737 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:03.497059 31719 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:11:03.504815 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.525306 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:03.526000 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.513042 31702 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:03.526427 31726 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:03.554488 30798 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.530937 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:03.532414 31557 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:03.534332 24521 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:03.516628 31548 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:03.521878 31571 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:03.544466 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:03.506880 31703 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:03.507987 31318 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:03.513751 31323 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.557765 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.534941 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.558831 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.562548 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.554536 31719 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:03.574744 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 43898.3us
I20260709 13:11:03.577314 24523 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:03.577396 24666 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:03.583917 24523 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:03.578337 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.587095 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:03.587275 31259 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.588032 31711 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:03.588269 31259 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.588513 31711 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.585127 24523 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.591728 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:03.595328 24665 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:03.596698 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.597425 24670 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:03.590792 30798 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:03.558101 31361 raft_consensus.cc:2764] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:11:03.600535 24523 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:03.599148 24669 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:03.558727 31737 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:03.563148 31571 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:03.559154 31702 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:03.565241 31558 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.617511 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:03.589766 31719 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:03.620338 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.621284 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:03.622151 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.610056 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.616230 24665 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:03.588974 31711 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:03.590639 31435 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.626780 24592 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:03.622727 24668 raft_consensus.cc:2368] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26.
I20260709 13:11:03.570716 31703 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.590564 31323 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.620606 31710 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:03.648116 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:03.624086 31547 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:11:03.653999 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.655381 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63749.1us
I20260709 13:11:03.656122 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:03.651206 31743 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:11:03.658320 31749 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:03.658993 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.625422 31549 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:11:03.643855 31725 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.644129 31466 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:03.644008 31594 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:03.662093 25184 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:03.597461 31715 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.667148 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.650172 31548 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:03.667346 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:03.617331 31737 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.679414 25214 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:03.668738 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.672483 24593 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:03.657140 31547 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:03.677799 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.680773 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.660732 31609 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:03.682300 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:03.636482 31435 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.687357 31435 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.688385 31594 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:03.689674 31594 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.693488 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:03.694823 31323 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.697531 31720 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:03.698506 31715 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.699795 31733 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.671749 31718 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:03.704111 31703 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.669174 31725 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.705973 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.706473 31725 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.666453 31710 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:03.707187 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.708298 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.676721 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.709167 31717 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:11:03.712260 31723 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.722216 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.723419 24674 raft_consensus.cc:2410] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:11:03.731249 24592 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
W20260709 13:11:03.732836 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.733343 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 67045.7us
I20260709 13:11:03.737728 24598 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:03.748806 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.749768 24596 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:03.751505 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.752266 24599 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:03.665724 31749 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:03.766000 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:03.750790 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.765945 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:03.770576 24523 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:11:03.771590 24523 pending_rounds.cc:85] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 15
I20260709 13:11:03.772090 24523 pending_rounds.cc:107] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:11:03.772547 24523 raft_consensus.cc:2889] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:03.775130 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.776050 24672 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:03.781765 25210 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:03.782119 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.784737 24593 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:03.789392 31737 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.789850 31749 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.771529 31466 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.791675 31466 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.793901 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:03.794234 31466 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.794915 24668 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:03.775543 31571 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.796183 31571 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:03.797164 31733 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:03.800447 31723 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:03.801481 31548 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.801777 31547 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.803555 31547 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:03.772483 31609 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:03.810019 31609 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.680255 31702 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:03.812500 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 74761.8us
I20260709 13:11:03.813246 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.815693 31318 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:03.815814 31287 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:03.816421 31318 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.816569 31724 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:03.817785 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.823292 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:03.825179 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 185755us
I20260709 13:11:03.833892 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:03.836001 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:03.818995 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:03.847566 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:03.848178 25218 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:03.851106 24593 raft_consensus.cc:2410] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:03.853468 25215 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:03.854179 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:03.857797 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:03.857267 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.863627 24524 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:03.864319 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:03.864861 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.866766 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:03.859575 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:03.870236 25219 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:03.871264 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:03.872172 25219 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:03.816430 31287 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:03.863129 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:03.876768 24597 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:03.879392 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.824661 31592 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:03.824492 31754 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:03.816953 31318 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.884093 31259 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:03.885145 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:03.888186 31553 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.891043 31718 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:03.873275 31715 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:03.893850 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.895751 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:03.894989 31415 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:03.868536 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:03.818624 31711 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.918134 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 49710.7us
I20260709 13:11:03.923746 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:03.924098 24671 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:03.924396 25216 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:03.930349 25215 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:03.908515 31710 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.824534 31724 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.941650 25213 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 22: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:03.909524 31259 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:03.916854 31415 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.946575 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:03.947253 25217 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:03.923759 31721 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:03.927062 31723 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:03.909539 31720 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:11:03.910023 31727 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.950088 31259 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.910558 31592 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:03.926020 31754 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:03.951938 31415 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:03.926767 31715 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.997839 31762 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:04.002933 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:04.003814 25219 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:03.981868 24517 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:04.003538 31259 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:04.005524 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.007180 31259 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:04.007347 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:04.008457 25214 raft_consensus.cc:2410] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:11:04.009212 31547 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.010200 31710 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:04.010933 31605 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:04.011384 31605 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:04.012253 31605 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:03.962039 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 95339.9us
I20260709 13:11:04.015280 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.004997 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:04.027243 24673 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:04.028450 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:04.031886 31716 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:04.033174 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:04.033387 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:04.033743 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:04.034477 24596 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:04.034554 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:04.013737 31287 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.035486 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:04.033905 24599 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:04.036558 31754 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:04.037547 31757 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:11:04.033917 24597 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:04.039901 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:04.041018 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:04.009743 31547 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:04.046342 25211 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:04.047093 25214 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 21 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:11:04.046954 25216 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:04.055696 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:04.056725 24668 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:04.058487 25214 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:04.061398 25214 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:11:03.956851 31721 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:04.068513 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 53307.3us
I20260709 13:11:04.069517 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:04.070700 24525 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:04.077726 24673 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:04.078969 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.086862 25214 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:04.072392 31548 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.091661 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:04.101790 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.105069 24599 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
W20260709 13:11:04.128880 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.195107 25219 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:11:04.198948 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 99187.7us
I20260709 13:11:04.199955 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:04.218156 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.238405 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.202385 24665 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:04.302172 24673 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:11:04.305203 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 203462us
I20260709 13:11:04.195171 31725 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:04.198534 31259 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.314857 24566 leader_election.cc:400] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26.
I20260709 13:11:04.202965 31605 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:04.319205 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 119314us
I20260709 13:11:04.322170 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:04.312703 31586 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.326926 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.298866 31318 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:04.328577 25218 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 13.
I20260709 13:11:04.328980 30798 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:04.329666 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.301925 31594 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:04.314388 31719 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.680s	user 0.015s	sys 0.002s
W20260709 13:11:04.314476 31571 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.008s
W20260709 13:11:04.321590 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3318543149999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:11:04.335179 24639 connection.cc:256] RPC call timeout handler was delayed by -1.3228636289999258s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:11:04.335459 24639 connection.cc:256] RPC call timeout handler was delayed by -1.2553636289999304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:11:04.335675 24639 connection.cc:256] RPC call timeout handler was delayed by -1.2211636289999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:11:04.335891 24639 connection.cc:256] RPC call timeout handler was delayed by -1.1041636289999133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:11:04.336103 24639 connection.cc:256] RPC call timeout handler was delayed by -1.0483636289999367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 13:11:04.323405 31586 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.316946 31725 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.339156 25218 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:04.340214 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:04.325702 31749 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:04.344633 31586 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:04.328650 31617 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.331622 31259 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:04.350525 31754 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:04.351043 31763 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:11:04.314538 31610 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:11:04.334592 31323 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:11:04.331763 31752 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:11:04.338279 31719 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.365242 31727 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:04.366519 25215 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:04.367152 31592 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:04.367966 31415 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.356851 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:04.342490 31725 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:04.373914 24668 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:04.337218 31755 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.339334 31724 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:04.370527 31760 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:11:04.393419 31764 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.394356 31415 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:04.370201 31259 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:04.360009 31749 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:04.407059 24593 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:04.407051 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:04.407622 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:04.456538 24598 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:04.456672 24524 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:04.407663 31721 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:04.458153 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:04.415791 31756 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.524s	user 0.000s	sys 0.010s
I20260709 13:11:04.449837 24595 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:04.470381 24591 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:04.465731 24517 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:04.399437 31715 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:04.467118 24597 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:04.453194 31259 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:04.517802 25217 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.000s
I20260709 13:11:04.518292 25217 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:04.535965 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:04.541782 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:04.545240 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 205587us
I20260709 13:11:04.546010 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.547439 31571 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:04.547600 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.548764 31571 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:04.451243 31764 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.554173 31716 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.578138 31716 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:04.581051 31716 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:04.584502 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 43702.9us
I20260709 13:11:04.589654 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:04.568401 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:04.584978 31752 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:04.592473 31724 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:04.592602 31755 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:04.592760 31752 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:04.592976 31724 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:04.593444 31752 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:04.593585 31724 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:04.557943 31770 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:11:04.594542 31752 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.596006 31752 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:04.575049 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:04.597915 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:04.598562 24521 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:04.598433 31707 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:04.567983 31771 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:11:04.602634 31707 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:04.604050 24671 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:11:04.553283 31323 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:11:04.576229 31719 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:04.568845 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:04.611027 24521 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 26.
I20260709 13:11:04.577333 31749 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.549049 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:04.615619 31744 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:04.616047 31744 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:04.616603 31744 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.618888 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:04.591351 24520 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
W20260709 13:11:04.615996 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 67015.7us
I20260709 13:11:04.631788 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.632947 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:04.633855 24599 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:04.639102 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.632884 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:04.640748 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:04.655649 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:04.658669 24599 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:04.662436 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:04.667304 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:04.571532 31764 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:04.608791 31259 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:04.665706 31718 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:04.707898 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:04.654281 31701 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:11:04.712301 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45104.7us
W20260709 13:11:04.717736 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 377564us
I20260709 13:11:04.718958 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:04.661736 31702 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:04.654803 31707 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:11:04.654992 31721 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:04.708667 31718 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.665721 31571 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.746042 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:04.663290 31755 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260709 13:11:04.743412 31727 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:04.764771 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:04.768533 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:04.744060 31702 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.665995 31716 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:11:04.750411 31764 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.712037 31701 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:04.751001 31605 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:04.774125 31702 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:04.787266 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 79459.2us
I20260709 13:11:04.763600 31718 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:04.791486 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 150849us
W20260709 13:11:04.794410 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.795020 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.824533 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.767930 31571 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.789268 31775 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:04.793968 31727 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:04.823513 31749 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:04.827939 31764 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:04.793504 31724 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:04.849586 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 81145us
I20260709 13:11:04.857314 31755 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.874256 31749 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:04.881172 31605 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:11:04.892508 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 68047.5us
I20260709 13:11:04.894905 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.881249 31780 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:04.898914 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.870114 31701 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.896862 31782 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:04.899822 31727 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:04.909431 31778 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:11:04.903002 31787 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.953608 31787 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.954146 24674 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:04.955681 31787 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:04.956220 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:04.956971 24668 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 13: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:04.957901 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:04.958498 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1555) took 1089 ms. Trace:
I20260709 13:11:04.959331 24672 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:04.959051 25215 rpcz_store.cc:276] 0709 13:11:03.869326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.884858 (+ 15532us) service_pool.cc:224] Handling call
0709 13:11:04.958335 (+1073477us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b54003903d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:04.958442 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47428352}
I20260709 13:11:04.919411 31792 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:04.898214 31780 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:04.934933 31728 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:11:04.936503 31766 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.615s	user 0.003s	sys 0.007s
I20260709 13:11:04.938539 31547 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:04.940486 31605 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:04.992813 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 96999.5us
I20260709 13:11:04.943001 31701 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:04.944540 31571 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:04.946236 31765 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.635s	user 0.000s	sys 0.010s
I20260709 13:11:04.945488 31749 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.891638 31755 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.899080 31781 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:04.900538 31259 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:04.947631 31350 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:04.947897 31724 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:04.948477 31782 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.975054 24667 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:04.975895 31744 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:04.969635 31789 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:04.969771 31780 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:04.978514 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:04.992115 31783 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
W20260709 13:11:04.967516 31725 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
W20260709 13:11:04.994321 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 88390.1us
I20260709 13:11:04.924798 31790 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.999547 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:04.970072 31728 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:05.021533 31755 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.022543 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1548) took 1201 ms. Trace:
I20260709 13:11:04.970660 31702 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:05.023365 31785 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:11:05.014961 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 124583us
I20260709 13:11:05.027088 24592 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:05.006705 31707 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.037936 25212 rpcz_store.cc:276] 0709 13:11:03.821244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.821388 (+   144us) service_pool.cc:224] Handling call
0709 13:11:03.848164 (+ 26776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.875897 (+ 27733us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:03.903579 (+ 27682us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.069797 (+166218us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.083224 (+ 13427us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.083347 (+   123us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:04.083588 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.083835 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.083926 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.403108 (+319182us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b18000c1b40. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:04.935827 (+532719us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:05.022333 (+ 86506us) raft_consensus.cc:1685] finished
0709 13:11:05.022362 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.022486 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7578,"prepare.queue_time_us":29973,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":5404,"raft.queue_time_us":312,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":32914,"spinlock_wait_cycles":236003968,"thread_start_us":141330,"threads_started":1,"wal-append.queue_time_us":187994}
I20260709 13:11:05.007790 31553 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260709 13:11:05.008235 31350 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:05.045023 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.037194 31720 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.049016 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.053417 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:05.058622 25215 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 22: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:05.053472 31549 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:05.007386 31751 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:11:05.062753 24592 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:05.059764 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:05.065330 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.066133 24524 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:05.067550 24671 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:05.043088 31259 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:05.070331 25217 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:05.068606 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.078997 25213 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:05.068264 31549 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.083294 31549 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.039206 31725 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:05.097038 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 48077.8us
I20260709 13:11:05.097853 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.098594 24525 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:05.072717 31724 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.080281 31755 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:05.057121 31720 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.076905 31798 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.103902 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:05.056147 31707 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.106268 24520 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:05.107719 31744 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.037962 31789 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.100113 31792 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:05.112303 31795 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.103420 31549 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.100425 31728 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.112548 31702 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.106326 31790 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:05.170233 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 72458.8us
I20260709 13:11:05.212118 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:05.104408 31755 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:05.114845 31792 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.180892 31807 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.106178 31724 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.116786 31751 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:05.184010 31796 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.109475 31798 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.185889 31780 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.175015 31259 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:05.214663 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:05.219094 24520 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:05.239598 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.240239 24592 raft_consensus.cc:2368] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:05.172246 31744 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.192808 31782 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.104333 31350 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.196470 31789 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.229918 31553 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.170976 31718 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.239329 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:05.249034 24597 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:05.249850 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:05.240239 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.250955 24593 raft_consensus.cc:2393] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 25: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:05.251098 24666 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:05.226181 31792 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:05.252115 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.171886 31549 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.244383 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.232470 31790 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:05.168790 31795 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.231208 31719 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:05.258716 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.259348 24592 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:05.253625 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:05.254436 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:05.252802 24600 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:05.228807 31592 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:11:05.242877 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:05.241667 31571 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:05.279297 24597 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:05.279729 24522 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:05.280792 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:05.281349 24522 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:11:05.264873 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.266307 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:05.248443 31702 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:11:05.271744 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.285671 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.287703 24522 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:05.234187 31751 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.290198 31751 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.290323 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:05.290907 24593 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.290936 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:05.291872 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.294320 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:05.295800 24592 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:05.298009 24593 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:05.300164 31781 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.261737 31719 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.303274 31719 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.304145 31801 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:05.304603 31753 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.381s	user 0.000s	sys 0.006s
I20260709 13:11:05.260670 31350 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.311493 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.312270 25211 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:05.249233 31744 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.313647 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3700) took 1252 ms. Trace:
I20260709 13:11:05.315225 24490 leader_election.cc:400] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:05.315928 24490 leader_election.cc:403] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:05.320252 24594 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:05.324074 31707 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:05.324621 31549 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.262058 31755 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.313323 31725 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.325366 31744 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.325671 31755 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:05.255614 31553 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.326612 31798 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.324795 31724 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.304867 31800 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.314015 24516 rpcz_store.cc:276] 0709 13:11:04.061708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.061903 (+   195us) service_pool.cc:224] Handling call
0709 13:11:04.078501 (+ 16598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.078839 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:04.951986 (+873147us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b180031ab60. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf 00007f17bbf60038
0709 13:11:05.061408 (+109422us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.226910 (+165502us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.227378 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.227523 (+   145us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:05.227556 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.227621 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:05.306128 (+ 78507us) raft_consensus.cc:1685] finished
0709 13:11:05.313457 (+  7329us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:05.313590 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43557,"prepare.queue_time_us":282500,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":22171,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":23588,"spinlock_wait_cycles":5915520,"thread_start_us":240698,"threads_started":2,"wal-append.queue_time_us":153378}
I20260709 13:11:05.270265 31715 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.231170 31807 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.335662 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:05.277567 31610 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:05.300652 31781 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.311358 31717 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:05.332106 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:05.344799 31820 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:05.347491 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:05.237529 31796 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.349642 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:05.353938 24596 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:05.354007 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.357343 25211 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:05.342917 31610 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:05.342051 31720 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:05.366446 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.367112 24596 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:05.301347 31790 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.341650 31813 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:05.365260 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:05.347863 31806 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:05.352290 31749 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:05.341876 31715 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.360033 31609 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.340026 31800 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.360517 31798 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:05.353228 31802 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.352295 31744 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.358793 31717 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:05.372049 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:05.370527 24594 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:05.363673 31610 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.404444 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.340287 31259 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.407675 25211 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:05.404695 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.403266 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:05.410714 25215 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:05.370780 31549 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:05.382164 31350 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.474432 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.378177 31780 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.382367 31798 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:05.373140 31810 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:05.369671 31820 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:11:05.376374 31818 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.383270 31553 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.513794 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:05.369558 31720 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.381194 31749 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.380455 31800 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:05.519920 31750 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:05.520459 31815 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:05.520912 31812 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.521440 31814 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:05.369500 31797 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.292s
I20260709 13:11:05.474432 31617 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:05.535791 31807 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.382897 31796 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.536813 31717 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.541002 31819 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:05.376060 31806 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.515327 31350 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.375958 31609 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.572326 31710 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.540771 31549 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:05.610181 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 274593us
I20260709 13:11:05.522185 31808 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.408416 31744 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.548143 31718 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.603483 31749 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.547737 31820 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:05.647204 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.610622 31750 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.605290 31810 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:05.602806 31592 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:05.621598 31617 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.621312 31797 consensus_queue.cc:1243] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:05.516058 31813 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.123s
I20260709 13:11:05.617350 31795 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.655385 31800 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:05.645732 31710 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.662237 31725 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:05.625690 31814 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:05.650873 31605 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.612012 31720 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.661679 31750 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:05.685714 31780 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:05.684891 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.708137 31605 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.725477 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:05.726226 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 315050us
I20260709 13:11:05.661226 31617 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.709738 31710 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.611441 31818 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.728272 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.728945 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.620507 31812 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.731766 25215 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
W20260709 13:11:05.733355 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.686376 31795 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:05.736953 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 86760us
I20260709 13:11:05.664945 31592 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.648859 31819 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.728734 31800 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:05.650672 31808 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:05.742591 31727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.011s	sys 0.037s
I20260709 13:11:05.734467 31802 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:05.735026 31815 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.735683 31571 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:05.754770 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:05.759531 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:05.742651 31549 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.747519 31795 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:05.756958 31727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.011s	sys 0.037s
I20260709 13:11:05.766546 31350 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.767951 31592 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.730357 31824 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:05.710546 31725 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.682126 31798 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.744977 31796 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:05.771633 31825 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:11:05.800827 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.750065 31781 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:05.829972 31826 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:05.834756 31838 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:05.830291 31701 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.000s
I20260709 13:11:05.815208 31724 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.813197 31710 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:05.724704 31820 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.915549 31744 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.916298 31838 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.917441 31724 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.918795 31838 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.919714 31724 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.917475 31808 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.899382 31789 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:11:05.902043 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.921515 31725 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.921661 31808 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.922257 31808 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.924430 31808 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:05.925338 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.926239 31812 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.776417 31815 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.813678 31800 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:05.927203 31720 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.928418 31815 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:05.928701 31818 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.902556 31796 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.930517 31819 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.930889 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.931372 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.932482 31796 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.933209 31605 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:05.933506 24593 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:05.933578 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.934751 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.936506 31806 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.776031 31810 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.939635 31711 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:05.915297 31701 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.916261 31710 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:05.940879 31701 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:05.931499 24594 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:05.911299 31814 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:05.937613 31792 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
I20260709 13:11:05.942947 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:05.837172 31786 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.920s	user 0.001s	sys 0.009s
I20260709 13:11:05.789959 31595 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:05.901436 31795 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:05.964224 24668 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:05.964586 24594 pending_rounds.cc:85] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 9
I20260709 13:11:05.964968 24594 pending_rounds.cc:107] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 13:11:05.964921 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:05.965480 24594 raft_consensus.cc:2889] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.914394 31547 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.948845 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:05.966778 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:05.949753 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:05.950574 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:05.959798 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.960315 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.970641 25215 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:05.970767 24597 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:05.972244 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:05.974064 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:05.957567 31755 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.000s
I20260709 13:11:05.995497 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.998209 25215 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:05.998484 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.996920 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:05.995918 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.000885 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.007912 24672 raft_consensus.cc:2393] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:06.008327 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.008764 25215 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:06.010098 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.009382 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:06.010749 25218 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:06.011292 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.913635 31617 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.012506 25211 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:06.017553 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:06.019789 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.017814 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.018479 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.021216 24672 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:06.020473 25210 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 13.
I20260709 13:11:06.020505 25216 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:06.022593 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.024143 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:06.024685 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:05.957298 31610 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.002275 31724 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.029421 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:06.029507 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.031553 31702 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.033135 24672 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:06.012995 31720 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:06.007334 31710 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:06.037806 25210 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:06.038374 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.019246 31592 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:06.042116 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.044063 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.012406 31727 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:06.063607 24600 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:05.950778 31792 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.041453 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.050035 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:05.999821 31795 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:11:05.994565 31547 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.063247 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.047899 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.001331 31750 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.066435 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:06.073871 25218 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:06.074030 24593 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:11:06.075152 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:06.075465 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.076344 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:06.045985 31720 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:06.078302 24593 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:06.080772 24667 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:06.082831 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:06.082964 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.085292 31791 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.085700 31791 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.086052 31791 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.089296 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1468) took 1423 ms. Trace:
I20260709 13:11:06.089551 24596 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:06.079059 31810 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:06.090939 31810 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.089745 24599 rpcz_store.cc:276] 0709 13:11:04.666431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.666573 (+   142us) service_pool.cc:224] Handling call
0709 13:11:04.666900 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:04.704015 (+ 37115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.704048 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:05.828484 (+1124436us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b2c00170da8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:11:05.901849 (+ 73365us) log.cc:844] Serialized 52 byte log entry
0709 13:11:06.030599 (+128750us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:06.031027 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.031311 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.032040 (+   729us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.088972 (+ 56932us) raft_consensus.cc:1685] finished
0709 13:11:06.089106 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.089242 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6476,"prepare.queue_time_us":1557,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":36940,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":15990,"spinlock_wait_cycles":13944192,"thread_start_us":128343,"threads_started":1,"wal-append.queue_time_us":185113}
I20260709 13:11:06.091279 31810 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.072156 31727 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.094988 31727 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:06.044064 31749 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.098568 31791 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.097030 31749 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.100651 31791 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.102133 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.103781 24668 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:06.083431 24593 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
W20260709 13:11:06.104857 24524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2463) took 1503 ms (client timeout 1606 ms). Trace:
W20260709 13:11:06.105266 24524 rpcz_store.cc:269] 0709 13:11:04.601677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.618558 (+ 16881us) service_pool.cc:224] Handling call
0709 13:11:06.104714 (+1486156us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b540021dc54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:06.104808 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858944384}
I20260709 13:11:06.047910 31724 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.106853 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.081768 31720 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.119259 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:06.111891 31727 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:06.120584 31727 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:06.122638 31788 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.204s	user 0.009s	sys 0.005s
I20260709 13:11:06.122807 31727 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.124367 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1469) took 1457 ms. Trace:
I20260709 13:11:06.124477 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:06.124713 24591 rpcz_store.cc:276] 0709 13:11:04.666762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.666919 (+   157us) service_pool.cc:224] Handling call
0709 13:11:04.711857 (+ 44938us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:04.712214 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.712245 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:04.748885 (+ 36640us) log.cc:844] Serialized 52 byte log entry
0709 13:11:04.854611 (+105726us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:04.881824 (+ 27213us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.882641 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.882744 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.122096 (+1239352us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:06.124065 (+  1969us) raft_consensus.cc:1685] finished
0709 13:11:06.124166 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.124302 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26932,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":2263,"raft.queue_time_us":655,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":34252,"spinlock_wait_cycles":112600448,"thread_start_us":71161,"threads_started":1,"wal-append.queue_time_us":153520}
I20260709 13:11:06.126814 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:06.127295 24591 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.129226 31749 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:06.129649 31749 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.130025 31749 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:06.130617 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1614) took 1177 ms. Trace:
I20260709 13:11:06.130971 24666 rpcz_store.cc:276] 0709 13:11:04.953667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.958677 (+  5010us) service_pool.cc:224] Handling call
0709 13:11:04.975678 (+ 17001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.251509 (+275831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.130400 (+878891us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540017fa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:06.130564 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633012608}
I20260709 13:11:06.134349 24591 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:06.135003 31715 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.119861 25212 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.067617 31592 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.103415 31818 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.125097 24593 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.147470 25210 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:06.116490 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.147115 24591 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:06.141685 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.108103 31701 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.155732 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:06.150352 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.159619 25218 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:06.169360 25185 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.171834 25212 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:06.173859 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:06.177380 31710 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:11:06.185499 31710 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:06.186931 31842 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:11:06.188689 31848 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:06.161020 31727 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:06.190346 31718 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:06.191901 31610 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.192606 31725 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:06.172487 31711 raft_consensus.cc:2764] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:11:06.196310 31792 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.198514 31724 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:06.200143 31750 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.202347 31592 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:06.207873 24591 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:06.208884 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:06.209445 24591 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:06.216084 24591 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:06.202402 31744 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:06.217651 31744 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:06.218698 31744 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.220000 31744 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:06.155157 31818 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.232082 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.159339 31754 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:06.240253 24593 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:06.236752 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:06.246134 24591 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:06.254966 31834 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:06.255954 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:06.259487 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.259933 24673 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:06.260111 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:06.261480 24671 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:06.258272 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.262579 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.263402 24668 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:06.220714 31749 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.274665 24591 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:06.286542 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.287218 24668 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 15.
I20260709 13:11:06.289415 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:06.289983 24668 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:06.260910 31795 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:06.264330 31834 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:06.307039 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.264979 31754 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:11:06.313438 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.313763 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.310098 24671 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:06.257754 31755 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:11:06.320797 24668 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:06.321789 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.283000 31843 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:11:06.315964 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 142201us
I20260709 13:11:06.344092 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.307050 31617 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.346947 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.345679 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.348282 24668 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:06.349462 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.349946 24592 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:06.353222 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.356382 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.321489 31795 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:06.355939 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.361188 24668 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:06.339476 31764 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.358026 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.362855 24525 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:11:06.359479 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.360035 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.339331 31847 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.368686 31847 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.371137 31847 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.371799 31727 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:06.374577 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.375978 24669 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:06.376430 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.376938 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.377655 24669 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:06.377527 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.378075 24670 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:06.378528 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:06.378798 31592 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:06.379637 31592 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.382457 31711 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:06.385603 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.386210 24672 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:06.390297 31711 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:06.395318 31749 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.395625 24672 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:11:06.397116 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.398926 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.400933 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.407930 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:06.416031 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:06.416649 24671 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.416406 31720 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.403311 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.418265 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:06.419114 24672 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:06.420289 24672 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:06.316349 31834 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.423128 31834 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:06.423831 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.424625 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.424857 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.425279 31725 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:06.425930 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.426497 24523 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:06.426378 31725 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:06.427376 31725 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:06.427757 31725 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:06.428560 31856 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:11:06.429533 31724 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:06.429553 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.430119 31724 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:06.431109 31821 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:06.339243 31814 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:06.347631 31833 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:06.347451 31752 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.429456 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.431058 31724 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.436383 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.455371 31724 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:06.456645 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.360203 31710 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.097s
I20260709 13:11:06.457846 31824 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:06.458705 31824 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:06.459040 31824 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:06.459805 31824 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.460343 31547 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.465138 31824 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:06.364223 24524 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 22: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:06.432152 31814 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.477625 24518 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:06.479626 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.476794 31814 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.438745 31810 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.439117 31752 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.482373 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:06.483006 31752 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.483944 25218 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:06.439484 31605 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:06.484442 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:06.439845 31833 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.484823 24491 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.485678 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:06.486057 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:06.486488 31711 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:06.486869 31711 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:06.487164 31833 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.489235 31810 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.440438 31792 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.491684 31792 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.492363 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:06.493270 31801 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:06.493520 31784 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.587s	user 0.002s	sys 0.006s
I20260709 13:11:06.494068 31792 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:06.493985 31801 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:06.494663 31801 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.495138 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3707) took 1842 ms. Trace:
I20260709 13:11:06.495639 24521 rpcz_store.cc:276] 0709 13:11:04.652879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.653054 (+   175us) service_pool.cc:224] Handling call
0709 13:11:04.655975 (+  2921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.664148 (+  8173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.664192 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.704371 (+ 40179us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.826033 (+121662us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:04.826072 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.826136 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.492791 (+1666655us) spinlock_profiling.cc:243] Waited 60.1 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:06.494812 (+  2021us) raft_consensus.cc:1685] finished
0709 13:11:06.494840 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.495071 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10025,"raft.queue_time_us":52256,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3152,"spinlock_wait_cycles":138326400,"thread_start_us":121208,"threads_started":1,"wal-append.queue_time_us":185289}
I20260709 13:11:06.497769 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.484920 31605 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.498927 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.499907 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.499996 31605 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.500547 24521 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:06.501060 25216 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:06.495167 31801 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:06.501989 24667 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:06.502360 31720 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:06.502681 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.503809 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.504949 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.505733 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:06.506945 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:06.443444 31754 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.445847 31795 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.441545 24671 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:06.447377 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.448606 31818 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.357357 31843 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:11:06.450006 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.449880 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:06.450168 31716 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.517266 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.517179 31716 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.517462 31843 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.519281 31716 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.519539 24524 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:06.428771 31725 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.454238 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:06.521386 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74104.1us
I20260709 13:11:06.522620 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:06.457404 31571 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.473459 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.437574 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.487226 31711 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:06.440820 31764 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.480682 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.505575 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:06.521392 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.532620 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.511593 31801 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.448244 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.523330 24521 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:06.516171 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:06.529361 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:06.566100 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.529317 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:06.568110 24524 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:11:06.533288 24672 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:06.531044 31752 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:06.521620 31716 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:06.593995 25182 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:06.627072 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 97812.9us
I20260709 13:11:06.627828 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.630553 24516 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
W20260709 13:11:06.632483 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 66465.9us
I20260709 13:11:06.637243 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.531833 31810 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:06.640578 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:06.584945 31605 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:06.649114 24523 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:11:06.640079 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:06.647706 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.650662 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:06.651397 24521 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:06.652047 24522 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:06.585160 31752 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.655261 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.657541 25182 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.656342 31323 raft_consensus.cc:2764] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:11:06.660209 31744 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.660619 31744 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:06.660988 31744 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.662750 24672 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:06.636670 31607 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:06.639345 31821 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:06.633606 31710 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.665208 31727 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.637629 31725 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:06.666962 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.667318 31801 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.639230 31824 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:06.668956 31829 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:06.669565 31716 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.669647 31821 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.670281 31821 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:06.671224 31744 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.666033 31710 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:06.631948 31840 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.665334 31607 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:06.673396 31710 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:06.673705 31744 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.673657 31607 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.674371 31710 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.639083 31750 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:06.678221 31750 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.680246 31750 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.681030 25212 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:11:06.642880 31810 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.682628 31810 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:06.684616 31829 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:06.690948 31821 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.566776 31814 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:11:06.531133 31774 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 13:11:06.698072 31724 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:06.696836 31607 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.700377 31728 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.702472 31607 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.704327 31774 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.704813 31774 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.705552 31821 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.641390 31860 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:06.638873 31749 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:06.706909 31774 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.706700 31749 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.655556 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.665207 31764 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:06.711934 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 56493.6us
W20260709 13:11:06.718264 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 286273us
I20260709 13:11:06.722267 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:06.709369 31792 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:06.712481 31744 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:06.736613 24599 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:06.737015 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.711141 31752 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:06.653585 31592 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 13:11:06.737982 25216 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:06.673605 31840 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.725930 31792 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.753319 31792 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:06.726084 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:06.762348 24523 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:06.733721 31824 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:11:06.739760 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:06.742168 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:06.742481 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:06.770380 24599 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:06.774259 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:06.774480 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.774821 25211 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:06.776003 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:06.800966 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.739441 31801 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:11:06.766036 24637 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:06.805321 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.766535 31779 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.849s	user 0.009s	sys 0.009s
I20260709 13:11:06.765632 31744 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.814415 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:06.766969 31711 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.829036 24596 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:06.817478 31605 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:06.872658 25211 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:11:06.825261 31824 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:06.883148 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60201.2us
I20260709 13:11:06.837922 31744 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.829483 31782 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:06.840715 31749 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.875660 31829 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.875739 31605 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:11:06.893527 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 236076us
I20260709 13:11:06.894070 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:06.898397 24519 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:11:06.896401 31782 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.903262 31782 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:06.897593 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.909315 31866 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:11:06.911168 31605 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.912405 31605 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:06.914211 31711 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:06.918756 31794 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 2.000s	user 0.000s	sys 0.013s
I20260709 13:11:06.920259 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1471) took 2085 ms. Trace:
I20260709 13:11:06.920632 24595 rpcz_store.cc:276] 0709 13:11:04.834807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.834982 (+   175us) service_pool.cc:224] Handling call
0709 13:11:04.835358 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.835757 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:04.835794 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.836244 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.894590 (+ 58346us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:04.894761 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.894898 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.918230 (+2023332us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:06.919999 (+  1769us) raft_consensus.cc:1685] finished
0709 13:11:06.920019 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.920201 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":34176,"spinlock_wait_cycles":114353152,"thread_start_us":20923,"threads_started":1,"wal-append.queue_time_us":70157}
I20260709 13:11:06.354856 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:06.923561 31715 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.924044 31715 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:06.924907 31830 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:06.925309 31830 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:06.926153 31830 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.928093 31830 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.934029 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.939774 31728 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:06.939913 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:06.940228 31728 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.940639 31728 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.940968 31609 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:06.941577 31609 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:06.941928 31609 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.942260 31609 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.896608 31829 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.943933 31860 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:06.944993 31725 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:06.945451 31725 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:06.946242 31829 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.946295 31725 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.947515 31725 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:06.950129 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2131) took 1662 ms. Trace:
I20260709 13:11:06.950531 24600 rpcz_store.cc:276] 0709 13:11:05.287239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.288798 (+  1559us) service_pool.cc:224] Handling call
0709 13:11:05.289217 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.071213 (+781996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.949879 (+878666us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54001caf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:06.950060 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780533632}
I20260709 13:11:06.952040 31728 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:06.960006 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 194079us
I20260709 13:11:06.885619 31824 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.976302 31803 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:06.977545 31840 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.981598 31824 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:06.982020 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.982339 31607 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.982906 31607 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.984670 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:06.986505 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:06.987123 24600 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:06.987622 31728 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:06.966535 31792 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.961742 31549 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:06.982029 31810 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:06.990195 31792 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.990758 31607 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.991834 31810 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:06.993438 31609 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:07.000269 31863 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.579s	user 0.000s	sys 0.003s
I20260709 13:11:07.005436 31820 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:07.005527 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:07.006557 31435 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:11:07.007541 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45659.7us
I20260709 13:11:07.008219 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.006951 31435 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.009193 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:07.009744 31435 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:07.009985 31790 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:07.011883 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.013929 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:07.030988 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.020867 24594 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:07.012229 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.013055 31782 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.039228 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.036046 24599 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:11:07.020355 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.040671 24592 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:07.026186 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.042515 24597 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:07.031960 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:07.044476 24595 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:07.047528 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:07.017970 31824 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:07.040201 24594 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:07.021675 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:07.017710 31834 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:07.051210 24599 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:07.015913 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:07.038791 31571 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:07.058933 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:07.061887 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.042562 31549 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:07.069305 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.071508 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.068593 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.017272 31792 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:11:07.045935 31609 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:07.101912 24599 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:07.058591 31834 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.042248 31782 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:07.115134 31782 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:07.021802 31790 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.121496 31790 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:07.106104 24592 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:07.107095 31752 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.124413 31752 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:07.112206 31715 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:07.129681 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.132231 25217 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:07.132295 31795 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:07.132787 31795 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:07.137023 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.135908 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:07.137635 24597 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:07.139752 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.137645 24598 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:07.142032 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.144757 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.145560 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.145766 25210 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:07.145961 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.146358 24597 raft_consensus.cc:2410] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:07.145501 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:07.145457 25211 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:07.147346 24593 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:07.148046 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.148703 24596 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:07.149415 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:07.152207 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.152961 24519 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:07.153601 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.154320 24521 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:07.158100 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.163275 24599 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:11:07.170053 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:07.170665 25217 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:07.172645 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:07.174453 24594 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:11:07.174866 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:07.179221 24593 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:07.183077 25217 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:07.185067 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.185431 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:07.186170 24522 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.138290 31834 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:07.104784 31801 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:07.190068 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.194339 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:07.199218 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.200024 31724 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:07.201702 31885 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:07.203243 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.105006 31886 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.105s
I20260709 13:11:07.173941 31711 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:07.215891 24599 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:07.188133 31710 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:07.203574 31875 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:07.231079 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:07.231899 24597 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:07.213690 31807 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:07.209359 31717 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:07.231135 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:07.242028 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 226166us
I20260709 13:11:07.259703 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:07.245321 24522 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:07.209400 31801 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:07.260020 24593 raft_consensus.cc:2410] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 13:11:07.260031 24517 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:07.213449 31792 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:07.197028 31798 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:11:07.228487 31847 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.229383 31710 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:07.274576 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.236200 31875 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:07.276163 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.240226 31807 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:07.228847 31830 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:11:07.267817 31711 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:07.277992 31847 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:07.278298 31818 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:07.278592 31711 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.278203 31807 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:07.264885 31810 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:07.265534 31592 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:07.266352 31792 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:07.288506 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.268016 31775 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:07.291235 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.295856 24597 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:07.298244 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:07.301443 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.302479 24522 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:07.302254 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.276029 31710 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.315831 24597 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:07.315286 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:07.280754 31875 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:07.262668 31435 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.296299 31830 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:11:07.321149 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.325426 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.326347 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.327440 24668 raft_consensus.cc:2410] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:07.296592 31818 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:07.333141 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:07.334124 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.286962 31810 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:07.334786 24670 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:07.274006 31752 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:11:07.296859 31775 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:07.338555 24670 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:11:07.341195 24595 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 25: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:07.341027 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:07.341784 24522 raft_consensus.cc:2376] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22. Re-sending same reply.
I20260709 13:11:07.342895 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.344923 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:07.281904 31717 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:11:07.312465 31840 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:11:07.336705 31810 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:07.333715 31883 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.282337 31548 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.056s
I20260709 13:11:07.328390 31715 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:07.328570 31820 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:07.350433 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3822) took 1072 ms. Trace:
I20260709 13:11:07.343641 24523 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:07.341835 31775 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.329423 31801 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.353309 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.355930 24668 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:07.380934 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.402593 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.356505 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.348134 31792 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:07.407075 31792 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:07.407680 31890 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:07.409390 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:07.409917 24673 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:07.410734 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.411513 31893 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:07.413519 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.414060 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:07.414641 24672 raft_consensus.cc:2410] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:11:07.414819 31893 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:07.415387 31893 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:07.415843 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.416460 31724 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:07.416314 31893 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.417029 24520 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:11:07.354105 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 293844us
I20260709 13:11:07.418267 24520 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:11:07.364775 24670 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:11:07.355854 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 152706us
I20260709 13:11:07.421819 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.422134 24597 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:07.422901 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.407660 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:07.355495 24666 rpcz_store.cc:276] 0709 13:11:06.277817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.278238 (+   421us) service_pool.cc:224] Handling call
0709 13:11:06.306473 (+ 28235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.422142 (+115669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.422175 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.422219 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:06.422251 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.350225 (+927974us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540044e154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:07.350271 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.350380 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265539968}
I20260709 13:11:07.423983 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.403697 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:07.356520 31820 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.379841 31435 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:07.352272 31711 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:07.425071 24673 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:07.425495 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:07.425552 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:07.427744 25211 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:07.428036 24599 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.428223 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:07.425849 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.430377 24670 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:07.425849 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:07.431819 24594 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:07.424953 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.405077 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.370622 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.433890 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:07.394124 31889 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:11:07.443920 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:07.379920 31854 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.959s	user 0.000s	sys 0.004s
I20260709 13:11:07.405910 31775 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.414690 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:11:07.422783 31723 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.009s	sys 0.027s
I20260709 13:11:07.443723 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.462023 24673 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:07.424271 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:07.442958 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.426074 31901 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:07.448280 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:07.426261 31820 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.449150 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:07.474866 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 50646.6us
I20260709 13:11:07.445636 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:07.476985 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:07.477717 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:07.450572 25210 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:07.479470 24592 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:07.481757 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50164 (request call id 3722) took 1161 ms. Trace:
I20260709 13:11:07.482180 24516 rpcz_store.cc:276] 0709 13:11:06.320079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.321497 (+  1418us) service_pool.cc:224] Handling call
0709 13:11:07.481546 (+1160049us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400278dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:07.481685 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667421056}
I20260709 13:11:07.483822 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.466033 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.486300 24670 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
W20260709 13:11:07.467401 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.487392 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:07.484413 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:07.484699 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.482676 25211 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:07.488952 24666 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:07.489929 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.490531 25219 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:07.491976 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.428612 24523 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:07.495191 24600 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:07.495785 24599 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:07.497023 24596 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 17. (term mismatch)
I20260709 13:11:07.497545 24596 pending_rounds.cc:85] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 16
I20260709 13:11:07.497828 24596 pending_rounds.cc:107] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 25.17
I20260709 13:11:07.498160 24596 raft_consensus.cc:2889] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.499505 24520 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:07.501968 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:07.443504 31725 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:07.502832 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.503558 24670 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:07.504112 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:07.504444 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:07.461796 31723 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.010s	sys 0.028s
I20260709 13:11:07.460055 31724 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:07.507344 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:07.506553 24668 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:07.511982 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.513144 25212 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:07.462677 31894 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.512738 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:07.512208 31824 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:07.515592 31891 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:11:07.507856 31892 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:07.362968 31883 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:07.516789 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:07.495575 31818 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:07.525868 24668 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:07.528084 31810 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.533973 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1950) took 1492 ms. Trace:
I20260709 13:11:07.534281 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:07.535389 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:07.536219 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1640) took 1061 ms. Trace:
I20260709 13:11:07.536458 31549 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:07.537448 31549 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:07.536677 24674 rpcz_store.cc:276] 0709 13:11:06.474753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.817676 (+342923us) service_pool.cc:224] Handling call
0709 13:11:06.818374 (+   698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.071433 (+253059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.071477 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.105661 (+ 34184us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.349798 (+244137us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:07.349850 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.349921 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.535989 (+186068us) raft_consensus.cc:1685] finished
0709 13:11:07.536014 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.536160 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11000,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2916,"thread_start_us":494119,"threads_started":2,"wal-append.queue_time_us":402812}
I20260709 13:11:07.537866 31549 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.538379 31549 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:07.511688 31744 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:11:07.520499 31824 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:07.512364 31792 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:07.534384 25214 rpcz_store.cc:276] 0709 13:11:06.046379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.050249 (+  3870us) service_pool.cc:224] Handling call
0709 13:11:06.050525 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.071431 (+ 20906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.071461 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.071916 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.244430 (+172514us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:06.244487 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.244599 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.379339 (+1134740us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:07.533695 (+154356us) raft_consensus.cc:1685] finished
0709 13:11:07.533716 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.533917 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13154,"raft.queue_time_us":21270,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4440,"spinlock_wait_cycles":73375616,"thread_start_us":147423,"threads_started":1,"wal-append.queue_time_us":273079}
I20260709 13:11:07.501587 31787 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:07.501863 31782 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:11:07.547675 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 113315us
I20260709 13:11:07.518887 24673 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:07.541304 31818 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:07.511847 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.589679 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:07.590643 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.591349 25214 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 23 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:11:07.511015 31752 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:07.552078 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.556556 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:07.592752 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.517625 31548 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:07.541567 31833 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:07.592105 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:07.536278 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:07.593545 25211 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
W20260709 13:11:07.608109 24563 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.680s (SENT) [suppressed 2 similar messages]
I20260709 13:11:07.599042 25219 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:07.550105 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:07.541388 31840 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:07.550419 31894 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:07.606769 31810 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:07.541389 31824 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.541868 31792 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:07.609043 24666 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.516460 31830 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:11:07.611316 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:07.613457 25212 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:07.543480 31775 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:07.558398 31782 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:07.613123 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:07.615569 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:07.629515 25216 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:07.551030 31787 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.568248 31818 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:07.616125 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:07.614209 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 78034.1us
I20260709 13:11:07.636008 25213 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:07.610610 31807 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.623853 25212 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:11:07.539112 31725 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 13:11:07.643909 24673 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:07.625448 31829 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.542101 31415 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 13:11:07.629110 25218 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:07.551028 31774 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:11:07.610865 31744 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:07.607813 31833 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.591460 31813 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:11:07.618461 31323 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:07.649015 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:07.608151 31717 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:11:07.654107 24666 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:07.657894 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2377) took 1281 ms. Trace:
I20260709 13:11:07.633004 31782 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:07.637583 31787 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:07.639074 31810 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:07.665408 31323 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.629110 31901 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.036s
I20260709 13:11:07.660890 31720 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:07.658475 31744 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.687218 25218 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:07.664474 31833 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:07.669445 24669 rpcz_store.cc:276] 0709 13:11:06.376137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.378149 (+  2012us) service_pool.cc:224] Handling call
0709 13:11:06.378411 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.378582 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:06.728543 (+349961us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.507568 (+779025us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b18000ed160. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a
0709 13:11:07.657436 (+149868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.657495 (+    59us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:07.657560 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.657668 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.657823 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":736,"prepare.queue_time_us":447693,"prepare.run_cpu_time_us":7703,"prepare.run_wall_time_us":31861,"raft.queue_time_us":11970,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":10949888,"thread_start_us":642223,"threads_started":3,"wal-append.queue_time_us":244444}
I20260709 13:11:07.678848 31798 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:07.701333 31905 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:07.664052 31834 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.704058 31725 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:07.703859 31795 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.672106 31789 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:07.705649 31904 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:07.732831 31884 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.658069 31829 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.690532 31774 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:07.701654 31818 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.733855 31744 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:07.691447 31323 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.751245 24673 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:11:07.776216 24667 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:07.736605 31798 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:07.694365 31820 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:07.840601 25213 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:07.818152 31548 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:07.817008 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:07.842949 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 332314us
I20260709 13:11:07.853477 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.857498 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.779083 31789 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:07.812016 31795 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:07.736526 31792 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:07.859457 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 251355us
I20260709 13:11:07.779960 31774 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:07.866328 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:07.879256 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.877853 24490 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:07.778313 31884 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.858886 31813 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:07.772697 31875 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.868149 31810 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:07.771397 31904 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:07.893596 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.885511 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:07.903940 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.910971 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:07.912062 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:07.878731 31710 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.002s
I20260709 13:11:07.916409 24516 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:07.916781 25215 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:07.917676 31907 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:07.918030 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.924269 25210 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:07.926760 25215 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:11:07.927273 25215 pending_rounds.cc:85] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 13
I20260709 13:11:07.927621 25215 pending_rounds.cc:107] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:11:07.927999 25215 raft_consensus.cc:2889] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.871546 31415 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:07.884152 31830 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:07.956058 25218 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:07.956835 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80044.1us
I20260709 13:11:07.881922 31894 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:07.912623 31807 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:07.981109 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:07.883770 31798 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:08.000562 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.003705 31908 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:11:08.004094 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.926275 31892 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:07.939949 31752 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:07.923274 31710 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.046306 31887 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:08.047053 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 66138.7us
I20260709 13:11:08.002187 31918 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:08.047981 31801 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:08.049028 31829 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.035650 31894 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:11:07.958441 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:07.955189 31774 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:08.057367 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 465326us
W20260709 13:11:08.056273 31549 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.006s
I20260709 13:11:08.064913 31901 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.052892 31840 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:11:08.066335 31927 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:08.050185 31913 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 13:11:08.094352 25218 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:08.094820 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:07.954932 31548 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.105578 25211 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:08.088548 31834 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.079010 31717 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:08.080689 31807 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:07.958420 31789 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.122509 31807 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.124672 31807 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.125160 31935 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:11:08.125610 24595 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:08.096272 31901 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:08.129688 31915 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:08.129803 31901 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.130263 31810 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:08.130467 31752 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.077381 31801 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.105967 31774 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:08.097467 31916 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:08.088403 31912 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 13:11:08.115926 31830 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:08.091562 31549 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.116585 31904 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.068183 31887 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:08.159323 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.117841 31717 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.145777 31914 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.141673 31820 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.170043 31833 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.170408 31323 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:08.182688 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 278870us
I20260709 13:11:08.186146 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:08.174342 31864 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.291s	user 0.004s	sys 0.001s
I20260709 13:11:08.160327 31884 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.218106 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:08.220182 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:08.221203 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.222899 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:08.224156 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:08.190029 31875 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.231350 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:08.194722 31927 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:08.215341 31907 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:11:08.229797 31824 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.003s
W20260709 13:11:08.237399 31787 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.004s
W20260709 13:11:08.236503 31782 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.001s
I20260709 13:11:08.230337 31931 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:08.254873 31323 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.233393 31941 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:08.196264 31914 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.240412 31913 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:08.238720 31810 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:08.281006 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:08.256155 31931 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.253664 31710 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.297309 31943 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:08.296672 31913 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:08.234887 31916 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:11:08.255883 31782 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.266781 31833 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.305280 31931 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:08.314973 31717 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.272708 31790 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:08.315680 31549 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.315827 31790 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.318169 31790 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.241051 31830 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.250180 31824 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.320259 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:08.256983 31787 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.335464 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:08.336611 24669 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:08.308301 31943 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:08.344733 31913 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.345749 31847 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.345940 31943 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.347301 31943 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:08.347467 31918 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:08.350941 31787 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.332594 31927 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.352896 24674 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:08.275065 31941 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:08.354269 31923 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.251s	user 0.003s	sys 0.000s
I20260709 13:11:08.355512 31941 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:08.356566 31945 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:08.370667 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:08.267320 31907 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.362615 31801 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:08.385113 24521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28c13259bf74484588e0fb08995091cc"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:08.386112 24521 raft_consensus.cc:606] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:11:08.386534 24521 raft_consensus.cc:614] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:08.387446 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:08.369202 31918 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.394204 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:08.394971 24669 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.369948 31886 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.384438 31548 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:08.413750 31936 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:11:08.419006 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:08.420183 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2405) took 1022 ms. Trace:
I20260709 13:11:08.420267 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:08.420970 24666 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:08.400272 31918 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:08.421478 31950 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:08.423127 31918 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:08.428897 24669 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:08.429958 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:08.430675 24669 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:08.431636 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:08.433153 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:08.433733 24517 raft_consensus.cc:606] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:08.434044 24517 raft_consensus.cc:614] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:08.420683 24670 rpcz_store.cc:276] 0709 13:11:07.398029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.517235 (+119206us) service_pool.cc:224] Handling call
0709 13:11:07.517583 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.524253 (+  6670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.524281 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.524319 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:07.524347 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.419950 (+895603us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b54002b5554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:08.420002 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.420124 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14903552}
I20260709 13:11:08.434989 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:08.437871 24666 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:08.443487 31931 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:08.438974 31744 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.008s
I20260709 13:11:08.402942 31886 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.408376 31548 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.449285 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:08.520793 24669 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
W20260709 13:11:08.635972 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.518628 31801 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:08.645553 31752 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:08.666770 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:08.667418 24517 raft_consensus.cc:606] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
W20260709 13:11:08.658641 31774 consensus_meta.cc:287] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.006s
I20260709 13:11:08.658978 31752 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.655099 31801 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.705920 31548 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:08.711138 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.716804 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:08.717700 24517 raft_consensus.cc:606] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:08.718139 24517 raft_consensus.cc:614] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:08.721877 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.711859 31830 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:08.720533 31801 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.734987 31886 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.730602 31571 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:08.754173 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:08.755050 24517 raft_consensus.cc:606] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:11:08.755396 24517 raft_consensus.cc:614] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:08.730208 31830 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.771550 31830 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.778946 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:08.521183 31744 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:08.789983 31711 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.790582 31711 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.792786 31711 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:08.806478 24669 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:08.807307 31752 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:08.807412 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.811758 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2404) took 1414 ms. Trace:
I20260709 13:11:08.812245 24667 rpcz_store.cc:276] 0709 13:11:07.397766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.433612 (+ 35846us) service_pool.cc:224] Handling call
0709 13:11:08.811511 (+1377899us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540026b1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:08.811654 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778184576}
I20260709 13:11:08.819564 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:08.819468 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:08.825739 31905 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:08.826186 31905 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:08.826985 31905 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.827989 31905 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:08.833487 24517 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:08.839648 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:08.848318 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:08.850663 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:08.850966 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:08.852351 24516 raft_consensus.cc:2410] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:11:08.863340 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:08.864346 24523 raft_consensus.cc:2368] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:11:08.837481 31943 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:11:08.848662 31752 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:08.870718 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:08.874051 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:08.876140 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 76941us
I20260709 13:11:08.877161 31925 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:08.877581 31925 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:08.877952 31925 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:08.881451 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:08.886876 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1969) took 1258 ms. Trace:
I20260709 13:11:08.887382 25213 rpcz_store.cc:276] 0709 13:11:07.628295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.853712 (+225417us) service_pool.cc:224] Handling call
0709 13:11:07.872217 (+ 18505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.945810 (+ 73593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.945845 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:07.945901 (+    56us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:07.945943 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.886657 (+940714us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b54002e59d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:08.886701 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.886824 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168746240}
I20260709 13:11:08.892972 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 1958) took 1409 ms. Trace:
I20260709 13:11:08.893436 25210 rpcz_store.cc:276] 0709 13:11:07.483525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.484483 (+   958us) service_pool.cc:224] Handling call
0709 13:11:08.885588 (+1401105us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002ff8d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:08.892917 (+  7329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002306944}
I20260709 13:11:08.896870 24516 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:08.876371 31744 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:08.896049 31916 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.905055 31903 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.282s	user 0.000s	sys 0.008s
I20260709 13:11:08.902917 31916 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:08.917994 31883 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:08.920046 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1635) took 2450 ms. Trace:
I20260709 13:11:08.920989 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2407) took 1430 ms. Trace:
I20260709 13:11:08.940861 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:08.921590 31775 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:08.922539 31720 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:08.925927 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.927359 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3838) took 1528 ms. Trace:
I20260709 13:11:08.962611 24674 rpcz_store.cc:276] 0709 13:11:07.398743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.538361 (+139618us) service_pool.cc:224] Handling call
0709 13:11:07.538648 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.353321 (+814673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.927099 (+573778us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54002ec054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:08.927300 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872197888}
I20260709 13:11:08.928817 31782 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:08.930907 31914 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:08.941231 24673 rpcz_store.cc:276] 0709 13:11:07.490741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.729150 (+238409us) service_pool.cc:224] Handling call
0709 13:11:07.738878 (+  9728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.811513 (+ 72635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.920772 (+1109259us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54001383d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:08.920938 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27820800}
I20260709 13:11:08.940198 24671 rpcz_store.cc:276] 0709 13:11:06.469934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.515710 (+ 45776us) service_pool.cc:224] Handling call
0709 13:11:06.529105 (+ 13395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.639388 (+110283us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:07.480929 (+841541us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b180034c480. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bf93e3c7 00007f17bbf509a7 00007f17bbf600bf 00007f17bbf60038
0709 13:11:07.642473 (+161544us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.869762 (+227289us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.874276 (+  4514us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.874446 (+   170us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:07.874479 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.209440 (+334961us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:08.919734 (+710294us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b54001388d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:08.919781 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.919823 (+    42us) raft_consensus.cc:1685] finished
0709 13:11:08.919837 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.919966 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36835,"prepare.queue_time_us":254484,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":14015,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":11700,"spinlock_wait_cycles":352799872,"thread_start_us":351067,"threads_started":2,"wal-append.queue_time_us":342965}
I20260709 13:11:09.021344 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.013957 31720 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:08.945392 31775 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:09.023944 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1494) took 1429 ms. Trace:
I20260709 13:11:09.014643 31609 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.024508 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 1.37436e+06us
I20260709 13:11:09.025504 24593 rpcz_store.cc:276] 0709 13:11:07.594759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.594897 (+   138us) service_pool.cc:224] Handling call
0709 13:11:07.615774 (+ 20877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.615958 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:07.632224 (+ 16266us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.632625 (+   401us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.642779 (+ 10154us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.421456 (+778677us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18004e5140. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:08.895794 (+474338us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18004e5140. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:09.021269 (+125475us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b18004e5140. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:11:09.023654 (+  2385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.023702 (+    48us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:09.023742 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.023802 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.023895 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1381502,"prepare.queue_time_us":2551716,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":1388167,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":5732,"spinlock_wait_cycles":46613504}
I20260709 13:11:09.031198 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.031694 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:09.031903 24599 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 16: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:09.032361 24598 raft_consensus.cc:2368] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:11:09.033201 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.033378 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.033867 24598 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:09.033730 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.033906 24596 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:11:09.034379 24521 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:09.035056 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:09.035574 24596 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:09.036101 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.030596 31829 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:09.036589 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1641) took 2522 ms. Trace:
I20260709 13:11:09.037348 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:09.027608 31964 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:11:09.039985 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.038614 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:09.040339 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 146184us
I20260709 13:11:09.025195 31782 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:09.038204 24597 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:09.041793 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:09.036962 24665 rpcz_store.cc:276] 0709 13:11:06.514017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.910811 (+396794us) service_pool.cc:224] Handling call
0709 13:11:06.911156 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.953198 (+ 42042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.953229 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.236346 (+283117us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b2c00173798. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:11:07.242267 (+  5921us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.448535 (+206268us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:07.518252 (+ 69717us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.254809 (+736557us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b18001449a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:08.419349 (+164540us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b18001449a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:11:08.729963 (+310614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.730079 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.859405 (+129326us) spinlock_profiling.cc:243] Waited 8.82 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:09.036395 (+176990us) raft_consensus.cc:1685] finished
0709 13:11:09.036416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.036534 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41634,"prepare.queue_time_us":69519,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":45653,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":8065,"spinlock_wait_cycles":178095360,"thread_start_us":475060,"threads_started":2,"wal-append.queue_time_us":337975}
I20260709 13:11:09.044026 24523 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.045367 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.050900 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:09.053220 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.054325 24593 raft_consensus.cc:2410] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:09.063994 24517 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:09.065435 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:09.067260 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:09.069471 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.070079 24597 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
W20260709 13:11:09.071637 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.072496 24596 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:09.042897 31703 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.087746 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:09.042747 31914 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:09.028745 31609 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.090605 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2496) took 1778 ms. Trace:
I20260709 13:11:09.091425 24591 raft_consensus.cc:2368] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 24. Current term is 25.
I20260709 13:11:09.096745 24523 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:09.048408 31435 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:09.099475 24520 rpcz_store.cc:276] 0709 13:11:07.312202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.419052 (+106850us) service_pool.cc:224] Handling call
0709 13:11:07.419298 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.499999 (+ 80701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.089310 (+1589311us) spinlock_profiling.cc:243] Waited 79.9 ms on lock 0x7b54000bb8d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:09.090548 (+  1238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183847168}
I20260709 13:11:09.036991 31829 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.063068 31549 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.073601 31847 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:09.047760 31782 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.042479 31883 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:11:09.101397 31914 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.103569 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.089879 31323 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:09.070698 31833 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:11:09.102922 31435 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.047842 31775 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.097261 31703 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.117991 31715 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:09.112223 31847 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.112560 31323 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.120973 31323 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:09.148378 31917 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.060s	user 0.000s	sys 0.009s
I20260709 13:11:09.150400 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2163) took 1645 ms. Trace:
I20260709 13:11:09.153806 24595 rpcz_store.cc:276] 0709 13:11:07.505060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.505225 (+   165us) service_pool.cc:224] Handling call
0709 13:11:07.505581 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.125959 (+620378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.150081 (+1024122us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54003e8d54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:09.150326 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425240832}
I20260709 13:11:09.111421 31549 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.160651 24520 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:09.168944 31752 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.169168 31932 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.169627 31932 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.177202 31792 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:09.177937 31792 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.178957 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.179777 24516 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:11:09.180580 31931 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.182329 31968 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:09.182740 31968 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:09.169538 31752 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.190558 31887 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:09.191833 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:09.194386 31912 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:09.199224 31798 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.202775 31824 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:09.232389 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:09.243623 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 121208us
I20260709 13:11:09.244989 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:09.245841 24674 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:11:09.251271 24516 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:11:09.251647 24516 pending_rounds.cc:85] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 13
I20260709 13:11:09.251865 24516 pending_rounds.cc:107] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:11:09.252149 24516 raft_consensus.cc:2889] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.225419 31725 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.255276 24669 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:11:09.257365 24669 pending_rounds.cc:85] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 13
I20260709 13:11:09.257602 24669 pending_rounds.cc:107] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:11:09.257953 24669 raft_consensus.cc:2889] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.262362 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:09.235183 31912 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:09.237767 31571 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.268898 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 195441us
I20260709 13:11:09.184958 31968 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.250515 31887 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.242452 31715 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:09.243480 31860 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:09.249903 31723 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:09.257722 31711 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:09.260154 31818 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.259828 31886 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:09.298458 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 271002us
I20260709 13:11:09.270820 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:09.271116 31830 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:11:09.317510 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 71070.4us
W20260709 13:11:09.318426 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47691.4us
I20260709 13:11:09.278056 31792 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:09.316247 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:09.346069 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:09.347582 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:09.328627 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:09.263602 31725 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.285194 31847 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.278785 31703 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:09.349462 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 82130.6us
I20260709 13:11:09.351468 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:09.315091 31902 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.353998 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 102636us
I20260709 13:11:09.360625 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.319362 31916 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.316586 31702 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:09.290351 31571 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.322034 31833 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:09.294929 31887 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.292344 31925 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.299265 31723 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.315568 31711 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.384905 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:09.390910 25216 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:09.299110 31860 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.381834 25210 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:09.353369 31549 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:09.368230 31703 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:09.367841 31912 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:09.406054 25214 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:09.319348 31886 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.372161 31847 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:09.375232 31752 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.375290 31884 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.374341 31914 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:09.381819 31924 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:09.417683 31932 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:09.417555 31924 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.418324 31886 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.419608 31924 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:09.385178 31916 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:09.420178 31860 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:09.386234 31702 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.420274 31916 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.383239 31902 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.410979 31549 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:09.413798 31970 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:09.384727 31715 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.404428 31971 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:09.439116 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.451532 24516 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:11:09.439934 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:09.451658 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 104140us
I20260709 13:11:09.441390 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.447095 25214 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:09.441690 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.452515 24517 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:09.434218 31887 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:09.428840 31725 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:09.438431 31702 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.440840 31829 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.448369 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.425815 31884 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.448953 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.426815 31723 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:09.450676 31925 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:09.406266 31912 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:09.457628 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:09.452061 31886 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:09.463676 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:09.493410 25216 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:09.371198 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:09.430323 31711 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:09.432219 31916 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.470762 24524 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
W20260709 13:11:09.499557 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.442353 31720 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.437429 31970 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:09.438526 31968 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.425359 31820 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.454746 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:09.457209 31703 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:09.489682 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.491189 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:09.495347 24637 leader_election.cc:400] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:11:09.531454 24637 leader_election.cc:403] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:11:09.531838 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 77238.7us
I20260709 13:11:09.493813 31725 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.468415 31902 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:09.533967 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:09.504351 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:09.535743 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44643.4us
I20260709 13:11:09.536092 25210 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:09.496891 31795 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:09.494812 31928 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:09.503963 31925 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:11:09.494670 31980 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 13:11:09.493216 31932 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:11:09.519490 31702 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:11:09.501773 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 130661us
I20260709 13:11:09.531435 25214 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:09.490312 31914 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:09.545547 24563 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:09.546121 31914 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.550947 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.542006 25210 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:09.549022 31914 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:09.558722 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.559376 25210 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:09.531435 31847 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.535609 31792 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:09.495893 31886 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.565527 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.574268 24599 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:09.534566 31829 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:11:09.571421 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:09.577793 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.578364 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:09.581969 24599 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:09.585448 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.588853 24599 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:09.500795 31957 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:11:09.541564 31711 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:09.594732 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.595387 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.595559 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.596205 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.541246 31928 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:09.623389 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 294802us
I20260709 13:11:09.623572 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.596611 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.617928 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:09.628882 25217 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:09.539109 31725 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.559478 31744 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:11:09.590812 31905 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:09.534986 31820 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.578879 31914 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:09.590811 31973 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.590571 31902 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.542199 31912 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.555228 31801 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:09.632160 24599 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:09.633248 31702 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:09.621871 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.678591 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.591233 31860 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:09.597431 31924 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:09.681629 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.571951 31795 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:11:09.619395 31711 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.540279 31323 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.575824 31976 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:09.649260 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:09.651755 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 164554us
I20260709 13:11:09.626259 31928 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:09.626909 31982 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:11:09.615384 31833 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:09.623153 31829 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:09.656823 25218 raft_consensus.cc:1240] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:09.658663 24593 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:09.597990 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:09.789623 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 244179us
I20260709 13:11:09.789856 25216 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:09.665608 31957 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:09.632709 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:09.580228 31847 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.658047 31782 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:09.773526 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 230463us
I20260709 13:11:09.805119 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.805739 25216 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:09.806042 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:09.806600 24674 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:09.731007 24598 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:09.782672 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:09.783751 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.785029 24599 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:09.792088 25184 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:09.797923 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.805527 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:09.798707 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:09.799016 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 166386us
I20260709 13:11:09.799510 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.811219 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.811630 24516 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:09.812052 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:09.811241 24639 leader_election.cc:400] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:11:09.812721 24674 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:09.813102 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:09.813987 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:09.815789 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:09.816313 24669 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:09.818248 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:09.808331 25215 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:09.658429 31905 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.819646 24670 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:09.808511 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:09.821010 24674 raft_consensus.cc:2410] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 18 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:11:09.730664 31711 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:09.840366 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:09.821162 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:09.822127 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:09.842998 25215 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:09.843369 25218 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.827144 24525 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:09.780020 31932 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.689431 31702 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:09.853662 24596 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:09.834656 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:09.854660 25216 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:09.840366 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:09.662900 31914 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.842603 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:09.688108 31801 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:09.669170 31973 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:09.778416 31977 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:09.797155 31957 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:09.870302 24668 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:11:09.856889 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 48449.4us
I20260709 13:11:09.857872 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:09.680410 31902 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.796217 31723 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.859023 24522 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:09.878729 24666 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:09.794088 31976 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:09.882897 24669 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:09.872373 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:09.827890 31752 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:09.818961 31972 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.881023 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:09.894851 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:09.689224 31860 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.729359 31924 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.915824 25215 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:09.803803 31829 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.916532 25219 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:09.870074 31941 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:09.633929 31970 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.873718 31549 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:09.940469 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 119438us
I20260709 13:11:09.906955 31830 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:09.905982 31720 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.988695 31752 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:09.872255 31932 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:09.950136 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46254.1us
I20260709 13:11:09.998804 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:09.887998 31980 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.102s
I20260709 13:11:10.011904 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:10.012669 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 221601us
I20260709 13:11:09.918521 32004 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:09.993119 31999 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.030030 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.016856 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:10.032393 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.033488 24669 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:10.035048 31927 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:09.991350 31782 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:09.899986 31723 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.927158 31715 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.928324 31941 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.998556 31998 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:09.998106 31720 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:10.024031 25218 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:10.036566 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:10.002959 31997 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:10.017796 31886 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:09.908793 31972 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:10.039299 31989 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:11:10.039402 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.041167 31982 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.041651 31782 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:10.096594 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60119.4us
I20260709 13:11:09.896668 31977 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.003993 32002 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.998994 31830 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:10.013721 31884 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.080168 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:10.037849 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.080543 31725 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.029913 32004 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.991349 31986 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.115s
I20260709 13:11:10.098565 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:10.126323 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:10.128240 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:09.920923 31833 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.083470 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.005803 31702 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:10.001231 31549 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.106838 24669 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:10.083860 31720 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:10.042974 32003 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.110706 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:10.104254 31990 log.cc:927] Time spent T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:11:10.098152 31782 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:10.105186 31984 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
W20260709 13:11:10.121780 31996 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:11:10.105970 32018 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:10.112501 31916 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:10.122901 31980 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:10.130844 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:10.081622 31941 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:10.112785 31991 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:11:10.104882 31973 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.099543 31820 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.002178 31976 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:10.171241 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 125181us
W20260709 13:11:10.140842 25212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.008s	sys 0.004s
W20260709 13:11:10.223160 25212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.010s	sys 0.005s
I20260709 13:11:10.161875 24670 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
W20260709 13:11:10.149128 24595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.003s	sys 0.009s
I20260709 13:11:10.090677 31998 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:09.998670 31957 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.179654 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.259207 24667 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:10.093812 31927 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:11:10.107018 31830 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:10.181767 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.106480 32015 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:10.032256 31801 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.191586 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.078951 31999 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.185519 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.090941 31715 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.213526 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.135063 32004 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:10.210150 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1496) took 2282 ms. Trace:
I20260709 13:11:10.175343 31720 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:10.175100 31782 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:10.136262 32007 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:10.221026 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 96005.4us
I20260709 13:11:10.223402 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:10.223692 24595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.005s	sys 0.010s
I20260709 13:11:10.175691 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:10.217530 32022 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.093532 31997 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:10.187592 31847 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.187872 31905 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:10.258455 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 147836us
I20260709 13:11:10.102283 31752 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.148289 31744 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:11:10.131865 31884 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:10.135846 31886 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:10.209609 32003 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:10.113637 32002 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:10.216398 31914 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:10.305181 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 513170us
I20260709 13:11:10.305908 24668 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:10.224596 31980 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:10.229434 31916 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.217200 31703 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:11:10.229012 31902 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.310002 24600 rpcz_store.cc:276] 0709 13:11:07.906420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.906569 (+   149us) service_pool.cc:224] Handling call
0709 13:11:07.922813 (+ 16244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.243326 (+1320513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.243355 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.256314 (+ 12959us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.536108 (+279794us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:11:09.536154 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.536302 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.188291 (+651989us) raft_consensus.cc:1685] finished
0709 13:11:10.188319 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.188479 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1106784,"raft.queue_time_us":1112190,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":470232,"threads_started":2,"wal-append.queue_time_us":369342}
I20260709 13:11:10.260123 31860 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.338284 24517 raft_consensus.cc:2410] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 13:11:10.338045 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 114727us
I20260709 13:11:10.257534 31840 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.086s
I20260709 13:11:10.264518 32018 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:10.266431 31795 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.089s
W20260709 13:11:10.455118 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 122657us
I20260709 13:11:10.374332 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:10.428433 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:10.413833 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.355492 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:10.354961 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:10.468070 24523 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:11:10.467694 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 93494.9us
I20260709 13:11:10.470992 24524 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:10.470535 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:10.492954 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.493937 24516 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:11:10.503263 32016 log.cc:927] Time spent T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 13:11:10.504673 32010 log.cc:927] Time spent T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
W20260709 13:11:10.505467 32017 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:11:10.401427 31957 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:10.340139 32007 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.521386 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:10.522377 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56295us
I20260709 13:11:10.401886 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.430742 31932 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.524739 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:10.568077 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.464507 31977 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:10.308563 31435 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.267989 31829 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.574446 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.573890 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:10.573199 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 102795us
I20260709 13:11:10.309650 31924 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.528016 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.520594 31980 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:10.476045 32028 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:10.507645 31886 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:10.587778 24595 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
W20260709 13:11:10.529881 31818 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.214s	user 0.002s	sys 0.010s
W20260709 13:11:10.595326 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 99031.4us
I20260709 13:11:10.602310 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:10.520541 32007 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:10.601051 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.467214 31916 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.605907 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:10.529328 32013 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.609061 25184 leader_election.cc:400] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 24. Current term is 25.
I20260709 13:11:10.612757 25184 leader_election.cc:403] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.611850 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:10.613137 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.614101 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:10.617987 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:10.618391 31902 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 24. Current term is 25.
I20260709 13:11:10.619159 31902 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:10.620896 25185 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:10.583326 31549 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:10.629101 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.039s	sys 0.065s
W20260709 13:11:10.629443 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.039s	sys 0.065s
I20260709 13:11:10.599910 31980 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:10.631949 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.622233 31926 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:10.473989 32018 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.615576 31883 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.304163 32015 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:10.616945 31927 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:10.616469 31905 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.596300 31993 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:11:10.646572 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.650766 24666 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:11:10.651335 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.696734 24666 pending_rounds.cc:85] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 9
I20260709 13:11:10.697324 24666 pending_rounds.cc:107] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:11:10.652737 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.595589 31752 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:10.606815 31924 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:11:10.653600 31883 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.686141 31998 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:10.670146 32024 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:11:10.686136 31999 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:10.678171 32021 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 13:11:10.671032 32026 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:11:10.694193 32015 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:10.671666 31927 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:10.567241 32022 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:10.715530 31792 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.136s	user 0.006s	sys 0.005s
I20260709 13:11:10.715596 32022 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:10.654070 32020 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:10.716219 31792 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19.
I20260709 13:11:10.716554 32020 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.717123 32020 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:10.698704 24666 raft_consensus.cc:2889] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.720397 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:10.671532 32014 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:10.652593 31571 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.697052 31905 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.642984 31980 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:10.724239 31905 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.726361 31905 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:10.726711 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.727305 24666 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:10.701409 31752 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.728137 31752 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.686560 31997 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:10.688475 32033 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:11:10.687724 31715 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.690112 31916 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.626113 32028 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:10.698240 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.653285 32002 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:10.698882 32032 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.058s
I20260709 13:11:10.701807 32003 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.706959 31830 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.709445 31957 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.710965 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1495) took 2805 ms. Trace:
I20260709 13:11:10.683477 31886 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:10.721295 31801 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:10.759372 24592 rpcz_store.cc:276] 0709 13:11:07.905836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.906014 (+   178us) service_pool.cc:224] Handling call
0709 13:11:07.923396 (+ 17382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.110410 (+1187014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.110438 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.133863 (+ 23425us) log.cc:844] Serialized 26 byte log entry
0709 13:11:09.290285 (+156422us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:09.315832 (+ 25547us) log.cc:844] Serialized 14 byte log entry
0709 13:11:09.316040 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.316111 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.434523 (+118412us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18003ecaa0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:10.118146 (+683623us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b18003ecaa0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:10.705463 (+587317us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b18003ecaa0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:10.710716 (+  5253us) raft_consensus.cc:1685] finished
0709 13:11:10.710752 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.710904 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1106407,"prepare.queue_time_us":24563,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":22212,"raft.queue_time_us":1111895,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":146,"spinlock_wait_cycles":16262016,"thread_start_us":236231,"threads_started":2,"wal-append.queue_time_us":185430}
I20260709 13:11:10.761404 31801 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.722788 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.762470 24668 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:10.763295 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.763576 31801 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.763991 24668 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:10.764041 31887 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:10.764638 31887 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:10.765098 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.766466 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.722936 24665 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:10.728098 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:10.695276 24488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.013s
W20260709 13:11:10.767539 24488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.013s
I20260709 13:11:10.743492 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.773437 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.774288 24597 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:10.750869 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.778035 24596 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
W20260709 13:11:10.750784 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 158570us
I20260709 13:11:10.779376 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:10.706574 32018 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.624183 32013 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.756229 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:10.713073 31941 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:10.701373 31968 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.170s	user 0.017s	sys 0.001s
I20260709 13:11:10.762490 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.785527 24592 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:11:10.793812 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.794023 24592 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:11:10.794677 24596 raft_consensus.cc:2410] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:11:10.846576 24600 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:10.728468 32020 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.758776 31720 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.848683 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1505) took 1030 ms. Trace:
I20260709 13:11:11.020960 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.849947 24521 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:11.015543 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.758515 31977 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.757503 31924 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:11.083523 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.145372 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:10.907979 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:10.923494 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:10.880395 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2504) took 1312 ms. Trace:
I20260709 13:11:11.170378 24598 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:10.904577 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:10.865312 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2420) took 1061 ms. Trace:
I20260709 13:11:11.021445 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:10.935428 31931 raft_consensus.cc:993] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:11:11.093878 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 2175) took 1297 ms. Trace:
I20260709 13:11:10.901659 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:11.016839 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:11.183931 24596 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.183612 24600 rpcz_store.cc:276] 0709 13:11:09.796537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.574235 (+777698us) service_pool.cc:224] Handling call
0709 13:11:11.093673 (+519438us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540025bf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:11.093813 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598175616}
I20260709 13:11:11.016140 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:10.949404 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1567) took 1353 ms. Trace:
W20260709 13:11:11.185066 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 277151us
I20260709 13:11:11.182426 24672 rpcz_store.cc:276] 0709 13:11:09.804036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.804186 (+   150us) service_pool.cc:224] Handling call
0709 13:11:09.850503 (+ 46317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.035423 (+184920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.035705 (+   282us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.114186 (+ 78481us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.316444 (+202258us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:10.316499 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.316587 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.865114 (+548527us) raft_consensus.cc:1685] finished
0709 13:11:10.865133 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.865254 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":188090,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":313012,"threads_started":2,"wal-append.queue_time_us":312112}
I20260709 13:11:11.186419 25213 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:11.187436 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.187981 25213 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:11.192445 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:11.193303 24674 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:11.193966 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:11.194555 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:11.024070 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:10.876099 31982 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.000s
I20260709 13:11:11.199759 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:11.155798 24592 rpcz_store.cc:276] 0709 13:11:09.822272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.846867 (+1024595us) service_pool.cc:224] Handling call
0709 13:11:10.847427 (+   560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.847713 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.847772 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.847863 (+    91us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:10.847934 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.848032 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.848519 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:10.856460 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51377.1us
I20260709 13:11:11.028373 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:10.998525 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 473864us
I20260709 13:11:11.054369 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:11.201968 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:11.203003 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:11.180814 24667 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.060141 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:10.958920 32004 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
W20260709 13:11:10.964596 32044 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
W20260709 13:11:10.926407 31782 consensus_meta.cc:287] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.002s
I20260709 13:11:10.869544 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2500) took 1306 ms. Trace:
I20260709 13:11:10.946857 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1571) took 1317 ms. Trace:
I20260709 13:11:11.216163 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.188494 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:10.882179 31830 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.847551 31932 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:11.185294 25219 rpcz_store.cc:276] 0709 13:11:09.595527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.596008 (+   481us) service_pool.cc:224] Handling call
0709 13:11:10.949182 (+1353174us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400532354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:10.949330 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679880960}
I20260709 13:11:10.949823 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1657) took 1705 ms. Trace:
I20260709 13:11:11.195354 25214 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:11:11.236058 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.018426 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.192756 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.869614 31993 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.342s
W20260709 13:11:10.901760 31928 consensus_meta.cc:287] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.082s	user 0.011s	sys 0.001s
I20260709 13:11:11.198588 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:10.934331 31907 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:10.792023 31905 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:10.877369 31711 consensus_meta.cc:287] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 1.004s	user 0.010s	sys 0.002s
I20260709 13:11:11.199815 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.217367 31968 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:11.200493 25213 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:11:10.950119 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2515) took 1295 ms (client timeout 1606 ms). Trace:
I20260709 13:11:11.202049 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.201960 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:11.262203 24599 rpcz_store.cc:269] 0709 13:11:09.655228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.681299 (+ 26071us) service_pool.cc:224] Handling call
0709 13:11:10.942016 (+1260717us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540025e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:10.950022 (+  8006us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235397504}
W20260709 13:11:11.204653 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 150405us
I20260709 13:11:11.231904 31840 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:11.264508 31824 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:11.282836 31824 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.283228 31824 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.283430 31931 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.284137 31931 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.280821 32023 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:11.285681 32023 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.286573 31931 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.253718 31943 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:11:11.265575 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:11.288702 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:11.288836 25213 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.894014 31887 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.234824 31932 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:11.087060 31976 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:11.011802 31723 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:10.920147 32028 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:10.871655 32020 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.288007 31830 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:11.210940 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.088438 31970 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:11.113555 31820 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:11.018097 31323 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.281575 31968 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.279366 31711 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.908063 32013 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.970911 31883 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:10.938578 31992 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.039s	user 0.003s	sys 0.000s
I20260709 13:11:11.219048 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.217693 32004 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:11.216086 24591 rpcz_store.cc:276] 0709 13:11:09.563478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.565184 (+  1706us) service_pool.cc:224] Handling call
0709 13:11:09.597512 (+ 32328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.647590 (+ 50078us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:09.647619 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.679740 (+1032121us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b2c00170da8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:11:10.685440 (+  5700us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.749714 (+ 64274us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:10.749768 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.749873 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.869260 (+119387us) raft_consensus.cc:1685] finished
0709 13:11:10.869282 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.869486 (+   204us) inbound_call.cc:177] Queueing success response
0709 13:11:10.962629 (+ 93143us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
Metrics: {"mutex_wait_us":49677,"raft.queue_time_us":50677,"raft.run_cpu_time_us":19815,"raft.run_wall_time_us":1308956,"spinlock_wait_cycles":42259456,"thread_start_us":63899,"threads_started":1,"wal-append.queue_time_us":110173}
I20260709 13:11:11.365990 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.366590 24591 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:11.366892 32004 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.221567 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:10.918588 31941 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:10.857903 31813 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:11.222703 24518 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:11:11.439510 24518 pending_rounds.cc:85] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 11
I20260709 13:11:11.439805 24518 pending_rounds.cc:107] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:11:11.440141 24518 raft_consensus.cc:2889] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.216423 25217 rpcz_store.cc:276] 0709 13:11:09.629760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.629906 (+   146us) service_pool.cc:224] Handling call
0709 13:11:09.630139 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.992358 (+362219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.992404 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.992461 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:09.992508 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.946527 (+954019us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400608e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:10.946597 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.946780 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832497024}
I20260709 13:11:11.441581 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.225623 24519 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:11.434022 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:11.227252 24667 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:11.013132 31609 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.003820 32027 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:11.228807 31994 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:11.228703 24409 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet de2b0253cbb445a4bb49f874e70ea972 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96002c98f2d142e4b67dc5105a06079c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:11.229132 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:11.229375 31782 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.458063 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:11.458523 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 229491us
I20260709 13:11:11.230535 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.459493 32004 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:11.452852 32063 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.460171 32004 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:11.445719 31813 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:11.461470 24668 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:11.192418 31702 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:11.462620 31813 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.237505 24598 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:11.463742 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.464810 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.465463 24598 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:11.466151 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.468359 24598 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:11.180828 24594 rpcz_store.cc:276] 0709 13:11:09.567846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.569961 (+  2115us) service_pool.cc:224] Handling call
0709 13:11:09.570317 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:09.647924 (+ 77607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.647951 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:10.679410 (+1031459us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b2c00170da8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:11:10.687436 (+  8026us) log.cc:844] Serialized 52 byte log entry
0709 13:11:10.757606 (+ 70170us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:10.851932 (+ 94326us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.862366 (+ 10434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.862445 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.880070 (+ 17625us) raft_consensus.cc:1685] finished
0709 13:11:10.880176 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.880335 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90144,"prepare.queue_time_us":122897,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":95004,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":42251,"spinlock_wait_cycles":12503424,"thread_start_us":161914,"threads_started":2,"wal-append.queue_time_us":190670}
I20260709 13:11:11.234517 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:10.874882 32007 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.470515 31711 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.471513 31968 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.471761 32007 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.236981 25212 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:11.472992 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.473420 24598 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:11.474215 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:11.475308 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:11.435708 31979 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:11.184001 31977 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.476820 31979 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.204051 32051 raft_consensus.cc:1081] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:11:11.194705 31924 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.204296 31715 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.208875 31971 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:11.205761 31969 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:11.251408 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:10.926945 31980 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:11.215518 31982 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.478061 32059 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.241559 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:10.796252 31957 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.241911 24522 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:11:11.498474 24522 pending_rounds.cc:85] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 11
I20260709 13:11:11.498739 24522 pending_rounds.cc:107] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:11:11.498988 24522 raft_consensus.cc:2889] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:11.499153 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.489724 31971 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.499821 31971 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.500145 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:11.500766 24522 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.242143 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.489537 31969 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:11.505402 24524 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:11.505563 31969 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.506531 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:11.507287 24524 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:11.508137 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.509266 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.254365 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:11.217981 31978 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:11.231807 32043 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.205005 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.511893 25215 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
W20260709 13:11:11.263346 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 61462us
I20260709 13:11:11.262946 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.850968 32032 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:11.262635 31927 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:11.204398 32002 consensus_queue.cc:1059] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:11:11.296995 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:11.240775 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:10.787863 32003 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.477828 32027 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.297310 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.231942 32038 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:11.261210 31905 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:11.264752 31926 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:11.241364 32047 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:11:11.287751 32023 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.314314 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3761) took 1190 ms. Trace:
I20260709 13:11:10.991704 31752 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.257022 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:11.329524 24666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.021s	sys 0.066s
W20260709 13:11:11.329902 24488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.011s	sys 0.042s
I20260709 13:11:11.257570 31928 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:10.968493 31972 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:11.326855 31886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.022s	sys 0.062s
I20260709 13:11:11.329320 32020 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.009857 31775 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:11.303077 31840 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:11.340678 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.344278 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.219316 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.327642 31970 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:11.332561 31833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.035s	sys 0.091s
I20260709 13:11:11.329236 31820 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:11.321558 25213 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:11.367462 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.220882 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:11.368749 25211 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:11.317708 31720 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.329478 31830 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:11.357574 31883 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:11.338784 31932 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:11.385990 32061 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:11:11.408556 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:11.433038 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.437448 24596 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:11.445429 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.419580 31912 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.451501 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.455569 31609 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.476337 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.235504 24673 rpcz_store.cc:276] 0709 13:11:09.244352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.244450 (+    98us) service_pool.cc:224] Handling call
0709 13:11:09.260233 (+ 15783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.411519 (+151286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.411549 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:09.411601 (+    52us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:09.411630 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.940975 (+1529345us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000ee2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:10.941031 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.949737 (+  8706us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347526528}
I20260709 13:11:11.432685 31829 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:11.481833 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55866.5us
I20260709 13:11:11.513906 31977 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:11.542961 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.543471 24520 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:11.544639 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.545650 25212 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:11:11.410187 32028 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:11:11.545843 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.487932 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:11.546487 32028 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:11.542871 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.492326 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:11.494706 25210 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:11.547008 32028 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:11.547408 24518 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:11.510182 24671 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:11:11.532861 31985 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.549242 24519 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
W20260709 13:11:11.549791 31886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.022s	sys 0.063s
I20260709 13:11:11.550218 31830 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.254346 31907 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:11.550688 24595 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:11.516988 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:11.551540 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:11.551298 31907 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.552060 24669 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:11.552390 31907 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.552772 31932 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.546921 24525 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:11.241501 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.556895 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:11.547993 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.547780 31609 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:11.497493 25218 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:11.548998 31985 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.513028 24592 raft_consensus.cc:2410] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:11:11.551776 31883 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.551755 24670 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:11.490164 31715 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.543191 24593 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:11.545480 31982 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:11.547439 24667 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:11.546583 24488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.011s	sys 0.042s
W20260709 13:11:11.553378 24666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.022s	sys 0.066s
I20260709 13:11:11.554046 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.551071 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.555846 24672 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.556249 24522 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:11.557008 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:11.546594 24520 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
W20260709 13:11:11.554729 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 146250us
I20260709 13:11:11.515552 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.552098 24595 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:11.460210 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:11.546538 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:11.514766 24420 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 18, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 18 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:11.561435 24517 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:11.582845 24516 raft_consensus.cc:1240] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:11:11.560551 25214 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:11.555142 24521 rpcz_store.cc:276] 0709 13:11:10.124192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.125172 (+   980us) service_pool.cc:224] Handling call
0709 13:11:10.125565 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.182700 (+1057135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.314077 (+131377us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54003dc7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:11.314258 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665381760}
I20260709 13:11:11.585619 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:11.627548 25213 raft_consensus.cc:2410] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:11:11.627746 24520 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:11.627967 24521 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:11:11.629478 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:11.584848 25185 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:11.558290 31905 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.510108 32059 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.632692 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:11.650643 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 65892.5us
I20260709 13:11:11.587502 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:11.537492 31887 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:11.526894 32063 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:11.594991 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.595739 25216 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:11.639118 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.653610 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:11.553834 31782 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.673557 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.633369 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:11.674789 24599 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:11.587494 31840 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:11.675020 32037 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:11.675493 32037 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.675855 32037 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:11.554728 31833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.035s	sys 0.092s
I20260709 13:11:11.516889 31957 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.681725 31824 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.682557 31720 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:11.682955 31720 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.683274 31720 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.683923 31824 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.551106 32002 raft_consensus.cc:3055] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:11.557866 31987 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:11.665588 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 108636us
I20260709 13:11:11.666100 24667 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:11.666456 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:11.666004 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:11.528853 31924 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.667805 25219 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:11.734543 25218 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
W20260709 13:11:11.632428 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 172298us
I20260709 13:11:11.735097 25218 pending_rounds.cc:85] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 15
I20260709 13:11:11.735445 25218 pending_rounds.cc:107] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:11:11.668375 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:11.693115 25210 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:11.662246 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1570) took 2033 ms. Trace:
I20260709 13:11:11.658298 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.658957 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:11.596853 31979 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.663431 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:11.582545 32023 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:11.736160 25211 rpcz_store.cc:276] 0709 13:11:09.628967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.629097 (+   130us) service_pool.cc:224] Handling call
0709 13:11:09.629373 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.551309 (+1921936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.662027 (+110718us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54002e7054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:11.662196 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3999800704}
I20260709 13:11:11.558454 32047 consensus_queue.cc:1243] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:11:11.682169 32067 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:11.584863 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:11.746698 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 161888us
I20260709 13:11:11.556509 32038 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:11.686717 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1975) took 2035 ms. Trace:
I20260709 13:11:11.588721 31715 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.595449 31928 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:11.588943 31883 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.649945 31702 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:11.712636 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:11.596511 31752 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.515076 32043 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:11.715353 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 56168.8us
I20260709 13:11:11.593839 32027 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:11.775514 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 63013us
I20260709 13:11:11.713752 24670 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:11.665117 31711 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.735724 25218 raft_consensus.cc:2889] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.746183 32067 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:11.737332 25215 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:11:11.757947 32038 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:11.657366 32064 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:11.561435 32020 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.686625 32032 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:11.561589 31829 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:11.583334 31886 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.129s
I20260709 13:11:11.788872 31883 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:11.591821 32018 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:11:11.685807 31723 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:11:11.458076 24409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 247281us
I20260709 13:11:11.855336 24420 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 15, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 15 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:11.925704 31723 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.926456 31723 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:11.715703 24517 raft_consensus.cc:1275] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:11.931588 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.859377 24518 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:11.696898 24525 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:11.933904 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.934319 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.935500 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.935737 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:11.936789 24525 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:11.865518 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 129653us
I20260709 13:11:11.663254 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.740072 24595 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:11.868779 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.877703 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:11.747658 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:11.879580 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.789744 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:11.587857 31820 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.774432 25182 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:11.885636 24416 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 350) took 33061 ms (client timeout 15000 ms). Trace:
W20260709 13:11:11.894495 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 261050us
W20260709 13:11:11.895985 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 240513us
I20260709 13:11:11.736591 25213 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:11.753602 25216 rpcz_store.cc:276] 0709 13:11:09.651257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.855392 (+204135us) service_pool.cc:224] Handling call
0709 13:11:09.855740 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.667975 (+1812235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.686483 (+ 18508us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54006e46d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:11.686649 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4001150720}
I20260709 13:11:11.899381 25218 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:11.741386 31323 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:11.767410 31609 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:11.913899 31702 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:11:11.714970 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 49027us
I20260709 13:11:11.755723 31824 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:11.561494 31927 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.561542 31926 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.711696 31941 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:11.546496 31970 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.041536 31970 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.043408 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:11.561831 31977 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:11.767498 31971 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.713042 31976 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.599177 32003 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.763548 31985 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.741883 32023 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:11.712186 32002 raft_consensus.cc:740] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:11.548080 32028 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.673264 32004 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 13:11:11.806104 32032 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.766494 32037 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.822463 32020 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.821936 32038 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.121770 24591 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:11:12.121918 32038 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:11.812223 31969 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:11.811389 32043 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:11.812551 32059 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.123925 24596 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:11.944492 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.787864 24672 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
W20260709 13:11:11.810642 32065 log.cc:927] Time spent T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:11.821214 32067 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:12.006448 24416 rpcz_store.cc:269] 0709 13:10:38.823745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.824299 (+   554us) service_pool.cc:224] Handling call
0709 13:11:11.885386 (+33061087us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:02.821892 (+     0us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17b8e3c0ac 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bf97b16c
0709 13:11:03.157675 (+335783us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:03.158329 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:03.158387 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:11:03.158418 (+    31us) tablet.cc:662] Decoding operations
0709 13:11:03.159973 (+  1555us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:03.160060 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:03.160085 (+    25us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:11:03.243729 (+ 83644us) tablet.cc:701] Row locks acquired
0709 13:11:03.269028 (+ 25299us) write_op.cc:260] PREPARE: finished
0709 13:11:03.307361 (+ 38333us) write_op.cc:270] Start()
0709 13:11:03.335271 (+ 27910us) write_op.cc:276] Timestamp: P: 1783602663297725 usec, L: 0
0709 13:11:03.340111 (+  4840us) op_driver.cc:348] REPLICATION: starting
0709 13:11:03.391595 (+ 51484us) log.cc:844] Serialized 7508 byte log entry
0709 13:11:03.697791 (+306196us) op_driver.cc:464] REPLICATION: finished
0709 13:11:03.947923 (+250132us) write_op.cc:301] APPLY: starting
0709 13:11:03.948029 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:04.414740 (+466711us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:04.414791 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:04.552599 (+137808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:04.553013 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:11:04.578055 (+ 25042us) write_op.cc:312] APPLY: finished
0709 13:11:04.578667 (+   612us) log.cc:844] Serialized 172 byte log entry
0709 13:11:04.579584 (+   917us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:04.579796 (+   212us) write_op.cc:454] Released schema lock
0709 13:11:04.579880 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:04.588800 (+  8920us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:04.588836 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24329,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":249812,"apply.run_cpu_time_us":30507,"apply.run_wall_time_us":640851,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83547,"num_ops":19,"prepare.queue_time_us":677665,"prepare.run_cpu_time_us":19789,"prepare.run_wall_time_us":267757,"raft.queue_time_us":131363,"raft.run_cpu_time_us":79461,"raft.run_wall_time_us":241217,"replication_time_us":328802,"spinlock_wait_cycles":4594432,"thread_start_us":758236,"threads_started":4,"wal-append.queue_time_us":65509,"wal-append.run_cpu_time_us":30312,"wal-append.run_wall_time_us":2136801}]]}
I20260709 13:11:12.128038 32067 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.770820 32074 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:11.936998 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:11.927670 24420 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 19, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 19 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.030141 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:11.986873 31829 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.049861 24600 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:12.048398 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 258605us
W20260709 13:11:12.045796 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 298065us
I20260709 13:11:12.043699 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:12.052033 31972 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.054634 31971 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.049489 31907 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:12.047745 32018 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:12.070122 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 192924us
I20260709 13:11:12.051656 31824 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.072312 32032 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.077997 31820 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:12.078523 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.141510 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.141109 31723 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.143576 31723 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:12.135461 32018 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:12.144312 31711 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:12.078204 31720 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:12.145432 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55287.6us
I20260709 13:11:12.146420 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:12.146955 31720 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.079113 31941 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.150285 32007 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:12.150787 32007 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.050940 32023 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.151162 32007 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.151573 24516 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:12.151966 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 122086us
I20260709 13:11:12.049629 31976 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.080938 31323 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:12.153139 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:12.153709 31323 consensus_queue.cc:1048] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:12.154901 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:12.079878 24525 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:12.155890 31323 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:12.054212 32004 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:12.156486 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.083859 31702 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:12.157255 24518 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 16.
I20260709 13:11:12.157542 31702 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:12.158151 31702 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.158742 32075 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:12.159466 32075 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:12.160528 31978 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:12.094491 24524 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:12.095082 24519 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:12.101970 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 327492us
I20260709 13:11:12.092173 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:12.111260 31926 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.111982 32028 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.113502 25217 raft_consensus.cc:2410] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:11:12.118547 32037 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.137192 31977 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:12.100914 32071 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
W20260709 13:11:12.137449 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 94163.7us
I20260709 13:11:12.138092 24517 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:12.138271 32059 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:12.139974 31927 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.144852 32018 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.151126 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.156917 32004 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:12.052470 32002 consensus_queue.cc:260] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.161054 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.140808 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:12.188071 24516 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:11:12.145426 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2174) took 2337 ms. Trace:
I20260709 13:11:12.107416 31980 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.188271 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:12.174299 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.135653 31907 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:12.163781 32043 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:12.161540 31824 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:12.160941 31978 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.140769 31609 consensus_queue.cc:1059] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:11:12.199129 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:12.151072 31941 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.138103 24420 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 5 to 9, term changed from 9 to 16, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to <none>, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:12.203269 31971 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:12.201323 31969 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.215495 31798 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:12.217368 31840 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:12.217788 31840 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:12.218761 31840 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.220280 31840 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.220922 24420 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.223217 24420 catalog_manager.cc:5697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 7 to 16, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 16 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:12.190275 32059 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:12.225822 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 74829us
I20260709 13:11:12.229238 31720 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:12.230037 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:12.230628 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.216919 31798 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:11:12.234490 31798 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:12.234903 31798 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:12.236003 31798 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.237234 31723 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.237685 31723 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:12.238065 31723 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.241726 31927 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.242532 31927 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.241773 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2521) took 1001 ms. Trace:
I20260709 13:11:12.243777 24598 rpcz_store.cc:276] 0709 13:11:11.239954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.475093 (+235139us) service_pool.cc:224] Handling call
0709 13:11:11.475364 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.475919 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.475948 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.476514 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.583635 (+107121us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:11.583683 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.583745 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.099716 (+515971us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:12.241310 (+141594us) raft_consensus.cc:1685] finished
0709 13:11:12.241345 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.241608 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":4745088,"thread_start_us":106824,"threads_started":1,"wal-append.queue_time_us":268849}
I20260709 13:11:12.245565 32073 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:12.201952 31977 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:12.161911 31972 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.247038 31977 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.228647 32059 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.196919 31907 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.202224 31978 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:12.252384 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 111761us
I20260709 13:11:12.196404 32043 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:12.200312 31976 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:12.254226 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 186742us
I20260709 13:11:12.160775 32075 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.244989 31927 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.204252 32038 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:12.255975 31782 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:12.230221 31720 raft_consensus.cc:3055] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:12.193441 24597 rpcz_store.cc:276] 0709 13:11:09.796179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.794972 (+998793us) service_pool.cc:224] Handling call
0709 13:11:10.796068 (+  1096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.796514 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:11.294622 (+498108us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.497168 (+202546us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.497401 (+   233us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.498247 (+   846us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.498451 (+   204us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:11.499918 (+  1467us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.500368 (+   450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.500439 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.501934 (+  1495us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180048e4a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:11.502744 (+   810us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b180048e4a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:11.650308 (+147564us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:11:12.049541 (+399233us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b4800150258. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:11:12.131171 (+ 81630us) raft_consensus.cc:1685] finished
0709 13:11:12.131194 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.133356 (+  2162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8028,"prepare.queue_time_us":89216,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":87,"raft.queue_time_us":347,"raft.run_cpu_time_us":5011,"raft.run_wall_time_us":731909,"spinlock_wait_cycles":48238976,"thread_start_us":641571,"threads_started":2,"wal-append.queue_time_us":363837}
I20260709 13:11:12.255635 24420 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 22, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 22 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.256332 32004 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.269897 32051 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.264729 31782 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:12.271780 31782 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.271804 32051 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.274685 32051 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.264851 31720 raft_consensus.cc:740] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:12.276502 31720 consensus_queue.cc:260] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:12.277455 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 132511us
I20260709 13:11:12.278710 24520 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:12.279211 32004 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:12.281356 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.287686 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.287444 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.288702 24670 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:11:12.289089 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:12.287932 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.278358 31720 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:12.293980 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 144978us
W20260709 13:11:12.264846 31932 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.517s	user 0.015s	sys 0.004s
I20260709 13:11:12.289124 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.298977 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.295117 24420 catalog_manager.cc:5697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.307651 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:12.311899 32073 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:12.312404 32073 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:12.312592 31985 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:12.313524 31702 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.316107 32002 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.319015 31702 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.327674 24516 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 14.
I20260709 13:11:12.325846 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.330682 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.334764 24598 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:12.335462 31972 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:12.337116 31813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.026s	sys 0.032s
W20260709 13:11:12.337494 31813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.026s	sys 0.033s
W20260709 13:11:12.338953 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.341300 31609 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:12.343489 31912 consensus_meta.cc:287] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.800s	user 0.015s	sys 0.000s
I20260709 13:11:12.344038 31913 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.344841 31798 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.344533 31913 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.347368 31913 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.335350 24600 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:12.302203 31971 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:11:12.355768 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.321028 32018 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.358733 24420 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 23, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 23 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.364089 24518 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:12.365311 24600 pending_rounds.cc:85] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 14
I20260709 13:11:12.366737 24600 pending_rounds.cc:107] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:11:12.367753 24600 raft_consensus.cc:2889] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.365386 31820 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:12.374533 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 86876.3us
I20260709 13:11:12.300482 32043 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.378814 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:12.380407 31905 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.011s
I20260709 13:11:12.384299 31905 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:12.385921 32088 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:11:12.386555 31905 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.387835 32059 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.390278 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:12.391829 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:12.380416 24420 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 11 to 18, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 18 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:12.381665 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 112489us
I20260709 13:11:12.397346 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.398159 25182 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:12.401162 24518 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:12.403000 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:12.404623 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.384675 31824 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.406363 24523 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:12.409220 31820 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:12.409832 31820 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:12.410349 31926 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:12.410910 31820 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.414445 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:12.414788 32074 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:12.414796 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2516) took 1194 ms. Trace:
I20260709 13:11:12.415585 32063 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:12.415840 24523 rpcz_store.cc:276] 0709 13:11:11.220566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.220679 (+   113us) service_pool.cc:224] Handling call
0709 13:11:12.414560 (+1193881us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54000baed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:12.414718 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716600192}
I20260709 13:11:12.417816 31824 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:12.420101 31723 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.430500 31978 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.431980 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.432834 31978 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.451453 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.435263 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.406322 31905 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.461541 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.462236 24599 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:12.463268 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.463351 31907 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.463862 24599 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.455106 24420 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.457345 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.465611 31907 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.465652 24591 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
W20260709 13:11:12.466585 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:12.457463 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 98506.8us
I20260709 13:11:12.457883 31824 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.457999 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:12.435220 31798 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.458531 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.458544 32063 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:12.459764 32020 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.466389 24420 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 10 to 16, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 16 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.410871 31926 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.383740 32023 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.467857 24525 raft_consensus.cc:2410] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:11:12.470728 24598 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:12.473766 31824 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:12.474884 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 70578.9us
I20260709 13:11:12.488255 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:12.475519 31798 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.481870 32043 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:12.483315 31971 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:12.484591 32018 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:12.485577 32028 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:12.486644 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:12.487413 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:12.487578 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:12.417809 32059 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:12.495078 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 61269.8us
W20260709 13:11:12.475744 32087 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:11:12.495266 24420 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:12.514930 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2528) took 1035 ms. Trace:
I20260709 13:11:12.515053 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.502933 31971 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.503151 32073 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.535234 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.536278 31971 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:12.504189 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46275.9us
I20260709 13:11:12.504932 31833 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.538219 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.538825 31833 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.505332 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:12.539294 31907 raft_consensus.cc:2764] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:11:12.539702 25213 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.540118 31907 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:12.540550 31907 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:12.540961 31907 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.510120 32074 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:12.541844 32076 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:12.542655 32076 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.507778 31715 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:12.506083 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:12.539301 31833 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.545465 25211 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.510459 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:12.512337 25217 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:12.547375 24672 raft_consensus.cc:2410] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:11:12.512426 32028 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.512531 32020 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.495500 31926 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:12.514520 24420 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.515362 24593 rpcz_store.cc:276] 0709 13:11:11.479673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.892947 (+413274us) service_pool.cc:224] Handling call
0709 13:11:11.893851 (+   904us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:11.894757 (+   906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.894795 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:11.925337 (+ 30542us) log.cc:844] Serialized 52 byte log entry
0709 13:11:12.135109 (+209772us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:12.135148 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.135214 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.514585 (+379371us) raft_consensus.cc:1685] finished
0709 13:11:12.514603 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.514733 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31457,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":77205,"threads_started":1,"wal-append.queue_time_us":331881}
I20260709 13:11:12.488428 32063 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.567107 32063 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.567914 31715 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:12.568437 31715 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:12.569463 31715 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.570688 31715 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.517858 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:12.518558 25182 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:12.519528 25215 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
W20260709 13:11:12.574299 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 62805.9us
I20260709 13:11:12.575078 32074 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:12.520673 32023 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:12.526901 24666 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:12.575951 32074 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:12.529327 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.529517 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.521417 31720 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:12.577215 24669 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:12.536331 32073 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.577365 31720 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.496739 31840 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:11:12.579114 31840 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:12.579476 31840 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:12.579731 31720 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:12.498697 32007 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.580497 31840 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.581296 31723 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:12.553009 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:12.582095 32007 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.582991 31970 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.584141 32018 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:12.584528 25214 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:12.507841 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:12.557396 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 85165.9us
I20260709 13:11:12.586700 31970 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:12.587221 31970 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:12.587661 31970 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:12.552521 25213 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:12.588634 31833 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.560823 24592 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:12.566324 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:12.489611 31782 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.575312 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:12.599658 32074 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.601504 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:12.603250 32064 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:12.603714 32064 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:12.604147 32064 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.605875 32073 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:12.606559 32073 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:12.607635 32073 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.609318 31720 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.609835 31720 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.611416 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.612490 24518 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:12.561322 32028 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.575217 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 1991) took 1157 ms. Trace:
I20260709 13:11:12.613538 25215 rpcz_store.cc:276] 0709 13:11:11.417808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.795960 (+378152us) service_pool.cc:224] Handling call
0709 13:11:11.796411 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.574250 (+777839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.574939 (+   689us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540066b2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:12.575166 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662226816}
I20260709 13:11:12.578409 24420 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 15, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 15 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.556288 31824 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:12.573625 31979 consensus_queue.cc:1175] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0131806e3b9647128f32db1ab8d314fc" responder_term: 17 status { last_received { term: 16 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:12.625587 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:12.626626 24669 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:12.629534 31905 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:12.633509 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:12.634332 25215 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:12.639305 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.640435 24592 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:12.640183 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.641991 31913 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:12.643944 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.644757 24593 raft_consensus.cc:2376] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21. Re-sending same reply.
I20260709 13:11:12.646554 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:12.653630 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.553661 24597 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:11:12.667914 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 126835us
I20260709 13:11:12.668355 31833 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.668434 31840 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:12.687459 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 169727us
I20260709 13:11:12.674486 25185 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:12.617643 24420 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 12 to 14, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 14 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:12.695783 25211 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
W20260709 13:11:12.703096 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 195350us
I20260709 13:11:12.706683 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:12.708182 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:12.714794 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.715530 24593 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.717149 32059 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:12.717651 32059 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:12.718147 32059 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:12.718271 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:12.720085 24599 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:12.721630 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:12.722257 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.725301 32020 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.725845 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.717702 24669 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:11:12.730114 24669 pending_rounds.cc:85] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 15
I20260709 13:11:12.730386 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:12.730245 32067 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:12.731612 32018 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:12.732108 32018 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:12.733042 32018 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.736011 32059 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.730387 31913 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:12.737180 24669 pending_rounds.cc:107] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:11:12.737323 31913 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.737526 24669 raft_consensus.cc:2889] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:12.737748 31913 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.739531 31970 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.742686 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.742908 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.746762 24666 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:12.729991 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:12.748178 31907 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.749614 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.750257 24671 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 16.
I20260709 13:11:12.750209 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.752230 24673 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:12.753501 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:12.753917 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:12.754490 24669 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:12.755961 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.756199 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:12.756506 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:12.758172 24516 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:12.756532 24525 raft_consensus.cc:2376] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21. Re-sending same reply.
I20260709 13:11:12.759703 31720 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.702636 32076 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.760367 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:12.754509 25212 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:12.762832 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1589) took 1248 ms. Trace:
I20260709 13:11:12.763562 31782 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:12.763841 24521 raft_consensus.cc:2393] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:12.753511 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.764567 24668 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:12.764607 32059 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.766094 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:12.763424 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:12.763226 25212 rpcz_store.cc:276] 0709 13:11:11.514874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.546312 (+ 31438us) service_pool.cc:224] Handling call
0709 13:11:12.762602 (+1216290us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b540066bf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:12.762751 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904510720}
I20260709 13:11:12.768260 24671 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:12.767596 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57943.1us
I20260709 13:11:12.770134 24490 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:12.772032 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.774430 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:12.778571 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 104224us
I20260709 13:11:12.781226 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.773648 24665 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.782763 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:12.790681 24516 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:12.790674 24518 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:11:12.790735 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:12.748154 31970 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.793898 24599 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:12.801780 31798 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.801908 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.802460 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:12.802825 24518 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:12.785842 31813 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.803352 31813 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.803745 31813 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.801826 24525 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: [16.9-17.10]
I20260709 13:11:12.794481 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:12.807207 31820 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:12.807694 31820 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:12.807803 31702 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:12.809028 31702 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:12.808619 31820 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.809448 31702 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:12.810335 31702 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.811550 31702 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:12.814236 32004 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.006s
I20260709 13:11:12.814991 32064 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.817155 32064 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.778103 32007 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:12.825949 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:12.827162 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.823822 32051 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.786062 31715 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:11:12.845763 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.845906 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:12.846621 32075 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:12.853464 24665 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:12.861497 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:12.864017 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:12.871551 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.783304 32063 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.876403 24599 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:12.876689 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:12.885696 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 59813.1us
I20260709 13:11:12.886241 31711 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.887082 32075 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:12.915504 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:12.887768 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.888330 31977 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:11:12.893383 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.896884 24598 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:12.898882 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:12.926373 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 49793.9us
I20260709 13:11:12.899192 25219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48942
I20260709 13:11:12.899933 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.927109 25219 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.927278 24597 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.927552 25219 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:12.927712 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.929263 24591 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:12.900930 24669 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:12.901588 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:12.901381 31813 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.902235 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:12.906773 31720 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:12.908458 31824 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:12.944224 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.908576 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:12.910399 31782 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:12.874297 32059 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.924290 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:12.935634 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:12.950855 31824 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.951143 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:12.958101 25215 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:12.968614 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:12.970808 24522 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:12.972602 25215 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:12.956403 31720 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.975298 31720 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:12.977295 31813 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:12.978230 24665 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:12.943497 31798 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:12.979125 24596 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:12.979338 25212 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:12.981464 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:12.953655 32043 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:12.869560 32051 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:12.952018 24594 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:12.955050 24595 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:12.946298 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:12.957671 31977 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:12.990878 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:12.998169 32063 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:13.000909 31813 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:13.001617 31813 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:13.002562 31813 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:13.004643 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:13.006376 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.007088 25216 raft_consensus.cc:2368] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22.
W20260709 13:11:13.007346 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 61168.1us
I20260709 13:11:13.008616 32004 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:13.009162 32004 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:13.009291 32067 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:13.009466 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.009902 32067 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:13.010160 32004 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.010890 32067 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.013557 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.016959 31907 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:13.017705 31907 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.018154 31907 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:13.019905 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.020081 31907 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:13.021485 31977 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:13.025461 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 116956us
I20260709 13:11:13.026207 24637 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.027268 32076 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.029147 31824 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:13.029714 31824 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:13.029898 25211 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:12.988358 31711 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.030766 32075 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:12.985389 32043 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.033475 32043 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:12.982614 31798 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:13.037457 31798 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:12.985622 32032 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:11:12.985019 31913 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.043890 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.044441 24596 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:13.010211 25217 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:13.044473 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:13.046180 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60934.7us
I20260709 13:11:13.046936 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.047701 24566 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:13.048738 31833 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:13.049230 31833 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:13.049427 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.050223 31833 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.051290 24596 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:13.030781 31711 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.055056 25215 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:13.055281 31711 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:13.058290 32051 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:13.059190 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.030040 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:13.044571 31913 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:13.072603 24518 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:13.074942 24522 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:13.076324 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.078217 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.078488 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.078913 24596 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:13.079946 24594 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:12.939729 25219 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:13.080945 31926 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.004s
I20260709 13:11:13.081386 31926 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.083868 31798 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.085976 31970 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.086488 31970 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:13.088490 31970 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:13.089051 31913 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:13.089816 31913 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:13.090178 25213 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 22. Ops: []
I20260709 13:11:13.092420 25219 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:13.021943 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.094481 31913 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:13.095422 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.079115 24600 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:13.117673 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:13.118068 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 136706us
I20260709 13:11:13.118497 24600 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:13.119117 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:13.120338 25185 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:13.121438 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:13.122366 32020 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:13.123072 31723 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.123384 32020 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:13.123903 32020 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:13.124358 32020 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:13.125656 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 103806us
I20260709 13:11:13.126735 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.103102 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.105366 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.133148 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.133424 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.134294 24591 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:13.134454 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.135583 24591 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:13.136761 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.108686 24597 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:13.101611 31926 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:13.098424 24639 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.113481 24599 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
W20260709 13:11:13.141878 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 43565.8us
I20260709 13:11:13.142763 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.128554 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:13.144131 24517 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:13.129439 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.130646 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:13.145942 24669 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 23: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:13.130841 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.147081 24667 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:13.147544 24594 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:13.131949 24673 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:11:13.137691 24672 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:13.147993 24673 pending_rounds.cc:85] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 9
I20260709 13:11:13.148361 24673 pending_rounds.cc:107] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:11:13.122404 31977 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:13.148609 24673 raft_consensus.cc:2889] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:13.148613 32076 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:13.152698 31977 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:13.115372 24593 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:13.155319 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.155928 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.130873 24665 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:13.156387 31979 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:13.153717 31977 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.143453 31907 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:13.160028 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:13.161219 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 225679us
I20260709 13:11:13.163911 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:13.164882 31813 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:11:13.165472 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.166385 24595 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:13.127475 31711 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:13.169646 24592 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:11:13.168557 32110 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:13.169183 32109 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:13.169499 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.177462 32110 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:11:13.111138 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 265296us
I20260709 13:11:13.177405 32109 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:13.177836 24673 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:13.178573 32110 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:13.178812 32109 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.180150 32109 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:13.165066 24596 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:13.189875 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:13.232098 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50387.9us
I20260709 13:11:13.231017 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.202411 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.231824 25184 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:13.239946 25212 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:13.241910 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 52124us
I20260709 13:11:13.242029 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:13.242552 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:13.243098 25211 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:13.245679 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:13.242177 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.246826 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:13.247781 24669 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:13.248313 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.245096 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:13.247200 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.239849 31720 raft_consensus.cc:2764] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:11:13.254616 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:13.257467 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.257596 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.256852 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.258927 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:13.264346 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.264997 25212 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:13.265113 24596 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:13.263571 24673 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:13.266894 24593 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:13.246656 32064 raft_consensus.cc:2804] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:13.267611 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.246838 31723 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:11:13.269518 31715 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:13.269968 31715 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.270026 25215 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:11:13.270401 31715 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:13.273337 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 130695us
I20260709 13:11:13.203608 31926 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:13.278957 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.278980 25216 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:13.279891 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.275931 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:13.201875 31970 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:11:13.283244 24592 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:13.288249 24592 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:13.183895 31979 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:11:13.282521 25211 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:13.190120 32043 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.292842 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:13.293390 24669 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 17: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:13.293491 24673 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.295874 25214 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:13.280571 32064 raft_consensus.cc:697] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:13.282641 31978 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:13.303448 25219 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:13.298734 24592 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.306612 24592 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:13.311004 24669 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:13.315258 24592 raft_consensus.cc:2410] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:11:13.291821 31913 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:13.317236 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.321173 24672 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:13.317219 31711 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:11:13.352185 32043 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:13.353569 24669 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:13.337184 31813 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:13.353832 32064 consensus_queue.cc:237] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.356573 31813 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:13.356961 31813 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:13.357456 32109 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:13.343458 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.358764 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.359764 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.343756 31907 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:13.344429 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.304150 25218 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:13.365980 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:13.363268 25216 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
W20260709 13:11:13.375941 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56997.3us
I20260709 13:11:13.376750 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.377243 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:13.378661 24669 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:13.385063 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:13.332544 32020 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.379663 31912 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:13.392973 31912 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:13.393401 31912 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.393745 31912 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:13.393793 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.394646 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:13.395193 25213 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:13.359642 32112 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:13.388214 24596 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:11:13.380013 31824 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:13.377553 32067 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.377203 31782 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:11:13.392040 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:13.399241 24595 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:11:13.377679 31720 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:13.398785 31824 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.401512 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.416381 24672 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:13.364243 31978 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:13.401146 32018 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:13.406539 25213 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:13.377632 32023 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.429237 25215 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:13.357821 31813 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.433272 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:13.435863 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 43916.2us
I20260709 13:11:13.437773 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.404675 31798 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:13.439814 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:13.380585 32063 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:11:13.447022 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:13.416821 32051 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:13.425488 31824 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:13.425349 32018 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:13.459055 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:13.460565 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:13.455015 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60104.4us
I20260709 13:11:13.457371 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:13.456029 25213 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:13.389653 32076 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:11:13.448167 32032 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:13.437286 31833 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:13.475418 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:13.481202 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:13.432994 31840 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
W20260709 13:11:13.490592 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49318.1us
I20260709 13:11:13.456279 32067 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:13.492874 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 55184.9us
W20260709 13:11:13.494894 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 57195.6us
I20260709 13:11:13.434772 32023 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.456175 32109 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:13.455938 31782 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:13.448395 32028 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:11:13.463606 32004 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:13.497942 32002 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:13.466553 31907 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:13.467404 32032 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.459646 32018 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.497404 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.503518 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.499064 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.492641 32067 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:13.459041 31926 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.043s
W20260709 13:11:13.544584 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 52904.9us
I20260709 13:11:13.553287 24490 leader_election.cc:400] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22.
I20260709 13:11:13.554229 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.557770 24518 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:13.505401 32134 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:13.543808 32032 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:13.500742 32073 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 13:11:13.498960 31798 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:11:13.491506 32038 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:11:13.502202 31971 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:11:13.540290 31907 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:13.590612 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.545151 32004 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:13.542373 31720 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:13.554864 31833 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:13.511538 31977 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:11:13.570103 32134 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.583683 31609 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:13.547264 32110 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:11:13.583386 31813 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:13.589746 32109 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:13.605540 32122 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:11:13.595176 31907 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:13.543617 31978 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.609820 32134 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.663969 24673 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:13.668865 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.677788 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:13.678390 25213 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:13.679070 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.680086 24597 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:13.681303 32139 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:13.683612 25215 raft_consensus.cc:1240] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:11:13.684767 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:13.684938 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 187594us
I20260709 13:11:13.683568 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.685665 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:13.685911 25218 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:13.685938 24598 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:13.615276 32043 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:11:13.655231 31609 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:13.693969 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.696532 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.697125 24595 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:13.706521 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:13.704927 25213 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:13.657730 31720 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.720536 31609 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.705998 32004 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:13.727605 32128 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.176s	user 0.003s	sys 0.000s
I20260709 13:11:13.662918 32067 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:13.743558 32131 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:11:13.749162 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 53299.9us
I20260709 13:11:13.749948 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.751296 24673 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:13.752662 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.762921 24667 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:13.766402 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.767426 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:13.771368 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.736627 31715 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:13.715430 32140 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:13.774358 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:13.779526 24525 raft_consensus.cc:3060] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:13.721045 32135 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:13.777297 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:13.781023 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:13.778419 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:13.795320 24523 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:13.784752 32007 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:13.785447 32130 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:13.787674 31912 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.792800 25213 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:13.814832 24593 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:13.801246 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:13.815641 24596 raft_consensus.cc:2368] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22.
I20260709 13:11:13.764789 31833 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:11:13.773123 32127 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.311s	user 0.000s	sys 0.003s
I20260709 13:11:13.795639 24521 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:13.809239 24598 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:13.810768 24595 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:13.774974 31711 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.792043 31824 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.826598 24490 leader_election.cc:400] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22.
I20260709 13:11:13.799885 32002 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:13.837730 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.870401 24672 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:13.846632 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:13.847180 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.847044 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:13.871999 24673 raft_consensus.cc:2410] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:13.824150 24525 raft_consensus.cc:2468] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:13.866276 24490 leader_election.cc:403] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.836481 32144 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:13.866865 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:13.814400 31820 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.873570 24667 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:13.873911 24522 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:11:13.883123 24594 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:13.889539 24523 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:13.862931 32038 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:13.807397 32135 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:13.908295 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 246542us
I20260709 13:11:13.910581 32148 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22.
I20260709 13:11:13.863696 32140 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:11:13.871228 31711 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:13.923302 32146 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:11:13.923903 31711 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:13.924474 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:13.927229 32137 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:11:13.929551 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:13.930461 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:13.932992 32139 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:13.933243 32156 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:13.933424 32139 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.933686 32156 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.933833 32139 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:13.934072 32156 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:13.934337 31912 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:13.936010 32020 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:13.937338 32144 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:13.938071 32144 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:13.985355 24525 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:11:13.985535 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:13.898038 31833 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:11:13.997694 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 154690us
I20260709 13:11:14.000089 24525 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: []
W20260709 13:11:14.005719 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 207931us
W20260709 13:11:13.994692 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55770.6us
I20260709 13:11:14.007681 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:14.012976 24595 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:11:14.018738 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 192272us
I20260709 13:11:14.023638 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:14.028146 24595 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:13.998484 32137 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.031947 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:14.035501 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:14.041934 25213 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:14.042299 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:14.057163 32145 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:14.058545 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:14.060639 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.061548 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.062716 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.063450 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:14.063776 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:14.064810 24516 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:11:14.065043 24519 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:11:14.066243 32023 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:14.066442 24673 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:11:14.062776 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.067947 32135 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:14.040592 32109 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:11:14.069216 32109 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:14.069674 32109 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:14.070541 32109 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:14.084631 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 56921.1us
I20260709 13:11:14.067307 25217 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:11:14.086421 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:14.091641 24595 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:11:14.093343 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:14.093827 24669 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:14.095485 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.046198 31913 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:14.044673 32137 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:14.083882 32139 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:14.046041 32075 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.031000 32112 consensus_queue.cc:1059] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:11:14.114820 31824 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.116684 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.147272 24522 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:14.086311 31715 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:14.155328 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 89172.1us
W20260709 13:11:14.161259 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74914.4us
W20260709 13:11:14.208062 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 181056us
I20260709 13:11:14.211719 24667 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:11:14.220316 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:14.221267 25218 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:14.204640 32109 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.149529 32137 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:14.145848 31913 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:14.241797 24669 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
W20260709 13:11:14.218225 32134 consensus_meta.cc:287] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.003s
I20260709 13:11:14.096720 32161 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260709 13:11:14.216604 32059 raft_consensus.cc:3055] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:14.273540 32059 raft_consensus.cc:740] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:11:14.296540 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 81007.4us
I20260709 13:11:14.150547 32075 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.305298 32154 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.305912 32154 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.308064 32154 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:14.308969 32152 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.309486 32152 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.311693 32152 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.267524 32109 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.269987 32134 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.396955 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:14.400192 24671 raft_consensus.cc:2410] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
W20260709 13:11:14.393748 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 256022us
I20260709 13:11:14.355005 31715 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:14.433539 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:14.434357 24668 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:14.435444 24666 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:11:14.448829 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:14.431864 32032 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.831s	user 0.007s	sys 0.003s
I20260709 13:11:14.453562 31824 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.461374 32139 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:14.471062 32179 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.512292 24491 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:14.498136 31978 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:14.431305 31913 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.461040 32032 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.498433 31824 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.515065 31715 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:14.520833 32064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.011s	sys 0.005s
I20260709 13:11:14.537662 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:14.464377 32059 consensus_queue.cc:260] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.525960 31978 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.543040 24600 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:14.519343 32139 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:14.556082 24524 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: [24.18-24.18]
W20260709 13:11:14.538715 32168 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:11:14.546370 32064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.011s	sys 0.006s
I20260709 13:11:14.515981 32179 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.557299 32171 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.557199 32192 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:14.608513 25218 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:14.612396 32191 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:14.613013 32191 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.614348 31978 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:14.615162 32191 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:14.616430 32172 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 13:11:14.633351 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 198257us
I20260709 13:11:14.636543 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.571434 32139 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:14.621085 32134 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.655879 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.658694 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.604136 32171 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.607276 32182 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.195s
I20260709 13:11:14.617069 32167 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.161s
I20260709 13:11:14.680161 32139 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:14.666534 32134 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:14.620754 32192 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:14.691293 32192 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:14.671471 24672 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:14.674239 32179 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.674731 32162 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:14.692860 32162 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.693351 32162 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:14.675211 32203 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.675567 32074 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:14.670995 32195 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:11:14.696409 32074 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:14.697314 32074 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.698613 32074 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:14.701663 31824 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.703440 32162 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:14.704365 32075 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:14.705998 32162 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:14.706208 32189 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:14.707512 32032 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.707871 32162 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:14.708263 32162 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:14.708376 32191 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:11:14.709064 24637 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.626s (SENT) [suppressed 10 similar messages]
I20260709 13:11:14.709383 32181 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.709959 32181 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:14.677448 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:14.710657 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2548) took 1035 ms. Trace:
I20260709 13:11:14.711130 24593 rpcz_store.cc:276] 0709 13:11:13.675623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.677257 (+  1634us) service_pool.cc:224] Handling call
0709 13:11:14.710420 (+1033163us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540032c154. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:14.710582 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275813120}
W20260709 13:11:14.670567 31907 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.010s	user 0.011s	sys 0.001s
I20260709 13:11:14.730872 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.732964 32171 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.733376 31702 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:14.733776 31702 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:14.734620 31702 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:14.735716 31702 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:14.736244 31820 consensus_meta.cc:287] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.844s	user 0.007s	sys 0.002s
I20260709 13:11:14.736657 31820 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:14.655368 31715 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:14.739779 32176 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.239s	user 0.000s	sys 0.002s
W20260709 13:11:14.717722 32018 consensus_meta.cc:287] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.166s	user 0.011s	sys 0.002s
I20260709 13:11:14.747051 24668 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
W20260709 13:11:14.746017 31813 consensus_meta.cc:287] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.130s	user 0.012s	sys 0.000s
W20260709 13:11:14.772193 32156 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.000s
I20260709 13:11:14.749989 32018 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.773566 24674 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:14.774498 32018 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.775223 32209 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:14.775923 32209 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:14.772668 32156 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:14.778362 32209 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:14.778944 32181 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:14.779287 32156 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:14.780220 24666 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:14.781052 32183 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.781539 32183 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.783485 32183 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.719607 31907 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.791203 31907 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:14.801932 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 92881.6us
I20260709 13:11:14.711386 32162 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.820314 24517 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:14.813448 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:14.822270 24669 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:14.809665 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:14.824908 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.826205 32063 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:14.826898 32063 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:14.821707 32109 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:14.817847 32146 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:11:14.818009 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:14.807809 31971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.213s	user 0.002s	sys 0.012s
W20260709 13:11:14.806788 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 145908us
I20260709 13:11:14.841276 24668 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:14.829831 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:14.845112 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:14.845669 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.861577 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.862421 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:14.865876 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.859400 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:14.868116 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.869676 24523 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:14.872326 32073 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:14.873147 32064 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:11:14.874404 32076 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:14.874577 32064 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:14.875412 32064 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:14.875738 32064 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:14.876721 32180 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.514s	user 0.000s	sys 0.002s
I20260709 13:11:14.878545 32076 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:14.842003 31971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.003s	sys 0.012s
I20260709 13:11:14.886231 24521 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:14.887190 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.873005 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:14.888787 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:14.891352 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:14.892158 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.880316 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:14.893920 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.894657 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.858566 32162 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:14.897830 24523 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:14.898350 32181 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:14.899127 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.899865 24523 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:14.900442 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.900652 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.901146 32156 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:14.901700 32212 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:14.858067 32028 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:14.905329 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.879148 31813 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:14.895649 32076 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:14.907256 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.912994 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:14.909157 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:14.914412 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55087.1us
I20260709 13:11:14.915310 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.917996 24518 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:14.923455 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:14.924010 24597 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:11:14.924831 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:14.926831 24597 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:14.876564 32064 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.899461 32209 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:14.938189 31840 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:14.939038 32197 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:14.948493 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:14.939848 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:14.893738 31907 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.936107 32183 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:14.943514 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:14.949383 24520 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:14.947149 31813 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:14.926286 32018 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:14.926702 32146 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:14.954013 31813 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.954898 32146 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.918649 32028 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:14.916406 32063 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:14.950320 24670 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:14.952090 24522 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
W20260709 13:11:14.958097 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.907105 31970 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:11:14.926193 32177 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:14.956689 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:14.942548 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:14.968858 24596 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:14.966689 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:14.932808 32181 consensus_queue.cc:1243] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:14.971367 24520 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:14.973313 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:14.977813 24596 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:14.971154 32177 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:14.963066 32028 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:14.948551 31978 consensus_queue.cc:1175] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "148dc963cec64232ad3b248abad6f36d" responder_term: 22 status { last_received { term: 20 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: [21.16-21.16]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:14.964569 32183 consensus_queue.cc:1243] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:11:14.983366 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.976758 32209 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:14.941781 32212 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.008168 32063 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:15.009359 32063 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.977394 32073 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:14.963382 32197 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:14.982645 32177 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:14.984925 32211 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.020072 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:14.993556 31926 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:11:15.025697 32073 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:15.028415 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 117556us
I20260709 13:11:15.027081 32211 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.014452 32181 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:15.031831 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:15.030090 32146 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.047093 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:15.048589 24669 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:15.036717 31913 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:15.049499 31913 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.051769 31913 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.052778 32197 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.054556 32211 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.058369 32212 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.059728 32076 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.033547 24522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28c13259bf74484588e0fb08995091cc"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:15.067188 24522 raft_consensus.cc:606] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:11:15.067606 24522 raft_consensus.cc:614] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:15.069041 32227 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:15.049000 24669 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:15.070233 24669 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.071414 24669 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:15.044371 32222 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:15.073675 32222 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.079238 24670 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:15.087296 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:15.035241 32228 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.089287 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 131766us
I20260709 13:11:15.096338 24669 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:15.099905 24670 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:15.101044 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:15.100767 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 69014.9us
W20260709 13:11:15.100860 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57019.6us
I20260709 13:11:15.102901 32231 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.099282 32177 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.105019 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2550) took 1043 ms. Trace:
I20260709 13:11:15.105432 24524 rpcz_store.cc:276] 0709 13:11:14.061837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.064594 (+  2757us) service_pool.cc:224] Handling call
0709 13:11:14.064908 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.566440 (+501532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.104764 (+538324us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540030e654. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:15.104949 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129080192}
I20260709 13:11:15.106712 24524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:15.106828 32177 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.107299 24524 raft_consensus.cc:606] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:15.107558 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:15.108747 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:15.110410 32136 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:15.111213 32136 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:15.111514 32136 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:15.112313 24671 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:15.112697 24671 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:15.113469 24671 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.097321 32146 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.114658 24671 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:15.115378 24669 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:15.115016 31782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.560s	user 0.008s	sys 0.013s
I20260709 13:11:15.131017 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:15.106946 32224 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:15.133011 32076 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:15.134346 25185 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:15.132202 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:15.137285 31782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.586s	user 0.008s	sys 0.013s
I20260709 13:11:15.149399 32229 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:15.136889 32231 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:15.187352 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.151881 31798 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:15.153115 32076 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:15.155225 31782 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:15.156291 32177 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:15.189030 32076 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:15.102481 32228 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.229945 32222 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:15.230780 32222 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:15.231942 32228 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.232690 32228 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:15.238086 31702 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:15.238291 32028 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.238858 31702 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.240614 32028 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.156598 32224 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.243316 32224 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.243925 32224 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:15.112322 32136 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.246379 32136 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:15.137022 32146 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.251278 32146 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:15.252100 32213 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:15.302821 24671 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:11:15.303359 24671 pending_rounds.cc:85] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 15
I20260709 13:11:15.303649 24671 pending_rounds.cc:107] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:11:15.303969 24671 raft_consensus.cc:2889] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.157883 32189 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:15.321497 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.357656 24491 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.22.225.190:40709, user_credentials={real_user=slave}} blocked reactor thread for 158437us
I20260709 13:11:15.365607 24665 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:15.366315 24665 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:15.159193 32231 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:15.368841 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 231974us
I20260709 13:11:15.390410 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:15.391402 24671 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:15.393913 24670 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:15.399896 24671 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:11:15.401508 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 270551us
I20260709 13:11:15.402972 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:15.390636 24665 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.357702 32146 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:15.366686 32028 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:15.368844 32182 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
W20260709 13:11:15.420053 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.412824 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:15.421011 25213 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:11:15.414952 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:15.416563 32051 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:15.192615 31798 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.396540 32231 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.422299 32051 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.427929 24665 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:15.393668 32189 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.430823 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:15.428915 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:15.431397 25213 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:15.390286 32177 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.416435 32229 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:15.435024 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:15.412294 32188 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:15.423187 31813 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:15.450660 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:15.420768 32146 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.453305 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:15.454028 25218 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:15.435534 32229 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.423364 32028 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.456980 32211 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:15.459519 32141 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.459699 32170 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:15.460392 32170 consensus_queue.cc:1243] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 148dc963cec64232ad3b248abad6f36d log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:15.460104 32141 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:15.461117 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.461637 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.461544 32170 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:15.462301 32141 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.462523 31913 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:15.466851 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2210) took 1992 ms. Trace:
I20260709 13:11:15.464637 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:15.467234 24594 rpcz_store.cc:276] 0709 13:11:13.474596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.474740 (+   144us) service_pool.cc:224] Handling call
0709 13:11:13.498950 (+ 24210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:13.893694 (+394744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.466637 (+1572943us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540025c954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:15.466794 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874455808}
I20260709 13:11:15.476351 32237 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:15.476605 32059 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:15.478454 32067 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:15.481820 32144 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:11:15.483052 31798 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.489463 32064 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:15.491699 32028 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:15.455853 31813 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.494104 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2015) took 1337 ms. Trace:
I20260709 13:11:15.494320 31813 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.494573 25217 rpcz_store.cc:276] 0709 13:11:14.156578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.156724 (+   146us) service_pool.cc:224] Handling call
0709 13:11:14.157033 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.359728 (+202695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.359775 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:14.414427 (+ 54652us) log.cc:844] Serialized 26 byte log entry
0709 13:11:14.560316 (+145889us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:14.560353 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.493599 (+933246us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54009ab854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:15.493655 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:15.493716 (+    61us) raft_consensus.cc:1685] finished
0709 13:11:15.493735 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:15.494001 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12522,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4375,"spinlock_wait_cycles":427065728,"thread_start_us":95530,"threads_started":1,"wal-append.queue_time_us":226192}
I20260709 13:11:15.496168 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:15.503758 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:15.506800 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:15.507128 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:15.465515 32229 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:15.452860 32110 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:15.508582 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:15.511693 25218 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 25 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 13:11:15.535145 25213 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:15.450790 32043 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 13:11:15.539618 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.594023 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:15.594753 24523 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:15.621407 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:15.437770 31782 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.503636 31702 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.627938 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:15.642908 25217 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:15.643710 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:15.473059 32164 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.153s
I20260709 13:11:15.648608 24665 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:11:15.524204 32162 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:15.469614 32212 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.124s
I20260709 13:11:15.528927 32028 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.465665 32188 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.653617 24665 pending_rounds.cc:85] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 11
I20260709 13:11:15.626200 31798 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:15.680361 24665 pending_rounds.cc:107] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:11:15.476966 32237 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.685698 24665 raft_consensus.cc:2889] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.628237 31971 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:15.628024 32197 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:15.689903 25217 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:15.645474 32141 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:15.595363 32110 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.723464 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2461) took 1843 ms. Trace:
I20260709 13:11:15.732206 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:15.734565 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:15.724010 24665 rpcz_store.cc:276] 0709 13:11:13.849679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.849818 (+   139us) service_pool.cc:224] Handling call
0709 13:11:13.873162 (+ 23344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.365485 (+1492323us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b540023a8a0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebddc0 00007f17bbf481c0 00007f17bbf49231 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c
0709 13:11:15.693157 (+327672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.693387 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12329856}
I20260709 13:11:15.685478 31798 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:15.679945 32239 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:15.771900 24523 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:15.761138 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:15.737051 32147 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:11:15.787784 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:15.687264 32028 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.790829 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:15.748128 32144 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.690315 32162 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.699476 31971 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.806012 32051 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.733484 32141 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.813405 24523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:53028
W20260709 13:11:15.813764 32244 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:15.813621 31798 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.815131 31913 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:15.816196 24522 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: [21.17-21.17]
W20260709 13:11:15.816355 32241 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:15.817464 24522 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:15.817699 31798 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:15.815399 32189 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.826632 32188 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.719756 32197 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.829284 24523 raft_consensus.cc:606] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:15.829437 32110 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.829731 24523 raft_consensus.cc:614] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:15.831336 24523 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:15.753221 32129 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:15.840258 24522 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:11:15.846572 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 394496us
I20260709 13:11:15.850431 25182 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:15.842796 32136 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.000s
W20260709 13:11:15.847558 32076 consensus_meta.cc:287] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.003s
I20260709 13:11:15.865512 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:15.868323 24592 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:15.845929 32198 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:15.872678 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.873525 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:15.881901 24523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:15.890419 24523 raft_consensus.cc:606] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:11:15.890937 24523 raft_consensus.cc:614] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:15.829573 32197 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:15.866387 32211 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:15.893762 32211 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:15.897437 32235 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 13:11:15.899273 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.761827 32239 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.896780 31702 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.841128 32144 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.870630 32240 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:11:15.910859 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.882190 32002 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:15.924541 24523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "96002c98f2d142e4b67dc5105a06079c"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:15.873333 32004 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.913671 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:15.925442 24666 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.008s	sys 0.032s
W20260709 13:11:15.943503 24666 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.009s	sys 0.033s
I20260709 13:11:15.933252 24523 raft_consensus.cc:606] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Received request to transfer leadership to TS 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:15.937165 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:15.944494 24522 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:15.942009 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:15.945838 24521 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:15.901667 32129 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:15.872746 32076 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.955459 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:15.912719 31702 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.960136 32197 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:15.960832 32162 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.941139 32002 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.890601 32198 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.913425 32146 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:15.915371 32136 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:15.969108 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:15.904460 32073 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:11:15.904871 32231 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.961310 31813 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.980046 24672 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 15.
I20260709 13:11:15.969504 32240 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:15.985941 32240 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.980763 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:15.971879 31978 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:15.977648 32220 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:15.977979 32136 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.973598 32129 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:15.972447 32197 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:15.992028 25215 raft_consensus.cc:2410] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:11:15.956166 32004 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:15.983522 31813 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.034368 24523 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:16.013486 32220 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:16.022727 32067 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.013720 31978 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:16.037906 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.028668 32148 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.027827 32188 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:16.036933 32184 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.070058 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:16.067776 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.038900 32147 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.066689 32067 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.038363 32220 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:16.085579 32245 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:11:16.086026 32197 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.087817 32004 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.089923 31702 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.091830 32129 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.092381 32188 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.098775 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:16.099192 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.116755 31820 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:16.129899 32144 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.129854 31820 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.132093 31820 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:16.118263 32254 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:16.122061 32002 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.099988 32239 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.119181 32231 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.119354 32067 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.118880 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2460) took 2269 ms. Trace:
I20260709 13:11:16.136545 25213 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:16.128965 24523 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:16.134073 31905 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:16.154022 32144 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:16.155625 32129 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:16.111846 32147 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:16.100883 32249 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:16.099462 31978 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:16.157267 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.160924 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1565) took 1238 ms. Trace:
I20260709 13:11:16.171263 25218 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:16.095085 32148 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.173904 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.039456 32229 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:16.175175 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 258149us
I20260709 13:11:16.171356 24598 rpcz_store.cc:276] 0709 13:11:14.922114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.954342 (+ 32228us) service_pool.cc:224] Handling call
0709 13:11:14.954665 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:14.954990 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.955016 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.486686 (+531670us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180036c7c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e272a6 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a
0709 13:11:15.487859 (+  1173us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b2c00170da8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:11:15.488351 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.857377 (+369026us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:15.857429 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.857526 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.160688 (+303162us) raft_consensus.cc:1685] finished
0709 13:11:16.160715 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.160861 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10190,"raft.queue_time_us":664,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":6183,"spinlock_wait_cycles":29424256,"thread_start_us":368632,"threads_started":1,"wal-append.queue_time_us":489967}
I20260709 13:11:16.159453 24674 rpcz_store.cc:276] 0709 13:11:13.849339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.849485 (+   146us) service_pool.cc:224] Handling call
0709 13:11:13.872239 (+ 22754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.773919 (+901680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.118621 (+1344702us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54000483d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:16.118803 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072225536}
I20260709 13:11:16.162192 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.183574 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:16.163411 32253 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:16.158385 32073 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:16.170919 32002 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.210417 24523 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:16.214867 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.101876 32184 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.177593 32067 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:16.216902 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.208552 31702 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.225670 24598 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:16.211428 32043 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:16.226752 32043 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.228780 32043 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.229861 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.193384 32076 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:16.212858 31820 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.233791 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.217479 32067 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:16.210301 32162 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 13:11:16.233286 32059 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.754s	user 0.013s	sys 0.000s
W20260709 13:11:16.242998 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 90918us
I20260709 13:11:16.243039 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.243054 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:16.229290 32261 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.246652 24674 pending_rounds.cc:85] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 10
I20260709 13:11:16.247128 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.229552 31702 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:16.219515 32002 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.265223 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.265285 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.266361 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.247655 32110 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.258172 32229 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.259256 32198 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.255112 24674 pending_rounds.cc:107] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:11:16.256507 32148 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.267378 32110 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.262749 25212 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:16.267863 24674 raft_consensus.cc:2889] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:16.268185 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.268915 24670 raft_consensus.cc:2393] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:16.263794 25219 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:16.260504 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.269737 24673 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:16.269902 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:16.265288 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.270438 25219 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:16.264889 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.267884 24665 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:16.271358 24668 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:16.267045 25214 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:16.264535 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.272382 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:16.272830 25210 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:11:16.273939 25210 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:16.268778 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.274572 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.274907 25212 raft_consensus.cc:2393] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:16.275139 24665 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:16.278743 31702 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.279697 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.280881 32059 consensus_queue.cc:1059] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:16.267488 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.282167 24669 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:16.282457 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.283030 25218 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:16.285071 24598 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:16.285454 25219 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:16.292739 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.266922 32002 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.296579 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.297101 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.297322 25212 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:16.297730 25210 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:16.298166 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.298254 31798 raft_consensus.cc:3055] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:16.298693 31798 raft_consensus.cc:740] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:16.299046 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:16.299257 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:16.299749 24596 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:16.299546 31798 consensus_queue.cc:260] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.300491 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.300761 31798 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:16.300839 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:16.238783 31820 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.301043 24596 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:16.301355 25216 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 15.
I20260709 13:11:16.280611 32261 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.302383 32059 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
W20260709 13:11:16.307682 32266 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:11:16.306916 32256 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:16.310532 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.217517 32073 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.302382 32067 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.324632 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.314674 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.339416 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.302161 32051 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:16.379855 24671 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:11:16.321062 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.480436 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:16.476213 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 161640us
I20260709 13:11:16.359758 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.482293 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.484390 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.485248 24591 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:16.455457 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.304316 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.432000 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.338368 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2475) took 1280 ms. Trace:
I20260709 13:11:16.362452 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.468258 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:16.331449 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1561) took 1410 ms. Trace:
W20260709 13:11:16.358019 24517 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2541) took 2336 ms (client timeout 1831 ms). Trace:
I20260709 13:11:16.443151 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:16.374428 24516 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:16.485442 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.301909 32147 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:16.303553 32177 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.378934 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:16.583763 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 151874us
I20260709 13:11:16.594969 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.509160 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.595422 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.592857 24597 rpcz_store.cc:276] 0709 13:11:14.921091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.927380 (+  6289us) service_pool.cc:224] Handling call
0709 13:11:14.927645 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:14.957706 (+ 30061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:14.957734 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:14.957769 (+    35us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:11:14.957796 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.331206 (+1373410us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b540013fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:16.331256 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.331391 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68748672}
W20260709 13:11:16.427049 32236 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.904s	user 0.005s	sys 0.000s
I20260709 13:11:16.620857 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.349340 31820 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.377730 32188 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.373193 32193 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.379369 32109 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:11:16.610494 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 142304us
I20260709 13:11:16.610988 32177 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:16.332078 32198 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.287s
I20260709 13:11:16.611997 32141 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.373495 32004 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:16.612128 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.612823 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.656934 24597 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
W20260709 13:11:16.599243 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 113856us
W20260709 13:11:16.353715 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 140231us
I20260709 13:11:16.598023 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:16.392549 31971 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.311805 32162 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:16.600823 25215 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 25: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:16.521451 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:16.422260 32256 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.066s	user 0.000s	sys 0.002s
I20260709 13:11:16.371703 32181 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:16.617755 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.356389 31913 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.254s
I20260709 13:11:16.347884 32249 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:16.486284 32051 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:16.447721 32136 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.387845 32184 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.692935 24598 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:16.594442 31782 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:16.431329 32197 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:16.597942 32148 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:16.609491 32138 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:16.700521 32268 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.095s	user 0.004s	sys 0.000s
I20260709 13:11:16.645246 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.699543 32136 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:16.649003 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.650517 24595 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:16.649039 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.491074 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:16.710999 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 62063.6us
I20260709 13:11:16.658376 24639 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:16.486652 24672 rpcz_store.cc:276] 0709 13:11:15.058456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.100812 (+ 42356us) service_pool.cc:224] Handling call
0709 13:11:16.338189 (+1237377us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54001383d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:16.338294 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019616512}
W20260709 13:11:16.654266 24517 rpcz_store.cc:269] 0709 13:11:14.021264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.021461 (+   197us) service_pool.cc:224] Handling call
0709 13:11:16.357833 (+2336372us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54003aedd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:16.357936 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736400256}
I20260709 13:11:16.666165 24591 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:16.711237 25211 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:16.478864 31970 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.169s
I20260709 13:11:16.336779 31978 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.717845 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:16.425069 32163 log.cc:927] Time spent T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.550s	user 0.000s	sys 0.003s
I20260709 13:11:16.656379 24600 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:16.659258 25210 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:16.700894 32184 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:16.671442 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:16.678871 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.651612 32177 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.646019 32188 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:16.649554 32109 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:16.678850 32181 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.741246 32188 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:16.743538 32188 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.748355 24668 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:11:16.730940 32177 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:16.649171 32193 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:16.699041 25213 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:16.753751 32109 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:16.754741 32193 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.509126 32152 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.149s
W20260709 13:11:16.757128 32274 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:16.754787 32109 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:16.759541 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:16.760118 24525 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:16.766700 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.767128 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:16.769065 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.773939 32110 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.777503 32073 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.779217 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:16.708122 31782 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.780378 24670 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:16.781574 31782 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.720662 32261 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.785449 31813 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.787323 32181 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:16.788363 24671 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:16.789822 24525 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:16.789960 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.790756 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.793383 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.793957 24518 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 14.
I20260709 13:11:16.794708 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.795181 24518 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:16.795886 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:16.796169 24525 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:16.796478 24518 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:16.797295 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:16.798939 32161 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:16.799371 32161 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:16.800185 32161 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:16.801461 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1642) took 1940 ms. Trace:
I20260709 13:11:16.802201 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1574) took 1023 ms. Trace:
I20260709 13:11:16.801875 24519 rpcz_store.cc:276] 0709 13:11:14.860641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.860750 (+   109us) service_pool.cc:224] Handling call
0709 13:11:14.861059 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.093240 (+1232181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.093272 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:16.093319 (+    47us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:16.093353 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.801053 (+707700us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000bccd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:16.801290 (+   237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.801408 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24233,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5102,"spinlock_wait_cycles":2780367616}
I20260709 13:11:16.802664 24592 rpcz_store.cc:276] 0709 13:11:15.779334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.889490 (+110156us) service_pool.cc:224] Handling call
0709 13:11:15.889949 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.017970 (+128021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.018015 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.023093 (+  5078us) log.cc:844] Serialized 26 byte log entry
0709 13:11:16.247988 (+224895us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:16.248063 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.801846 (+553783us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001ed7d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:16.801893 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.801938 (+    45us) raft_consensus.cc:1685] finished
0709 13:11:16.801951 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.802145 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2610,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10139,"spinlock_wait_cycles":293378304,"thread_start_us":215002,"threads_started":1,"wal-append.queue_time_us":299887}
I20260709 13:11:16.803875 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.804522 24519 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:16.805740 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.683811 32189 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.806782 32189 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:16.809633 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.344159 32028 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.688408 32051 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:16.676021 32162 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:16.694358 32264 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.083s	user 0.001s	sys 0.002s
W20260709 13:11:16.694561 32246 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.454s	user 0.000s	sys 0.003s
I20260709 13:11:16.672377 32004 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:16.694671 32272 log.cc:927] Time spent T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.091s	user 0.004s	sys 0.000s
I20260709 13:11:16.615154 32067 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:16.689630 31971 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:16.483446 32182 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:16.709167 24524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1646) took 1795 ms. Trace:
W20260709 13:11:16.705145 32269 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
W20260709 13:11:16.717447 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 59173.9us
I20260709 13:11:16.719408 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.719961 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.707037 32273 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.352981 32220 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.707247 32148 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:16.722337 24672 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:16.721025 32147 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:16.866310 32147 raft_consensus.cc:697] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:16.867269 32147 consensus_queue.cc:237] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.869335 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.870622 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.871644 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:16.875185 32237 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:16.878633 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2558) took 1986 ms. Trace:
I20260709 13:11:16.879076 24516 rpcz_store.cc:276] 0709 13:11:14.891853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.953955 (+ 62102us) service_pool.cc:224] Handling call
0709 13:11:16.373997 (+1420042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.651042 (+277045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.878431 (+227389us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003aedd0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:16.878570 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3265197440}
I20260709 13:11:16.880239 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.729704 31978 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:16.727698 32184 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.883034 32004 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:16.883173 32184 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.735378 24673 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:11:16.883400 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:16.884466 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.884611 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.805938 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1560) took 1885 ms. Trace:
I20260709 13:11:16.813386 25182 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:16.904269 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.814530 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.815443 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.382141 31979 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Stepping down as leader of term 25
W20260709 13:11:16.816897 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.820361 24637 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:16.821825 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:16.906071 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 85808.8us
I20260709 13:11:16.904886 24516 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:16.906927 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:16.905267 24518 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:16.908311 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.831480 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:16.709715 32197 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.833389 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:16.813182 32136 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:16.829319 32161 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:16.822482 32043 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:16.832470 32028 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.832216 32162 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:16.845804 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 126440us
I20260709 13:11:16.846819 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.844044 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:16.851199 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.844488 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.840431 24524 rpcz_store.cc:276] 0709 13:11:14.912048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.108153 (+196105us) service_pool.cc:224] Handling call
0709 13:11:15.108453 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:15.108767 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.108795 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:15.114326 (+  5531us) log.cc:844] Serialized 26 byte log entry
0709 13:11:15.371953 (+257627us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:15.371999 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:15.372081 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:16.356552 (+984471us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:16.702857 (+346305us) raft_consensus.cc:1685] finished
0709 13:11:16.702887 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.707763 (+  4876us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2428,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":11383168,"thread_start_us":243982,"threads_started":1,"wal-append.queue_time_us":333172}
I20260709 13:11:16.864220 32181 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:16.864604 32148 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:16.865636 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.718406 31820 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:16.885238 32189 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.885730 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.889092 24671 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:16.893455 25217 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:16.894505 32220 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:16.895430 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.842548 31971 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.959240 31926 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:16.961100 31971 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.836202 31715 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:11:16.832121 32177 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:16.909498 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 94170.3us
I20260709 13:11:16.903723 24599 rpcz_store.cc:276] 0709 13:11:14.920765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.920878 (+   113us) service_pool.cc:224] Handling call
0709 13:11:14.943514 (+ 22636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:15.032663 (+ 89149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:15.032695 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:15.032735 (+    40us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:15.032766 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:16.805740 (+1772974us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b540002dfd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:16.805785 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:16.805889 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204561280}
I20260709 13:11:16.963866 32177 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.964504 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:16.863149 32273 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:16.911258 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 97988.5us
I20260709 13:11:16.918490 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.921536 32182 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:16.919117 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:16.861543 32002 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:16.921334 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 89974.5us
I20260709 13:11:16.974121 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:16.921753 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 88443.3us
W20260709 13:11:16.925885 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 79128.1us
I20260709 13:11:16.924223 24523 raft_consensus.cc:2376] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19. Re-sending same reply.
I20260709 13:11:16.929266 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:16.974960 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.976015 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.926532 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:16.935828 24517 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:16.930842 24669 raft_consensus.cc:2410] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:11:16.918192 32184 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:16.918298 32152 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:16.919257 32144 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.962384 32197 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:16.923483 32237 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:16.983474 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.983808 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.966673 24597 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:16.910813 24670 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:16.917757 24522 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:16.968904 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:16.985239 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:16.926663 32146 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:16.907332 31979 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:16.974977 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:16.923802 32249 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:16.979593 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50388.5us
I20260709 13:11:16.998719 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.986837 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:16.978863 32184 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.986584 32212 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:16.972632 32182 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:17.005623 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:16.930373 32261 consensus_queue.cc:1059] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:11:16.989526 24672 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:16.986300 31971 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.926895 32004 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.055s
I20260709 13:11:16.925151 32043 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:16.969650 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:16.982503 32177 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:16.971618 31913 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:16.973392 32136 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:11:16.925724 32193 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:11:16.926766 32028 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:16.986136 31820 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.989387 24668 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 23: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:16.984143 32240 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:16.979180 32152 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:17.010288 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:17.001869 32181 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:16.984061 31715 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:17.016886 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47283.9us
I20260709 13:11:16.946272 31782 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:17.002395 32002 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:17.082109 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:17.082829 24517 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:17.002216 32184 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:17.004719 32237 raft_consensus.cc:697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:17.008997 32182 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.006655 32281 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:16.986470 32144 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:17.074759 32152 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:17.071916 32162 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:17.018122 32283 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:17.012169 32197 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:11:17.073894 32273 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.026319 32177 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.033501 32249 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:17.026537 31913 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:17.038199 32212 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:17.092896 32281 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.075771 31715 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.074635 32181 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:17.024384 31971 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.105661 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 121913us
W20260709 13:11:17.106774 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 96493us
I20260709 13:11:17.069204 32198 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:17.041358 31820 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.077672 31970 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:11:17.117396 32188 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.086599 32051 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:17.136475 25218 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:17.120553 31913 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.132313 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:17.148236 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 65338.4us
W20260709 13:11:17.137467 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 137177us
I20260709 13:11:17.127866 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.149889 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.117214 32177 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:17.131266 25211 raft_consensus.cc:1240] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:17.122812 32281 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:17.142045 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.142261 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.145023 25210 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:11:17.156145 25210 pending_rounds.cc:85] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 15
I20260709 13:11:17.156463 25210 pending_rounds.cc:107] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:11:17.117012 32249 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.131387 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.158347 25216 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:17.158809 25217 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:11:17.150611 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56521.9us
I20260709 13:11:17.160012 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.160581 25216 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
I20260709 13:11:17.127200 31715 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:17.126986 32181 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.151014 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:17.156862 25210 raft_consensus.cc:2889] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:17.149772 32285 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:11:17.154307 32197 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:17.154877 32291 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:11:17.169662 24525 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:17.168766 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.150930 31970 consensus_queue.cc:1243] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 26.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:11:17.186468 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.187235 25219 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:17.170722 32249 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:17.191818 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:17.203804 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:17.205168 32004 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:17.206333 32004 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:11:17.191843 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 181607us
I20260709 13:11:17.211670 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:17.151046 32188 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.221592 32136 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:17.227101 32136 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.227182 32110 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:17.227528 32136 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:17.227828 32110 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.228320 32110 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:17.195699 32189 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:11:17.229382 32303 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:17.229849 32303 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.230006 32051 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:17.230201 32303 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:17.231086 32144 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:17.232389 31820 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.233206 32028 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:17.240010 32136 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.239938 32110 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.242517 32136 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.244459 32110 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.247787 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:17.252763 25216 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:11:17.208019 32170 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:17.266052 25217 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:17.262442 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:17.263068 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.220324 32043 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:17.258270 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 176284us
I20260709 13:11:17.267882 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.184864 32197 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.270364 24670 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:11:17.270825 24670 pending_rounds.cc:85] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 16
I20260709 13:11:17.271045 24670 pending_rounds.cc:107] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:11:17.271346 24670 raft_consensus.cc:2889] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:17.183689 32237 consensus_queue.cc:237] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.286398 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 135453us
W20260709 13:11:17.290228 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 138445us
I20260709 13:11:17.292106 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:17.311228 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:17.285809 32136 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:17.351511 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.319057 32137 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:17.423102 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.427541 24592 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:17.312778 32144 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.428880 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:17.387010 32277 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:17.358790 32043 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:17.436187 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.386170 32302 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:17.384956 32147 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:17.463100 31971 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:17.499677 32294 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 13:11:17.469749 32004 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:17.471385 32288 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.554s	user 0.003s	sys 0.009s
I20260709 13:11:17.504619 32051 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.438630 32043 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:17.332840 32164 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.104s
W20260709 13:11:17.483229 32293 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:11:17.483882 32283 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:17.573662 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1660) took 1502 ms. Trace:
I20260709 13:11:17.573971 32283 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:17.574221 24518 rpcz_store.cc:276] 0709 13:11:16.071040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.921797 (+850757us) service_pool.cc:224] Handling call
0709 13:11:16.922146 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.922529 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.922548 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:16.925566 (+  3018us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.087468 (+161902us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:17.087506 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.087564 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.573329 (+485765us) raft_consensus.cc:1685] finished
0709 13:11:17.573360 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.573566 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1438,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":4386,"thread_start_us":109599,"threads_started":1,"wal-append.queue_time_us":209766}
I20260709 13:11:17.575304 32283 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.576788 32314 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:17.490207 32002 raft_consensus.cc:3055] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:17.577407 32002 raft_consensus.cc:740] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:17.578234 32002 consensus_queue.cc:260] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:17.493278 32273 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:17.579599 32212 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:17.580013 32212 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:17.432996 32279 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:17.319873 32189 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.367185 32261 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.090s
I20260709 13:11:17.419349 32136 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.585924 32136 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:17.507185 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 218052us
I20260709 13:11:17.587212 32189 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.465243 32141 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:17.481614 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:17.560449 32306 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:17.452806 32144 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:17.487663 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 101333us
I20260709 13:11:17.434753 32137 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.607650 32136 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.629623 32162 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:17.591434 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:17.656476 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65137.8us
I20260709 13:11:17.582564 32051 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.583092 32043 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:17.576802 32283 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:17.666190 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 462456us
I20260709 13:11:17.573686 31979 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.677500 32197 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.678105 31979 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:17.556268 32147 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.682674 32152 consensus_meta.cc:287] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.576s	user 0.002s	sys 0.006s
I20260709 13:11:17.683096 32152 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.683691 32147 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.655709 32028 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:11:17.580791 32212 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.685550 31715 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 13:11:17.655493 32141 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.685907 31715 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.686414 32184 consensus_meta.cc:287] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 13:11:17.686787 32184 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.663410 32304 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:17.689206 32304 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:17.690130 32304 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.698534 32281 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 13:11:17.700516 32002 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:17.665556 32004 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:17.702687 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3813) took 1676 ms. Trace:
I20260709 13:11:17.702409 32004 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.703045 24525 rpcz_store.cc:276] 0709 13:11:16.025872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.799173 (+773301us) service_pool.cc:224] Handling call
0709 13:11:16.799400 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.182526 (+383126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.702463 (+519937us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540018a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:17.702631 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850995072}
I20260709 13:11:17.702307 32043 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.704953 32004 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.706064 32043 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.709942 32317 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:17.710319 32317 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:17.711092 32317 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.711890 32182 consensus_meta.cc:287] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.000s
W20260709 13:11:17.688484 32161 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.000s
I20260709 13:11:17.698427 31715 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:17.704569 31913 consensus_meta.cc:287] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.000s
I20260709 13:11:17.720405 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.722754 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.725229 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:17.725889 25216 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:17.725968 25217 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:17.699023 32281 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:17.728952 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 377553us
I20260709 13:11:17.730654 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:17.668008 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:17.732362 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 64468.4us
I20260709 13:11:17.733817 24563 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.512809 32302 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.738489 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.743263 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.743804 25212 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:17.744534 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.706060 32188 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:17.741995 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.745829 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:17.750793 25219 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:17.747546 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.712307 32317 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:17.712296 32182 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:17.734545 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:17.765373 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:17.770884 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:17.786034 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 51546.9us
I20260709 13:11:17.789037 24563 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.742821 32162 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:17.799583 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:17.801496 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.806690 25219 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
W20260709 13:11:17.762588 32303 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.003s
I20260709 13:11:17.812674 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.797005 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.808874 24671 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:17.760772 32148 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.812s	user 0.002s	sys 0.008s
I20260709 13:11:17.807691 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.739041 31913 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.812933 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:17.859272 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.070s	sys 0.097s
I20260709 13:11:17.787474 32295 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:11:17.859745 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.070s	sys 0.097s
I20260709 13:11:17.865892 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.777798 31715 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:17.865579 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 57942.7us
W20260709 13:11:17.834803 32177 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.003s
W20260709 13:11:17.866372 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 549483us
I20260709 13:11:17.798597 32043 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:17.798931 32188 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:17.799765 32315 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:17.890583 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:17.891922 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:17.892074 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:17.867362 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 207034us
W20260709 13:11:17.872659 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 75770.2us
I20260709 13:11:17.892902 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.893371 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.811553 32110 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:11:17.874327 32112 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:17.877455 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:17.893580 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.894287 25217 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
W20260709 13:11:17.880213 32181 consensus_meta.cc:287] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.696s	user 0.004s	sys 0.003s
I20260709 13:11:17.845237 32303 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.893517 25216 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
I20260709 13:11:17.902207 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.894387 25213 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:17.903071 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.895296 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:17.841653 32182 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:17.892853 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:17.892592 25215 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:17.898623 24594 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:17.903926 32325 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.904558 25215 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:11:17.904493 32325 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.898902 24525 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:17.899083 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:17.899537 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:17.877094 32177 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.894886 32028 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:17.912576 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.915464 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:17.915963 24594 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:17.876549 31971 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:17.866281 32295 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:17.912691 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:17.897756 32043 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:17.906536 25217 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 15: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:17.916791 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:17.919487 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:17.929410 24600 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:17.922010 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:17.925396 25214 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:17.926676 25215 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:11:17.927285 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:17.910171 32319 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:11:17.885195 32188 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.929947 25216 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:17.931802 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.906339 31979 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:11:17.926385 32028 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:17.926553 32110 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:17.934203 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:17.934819 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.925732 25185 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:17.935760 24598 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:17.944890 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:17.937469 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.945611 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:17.938290 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:17.897531 32112 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:17.942817 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:17.946621 24595 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:17.949308 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.985857 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.989822 32109 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:17.991937 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:17.992086 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46559.1us
I20260709 13:11:17.993033 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:11:17.993855 32290 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.886s	user 0.005s	sys 0.000s
I20260709 13:11:17.898118 32162 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:11:17.988579 24591 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:11:17.996858 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:17.997485 24595 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:17.945005 24596 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:17.999059 24598 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:17.929926 32295 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:17.999051 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:18.002722 24518 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:11:18.007263 24519 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:18.011103 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.011742 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:18.013375 25213 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:17.940778 32188 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:17.912570 32181 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.011709 24591 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:17.867041 32148 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:18.061421 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 136339us
I20260709 13:11:18.082458 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:18.083285 24519 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:18.005620 31813 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:18.090626 32324 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:18.105676 31813 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:18.105908 32324 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.106240 31813 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:18.106389 32324 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:17.949283 32112 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:18.106009 32238 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:18.091593 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:18.113628 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.000567 32297 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:18.123668 24524 raft_consensus.cc:2393] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:18.125247 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:18.128835 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.130110 24668 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:18.130718 24521 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
W20260709 13:11:18.137378 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 148443us
I20260709 13:11:18.131517 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:18.164637 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.165524 32182 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:18.166569 31971 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:18.167024 31971 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.167356 31971 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:18.169566 32327 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:11:18.170760 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2583) took 1048 ms. Trace:
I20260709 13:11:18.171133 24517 rpcz_store.cc:276] 0709 13:11:17.122011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.122217 (+   206us) service_pool.cc:224] Handling call
0709 13:11:17.136345 (+ 14128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.136693 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.136727 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.137158 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.487230 (+350072us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18004a2360. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:11:17.713751 (+226521us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:17.713807 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.713895 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.170454 (+456559us) raft_consensus.cc:1685] finished
0709 13:11:18.170475 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.170700 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11751,"spinlock_wait_cycles":4604288,"thread_start_us":226248,"threads_started":1,"wal-append.queue_time_us":767776}
I20260709 13:11:18.173043 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:18.176077 31971 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.178932 32028 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:18.180809 31971 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:18.177039 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 217813us
I20260709 13:11:18.186127 24594 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:18.187162 32303 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.187162 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.188490 32303 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:18.190510 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.190718 32148 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:18.184321 32249 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.971s	user 0.005s	sys 0.002s
W20260709 13:11:18.184588 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.193382 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.204346 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:18.132799 31715 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:18.209869 24565 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:18.248373 32283 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:18.249300 32283 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.252148 32283 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:18.298045 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.384205 24524 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:18.199074 32303 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:18.108705 32322 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.105s
W20260709 13:11:18.411051 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 319595us
I20260709 13:11:18.207615 32281 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.210129 31979 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:18.214511 32004 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:18.421214 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:18.421411 32004 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:18.422281 32004 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.207181 32249 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.426752 24672 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:11:18.427161 24672 pending_rounds.cc:85] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 13
I20260709 13:11:18.427397 24672 pending_rounds.cc:107] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:11:18.427615 24672 raft_consensus.cc:2889] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.428290 32249 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:18.383406 32043 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:18.428956 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:18.431031 24523 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:18.431329 25212 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 26: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:18.432482 24523 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 13:11:18.432865 24523 pending_rounds.cc:85] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 15
W20260709 13:11:18.438652 24522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.007s
W20260709 13:11:18.439067 24522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.005s	sys 0.007s
I20260709 13:11:18.439862 24600 raft_consensus.cc:2410] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:11:18.442373 24523 pending_rounds.cc:107] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:11:18.444023 24523 raft_consensus.cc:2889] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.445173 24524 raft_consensus.cc:1275] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:11:18.449313 24519 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:18.452210 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:18.457845 32328 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
W20260709 13:11:18.459888 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.463529 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.412047 31715 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.460984 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.419694 31913 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.217262 32028 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.229s
I20260709 13:11:18.486065 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.438421 32043 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:18.428778 32223 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:18.493335 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.494239 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.494616 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.495141 25211 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:18.495231 32223 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:18.496883 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:18.497372 24600 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:18.497622 24674 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 26: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:18.443353 32325 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.457880 32152 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.465713 32112 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.467083 32002 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.502480 25211 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:18.516125 31813 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.508975 32002 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.518891 31813 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.519680 32059 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:18.521692 32315 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:18.522219 32315 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:18.523231 32315 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.508671 32112 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.509513 32043 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.536780 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.538520 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2586) took 1116 ms. Trace:
I20260709 13:11:18.539114 24597 rpcz_store.cc:276] 0709 13:11:17.422084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.422192 (+   108us) service_pool.cc:224] Handling call
0709 13:11:17.422526 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.432147 (+  9621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.432177 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.432591 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.896245 (+463654us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:17.896283 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.896345 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.538277 (+641932us) raft_consensus.cc:1685] finished
0709 13:11:18.538307 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.538469 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9277,"raft.queue_time_us":42182,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":389304,"threads_started":1,"wal-append.queue_time_us":533201}
I20260709 13:11:18.541504 24592 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:11:18.512212 24565 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:18.524791 32315 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:18.553716 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.009s	sys 0.009s
W20260709 13:11:18.554206 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.009s	sys 0.009s
W20260709 13:11:18.554512 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 559183us
I20260709 13:11:18.554728 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:18.561573 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:18.563210 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.564157 25210 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:18.561998 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:18.575248 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:18.579668 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:18.582723 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:18.519691 32002 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:18.485507 31715 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.548197 32303 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:18.604420 32303 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:18.606050 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 3933) took 1821 ms. Trace:
I20260709 13:11:18.605659 32303 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.606462 24671 rpcz_store.cc:276] 0709 13:11:16.784524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.947308 (+162784us) service_pool.cc:224] Handling call
0709 13:11:16.947609 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.854899 (+907290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.605811 (+750912us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400047ed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:18.605986 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980385408}
I20260709 13:11:18.548668 31971 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:18.607872 25244 heartbeater.cc:646] Failed to heartbeat to 127.22.225.190:40709 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.225.190:40709 timed out after 15.000s (SENT)
I20260709 13:11:18.608220 31971 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.610270 32184 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.610831 31971 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.565058 32281 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:18.588203 32152 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:18.618134 32144 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:18.620826 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.621309 32325 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:18.621702 32325 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:18.621954 24597 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:18.622102 32325 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.486421 32295 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.623072 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.624033 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.565224 32283 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:18.599182 32177 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.599552 32110 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:18.585033 31913 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:18.627611 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.629359 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.610276 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.625190 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.668113 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:18.584524 31813 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
W20260709 13:11:18.669189 32306 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:11:18.689636 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:18.675148 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 43951.5us
I20260709 13:11:18.691344 24595 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:18.675604 24593 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:18.648102 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.625214 32295 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.696146 25219 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 25: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
W20260709 13:11:18.697101 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 86883us
I20260709 13:11:18.610867 32184 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:18.704144 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.729508 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:18.625799 32283 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.738960 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:18.731195 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.741976 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.692619 24596 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:18.718129 32324 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:11:18.639164 32144 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:18.718343 32317 consensus_meta.cc:287] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.949s	user 0.006s	sys 0.006s
I20260709 13:11:18.699932 32110 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:18.682940 32281 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 13:11:18.758066 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.758805 24593 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:18.768834 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.771503 24600 raft_consensus.cc:2410] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:11:18.713493 32240 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.727298 32212 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:18.761699 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:18.754770 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.757006 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:18.772861 32136 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.779978 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:18.773860 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.782322 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:18.774449 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.752851 32347 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:18.741268 32322 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:18.775743 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.776160 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:18.702881 32356 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:11:18.783535 24596 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:18.767315 32177 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:18.767227 31813 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:18.766816 31978 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:18.773991 31715 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.785705 32110 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:18.787802 25216 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:18.753574 32004 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:18.787534 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.741554 32184 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:18.793902 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 89842.7us
I20260709 13:11:18.767096 32324 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.787703 32152 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:18.779323 32317 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:18.806777 32110 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.816793 32317 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.820001 31971 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:18.820434 32184 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.822412 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:18.823273 25211 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:18.794657 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.785319 32351 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:18.769061 32144 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.784268 32043 raft_consensus.cc:2764] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:11:18.833324 32184 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:18.809798 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:18.833871 32184 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.834709 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.798983 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.825582 24596 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:18.801340 24597 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:18.800258 32136 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:18.779978 32240 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.832546 25216 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:18.834784 32144 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:18.827505 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:18.836987 24591 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:18.843834 32362 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:18.815382 32295 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:11:18.812981 32152 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.816784 32110 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:18.849067 24596 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:18.895035 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.896202 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.896776 24596 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:18.899068 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.897980 25213 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.806818 31978 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.836001 32346 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.858578 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:18.848985 31913 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:18.850663 32137 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.893972 32152 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:18.855813 32188 consensus_meta.cc:287] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.000s
I20260709 13:11:18.807669 32177 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.900648 24596 raft_consensus.cc:2410] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:11:18.849341 32136 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:18.853907 32283 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:18.850009 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.902266 32184 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:18.858142 32356 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:18.896353 32144 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:18.905491 32346 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.918049 32368 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:18.924144 32368 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.926079 32368 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:18.926965 32223 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:18.902501 32358 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:18.929385 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.912017 25213 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:11:18.915060 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.905483 32281 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:18.858186 32361 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:18.930496 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:18.935834 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:18.936385 24671 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:18.916798 24600 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
W20260709 13:11:18.932147 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 97529us
I20260709 13:11:18.937582 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.937762 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.902848 32325 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.944410 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:18.944929 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:18.940111 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:18.932811 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 146204us
I20260709 13:11:18.945990 24672 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:18.947420 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:18.947772 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.941354 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:18.895694 32362 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.929052 32342 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.921752 32144 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.963928 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:18.964540 24520 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:18.965471 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:18.966013 24520 raft_consensus.cc:2393] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:18.967195 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.923406 32177 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.929713 32283 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:18.932261 32137 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.933393 32365 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:18.941665 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:18.942694 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.942619 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:18.977717 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.978457 24516 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:18.939479 32170 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:18.943324 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:18.943709 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:18.981141 24519 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:18.981204 24596 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:18.982610 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:18.945412 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:18.948323 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:18.985481 24524 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:18.986039 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:18.979774 32283 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.987200 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:18.987627 31978 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:18.950562 32240 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:18.988456 32324 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.988525 32283 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:18.931874 32358 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:18.989125 32109 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.989315 32358 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:18.974293 32342 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.991117 32365 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.992935 32342 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:18.957445 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:18.938890 32281 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.994136 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:18.994613 31971 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:18.995108 31971 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:18.995175 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:18.995503 32363 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:11:18.996088 24666 raft_consensus.cc:2410] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:11:18.996173 31971 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:18.996690 32372 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:18.960111 32138 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:18.975701 32295 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:18.997270 32138 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:18.997504 24525 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:18.998194 32138 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.998685 32362 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.933403 32356 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:18.999431 32138 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:19.001009 32356 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:19.000842 32136 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.001684 32177 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:18.928778 32051 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.923550 32346 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.913502 32188 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.002688 32177 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:19.003098 32177 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:18.941926 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:18.975666 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:19.004778 24669 raft_consensus.cc:2368] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 15. Current term is 16.
I20260709 13:11:18.933337 32361 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:18.963181 32341 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:18.993368 32365 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.957660 32373 consensus_queue.cc:1048] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:18.969993 32144 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:19.006035 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 58330.5us
I20260709 13:11:18.998716 24600 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:18.996913 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:18.941601 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 148331us
I20260709 13:11:18.988240 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:18.944782 32368 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:11:19.004233 24518 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:19.004199 32188 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:18.994992 32281 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.028151 24520 raft_consensus.cc:1275] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:19.030339 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:19.031548 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:19.008548 32051 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:19.003872 32177 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:19.083276 24599 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
W20260709 13:11:19.009699 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 68387.3us
I20260709 13:11:19.030571 24666 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:19.079983 24525 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
W20260709 13:11:19.084589 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 54338.2us
W20260709 13:11:19.081092 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47738.5us
I20260709 13:11:19.082067 24519 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 16.
I20260709 13:11:19.085040 24671 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:18.997186 32252 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:19.086277 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:19.087754 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:19.088550 24671 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:19.085062 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:19.089455 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:19.093017 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:19.084980 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:18.979683 32137 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.010380 32361 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:19.100019 24516 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 26.
I20260709 13:11:19.013293 32283 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:19.120795 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.102999 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:19.105793 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:19.123564 24519 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 26: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:19.107132 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:19.109540 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:19.108785 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:19.107036 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:18.997195 32372 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:19.090026 32043 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.083226 32297 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:19.124588 24671 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:19.102159 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:19.125581 24596 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:19.128120 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.094827 32188 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:19.008332 32109 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.130532 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:19.145903 24518 raft_consensus.cc:2368] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26.
I20260709 13:11:19.131846 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:19.132417 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:19.135049 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.147822 24519 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:19.152102 24516 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:11:19.152973 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:19.194468 25211 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:19.011101 32341 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:19.154987 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.198077 32341 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.199756 32341 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:19.011159 32170 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:19.146000 32356 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:19.203102 32170 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:19.113103 32189 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.172030 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.186960 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.205231 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:19.206679 32315 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:19.192463 24666 raft_consensus.cc:2410] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
W20260709 13:11:19.208923 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 54039.4us
I20260709 13:11:19.212625 25211 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:19.217860 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:19.109990 32051 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:19.095860 32252 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:19.134742 32295 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:19.105149 32240 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:11:19.222803 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:19.237007 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:19.223907 24596 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:19.239535 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:19.240877 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:19.224997 24671 raft_consensus.cc:1240] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:19.208470 32188 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:19.112293 32223 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.096s
I20260709 13:11:19.134563 32351 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:19.130201 32372 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:19.265887 24490 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:19.228794 32004 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:19.183377 32283 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:19.146025 32297 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.221449 32184 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:19.241837 32220 consensus_queue.cc:1048] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:11:19.245610 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.149255 32043 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.243978 32295 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.220805 24516 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:11:19.264921 32367 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:19.242427 32051 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:19.245592 32073 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:11:19.244692 32028 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:19.330567 32325 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:19.436101 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 190624us
I20260709 13:11:19.497378 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.295292 32004 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.319913 32370 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:19.328121 32184 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:19.265354 24669 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:19.551860 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.525302 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:19.476037 32110 consensus_meta.cc:287] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.003s
I20260709 13:11:19.444062 32170 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:19.557706 32377 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:19.558223 32109 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:19.559770 32375 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:11:19.669689 31715 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:19.560196 32237 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.671149 32237 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.560767 24669 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:19.561208 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.561854 32325 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:19.676057 24524 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:19.675982 32325 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:19.676599 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.507473 32184 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:19.677069 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.678242 32325 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.678308 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.678788 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2228) took 1743 ms. Trace:
I20260709 13:11:19.679507 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.559796 32310 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:11:19.670333 31715 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:19.681552 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.681941 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.551729 32240 consensus_queue.cc:1243] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:11:19.568351 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.504832 32004 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:19.587955 32358 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.000s
I20260709 13:11:19.593885 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:19.597618 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.614805 24600 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:19.682236 32295 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.648639 32137 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:19.645299 32335 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:11:19.653363 32051 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.654187 32141 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:19.655270 32152 consensus_meta.cc:287] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.742s	user 0.007s	sys 0.001s
W20260709 13:11:19.656071 25212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1629) took 1847 ms (client timeout 2103 ms). Trace:
W20260709 13:11:19.758667 25212 rpcz_store.cc:269] 0709 13:11:17.809007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.810150 (+  1143us) service_pool.cc:224] Handling call
0709 13:11:19.655784 (+1845634us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54005780d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:19.655968 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298067712}
W20260709 13:11:19.665738 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 2221) took 1732 ms (client timeout 2105 ms). Trace:
I20260709 13:11:19.646271 32370 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:19.682278 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:19.759987 24599 rpcz_store.cc:269] 0709 13:11:17.933761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.933978 (+   217us) service_pool.cc:224] Handling call
0709 13:11:19.665602 (+1731624us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001ec3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:19.665693 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2409588608}
W20260709 13:11:19.665692 24594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 2218) took 1739 ms (client timeout 1976 ms). Trace:
I20260709 13:11:19.666148 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2214) took 1770 ms. Trace:
I20260709 13:11:19.670334 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:19.292484 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 74691.5us
I20260709 13:11:19.761356 24592 rpcz_store.cc:276] 0709 13:11:17.895358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.896681 (+  1323us) service_pool.cc:224] Handling call
0709 13:11:18.541152 (+644471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.542053 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.665968 (+1123915us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54001ed2d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:19.666090 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481580416}
I20260709 13:11:19.761965 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:19.762540 24599 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:19.762639 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:19.679167 24595 rpcz_store.cc:276] 0709 13:11:17.935579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.470312 (+534733us) service_pool.cc:224] Handling call
0709 13:11:18.470635 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.699325 (+228690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.678566 (+979241us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540025bf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:19.678728 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507032960}
I20260709 13:11:19.763219 24592 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:19.763629 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:19.762926 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:19.589032 32379 log.cc:927] Time spent T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:19.689128 24519 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:11:19.577889 32374 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:11:19.589917 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 384740us
I20260709 13:11:19.681984 31715 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:19.694414 32181 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:19.695479 32378 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:11:19.603566 32342 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.692663 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1594) took 1076 ms. Trace:
I20260709 13:11:19.503801 32376 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:19.697096 32383 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:19.680809 32237 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:19.761252 24594 rpcz_store.cc:269] 0709 13:11:17.926782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.927050 (+   268us) service_pool.cc:224] Handling call
0709 13:11:19.665502 (+1738452us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540025ba54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:19.665601 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587537664}
I20260709 13:11:19.765818 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.771687 24563 leader_election.cc:400] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26.
I20260709 13:11:19.773061 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:19.506853 32188 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.776559 24600 rpcz_store.cc:276] 0709 13:11:18.616213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.496413 (+880200us) service_pool.cc:224] Handling call
0709 13:11:19.496708 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.692434 (+195726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.692610 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:19.785146 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 226803us
I20260709 13:11:19.785459 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:19.646495 32110 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.780964 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:19.780297 24598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.005s	sys 0.013s
W20260709 13:11:19.787462 24598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.005s	sys 0.013s
I20260709 13:11:19.787609 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.784337 24563 leader_election.cc:403] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:11:19.788316 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1588) took 1173 ms. Trace:
I20260709 13:11:19.697717 32358 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.790582 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.794059 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:19.794847 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.788727 24598 rpcz_store.cc:276] 0709 13:11:18.614727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.005675 (+390948us) service_pool.cc:224] Handling call
0709 13:11:19.008870 (+  3195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.009040 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:19.171194 (+162154us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.787877 (+616683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.787929 (+    52us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:19.788077 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.788141 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.788260 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10124,"prepare.queue_time_us":236895,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":22170,"thread_start_us":777427,"threads_started":2}
I20260709 13:11:19.764989 32152 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.811728 24598 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:11:19.808531 32237 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:19.808626 32182 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:19.808369 32295 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:19.815611 32295 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.816238 32295 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:19.817461 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:19.820391 32295 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:19.822824 32320 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 25.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:11:19.824203 32320 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:11:19.824640 32320 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:19.826308 32320 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.828053 32320 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:19.789162 32138 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.789s	user 0.011s	sys 0.003s
I20260709 13:11:19.781225 32383 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:19.791152 31715 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:19.835141 24522 raft_consensus.cc:2368] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:19.792570 32366 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:19.797403 32376 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:19.791451 32181 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:19.803223 32364 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:19.772976 32137 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:19.842932 32366 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.845214 32376 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:11:19.847479 32354 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.075s	user 0.015s	sys 0.014s
W20260709 13:11:19.848114 24591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 2229) took 1912 ms (client timeout 2408 ms). Trace:
I20260709 13:11:19.780237 32342 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:19.852119 24639 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 2.408s (SENT) [suppressed 17 similar messages]
I20260709 13:11:19.852520 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.805523 32385 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26.
I20260709 13:11:19.851157 32137 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.861902 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1587) took 1247 ms. Trace:
W20260709 13:11:19.851938 32144 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.734s	user 0.005s	sys 0.005s
I20260709 13:11:19.869987 24597 rpcz_store.cc:276] 0709 13:11:18.614499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.622863 (+  8364us) service_pool.cc:224] Handling call
0709 13:11:19.861730 (+1238867us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540033d954. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:19.861841 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335951616}
I20260709 13:11:19.872598 25216 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:19.873054 24597 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
W20260709 13:11:19.862200 24591 rpcz_store.cc:269] 0709 13:11:17.935839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.164365 (+228526us) service_pool.cc:224] Handling call
0709 13:11:19.847914 (+1683549us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54001caf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:19.848052 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544248192}
I20260709 13:11:19.873592 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:19.876194 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:19.879717 25216 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:11:19.880695 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:19.881274 25216 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:19.881383 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:19.882047 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:19.861581 32366 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:19.861917 32376 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:19.871742 32317 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.692405 31978 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.159s
I20260709 13:11:19.884270 25217 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 25: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:19.861156 32182 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:19.883690 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:19.871408 32137 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:19.873461 32351 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.904065 25214 raft_consensus.cc:2393] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 26: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:19.902992 25212 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:19.904201 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:19.875042 32385 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:19.910351 32358 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.915557 32184 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.916335 32043 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.917124 32004 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:19.918344 32322 consensus_meta.cc:287] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.124s	user 0.005s	sys 0.004s
I20260709 13:11:19.918738 32322 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:19.855508 32370 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.919186 32004 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:19.920025 24599 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20.
I20260709 13:11:19.924911 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1763) took 1423 ms. Trace:
I20260709 13:11:19.925477 24670 rpcz_store.cc:276] 0709 13:11:18.501641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.501774 (+   133us) service_pool.cc:224] Handling call
0709 13:11:18.502064 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.502400 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.502432 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.502827 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.627151 (+124324us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:18.627184 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.627243 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.846912 (+1219669us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:19.906703 (+ 59791us) raft_consensus.cc:1685] finished
0709 13:11:19.906731 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.924814 (+ 18083us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":990,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":111,"spinlock_wait_cycles":10140544,"thread_start_us":123963,"threads_started":1,"wal-append.queue_time_us":226462}
I20260709 13:11:19.926949 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:19.928200 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:19.931941 32162 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:19.933465 24594 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:11:19.935454 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:19.936666 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:19.938911 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.939452 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:19.939816 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.949733 24673 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:19.949010 32004 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.954878 32004 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:19.956187 32059 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:19.873214 32144 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:19.956712 32059 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:19.959010 32004 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:19.959390 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1754) took 2156 ms. Trace:
I20260709 13:11:19.959753 24668 rpcz_store.cc:276] 0709 13:11:17.803061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.803164 (+   103us) service_pool.cc:224] Handling call
0709 13:11:17.820201 (+ 17037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.132381 (+312180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.959157 (+1826776us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400276854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:19.959329 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712187264}
I20260709 13:11:19.928972 24670 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:19.984041 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2597) took 1222 ms. Trace:
I20260709 13:11:19.984947 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3953) took 1028 ms. Trace:
I20260709 13:11:19.984475 24596 rpcz_store.cc:276] 0709 13:11:18.761219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.593367 (+832148us) service_pool.cc:224] Handling call
0709 13:11:19.593611 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.593803 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:19.679959 (+ 86156us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.983704 (+303745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.983762 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:19.983816 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.983876 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.983983 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2614,"prepare.queue_time_us":81606,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":300699,"threads_started":1}
I20260709 13:11:19.985486 24666 rpcz_store.cc:276] 0709 13:11:18.964833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.092723 (+127890us) service_pool.cc:224] Handling call
0709 13:11:19.963399 (+870676us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b54001388d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:19.984858 (+ 21459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184035200}
I20260709 13:11:19.992339 32184 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.907389 32182 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:19.994787 32182 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:19.983407 32004 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:20.009413 32004 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.011890 32004 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:20.024435 32372 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.001s
I20260709 13:11:20.036532 32177 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:20.038095 32390 log.cc:927] Time spent T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:11:20.039603 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2600) took 1061 ms. Trace:
I20260709 13:11:20.040602 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2598) took 1279 ms. Trace:
I20260709 13:11:19.997526 32152 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.001456 32110 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.003491 32144 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:20.041052 24594 rpcz_store.cc:276] 0709 13:11:18.761507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.789805 (+1028298us) service_pool.cc:224] Handling call
0709 13:11:19.790233 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.933909 (+143676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.040352 (+106443us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001ebed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:20.040547 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291207552}
I20260709 13:11:20.045562 24666 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:19.947398 32351 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:20.028936 32283 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.705s	user 0.003s	sys 0.003s
I20260709 13:11:20.103411 32283 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.043643 32385 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:20.106537 32385 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.108713 32385 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.081328 32342 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.082885 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1674) took 2184 ms. Trace:
W20260709 13:11:20.083585 32341 consensus_meta.cc:287] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.883s	user 0.006s	sys 0.006s
I20260709 13:11:20.025025 32372 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.085712 32351 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.086534 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2518) took 1134 ms. Trace:
I20260709 13:11:20.083506 32366 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:20.094273 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:20.094697 24420 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 349) took 27180 ms (client timeout 15000 ms). Trace:
I20260709 13:11:20.095628 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2517) took 1143 ms. Trace:
I20260709 13:11:20.119488 24665 rpcz_store.cc:276] 0709 13:11:18.951718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.964117 (+ 12399us) service_pool.cc:224] Handling call
0709 13:11:18.980723 (+ 16606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.001270 (+ 20547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.001302 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.001342 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:19.001371 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.095375 (+1094004us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b540040a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:20.095430 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.095563 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46778240}
I20260709 13:11:20.116375 24667 rpcz_store.cc:276] 0709 13:11:18.951976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.953371 (+  1395us) service_pool.cc:224] Handling call
0709 13:11:18.953668 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.997009 (+ 43341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.997038 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:18.997097 (+    59us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:18.997130 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.086309 (+1089179us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b54002b6454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:20.086358 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.086464 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99263232}
W20260709 13:11:20.121169 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.098883 32297 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:20.100198 32361 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.955s	user 0.007s	sys 0.000s
I20260709 13:11:20.101027 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1640) took 1397 ms. Trace:
I20260709 13:11:18.107574 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:20.110316 24521 rpcz_store.cc:276] 0709 13:11:17.898881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.899532 (+   651us) service_pool.cc:224] Handling call
0709 13:11:17.899780 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.131155 (+231375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.082642 (+1951487us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54003dd1d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:20.082802 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530633472}
W20260709 13:11:20.127947 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.125684 25213 rpcz_store.cc:276] 0709 13:11:18.703621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.704683 (+  1062us) service_pool.cc:224] Handling call
0709 13:11:20.100861 (+1396178us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54004ee3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:20.100963 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357149056}
W20260709 13:11:20.133908 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 281797us
W20260709 13:11:20.124799 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 253972us
W20260709 13:11:20.118867 24420 rpcz_store.cc:269] 0709 13:10:52.914804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.916020 (+  1216us) service_pool.cc:224] Handling call
0709 13:10:55.096262 (+2180242us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:10:55.647356 (+551094us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b5400002490. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e22640 00007f17c1cf9b76 00007f17c1e03c3e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:11:20.094602 (+24447246us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:13.005504 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:13.006139 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:13.006196 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:11:13.006226 (+    30us) tablet.cc:662] Decoding operations
0709 13:11:13.007607 (+  1381us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:13.007725 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:13.007750 (+    25us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:11:13.009015 (+  1265us) tablet.cc:701] Row locks acquired
0709 13:11:13.083405 (+ 74390us) write_op.cc:260] PREPARE: finished
0709 13:11:13.083585 (+   180us) write_op.cc:270] Start()
0709 13:11:13.083756 (+   171us) write_op.cc:276] Timestamp: P: 1783602673083514 usec, L: 0
0709 13:11:13.083795 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:11:13.084481 (+   686us) log.cc:844] Serialized 6434 byte log entry
0709 13:11:13.266928 (+182447us) op_driver.cc:464] REPLICATION: finished
0709 13:11:13.453185 (+186257us) write_op.cc:301] APPLY: starting
0709 13:11:13.464758 (+ 11573us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:14.075759 (+611001us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:14.075887 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:14.776230 (+700343us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:14.776635 (+   405us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:11:14.776703 (+    68us) write_op.cc:312] APPLY: finished
0709 13:11:14.780966 (+  4263us) log.cc:844] Serialized 148 byte log entry
0709 13:11:14.858547 (+ 77581us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:14.895488 (+ 36941us) write_op.cc:454] Released schema lock
0709 13:11:14.918925 (+ 23437us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:14.977257 (+ 58332us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:14.980381 (+  3124us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2650277,"reported_tablets":45,"spinlock_wait_cycles":394749952,"child_traces":[["op",{"apply.queue_time_us":137884,"apply.run_cpu_time_us":43350,"apply.run_wall_time_us":1528262,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71007,"num_ops":16,"prepare.queue_time_us":260339,"prepare.run_cpu_time_us":5821,"prepare.run_wall_time_us":128425,"raft.queue_time_us":130002,"raft.run_cpu_time_us":5577,"raft.run_wall_time_us":26027,"replication_time_us":182988,"thread_start_us":436008,"threads_started":5,"wal-append.queue_time_us":164339,"wal-append.run_cpu_time_us":30391,"wal-append.run_wall_time_us":2151546}]]}
W20260709 13:11:20.142366 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 215498us
I20260709 13:11:20.138401 32182 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:20.133714 31971 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:20.152096 24490 leader_election.cc:400] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20.
I20260709 13:11:20.167816 24490 leader_election.cc:403] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.140784 32351 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:20.134096 32361 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:20.192070 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 283242us
I20260709 13:11:20.196249 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.197396 24671 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:20.192646 32364 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:20.200691 32110 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:20.200845 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.201018 32364 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.171737 31971 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.203801 32364 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.151315 32059 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.205652 31971 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.191747 32051 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.207140 32059 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.192345 32181 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:20.207929 32181 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.190795 32137 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.149677 32184 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:11:20.209949 32184 consensus_queue.cc:1243] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:11:20.191082 32351 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.210807 32137 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:20.188880 32188 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.211530 32376 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.211611 32188 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.213989 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2599) took 1452 ms. Trace:
I20260709 13:11:20.214380 24600 rpcz_store.cc:276] 0709 13:11:18.761788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.792968 (+1031180us) service_pool.cc:224] Handling call
0709 13:11:19.793418 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:19.796763 (+  3345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.796809 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:19.808291 (+ 11482us) log.cc:844] Serialized 52 byte log entry
0709 13:11:20.050460 (+242169us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:20.087446 (+ 36986us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.088042 (+   596us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.088244 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.088311 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.213761 (+125450us) raft_consensus.cc:1685] finished
0709 13:11:20.213782 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.213928 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2824,"prepare.queue_time_us":36589,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":3670,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":8633,"thread_start_us":238941,"threads_started":1,"wal-append.queue_time_us":330984}
W20260709 13:11:20.216629 32359 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.442s	user 0.000s	sys 0.015s
I20260709 13:11:20.170094 32182 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.225016 32361 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.225543 32357 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:20.225893 32182 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.225994 32357 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:20.227064 32357 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.228063 32188 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:20.228296 32357 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.231168 32051 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20.
I20260709 13:11:20.233675 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:20.234545 25213 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:20.238131 24521 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:20.239001 25213 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:20.239158 32370 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:20.239610 32370 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:20.240394 32370 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.241540 32370 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:20.243606 25213 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:20.245203 32372 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.245138 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.245788 25218 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:20.247190 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:20.249140 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.252030 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.253753 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.255525 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.256578 24524 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 16: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:20.256778 32366 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.257812 32351 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:20.233632 32392 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:20.259949 32376 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:20.260733 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.261065 24524 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:11:20.261376 25218 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:20.263188 32181 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.265902 32302 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:20.264860 24593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1580) took 1652 ms (client timeout 2114 ms). Trace:
W20260709 13:11:20.269344 24593 rpcz_store.cc:269] 0709 13:11:18.612616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.620546 (+  7930us) service_pool.cc:224] Handling call
0709 13:11:20.264707 (+1644161us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b540027c9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:20.264801 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124525952}
I20260709 13:11:20.270711 32383 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.271771 32383 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:20.276535 32303 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:20.277140 32303 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.279384 32303 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.279524 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2593) took 1336 ms. Trace:
I20260709 13:11:20.279948 24523 rpcz_store.cc:276] 0709 13:11:18.943284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.944129 (+   845us) service_pool.cc:224] Handling call
0709 13:11:18.944462 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.204128 (+259666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.204174 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.204232 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:19.204310 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.279292 (+1074982us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400442854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:20.279343 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.279464 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596667648}
I20260709 13:11:20.281169 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.281684 24600 raft_consensus.cc:2376] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22. Re-sending same reply.
I20260709 13:11:20.285481 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.287410 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.289072 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.289830 24593 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:20.255146 24517 raft_consensus.cc:1240] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:20.290355 32351 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.288049 24594 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:20.290889 32351 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.291703 24594 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:11:20.286182 24591 raft_consensus.cc:2376] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18. Re-sending same reply.
I20260709 13:11:20.293174 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.294083 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.294850 24597 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:20.298084 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:20.298846 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.300414 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:20.305704 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.306917 24517 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:20.309017 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.309832 32401 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:20.314599 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.314843 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:20.312873 24524 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:20.312645 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.316288 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.315459 24667 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:20.293171 24417 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 14 to 16, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 16 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:20.319635 31971 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:20.323632 32004 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:20.326745 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.327533 24524 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:20.334806 24565 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:20.340477 32303 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.304355 32238 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 13:11:20.344473 32303 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.348269 32004 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.348578 32252 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:20.348794 32004 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:20.349251 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.349493 32303 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:20.352419 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:20.352527 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:20.353119 25212 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:20.353416 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:20.354426 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:20.354596 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.355521 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.355782 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.350862 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:20.357071 25213 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:20.357409 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:20.358240 24668 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20.
I20260709 13:11:20.358203 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.358911 24591 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:20.040087 24598 rpcz_store.cc:276] 0709 13:11:18.978650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.812496 (+833846us) service_pool.cc:224] Handling call
0709 13:11:19.812756 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.812956 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:19.813247 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.039257 (+226010us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.039311 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:20.039368 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.039429 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.039547 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":581,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":9018,"thread_start_us":225654,"threads_started":1}
W20260709 13:11:20.360320 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.350842 32004 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:20.361373 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.362095 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.363612 32357 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:20.363987 32357 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:20.347177 32385 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:20.364540 32357 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.364641 32385 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.345903 31971 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:20.345201 32177 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:20.357383 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.363945 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.376605 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.376681 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:20.377174 25216 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:20.378640 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.380971 24591 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:20.371038 25213 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:11:20.373632 24593 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:20.374513 24673 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:20.369065 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.372418 25212 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:20.385851 25212 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:20.385872 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.397961 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.398638 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.399386 24519 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:20.400514 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:20.401443 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.401880 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:20.400719 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:20.410280 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:20.410929 25211 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:20.412137 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:20.414512 24674 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:20.412971 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.416775 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:20.417663 24519 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.409312 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.421275 32182 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:20.422552 32361 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:20.422976 32361 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:20.423327 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.423410 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.423924 24592 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:20.425213 24673 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:20.365072 32385 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.423996 24593 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.419832 24563 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:20.441622 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:20.444195 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.444741 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.445459 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.445816 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.419301 24417 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.426090 24523 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:20.426110 32004 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:20.427089 32188 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:20.418416 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:20.371349 32249 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 13:11:20.432021 24522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2590) took 1489 ms (client timeout 1598 ms). Trace:
I20260709 13:11:20.431919 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.366606 32351 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.434754 24519 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:20.416359 32181 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:11:20.436340 32059 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:20.411767 32302 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.418351 32372 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:20.425414 32366 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:20.444802 24598 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:20.447656 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.423355 32361 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.454293 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.475776 24599 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:20.454501 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:20.476868 24523 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:20.477917 24523 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:20.456106 24593 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:20.459928 24519 raft_consensus.cc:1240] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 13:11:20.458082 24522 rpcz_store.cc:269] 0709 13:11:18.942471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.944128 (+  1657us) service_pool.cc:224] Handling call
0709 13:11:20.431829 (+1487701us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54003ddbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:20.431963 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046937472}
I20260709 13:11:20.460474 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.460879 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.463359 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.447273 32283 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:20.482735 32283 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:20.464735 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.483408 24591 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:20.483588 32283 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.484488 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:20.457614 31971 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:20.485888 31971 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.486265 31971 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:20.487902 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50178 (request call id 2594) took 1540 ms. Trace:
I20260709 13:11:20.488294 24525 rpcz_store.cc:276] 0709 13:11:18.947098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.947220 (+   122us) service_pool.cc:224] Handling call
0709 13:11:20.487720 (+1540500us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b54000bc2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:20.487847 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113832192}
I20260709 13:11:20.488870 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.464838 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.508818 24518 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:11:20.469748 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.471573 24520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3845) took 1362 ms. Trace:
W20260709 13:11:20.491475 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 68615.2us
I20260709 13:11:20.512722 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.513705 32297 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:20.514093 32297 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:20.514865 32297 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.515458 32366 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:20.516026 32297 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.516358 32366 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:20.506953 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.511124 24520 rpcz_store.cc:276] 0709 13:11:19.109396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.110453 (+  1057us) service_pool.cc:224] Handling call
0709 13:11:19.110702 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.256824 (+146122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.256857 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.256902 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:19.256945 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.471269 (+1214324us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400278dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:20.471335 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.471493 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335601536}
I20260709 13:11:20.518381 31926 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.510995 24417 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 14 to 20, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 20 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:20.520768 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.490520 24597 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:20.466957 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:20.521322 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 107382us
I20260709 13:11:20.522070 24591 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.522073 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.522426 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:20.486266 32361 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.491500 32351 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:20.528026 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.532119 24600 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:20.532543 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.533538 32137 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.533938 24417 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 12 to 17, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 17 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:20.534911 32182 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:20.535310 32182 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:20.535661 32348 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:20.536033 32348 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:20.536145 32182 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.489322 32372 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.537261 32372 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.539688 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3851) took 1390 ms. Trace:
I20260709 13:11:20.536849 32348 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.540104 24518 rpcz_store.cc:276] 0709 13:11:19.149856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.183642 (+ 33786us) service_pool.cc:224] Handling call
0709 13:11:20.487844 (+1304202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:20.512114 (+ 24270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.539485 (+ 27371us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000bc2d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:20.539616 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2998527744}
I20260709 13:11:20.540706 32348 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:20.542012 32385 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.536825 24417 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.544286 32385 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.543994 24417 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:20.547005 32110 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:20.547188 32109 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:20.547626 32110 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:20.547853 32109 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.548611 32110 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.549978 32109 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:20.550616 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 83778.8us
I20260709 13:11:20.546213 24417 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 12 to 17, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 17 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
W20260709 13:11:20.551499 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 62099.1us
W20260709 13:11:20.520437 24566 connection.cc:256] RPC call timeout handler was delayed by -1.1722255310000946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 13:11:20.554620 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.555864 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.552287 24490 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:20.560572 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.563400 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:20.572607 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.525681 32237 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:20.564314 32401 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:20.566171 32181 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.566529 24490 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:20.556486 32303 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.569696 24600 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:20.571728 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.609782 24597 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:20.558893 32391 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:20.622088 24518 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:11:20.571815 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:20.570744 32004 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:20.574868 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.589748 32385 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:20.589247 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:20.587105 32177 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:20.630744 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55928.5us
I20260709 13:11:20.640038 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:20.641975 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 70262.9us
I20260709 13:11:20.568749 32240 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260709 13:11:20.641544 31715 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:20.649874 32240 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:20.650261 32240 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:20.531450 32404 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:20.529846 32357 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.597841 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:20.675714 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 77958us
I20260709 13:11:20.601488 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.677827 24593 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:20.624622 32303 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.558732 31978 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:20.556798 32302 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:20.568496 32188 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:20.573169 24591 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:20.589166 32182 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:20.557350 24417 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 14 to 16, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 16 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.626166 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:20.691318 24592 raft_consensus.cc:2393] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:20.552253 31971 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.646984 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.692099 24517 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:20.624346 32324 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.612097 32351 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:20.645298 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.648195 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:20.626794 32410 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:11:20.639209 32391 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:20.706881 32409 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:11:20.655293 32372 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.707826 32303 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:20.675812 32223 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.013s
I20260709 13:11:20.687556 32188 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.708801 32372 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.646848 32177 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.667474 32344 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:20.668725 32404 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:20.650626 32240 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:20.595208 32237 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.566205 32342 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:20.674436 31926 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:20.679733 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:20.668089 32249 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:11:20.652206 32341 consensus_queue.cc:1059] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:11:20.699541 24517 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:20.701653 32357 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.706565 32391 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.654232 32361 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.711052 32320 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:20.712242 32351 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:20.731513 32181 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:20.705689 24518 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:20.679410 32059 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:20.709185 32188 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:20.685564 31978 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:20.712935 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 64845.7us
I20260709 13:11:20.730280 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:20.795845 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:20.735903 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56244.2us
I20260709 13:11:20.742720 24592 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
W20260709 13:11:20.796280 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66084.7us
I20260709 13:11:20.712054 32344 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:20.733871 31926 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:20.755537 32252 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:20.561971 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:20.760272 32249 raft_consensus.cc:3055] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:11:20.792248 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 192517us
I20260709 13:11:20.797639 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:20.763720 32320 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:20.799954 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:20.710045 32324 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.768240 24417 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d reported cstate change: config changed from index 9 to 5, term changed from 16 to 14, leader changed from <none> to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130), 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from VOTER to NON_VOTER, now has a pending config: VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129), VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130), VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131), VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 14 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:20.800491 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 238555us
I20260709 13:11:20.837100 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:20.804600 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:20.827628 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:20.847190 24524 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:20.804708 25215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1689) took 2048 ms. Trace:
I20260709 13:11:20.816102 32361 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:20.862473 24637 leader_election.cc:400] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:20.862864 24637 leader_election.cc:403] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:20.863904 24637 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:20.814065 32177 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:20.795840 32383 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.005s
I20260709 13:11:20.812553 31971 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:20.799614 32252 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:20.796155 31978 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:20.802083 32249 raft_consensus.cc:740] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:20.815358 32351 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:20.804781 31926 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.804097 32181 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:20.871037 24491 leader_election.cc:400] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20.
I20260709 13:11:20.848158 25215 rpcz_store.cc:276] 0709 13:11:18.756220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.756346 (+   126us) service_pool.cc:224] Handling call
0709 13:11:18.756645 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.770587 (+ 13942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.770615 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.775791 (+  5176us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.333449 (+1557658us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b18004c73e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1 00007f17bbf01a0f
0709 13:11:20.454366 (+120917us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:20.481226 (+ 26860us) log.cc:844] Serialized 14 byte log entry
0709 13:11:20.510860 (+ 29634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.510933 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:20.803505 (+292572us) raft_consensus.cc:1685] finished
0709 13:11:20.804514 (+  1009us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.804648 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42941,"prepare.queue_time_us":26971,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":50828,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":3657,"spinlock_wait_cycles":14101248,"thread_start_us":120702,"threads_started":1,"wal-append.queue_time_us":1754724}
W20260709 13:11:20.874205 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 230972us
I20260709 13:11:20.818528 32283 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:20.879554 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 75020.6us
I20260709 13:11:20.801959 32303 raft_consensus.cc:2764] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:11:20.881446 25210 raft_consensus.cc:2410] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:11:20.862735 32004 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:20.872414 32184 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:11:20.912541 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:20.907918 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:20.908414 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:20.881491 32177 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:20.881829 32372 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:20.868170 32357 consensus_queue.cc:1059] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:11:20.817978 32320 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.900797 32252 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:20.906818 32137 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:20.924073 32391 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:20.868561 32404 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.959496 24417 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 14 to 15, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 15 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:20.941870 31926 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:20.965314 32411 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:11:20.965572 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.966856 24417 catalog_manager.cc:5697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 7 to 12, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 12 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.957518 32303 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.946787 32137 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:20.958287 32372 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:20.962584 32320 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:20.943646 32177 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:20.905844 32344 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.959311 32283 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:20.951951 32376 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.962229 32357 raft_consensus.cc:3055] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:20.948051 32238 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:20.975711 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 64279us
W20260709 13:11:20.975989 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 67064us
I20260709 13:11:20.978528 32324 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:20.970207 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:20.972817 32391 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.986683 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:20.974494 32137 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:21.007805 32423 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 13:11:21.009936 32372 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:21.011224 32348 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:21.038816 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:21.014330 32415 log.cc:927] Time spent T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:21.014643 32059 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:21.001513 32110 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:21.015616 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1647) took 1143 ms. Trace:
I20260709 13:11:21.003227 31813 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.045369 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:20.984855 32357 raft_consensus.cc:740] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:20.974754 32303 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:20.961987 32249 consensus_queue.cc:260] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.019327 32240 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.020520 24671 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:21.020366 32401 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:21.021281 24665 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:21.022161 32237 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:21.025449 32429 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:21.025138 32391 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.002101 32344 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:21.003610 32238 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:21.026943 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 56808.5us
I20260709 13:11:21.028339 32297 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:21.031989 25217 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:11:21.102228 24516 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:21.034204 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:21.034260 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:21.040525 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 192727us
I20260709 13:11:21.041401 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.105137 24667 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:21.042256 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.106640 24669 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:21.042960 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.042953 25219 rpcz_store.cc:276] 0709 13:11:19.872330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.878033 (+  5703us) service_pool.cc:224] Handling call
0709 13:11:19.878413 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.881490 (+  3077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.881518 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:20.341427 (+459909us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b2c00047778. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17ba83fa11 00007f17ba84f372 00007f17bbf81a01 00007f17bbf4643a 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2
0709 13:11:20.341990 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:11:20.731037 (+389047us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:20.731074 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.731141 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:21.015305 (+284164us) raft_consensus.cc:1685] finished
0709 13:11:21.015326 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.015552 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2658,"raft.queue_time_us":6805,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":18724,"spinlock_wait_cycles":3062656,"thread_start_us":287156,"threads_started":1,"wal-append.queue_time_us":509069}
I20260709 13:11:21.047458 24672 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:21.048616 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 136156us
I20260709 13:11:21.052378 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.108116 24673 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:21.109009 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.055444 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.055666 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:21.058498 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 425843us
I20260709 13:11:21.111898 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.059975 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:20.992467 32376 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:21.067322 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.119802 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:21.038574 32348 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:21.126165 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:21.074164 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.064364 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:21.112695 24566 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.129679 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.130347 24669 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:21.118917 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.122113 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.122153 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:21.133281 25219 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.105173 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:21.124065 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:21.131800 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.135917 32181 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:21.132607 24667 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:21.138506 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.139288 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.139546 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.140136 24665 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:21.132441 24672 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:21.141412 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.094497 32429 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.145323 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:21.147277 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:21.148002 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:21.144745 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:21.148770 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.144726 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.052043 31813 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:21.048218 32110 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.178503 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.179171 24665 raft_consensus.cc:2376] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22. Re-sending same reply.
I20260709 13:11:21.188248 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:21.198114 24666 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:21.064308 32177 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:21.209879 32428 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:21.209372 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 88862.3us
I20260709 13:11:21.119125 32385 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 13:11:21.204363 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:21.205017 25219 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:21.200970 32184 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:21.159072 32188 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:21.220546 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 107854us
I20260709 13:11:21.220782 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:21.204982 32431 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.131628 32357 consensus_queue.cc:260] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.253434 24665 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:11:21.235819 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.215317 32324 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:11:21.231524 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 126490us
I20260709 13:11:21.240345 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:21.344760 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 109054us
I20260709 13:11:21.343277 24665 pending_rounds.cc:85] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 15
I20260709 13:11:21.350898 24665 pending_rounds.cc:107] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 19.16
W20260709 13:11:21.248114 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 143935us
I20260709 13:11:21.345913 24668 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:21.218186 32404 raft_consensus.cc:2764] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:11:21.351260 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.351320 24665 raft_consensus.cc:2889] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.363358 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:21.351861 24600 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:21.350845 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:21.365521 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:21.366752 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 126503us
W20260709 13:11:21.366936 32435 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:11:21.367642 32437 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:11:21.368288 32059 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:21.368727 32444 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:21.369473 32429 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:21.375840 32434 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:11:21.376523 32110 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:21.377863 32358 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:21.379848 32252 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:21.380223 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.395232 32357 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:21.381516 32188 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:21.382320 32436 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:11:21.383128 31813 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:21.384073 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.419354 24667 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:21.237175 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.425364 24672 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:21.403748 32370 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.220112 32238 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:21.343724 32303 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:21.293094 32240 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:21.249272 32432 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:21.238955 32448 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:21.383169 31971 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:21.346747 32428 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:21.399273 24665 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:21.230074 32361 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
I20260709 13:11:21.348790 32324 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.400007 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:21.346692 32391 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:21.278824 31978 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.252875 32182 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.141s
W20260709 13:11:21.504928 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 440643us
I20260709 13:11:21.226212 32426 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.177s
I20260709 13:11:21.394480 32421 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:21.380821 32424 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.419s	user 0.004s	sys 0.000s
I20260709 13:11:21.227699 32181 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:21.400168 32004 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:21.417172 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.434576 24667 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:21.435678 25217 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:21.438858 24518 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:21.501405 32324 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:21.442414 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 91645.9us
I20260709 13:11:21.349272 32431 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.452188 32310 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:21.452943 31926 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:21.453173 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 59656.8us
I20260709 13:11:21.453418 32238 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:11:21.457636 32445 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:11:21.453068 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 89812us
I20260709 13:11:21.426826 32404 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:21.405349 32059 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:21.501255 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 101366us
I20260709 13:11:21.434921 32137 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:21.512213 25212 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 22: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:21.438898 32370 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.560297 32137 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:21.442093 32452 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.561057 32361 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:21.561458 32452 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.563594 32452 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:21.520486 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:21.521401 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:21.565007 24520 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:21.521515 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:21.524214 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:21.566306 24591 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.553774 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:21.509384 32426 consensus_queue.cc:1243] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:11:21.529294 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 112235us
W20260709 13:11:21.569350 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 46527.5us
I20260709 13:11:21.508661 32421 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.566910 24517 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:21.529234 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:21.566217 24671 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:21.568776 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:21.508289 32297 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:21.574988 24524 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:21.506007 31971 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:21.570817 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:21.572117 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.584401 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:21.585502 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.585724 24591 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:21.526492 32448 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:21.571951 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.570031 25185 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:21.573185 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.585613 24563 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:21.558207 32237 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.526821 31926 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:21.522992 32310 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:21.588107 32303 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:21.576223 32421 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:21.590899 32252 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:21.614820 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.593358 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:21.593621 32237 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.575855 32391 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:21.602334 24672 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:21.605561 31926 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:21.589937 24592 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:21.608860 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.609587 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.609694 32444 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:21.610224 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:21.609663 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80484.4us
I20260709 13:11:21.614849 24669 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:21.592442 32420 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:21.615736 24517 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
W20260709 13:11:21.616160 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.611069 32182 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:21.640918 32342 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:21.678009 31978 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:21.616852 32177 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:21.678665 32177 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.679114 32177 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.686276 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.686882 24667 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:21.689257 32182 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:21.690224 32182 consensus_queue.cc:1243] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:11:21.691236 24669 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:21.692158 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.692731 24669 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:21.693239 32458 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:21.636034 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:21.693915 32458 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:21.694401 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.694804 32458 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.696370 24669 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:21.696424 32458 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.699401 24667 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:21.644984 24673 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:11:21.616720 32422 raft_consensus.cc:2764] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:11:21.709739 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:21.645599 24670 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
W20260709 13:11:21.646445 32344 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.004s
I20260709 13:11:21.616573 32456 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:21.650143 32303 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:21.610750 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:21.716862 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:21.716996 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 106303us
I20260709 13:11:21.654567 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:21.655041 32237 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:21.606251 32448 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.587275 32452 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:21.607594 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.610731 32418 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:21.613049 32310 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:21.666675 32391 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.670511 24524 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:21.669854 24668 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:21.551846 32348 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:21.671799 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.673609 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.753947 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:21.754506 25212 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:21.693331 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.699536 24672 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:21.622349 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.644066 32223 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.759327 32223 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.761224 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:21.761615 32223 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:21.696852 24669 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:21.761982 24668 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:21.707036 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:21.708370 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.762837 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:21.735253 32456 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:21.764478 32456 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:21.745756 32418 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:21.765090 32418 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:21.735301 32182 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:21.768817 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 60577.9us
I20260709 13:11:21.671250 32420 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:21.734745 32370 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:21.641357 32431 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:21.737627 25210 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:21.743712 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:21.747674 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 140167us
I20260709 13:11:21.737365 32452 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.757223 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:21.757594 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 84091.4us
I20260709 13:11:21.734217 32444 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:21.792832 25210 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:11:21.703461 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:21.758215 32426 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:21.762780 24525 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:21.766870 31813 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:21.708544 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:21.719038 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 64553.9us
I20260709 13:11:21.731757 32376 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:21.770066 24491 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.736515 32237 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.731523 25215 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:11:21.812192 25215 pending_rounds.cc:85] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 17
I20260709 13:11:21.812577 25215 pending_rounds.cc:107] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 13:11:21.812875 25215 raft_consensus.cc:2889] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.756979 24666 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:21.744589 32457 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.713948 32297 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.775876 32420 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.777220 24524 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:21.792915 32452 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:21.765410 32456 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:21.774113 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:21.772390 32252 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:21.780319 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:21.781531 32348 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:21.783936 32177 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:21.784683 32391 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:21.798096 24521 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:21.746157 32004 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.793505 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:21.765853 25219 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:21.803823 24591 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:21.804019 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:21.801465 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:21.798298 32361 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:21.792570 32182 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:21.806584 31926 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.809265 25218 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:21.772056 32152 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:21.821779 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:21.797906 32431 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:21.797166 32303 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:21.844743 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:21.845204 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 75205.2us
W20260709 13:11:21.845898 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 71889us
I20260709 13:11:21.823644 32457 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.796408 32422 consensus_queue.cc:1059] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:11:21.800388 32444 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.946067 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:21.851406 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:22.032519 25210 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:22.030514 24595 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
W20260709 13:11:21.978927 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 205954us
I20260709 13:11:22.031888 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:21.959376 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:22.036502 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 232541us
I20260709 13:11:22.036536 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:22.037892 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:22.039819 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 63478.8us
I20260709 13:11:22.041179 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:22.040635 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:22.043967 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:22.040233 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:22.051251 24639 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:21.939669 32447 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.524s	user 0.000s	sys 0.005s
W20260709 13:11:21.897993 32465 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:11:22.060891 25212 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:21.884265 32420 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:21.851649 31978 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:21.911772 32059 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:21.924746 32448 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:22.060379 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 209536us
I20260709 13:11:21.885322 32426 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:22.039062 32428 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:22.046869 32402 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:22.071590 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:21.856616 32051 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:22.073668 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.074991 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:22.047117 32342 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:22.057649 32137 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:22.058287 32357 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:21.821051 32237 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:22.086344 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.086653 25217 pending_rounds.cc:85] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 15
I20260709 13:11:22.094357 25217 pending_rounds.cc:107] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:11:22.094681 25217 raft_consensus.cc:2889] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.909053 32418 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:21.881335 32376 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.188s
I20260709 13:11:21.857201 32188 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.216s
I20260709 13:11:21.952680 32421 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.063954 32361 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:21.857609 32252 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.095966 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2531) took 1048 ms. Trace:
I20260709 13:11:22.039669 32004 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.102828 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:22.103055 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:22.066398 32152 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:11:22.104839 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:21.889153 32450 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.196s
I20260709 13:11:22.081378 32426 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.084249 32402 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:22.043197 32431 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.112072 32237 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.112756 25213 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:11:22.113121 32324 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.001s
I20260709 13:11:22.113857 32418 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.114674 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:22.117833 32188 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:22.160143 32237 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:22.122077 32468 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:22.084473 32456 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:11:22.125177 32182 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.128055 32444 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.129642 32177 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.131318 32457 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:22.134652 32297 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.134815 25215 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:22.135524 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2075) took 1106 ms. Trace:
I20260709 13:11:22.068969 31978 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:22.148521 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 97326.9us
I20260709 13:11:22.089684 32223 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:22.150059 24673 rpcz_store.cc:276] 0709 13:11:21.047147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.108729 (+ 61582us) service_pool.cc:224] Handling call
0709 13:11:22.090995 (+982266us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540044f054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:22.095895 (+  4900us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230715136}
W20260709 13:11:22.160305 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 45703us
I20260709 13:11:22.120663 31926 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.160029 32188 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:22.160961 32468 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.157899 32402 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.164631 32303 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:22.228132 32303 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.231618 32431 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.232583 32421 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.217353 32223 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.217361 31978 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.158985 32324 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.223786 32468 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.236413 32223 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:22.248193 32324 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.268254 32426 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.277462 32452 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.282361 32468 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:22.315721 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 270178us
I20260709 13:11:22.322650 24597 raft_consensus.cc:2368] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25.
I20260709 13:11:22.104478 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:22.324301 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:22.326092 24591 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:22.328020 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:22.153944 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:22.329977 24596 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.333825 24598 raft_consensus.cc:2368] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23.
I20260709 13:11:22.335639 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:22.344398 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:22.345834 24591 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
W20260709 13:11:22.201921 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.236550 32297 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.357192 32177 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:22.394754 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:22.396174 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:22.399926 32297 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.400678 32372 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:22.402326 32376 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.407269 32479 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:22.409672 32492 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:22.410583 32468 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.411749 32450 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.412480 32488 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:11:22.413143 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 370457us
I20260709 13:11:22.413874 32443 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:22.415091 32491 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.216665 25216 rpcz_store.cc:276] 0709 13:11:21.029021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.029139 (+   118us) service_pool.cc:224] Handling call
0709 13:11:21.029474 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.029822 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.029848 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.030285 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.219559 (+189274us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:21.219615 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.219696 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:21.449218 (+229522us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b48001b06d8. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c0e6faa1 00007f17c0e66b37 00007f17c0e669ca 00007f17c0f5e26f 00007f17c0f5df37 00007f17c0f7255c 00007f17c0f72508 00007f17c0f72488 00007f17c0f72443 00007f17c0f716ec 00007f17bfe9ba96
0709 13:11:21.938919 (+489701us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:22.135278 (+196359us) raft_consensus.cc:1685] finished
0709 13:11:22.135311 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.135468 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11540,"raft.queue_time_us":934,"raft.run_cpu_time_us":8899,"raft.run_wall_time_us":417369,"spinlock_wait_cycles":5756032,"thread_start_us":188799,"threads_started":1,"wal-append.queue_time_us":359411}
I20260709 13:11:22.425047 32431 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:22.426062 32431 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:22.426529 32467 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:22.252593 32188 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.430131 32376 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.432252 32491 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.433656 32490 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:22.435815 32376 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.428167 32431 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.437506 24591 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
W20260709 13:11:22.453809 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 109782us
I20260709 13:11:22.470551 32496 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:22.436055 32491 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:22.473793 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44471.5us
I20260709 13:11:22.430141 32188 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.489758 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:22.491024 32443 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:22.493562 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.437827 32450 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.437435 32324 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.437665 31926 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:22.504792 24594 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:22.438361 32252 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.521860 31926 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.523269 32177 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:22.531571 32310 consensus_meta.cc:287] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.011s
I20260709 13:11:22.577404 32310 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.579190 25211 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:11:22.580184 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:22.580673 32310 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:22.537282 32004 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.582491 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:22.539767 32324 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.545586 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:22.546216 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2081) took 1511 ms. Trace:
I20260709 13:11:22.548847 32297 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:22.549899 32137 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.499434 32372 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:22.551469 32177 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.557157 32443 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.559724 31926 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:22.563484 31715 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.604851 32137 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.515076 24669 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.565630 32430 raft_consensus.cc:3055] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:11:22.566793 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 89234.9us
I20260709 13:11:22.567502 32252 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:22.570860 32461 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.072s	user 0.003s	sys 0.011s
I20260709 13:11:22.590023 24596 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
W20260709 13:11:22.592187 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.550722 32450 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.604055 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:22.604190 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:22.607174 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80032.9us
I20260709 13:11:22.605757 31715 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.614643 24520 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 26.
I20260709 13:11:22.614687 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:22.590094 25214 rpcz_store.cc:276] 0709 13:11:21.035020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.147057 (+112037us) service_pool.cc:224] Handling call
0709 13:11:22.545798 (+1398741us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b5400609ad4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:22.545999 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142766464}
I20260709 13:11:22.618021 31715 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.621518 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:22.621933 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:22.623057 32297 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.625555 32297 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:22.626675 32223 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:22.628140 32499 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:11:22.619572 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:22.608237 32252 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.607882 32430 raft_consensus.cc:740] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:22.630841 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 85467.1us
W20260709 13:11:22.616719 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 420686us
W20260709 13:11:22.636739 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.613596 32431 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.645247 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:22.645941 32430 consensus_queue.cc:260] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.646842 32051 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:22.647480 32051 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:22.647424 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:22.629045 32223 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:22.657759 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:22.658097 32324 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.637720 32252 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.639413 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:22.639451 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:22.647329 32430 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.676466 32431 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.677697 32450 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:22.677722 24525 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.679289 32431 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.684132 25218 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.684664 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:22.693706 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:22.694515 31978 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.695154 24516 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:22.694518 24522 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:11:22.682268 32297 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.674441 32479 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:22.762851 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1669) took 1007 ms. Trace:
W20260709 13:11:22.775360 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 128214us
I20260709 13:11:22.786217 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:22.763350 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.771999 24668 raft_consensus.cc:1240] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:22.815766 24522 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:22.815445 24516 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
W20260709 13:11:22.780696 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 89831.3us
I20260709 13:11:22.763566 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:22.722304 32137 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.772177 32433 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:22.649000 32051 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.764981 32249 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:22.706640 32310 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:22.824095 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 133421us
W20260709 13:11:22.845206 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 134984us
W20260709 13:11:22.864356 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.845104 24518 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:22.843737 24520 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:22.844664 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1791) took 1188 ms. Trace:
I20260709 13:11:22.844514 24490 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:22.894328 24525 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
W20260709 13:11:22.937551 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 193787us
I20260709 13:11:22.844198 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:22.863379 24669 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:22.756034 31978 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.853794 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:22.748550 32420 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.680s	user 0.003s	sys 0.014s
I20260709 13:11:22.845683 32433 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:22.949898 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 77271.3us
I20260709 13:11:22.931097 24672 rpcz_store.cc:276] 0709 13:11:21.656159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.663200 (+  7041us) service_pool.cc:224] Handling call
0709 13:11:21.663466 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.756656 (+ 93190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.844109 (+1087453us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b54000ee2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:22.844454 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82419968}
I20260709 13:11:22.959102 24523 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 22: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:22.758736 32491 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:22.868148 31926 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.771811 32452 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:22.988550 25218 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:22.982533 25210 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:22.965642 32433 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:22.823307 25213 rpcz_store.cc:276] 0709 13:11:21.755018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.757214 (+  2196us) service_pool.cc:224] Handling call
0709 13:11:21.789803 (+ 32589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.156843 (+367040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.762234 (+605391us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54005780d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:22.762626 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742715904}
W20260709 13:11:23.002825 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 145349us
I20260709 13:11:22.847887 32479 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:22.947631 32310 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:22.844687 32297 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:23.040999 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 196642us
I20260709 13:11:22.965910 32223 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.039997 24671 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:22.999930 32137 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
W20260709 13:11:23.067229 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 46369us
I20260709 13:11:23.069283 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:23.070096 24522 raft_consensus.cc:2368] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25.
I20260709 13:11:23.063329 32357 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.019956 31926 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.081418 32495 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:23.082281 32310 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:23.082403 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.083417 25215 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:23.090935 24592 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:23.091090 32479 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:23.093813 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 94821.4us
I20260709 13:11:23.097482 24519 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:23.097522 24516 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:23.100137 32297 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:22.845057 32372 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.105574 24639 leader_election.cc:400] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25.
I20260709 13:11:23.106176 24639 leader_election.cc:403] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
W20260709 13:11:23.105547 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.055778 32491 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.115250 32443 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:23.116014 32443 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:23.117678 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52687.8us
I20260709 13:11:23.120035 32443 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.133700 24524 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:23.133682 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.135803 24524 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:11:23.136600 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.137387 24522 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:23.137634 32361 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:23.138362 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.138947 25213 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:23.140841 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.142310 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.143158 24672 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:23.145578 32370 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:23.147035 32370 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:23.147460 32370 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:11:23.112095 32188 consensus_meta.cc:287] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.007s
I20260709 13:11:23.155718 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.156445 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.156527 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.157413 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.077309 32223 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.160964 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.166404 24594 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:23.161813 25212 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:23.166589 24592 raft_consensus.cc:2368] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24.
W20260709 13:11:23.164914 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52344.8us
I20260709 13:11:23.175812 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.192515 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.209911 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.210415 24592 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:23.210628 24672 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:23.148937 32370 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.217957 32370 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:23.221714 24674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 3962) took 2179 ms (client timeout 1918 ms). Trace:
W20260709 13:11:23.222191 24674 rpcz_store.cc:269] 0709 13:11:21.042488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.042769 (+   281us) service_pool.cc:224] Handling call
0709 13:11:23.221382 (+2178613us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400404a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:23.221523 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3517454080}
I20260709 13:11:23.224749 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.228098 24672 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:23.230898 32428 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:23.231541 32428 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:23.232386 32503 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:23.233346 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:23.234704 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:23.235493 24595 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:23.236372 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.236539 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.237737 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.238356 24516 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:23.239240 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:23.153692 32357 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:23.242189 32506 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:11:23.236459 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:23.269341 32430 consensus_meta.cc:287] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.006s
I20260709 13:11:23.200721 32443 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:23.269232 32428 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.276053 32452 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:23.277066 32468 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.277640 32468 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:23.280301 24600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1620) took 1545 ms (client timeout 1640 ms). Trace:
I20260709 13:11:23.282321 32443 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:23.283380 32443 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.287256 32188 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:23.287680 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:23.287894 32188 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.290362 32188 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.290831 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.291016 32051 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:23.290840 32188 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:23.276753 32452 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.293569 32188 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.295885 32452 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.297632 32188 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.204533 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.298987 24598 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:23.300771 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.302546 24596 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:11:23.280728 24600 rpcz_store.cc:269] 0709 13:11:21.734281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.780064 (+ 45783us) service_pool.cc:224] Handling call
0709 13:11:23.279978 (+1499914us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54001ec3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:23.280129 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3291771264}
I20260709 13:11:23.304531 32430 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.305208 32430 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:23.306495 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 74915.7us
I20260709 13:11:23.308005 32430 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:23.309398 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.310335 32404 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:23.310626 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.310985 32404 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.312623 32223 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.309475 25210 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 26. Current term is 27. Ops: [26.20-26.20]
I20260709 13:11:23.313683 31926 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.317916 32491 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:23.320892 32402 consensus_meta.cc:287] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.067s	user 0.011s	sys 0.006s
W20260709 13:11:23.321614 32252 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.000s
I20260709 13:11:23.321470 32402 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.326345 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.327060 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.280678 32468 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.329109 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:23.331403 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.333106 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:23.333906 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:23.327083 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.327390 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:23.350926 24596 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:23.337462 32357 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:23.352350 32237 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.354573 32237 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.355198 32498 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:23.355795 32498 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:23.357028 32498 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.364751 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.365425 24674 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:23.365954 32498 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:23.367820 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.368431 24591 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:23.371481 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.371606 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.372208 24525 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:23.344429 24518 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:23.373006 24522 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:23.357928 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.359244 24523 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 16.
I20260709 13:11:23.313016 32404 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.373167 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.374472 24518 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:23.374718 32252 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.376593 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2084) took 1622 ms. Trace:
I20260709 13:11:23.382107 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:23.424939 24671 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:23.382665 25215 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:23.353303 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:23.383654 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.385495 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.386373 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:23.388718 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.388974 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.392665 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.397305 32498 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.400736 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.402868 32357 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:23.403306 24637 leader_election.cc:400] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25.
W20260709 13:11:23.345553 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 137760us
I20260709 13:11:23.403666 32404 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:23.346107 24669 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:11:23.408990 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 80568.1us
I20260709 13:11:23.422494 24516 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:23.408748 32361 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25.
I20260709 13:11:23.430084 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.429921 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:23.418017 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 299573us
I20260709 13:11:23.429527 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.439970 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.425207 25211 rpcz_store.cc:276] 0709 13:11:21.754227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.754375 (+   148us) service_pool.cc:224] Handling call
0709 13:11:23.376366 (+1621991us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54001b7454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:23.376527 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813574400}
I20260709 13:11:23.426816 25217 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:23.435185 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2551) took 1747 ms. Trace:
I20260709 13:11:23.435564 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:23.409190 32152 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.441429 24669 rpcz_store.cc:276] 0709 13:11:21.687388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.695973 (+  8585us) service_pool.cc:224] Handling call
0709 13:11:21.696209 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:22.514147 (+817938us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b5400454820. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbec406f 00007f17bbf3cf60 00007f17bbf3e7de 00007f17bbf48b49 00007f17bbf49416 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62
0709 13:11:22.862689 (+348542us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b5800903bd0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbea20aa 00007f17bbf24447 00007f17bbf3cfe7 00007f17bbf3e7de 00007f17bbf48b49 00007f17bbf49416 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4
0709 13:11:23.431335 (+568646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.435130 (+  3795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576687744}
I20260709 13:11:23.440595 25212 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:23.432386 24596 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 27.
I20260709 13:11:23.444218 24521 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:23.444303 24517 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:23.444267 24666 raft_consensus.cc:2393] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:23.445410 24672 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
W20260709 13:11:23.447173 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44143.3us
I20260709 13:11:23.447995 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:23.445721 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.436239 32468 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:23.458042 25185 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.445689 32249 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.473168 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.474625 32181 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.475332 32181 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:23.476827 32302 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:11:23.477237 32357 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:23.477897 32361 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:23.478945 32430 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:23.479504 32430 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:23.480401 32430 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.483088 32496 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.483665 32496 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.485700 32496 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:23.477378 32448 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:23.488436 32448 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:23.488831 32448 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:23.493234 32426 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.493954 32426 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.502084 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:23.503024 32372 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:23.503999 25182 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:23.504618 32420 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.505014 32310 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:23.506588 32402 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.507323 32469 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:23.508054 32469 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.459190 31926 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:23.511675 31926 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.512041 31926 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:23.516176 32448 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.517249 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.517848 32249 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.454746 32468 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.454509 32498 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.461510 32237 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.519073 32469 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.463733 32433 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.538494 24639 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:23.539371 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58819.1us
I20260709 13:11:23.546041 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:11:23.539553 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 85439.1us
I20260709 13:11:23.540150 32483 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:23.460332 32370 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:11:23.496906 32426 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.576149 24517 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
W20260709 13:11:23.580381 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 112477us
W20260709 13:11:23.589069 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 153577us
I20260709 13:11:23.596664 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.537684 32468 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:23.593853 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.600001 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.602999 25211 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:23.603721 32302 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.604202 32237 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:23.604648 32249 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.597822 32297 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.604318 32302 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:23.605587 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59623.2us
I20260709 13:11:23.605404 32297 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.606870 24563 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:23.607373 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:23.607609 32297 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.607693 32177 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:23.607796 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:23.607290 32426 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:23.604673 32237 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.606846 32302 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:23.608767 32252 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.604030 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.609397 32303 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:23.609922 24674 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:23.610378 32303 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:23.610807 32303 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.611284 32303 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.611723 25217 raft_consensus.cc:2368] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24.
I20260709 13:11:23.608976 32237 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:23.608911 32426 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:23.613371 32479 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:11:23.613485 32426 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:23.613816 32479 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:23.614887 32479 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.618683 32428 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.619001 32433 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.619333 32428 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.563397 32483 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:23.620694 32483 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:23.621390 32518 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:23.621994 32428 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.621985 32518 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.622656 32428 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.623172 32428 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.624202 32518 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.624753 32518 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:23.629173 25215 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:23.580499 32372 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:11:23.631390 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 265157us
I20260709 13:11:23.637405 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.642485 25210 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:23.630766 32518 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.644860 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.645726 24674 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:23.646885 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:23.648007 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.644939 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.634229 32372 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.636590 32428 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:23.661921 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 158085us
I20260709 13:11:23.665858 25217 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:23.633062 32357 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:11:23.691685 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.692638 25215 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:23.661665 32372 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:23.660830 32448 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.704030 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.666198 32302 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.708884 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.668172 32181 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:23.720072 25215 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:23.722426 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.709918 32430 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:23.694514 32152 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.032s
I20260709 13:11:23.734282 32302 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.737829 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.738493 25215 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:23.739681 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.739773 32237 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.740490 32496 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:23.740865 32496 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.741194 32496 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:23.742254 31926 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.747444 32469 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.748006 32469 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.749241 32496 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.752928 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:23.753592 25215 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:23.754561 32303 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.729532 32181 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:23.757404 32181 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.757797 32181 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.759274 32426 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.761487 32498 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.762676 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.763315 24490 leader_election.cc:400] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23.
I20260709 13:11:23.763497 25214 raft_consensus.cc:2393] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:23.763746 24490 leader_election.cc:403] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.727808 32404 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:11:23.736825 32302 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.770998 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:23.775658 24517 raft_consensus.cc:606] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:23.775962 24519 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:23.774206 32430 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:23.776523 25216 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:11:23.776563 32430 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.777068 32303 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.777861 32051 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23.
I20260709 13:11:23.779934 32051 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:23.775988 24517 raft_consensus.cc:614] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:23.782899 32469 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.783119 32428 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:11:23.783641 32523 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:11:23.784572 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 126965us
I20260709 13:11:23.792842 25215 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:23.732028 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:23.822903 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.838162 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.854159 32518 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.854771 32518 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.855334 32518 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.856438 24490 leader_election.cc:400] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24.
I20260709 13:11:23.858436 24490 leader_election.cc:403] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:23.858572 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.861925 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.870478 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:23.876567 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:23.859333 32428 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:23.871362 25216 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:23.808980 32496 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:23.895255 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 287514us
I20260709 13:11:23.769030 32483 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.860543 32177 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:23.900131 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:23.904333 24517 raft_consensus.cc:606] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:11:23.904772 24517 raft_consensus.cc:614] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:23.876010 32357 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.872840 32303 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:23.868634 32469 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:23.889807 32370 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24.
I20260709 13:11:23.937847 32357 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.940646 32357 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:23.927971 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 425095us
I20260709 13:11:23.925060 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:23.893718 32249 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:23.954326 32249 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.954725 32249 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:23.954824 32483 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.877530 32452 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:11:23.957614 32498 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:23.958118 32498 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:23.958564 32498 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:23.958801 32469 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:23.959381 32469 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:23.933717 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 226611us
I20260709 13:11:23.962772 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:23.963372 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:23.965430 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:23.965719 32188 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:23.966198 25216 raft_consensus.cc:2368] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:23.966275 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:23.967084 24596 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:23.967120 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:23.968104 25216 raft_consensus.cc:2368] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:11:23.968050 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:23.968768 24592 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:23.971964 24591 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 26. Current term is 27. Ops: [26.20-26.20]
I20260709 13:11:23.925199 32428 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:23.902434 32051 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:23.973016 32051 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.973528 32051 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:23.973445 32428 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.910980 32518 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:23.941669 32519 log.cc:927] Time spent T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:11:23.942934 32372 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.909983 32426 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:23.944919 32302 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.946480 31926 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:23.842759 32468 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.999626 32181 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.983057 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:23.930542 24563 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:23.931596 32303 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.989255 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:23.990770 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:23.967294 32420 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:23.991242 32302 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:23.934861 32177 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:23.986956 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.001341 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.006572 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:24.007097 24521 raft_consensus.cc:2393] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:23.997679 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:24.003667 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:24.001130 32479 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:23.999642 32237 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:24.026381 25217 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:24.020692 25216 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:24.004599 32303 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:24.006353 32491 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:24.066316 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 166256us
I20260709 13:11:24.004695 32426 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:24.070873 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 366135us
I20260709 13:11:24.069736 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:24.019315 32483 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:24.074317 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 66791.1us
I20260709 13:11:24.061479 32223 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.106594 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.009389 32249 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.109794 25216 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:24.065943 32518 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.103477 32514 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:24.074070 32531 raft_consensus.cc:2804] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:24.146319 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:24.150063 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 74961.1us
I20260709 13:11:24.105685 32188 raft_consensus.cc:2764] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:11:24.077109 32483 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:24.106505 32426 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:24.179886 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 110259us
W20260709 13:11:24.198695 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.199172 32532 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:24.161706 32430 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:24.203572 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 97112.8us
W20260709 13:11:24.204677 32522 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:11:24.209616 32554 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:24.196852 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44686.8us
I20260709 13:11:24.216518 32548 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:24.172070 32531 raft_consensus.cc:697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:24.156172 32518 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.156158 32223 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:24.236868 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.235384 32181 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.248338 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:11:24.250617 32533 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:11:24.255312 32534 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.235242 32237 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:24.246170 32372 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.265053 24592 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
W20260709 13:11:24.269826 32542 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:24.271543 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:24.275588 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.304682 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:24.313383 25211 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:24.315231 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.316267 25217 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 26: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:24.290902 32554 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:24.317469 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 69235.7us
I20260709 13:11:24.320333 24525 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:24.322666 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.323220 24667 raft_consensus.cc:3060] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:24.324077 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.329620 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.335047 24520 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:24.336311 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.336496 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.300575 32402 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:24.339628 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:24.339654 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 351413us
W20260709 13:11:24.340256 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 194184us
I20260709 13:11:24.340700 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.343505 24665 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:24.344982 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.345821 24669 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:24.294134 32361 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:24.317409 32443 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:24.351312 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.353675 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.356122 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.355196 24523 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:24.356264 24671 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:24.354038 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.328874 32554 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:24.313515 32252 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:11:24.341652 32404 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.295670 32532 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:24.376761 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:24.372661 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 59166.6us
I20260709 13:11:24.378618 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.338083 32452 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:11:24.320189 31926 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 13:11:24.382445 24490 leader_election.cc:400] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24.
I20260709 13:11:24.371326 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:24.355549 32302 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.315089 32534 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:24.365716 32549 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:24.366707 32249 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:24.426470 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44183.4us
I20260709 13:11:24.352020 32402 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.429919 24592 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:24.432693 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:24.467123 24598 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:24.468545 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.426702 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:24.436456 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.436628 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.381924 32361 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:24.423079 32531 consensus_queue.cc:237] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:24.420439 31813 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:24.438061 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.453071 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:24.469694 24523 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:24.476325 24524 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 27: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:11:24.430770 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46359.7us
I20260709 13:11:24.464205 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:24.477245 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.383399 32498 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.479866 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.480530 24671 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:24.482290 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:24.383544 32051 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.484455 24672 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:24.479952 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:24.438899 32545 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:24.493168 24671 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:24.493361 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.488293 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.484380 24565 leader_election.cc:400] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:24.441897 32468 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.438534 32426 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:24.488160 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.494259 24673 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:24.494254 24565 leader_election.cc:403] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:11:24.460292 32420 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:24.385936 32558 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.102s
I20260709 13:11:24.544915 24674 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:24.561980 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.513900 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.515015 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:24.540094 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46804.4us
W20260709 13:11:24.566109 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 87152.6us
I20260709 13:11:24.512135 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.568457 24565 leader_election.cc:400] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
W20260709 13:11:24.513517 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45097.7us
I20260709 13:11:24.549903 31926 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:24.581178 32550 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:24.511018 24667 raft_consensus.cc:2468] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:24.582577 32550 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:24.573967 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63357.1us
I20260709 13:11:24.583303 32550 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.584528 32556 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:24.585716 32550 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:24.484616 32181 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:24.478749 32370 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.588133 32370 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.438177 32404 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:24.526381 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.437861 32559 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:24.486924 32551 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:24.589871 32559 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.569010 32448 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:24.586899 32564 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.590613 32559 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:24.590883 32404 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:24.590770 32564 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.591544 32181 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:24.592051 32181 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:24.508201 31813 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:24.593212 32564 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:24.594293 32555 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:24.523804 32302 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:24.594959 32555 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:24.595233 32302 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:24.595726 31813 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:24.569877 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.588943 32548 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:11:24.512090 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.596645 32548 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:24.567857 24672 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 26: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:24.596865 24595 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:24.597855 32564 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:24.597890 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.598145 32361 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:24.599048 24595 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:24.590076 32551 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:24.537267 25217 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:24.599280 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:24.587179 24565 leader_election.cc:403] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:11:24.600153 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.512518 32430 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:24.512887 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:24.601727 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.525892 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.475383 32152 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:24.515408 24596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2451462dc894ec98db5932996a9e329"
dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:42294
I20260709 13:11:24.567214 24669 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:24.595821 32302 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:24.511559 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.479378 32237 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:11:24.596179 32539 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:11:24.577136 32562 log.cc:927] Time spent T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:11:24.628069 24671 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:24.628454 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 60128.8us
W20260709 13:11:24.642355 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48131.5us
I20260709 13:11:24.523293 32223 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:24.618554 24596 raft_consensus.cc:606] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:11:24.486018 32310 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.149s
I20260709 13:11:24.602581 32402 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.646898 24668 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:11:24.647342 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 108753us
I20260709 13:11:24.612237 32443 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:24.649113 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.649560 32430 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:11:24.644300 32426 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.649122 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.562584 32518 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.668933 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.669487 25210 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:24.657779 24665 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:24.659965 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.661818 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:24.658579 32152 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.671895 32547 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:24.672372 32547 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:24.672713 32152 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.660439 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:24.629751 32237 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:24.685257 25211 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:24.662014 32552 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:11:24.711702 24669 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
W20260709 13:11:24.673964 32469 consensus_meta.cc:287] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
W20260709 13:11:24.674322 32479 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.002s
I20260709 13:11:24.663971 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.674500 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:24.714671 25215 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:24.675056 32498 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.675858 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1678) took 1037 ms. Trace:
I20260709 13:11:24.677784 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.678248 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:24.678339 32430 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:24.680649 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.681424 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.719128 24667 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:24.681674 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:24.681849 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.659799 32534 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:24.703806 32557 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:11:24.682565 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.683558 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:24.684769 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.693518 32051 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.757854 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:24.772154 24517 raft_consensus.cc:606] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Received request to transfer leadership to TS 983693721af6486c97ece1410a90cf30
I20260709 13:11:24.772552 24517 raft_consensus.cc:614] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:24.772677 24671 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 27.
I20260709 13:11:24.695015 32532 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:24.697542 32420 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:24.775527 32420 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:24.700071 32554 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:24.703783 24519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53446 (request call id 1720) took 1468 ms (client timeout 1887 ms). Trace:
W20260709 13:11:24.781338 24519 rpcz_store.cc:269] 0709 13:11:23.235681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.238973 (+  3292us) service_pool.cc:224] Handling call
0709 13:11:24.703591 (+1464618us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002c24d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:24.703696 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407913728}
W20260709 13:11:24.705801 32303 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.001s
I20260709 13:11:24.711551 32237 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:24.706808 32443 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.709251 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:24.710462 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:24.715157 24673 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:24.715803 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.682034 24670 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:24.725936 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.789640 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.687045 24639 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:24.794606 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.796689 24665 raft_consensus.cc:2368] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:24.798568 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:24.665511 32433 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 25.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.104s
I20260709 13:11:24.719760 32297 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:24.799203 25211 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
W20260709 13:11:24.799729 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 112958us
I20260709 13:11:24.801342 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:24.802699 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1739) took 1209 ms. Trace:
I20260709 13:11:24.805696 32496 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:24.805771 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:24.826987 24669 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:24.826395 32297 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.595961 32555 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.808171 24524 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:24.833896 25215 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:24.838124 24517 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:24.717988 32469 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.828730 25217 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:24.840579 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:24.716902 25219 rpcz_store.cc:276] 0709 13:11:23.638755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.689214 (+ 50459us) service_pool.cc:224] Handling call
0709 13:11:23.726269 (+ 37055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.743757 (+ 17488us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:11:23.744074 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.144663 (+400589us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.389862 (+245199us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.439190 (+ 49328us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.457907 (+ 18717us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:11:24.457975 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.458069 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.675561 (+217492us) raft_consensus.cc:1685] finished
0709 13:11:24.675581 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.675697 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24831,"prepare.queue_time_us":30622,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":91,"raft.queue_time_us":190899,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":51395,"thread_start_us":626624,"threads_started":3,"wal-append.queue_time_us":426993}
I20260709 13:11:24.844738 25185 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:24.848196 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:24.852396 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.855324 24669 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:24.848758 25184 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:24.830870 25212 rpcz_store.cc:276] 0709 13:11:23.588266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.588431 (+   165us) service_pool.cc:224] Handling call
0709 13:11:23.600185 (+ 11754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.603149 (+  2964us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:23.707946 (+104797us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.367157 (+659211us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.424593 (+ 57436us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.433716 (+  9123us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:24.433776 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.433867 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.797276 (+363409us) raft_consensus.cc:1685] finished
0709 13:11:24.797296 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.797421 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2087,"prepare.queue_time_us":134350,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":171848,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":3347,"thread_start_us":627380,"threads_started":3,"wal-append.queue_time_us":586015}
W20260709 13:11:24.850515 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 193046us
I20260709 13:11:24.862069 24565 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:24.863348 25184 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:24.826434 32496 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.870910 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:24.840417 32498 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.866904 24594 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:24.869858 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:24.871541 24666 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:24.880333 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:24.799373 32303 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.882236 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:24.907305 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.851548 32433 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:24.904668 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:24.859550 32564 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:24.854847 32550 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:24.846873 32479 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:24.915907 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:24.912999 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.870453 32518 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:24.869190 32496 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:24.875823 32532 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:24.872548 32249 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:24.936962 24591 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:24.964440 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.936962 24517 raft_consensus.cc:606] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:24.965376 24517 raft_consensus.cc:614] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:24.965528 24666 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:24.799822 32547 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.970027 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.970883 24596 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:24.909608 32570 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:11:24.971832 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:24.963824 32249 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.972848 32249 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:24.974337 32303 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.970671 32297 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:24.976366 32552 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:24.976961 32552 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.972924 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:24.979362 32552 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.948995 32433 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.982254 32469 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.983388 32433 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:24.987433 32420 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.950500 32479 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:24.904903 32498 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:24.994520 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 131290us
I20260709 13:11:24.904471 32430 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.005931 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:24.937500 32518 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:25.013365 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:25.025957 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 219582us
I20260709 13:11:25.029428 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:25.031391 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:25.042070 24517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723"
dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
mode: GRACEFUL
new_leader_uuid: "148dc963cec64232ad3b248abad6f36d"
 from {username='slave'} at 127.0.0.1:53028
I20260709 13:11:24.995646 32491 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:25.010149 32297 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:25.041715 32152 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:25.052174 32252 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:25.010485 32483 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:25.049360 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:25.028162 32518 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.013177 31926 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:25.028375 32433 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:11:25.080618 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 198453us
I20260709 13:11:25.052624 32252 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:25.043049 32581 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:25.058660 32564 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:25.084194 31926 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.089800 32433 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:25.132530 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:25.134367 25215 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 22: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:25.126303 32252 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:25.137362 32575 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:11:25.099236 32483 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:25.138688 32483 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.139176 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:25.140210 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.140887 32420 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:25.142174 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:25.143134 32433 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:25.146166 32479 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.148623 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:25.161803 24597 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:25.096698 32550 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:25.134589 31926 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:25.154469 32498 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.163342 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:25.149161 32576 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
W20260709 13:11:25.157325 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.117364 32571 consensus_queue.cc:1059] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.285s
W20260709 13:11:25.153770 32569 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:11:25.153123 32573 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:25.159155 32553 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.147s
W20260709 13:11:25.155382 32536 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.905s	user 0.006s	sys 0.009s
I20260709 13:11:25.050359 32181 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.053443 32496 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.158604 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.178172 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:25.177678 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 58042.1us
I20260709 13:11:25.140792 32483 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:25.177511 32531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.009s	sys 0.015s
I20260709 13:11:25.186578 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.189625 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:25.195385 32302 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.002s
I20260709 13:11:25.229341 32302 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.231542 32302 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:25.231730 24566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.131:37451 timed out after 1.580s (SENT) [suppressed 6 similar messages]
I20260709 13:11:25.195436 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.233268 24598 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:25.234511 24598 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:25.197530 32433 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.238163 32564 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.239513 32433 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.236369 24598 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:11:25.240332 32551 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:25.198495 32426 consensus_meta.cc:287] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:11:25.200055 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:25.224534 32550 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.225256 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.226826 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:25.231805 32448 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.009s
I20260709 13:11:25.198241 32496 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.196542 32181 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.258534 24594 raft_consensus.cc:2393] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:25.246553 32531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.013s	sys 0.015s
I20260709 13:11:25.249276 32237 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:25.265741 32559 consensus_meta.cc:287] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.003s
I20260709 13:11:25.266176 32559 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.267151 32237 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:25.254782 32448 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:25.269671 32252 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.271740 32252 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:25.254948 32536 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:25.274601 31926 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.283129 24596 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:25.268769 32559 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.249918 32426 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 17. Current term is 18.
I20260709 13:11:25.297725 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:25.250151 32310 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:25.305255 24594 raft_consensus.cc:1240] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:25.306300 24591 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:25.192004 32573 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.261498 32551 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:25.333133 24518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2633) took 1019 ms. Trace:
I20260709 13:11:25.333700 24518 rpcz_store.cc:276] 0709 13:11:24.314133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.314298 (+   165us) service_pool.cc:224] Handling call
0709 13:11:24.331208 (+ 16910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.350785 (+ 19577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.350818 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:24.359166 (+  8348us) log.cc:844] Serialized 26 byte log entry
0709 13:11:24.563748 (+204582us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:24.563805 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.563896 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.332859 (+768963us) raft_consensus.cc:1685] finished
0709 13:11:25.332884 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.333043 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16536,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8126,"thread_start_us":129406,"threads_started":1,"wal-append.queue_time_us":245918}
I20260709 13:11:25.337451 24597 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
W20260709 13:11:25.341308 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 109593us
I20260709 13:11:25.339802 31926 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:25.367709 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:25.368578 24671 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:25.304121 32249 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.373203 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:25.333196 32310 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.363497 24416 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.400759 32573 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.403240 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.404095 24597 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:25.405460 31926 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.406064 31926 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.407569 32548 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.20, Last appended by leader: 20, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.408233 31926 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:25.397715 32452 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:25.413460 32452 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:25.413813 32452 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:25.419777 32548 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:25.404776 24671 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:25.422679 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.423296 24666 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 18.
I20260709 13:11:25.426949 24521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2630) took 1118 ms. Trace:
I20260709 13:11:25.427354 24521 rpcz_store.cc:276] 0709 13:11:24.308790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.310843 (+  2053us) service_pool.cc:224] Handling call
0709 13:11:24.334655 (+ 23812us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:24.386008 (+ 51353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.386045 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:24.434405 (+ 48360us) log.cc:844] Serialized 52 byte log entry
0709 13:11:25.415857 (+981452us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b1800414ca0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae60d1
0709 13:11:25.426558 (+ 10701us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:25.426592 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.426652 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.426690 (+    38us) raft_consensus.cc:1685] finished
0709 13:11:25.426702 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.426875 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48580,"raft.queue_time_us":46766,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":34167,"spinlock_wait_cycles":51388672,"thread_start_us":198012,"threads_started":1,"wal-append.queue_time_us":195736}
I20260709 13:11:25.430146 32554 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:25.427367 32518 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:25.432106 24665 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:25.433137 32518 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:25.437222 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:25.437980 32554 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:25.438548 32554 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:25.438902 32554 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:25.442078 24591 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:25.442870 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.443411 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:25.444043 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.443497 32370 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:25.476742 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 397994us
I20260709 13:11:25.445592 25213 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:25.479327 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:25.488606 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47907.3us
I20260709 13:11:25.494583 24594 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:11:25.472374 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.475401 24519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3895) took 1103 ms. Trace:
I20260709 13:11:25.496603 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:25.472057 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:25.500487 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.497574 24598 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:25.499893 25210 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 26.
I20260709 13:11:25.502421 25219 raft_consensus.cc:2393] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:25.497498 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:25.478895 24522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2632) took 1167 ms. Trace:
I20260709 13:11:25.498178 24519 rpcz_store.cc:276] 0709 13:11:24.372054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.782369 (+410315us) service_pool.cc:224] Handling call
0709 13:11:24.782669 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.782895 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:11:24.995292 (+212397us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.077619 (+ 82327us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.474748 (+397129us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b1800112ea0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:11:25.474922 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:25.475003 (+    81us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:25.475064 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.475160 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.475319 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":407585,"prepare.queue_time_us":125221,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":88,"raft.queue_time_us":419629,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":7738,"spinlock_wait_cycles":8683648,"thread_start_us":253657,"threads_started":2,"wal-append.queue_time_us":160492}
I20260709 13:11:25.509707 24522 rpcz_store.cc:276] 0709 13:11:24.313825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.313946 (+   121us) service_pool.cc:224] Handling call
0709 13:11:24.331517 (+ 17571us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:24.383149 (+ 51632us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:11:24.426220 (+ 43071us) log.cc:844] Serialized 14 byte log entry
0709 13:11:24.963648 (+537428us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18001768c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:25.009506 (+ 45858us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18001768c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a 00007f17bbf50a2a
0709 13:11:25.089201 (+ 79695us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:25.124099 (+ 34898us) log.cc:844] Serialized 52 byte log entry
0709 13:11:25.124485 (+   386us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:11:25.124806 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.478512 (+353706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.478592 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:25.478639 (+    47us) raft_consensus.cc:1685] finished
0709 13:11:25.478654 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.478825 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":412023,"prepare.queue_time_us":43310,"prepare.run_cpu_time_us":260,"prepare.run_wall_time_us":8319,"raft.queue_time_us":457088,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"spinlock_wait_cycles":13759872,"thread_start_us":79456,"threads_started":1,"wal-append.queue_time_us":692634}
I20260709 13:11:25.524528 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:25.531287 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:25.472671 32469 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:25.501353 32188 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:25.472844 32483 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.539098 25184 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:25.511134 32443 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:25.536659 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:25.525527 32518 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:25.538770 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:25.521572 31926 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:25.536127 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:25.545661 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:25.546447 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.546494 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:25.547410 24520 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:25.550460 32370 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:25.551090 32370 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.550478 24566 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:25.553283 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.553915 24516 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:25.554886 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.555962 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.556867 24518 raft_consensus.cc:2393] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:25.558537 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:25.476514 32452 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.561264 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:25.536615 32591 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:11:25.537374 32181 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:25.563445 24519 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:25.575665 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:25.577677 32302 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:25.582026 32428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.012s	sys 0.012s
I20260709 13:11:25.582129 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:25.582547 32567 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:25.587020 32567 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:25.587163 32565 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:25.589790 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:25.592304 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:25.583757 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 87822.1us
I20260709 13:11:25.596429 32302 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:25.596978 32302 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.597407 32302 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:25.588301 32567 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:25.602670 24416 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 22, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 22 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:25.604414 32496 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:25.604486 32372 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:25.604727 24416 catalog_manager.cc:5697] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 17 to 22, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 22 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:25.606025 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:25.606969 32372 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:25.607355 32372 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:25.607398 24637 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:25.607878 32372 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:25.608243 32496 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:25.616755 32428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.388s	user 0.012s	sys 0.012s
I20260709 13:11:25.607728 24416 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 21, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:25.631585 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73214.7us
I20260709 13:11:25.635005 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:25.545799 32430 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:11:25.638159 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 108734us
I20260709 13:11:25.628361 24416 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 23, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 23 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.641403 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:25.646124 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.557665 32561 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:25.647013 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:25.541889 32566 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:11:25.642066 24416 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:25.665459 24671 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:25.665529 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.668654 24673 raft_consensus.cc:2368] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:25.540619 32469 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.660928 25215 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:25.669945 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:25.544468 32483 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.678158 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:25.679134 25215 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 23: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:25.679477 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:25.680199 24593 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:25.680584 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:25.681278 24671 raft_consensus.cc:2368] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:25.630460 32181 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:25.640606 32547 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:25.692750 24519 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 26.
I20260709 13:11:25.697566 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.700040 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:25.700332 24671 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:25.700819 24667 raft_consensus.cc:2368] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:25.701311 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.702024 24671 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:25.707901 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:25.708601 25215 raft_consensus.cc:2368] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:25.716487 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.716881 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.557915 32518 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.562078 31926 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.676278 32581 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:25.762044 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:25.773873 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.774055 24667 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:25.646195 32491 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:25.563212 32357 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.118s
I20260709 13:11:25.698601 32181 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:25.765829 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:25.769119 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.676607 32433 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:25.771790 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:25.780216 24673 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:25.780632 25215 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:25.761737 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:25.774348 24598 raft_consensus.cc:2393] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 27: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:25.776984 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 188992us
I20260709 13:11:25.562947 32598 consensus_queue.cc:1059] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 13:11:25.771057 24666 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:25.782651 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.646135 32590 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:11:25.652343 32479 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.111s
I20260709 13:11:25.794556 32534 raft_consensus.cc:993] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:11:25.795195 32426 raft_consensus.cc:1081] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:11:25.797204 32483 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.800168 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:25.801113 32551 consensus_queue.cc:1059] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:11:25.802276 32551 raft_consensus.cc:3055] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:11:25.802563 32188 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:25.802688 32551 raft_consensus.cc:740] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:25.803241 32188 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:25.803726 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.804557 24518 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:25.803776 32551 consensus_queue.cc:260] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.807631 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.807987 32551 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:25.810828 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:25.811611 32605 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:11:25.792284 32302 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:25.764020 32370 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:25.822754 24593 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:25.825752 24517 raft_consensus.cc:606] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Received request to transfer leadership to TS 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:25.826285 24517 raft_consensus.cc:614] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:25.770776 32249 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:25.825857 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3896) took 1404 ms. Trace:
I20260709 13:11:25.773845 32565 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.702353 32252 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 13:11:25.773690 32581 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.831693 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:25.841878 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.832531 32627 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.841322 24417 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 349) took 41768 ms (client timeout 15000 ms). Trace:
I20260709 13:11:25.843696 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:25.841464 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:25.783847 24416 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 5 to 9, term changed from 14 to 18, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129), VOTER 96002c98f2d142e4b67dc5105a06079c (127.22.225.130), VOTER 148dc963cec64232ad3b248abad6f36d (127.22.225.131), VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 18 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:25.853058 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 183172us
I20260709 13:11:25.859890 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.860564 24522 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:25.861984 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1637) took 1223 ms. Trace:
I20260709 13:11:25.862807 24518 raft_consensus.cc:2393] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 26: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:25.862356 24596 rpcz_store.cc:276] 0709 13:11:24.638694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.972686 (+333992us) service_pool.cc:224] Handling call
0709 13:11:25.861827 (+889141us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540025c454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:25.861925 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678827904}
I20260709 13:11:25.868065 24668 raft_consensus.cc:2368] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24.
I20260709 13:11:25.868355 24593 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:25.869335 24416 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:25.872434 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.873874 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.827015 32570 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.878257 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 111591us
I20260709 13:11:25.706566 32561 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.891892 24416 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 23, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 23 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.924351 24518 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:11:25.842845 32590 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:25.847163 32581 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:25.928560 24673 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:25.945765 24518 raft_consensus.cc:1275] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:11:25.947870 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 397351us
I20260709 13:11:25.948951 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:25.951895 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:25.954183 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.942644 24416 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 17 to 20, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 20 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:25.881450 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.958899 24593 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:11:25.952605 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73059.5us
I20260709 13:11:25.962910 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:25.963505 24519 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:25.966468 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:25.967559 24416 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.973984 24490 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:25.982836 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:25.983697 24520 raft_consensus.cc:3060] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:25.847388 32565 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:25.953850 32552 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:11:26.057924 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 71213.2us
I20260709 13:11:26.059355 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:25.831460 24523 rpcz_store.cc:276] 0709 13:11:24.421364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.782955 (+361591us) service_pool.cc:224] Handling call
0709 13:11:24.794686 (+ 11731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.794919 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:11:25.012723 (+217804us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.598217 (+585494us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b1800093460. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e3be07 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b 00007f17bbae5d23 00007f17bbae623a 00007f17bbf50a2a
0709 13:11:25.825538 (+227321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:25.825586 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:25.825633 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.825711 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.825806 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70456,"prepare.queue_time_us":172985,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":5840,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":13896,"spinlock_wait_cycles":34362624,"thread_start_us":402880,"threads_started":2}
W20260709 13:11:26.059494 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 101112us
I20260709 13:11:25.927203 32570 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.061203 24566 leader_election.cc:400] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:26.063067 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:26.064457 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:25.876735 32627 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.065062 24522 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:26.069602 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:25.990300 31813 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:25.985550 32443 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:26.117112 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:26.118784 24519 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 27.
I20260709 13:11:26.117852 24416 catalog_manager.cc:5697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 17 to 26. New cstate: current_term: 26 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:26.043473 32591 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.067080 32580 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:11:26.153339 32591 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.155483 32591 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.159622 32558 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:26.160050 32558 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:26.106446 32249 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.161398 32177 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:26.161808 32177 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:26.161936 24516 raft_consensus.cc:2376] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23. Re-sending same reply.
I20260709 13:11:26.162685 32177 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.164072 32177 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.123416 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.121501 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.121915 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.123416 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:26.127055 32566 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:11:26.127384 32372 consensus_meta.cc:287] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.001s
I20260709 13:11:25.976804 32555 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.099s
I20260709 13:11:26.128782 24522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:26.127741 24416 catalog_manager.cc:5697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:26.130402 32631 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:26.188484 24416 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 22 to 26, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 26 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:26.189734 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:26.131471 32626 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:26.040853 32623 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:26.138711 32627 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:26.142509 32496 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.003s
I20260709 13:11:26.144302 32570 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.144883 32469 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.145828 32561 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.097694 32621 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:25.847855 24417 rpcz_store.cc:269] 0709 13:10:44.018315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.018508 (+   193us) service_pool.cc:224] Handling call
0709 13:10:44.371651 (+353143us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:11:25.773924 (+41402273us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:21.400342 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:21.528390 (+128048us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:21.565859 (+ 37469us) write_op.cc:435] Acquired schema lock
0709 13:11:21.570474 (+  4615us) tablet.cc:662] Decoding operations
0709 13:11:21.662734 (+ 92260us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:21.662800 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:21.662829 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:11:21.667173 (+  4344us) tablet.cc:701] Row locks acquired
0709 13:11:21.667197 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:11:21.667349 (+   152us) write_op.cc:270] Start()
0709 13:11:21.667458 (+   109us) write_op.cc:276] Timestamp: P: 1783602681667301 usec, L: 0
0709 13:11:21.667482 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:11:21.668168 (+   686us) log.cc:844] Serialized 4734 byte log entry
0709 13:11:22.276794 (+608626us) op_driver.cc:464] REPLICATION: finished
0709 13:11:22.360918 (+ 84124us) write_op.cc:301] APPLY: starting
0709 13:11:22.361281 (+   363us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:22.496793 (+135512us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:22.496922 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:23.081618 (+584696us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:23.082077 (+   459us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:11:23.082134 (+    57us) write_op.cc:312] APPLY: finished
0709 13:11:23.082623 (+   489us) log.cc:844] Serialized 105 byte log entry
0709 13:11:23.084221 (+  1598us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:23.084463 (+   242us) write_op.cc:454] Released schema lock
0709 13:11:23.084531 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:23.089664 (+  5133us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:23.089741 (+    77us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28569,"reported_tablets":46,"spinlock_wait_cycles":250738560,"child_traces":[["op",{"apply.queue_time_us":8233,"apply.run_cpu_time_us":25849,"apply.run_wall_time_us":803807,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":290901,"prepare.run_cpu_time_us":37945,"prepare.run_wall_time_us":407895,"raft.queue_time_us":125136,"raft.run_cpu_time_us":7944,"raft.run_wall_time_us":7963,"replication_time_us":609091,"spinlock_wait_cycles":1792,"thread_start_us":435162,"threads_started":4,"wal-append.queue_time_us":178861,"wal-append.run_cpu_time_us":32150,"wal-append.run_wall_time_us":2259005}]]}
I20260709 13:11:26.168170 24524 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.178764 31813 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:26.167577 24521 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:26.061975 32552 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:26.188674 24522 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:26.181135 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:26.105481 32448 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:11:26.166615 32554 consensus_meta.cc:287] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.000s
I20260709 13:11:26.105520 32433 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.207840 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.166409 32426 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:11:26.206826 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 96308.6us
I20260709 13:11:26.216900 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:26.216594 24416 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 20, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 20 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.252168 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:26.161702 32249 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:26.252377 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 152509us
I20260709 13:11:26.177803 24520 raft_consensus.cc:2468] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:26.206823 32452 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.216161 32571 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.239068 32496 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:26.160936 32558 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.290637 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:26.305619 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 124738us
I20260709 13:11:26.305922 24520 raft_consensus.cc:2410] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 28 because replica has last-logged OpId of term: 26 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 19.
W20260709 13:11:26.306118 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 72195us
I20260709 13:11:26.307766 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.307473 24416 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 23 to 25, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 25 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:26.286068 24523 raft_consensus.cc:2368] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:26.308315 24491 leader_election.cc:400] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:26.293043 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:26.190759 32443 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:26.310827 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58731.9us
I20260709 13:11:26.311218 24490 leader_election.cc:400] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:26.311637 24490 leader_election.cc:403] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:11:26.240388 32627 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:26.207700 32624 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:11:26.253412 32552 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:26.197578 32372 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.317448 24416 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:26.311779 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:26.318840 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:26.322466 24525 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:11:26.321602 24491 leader_election.cc:400] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:26.324370 24491 leader_election.cc:400] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:26.286336 32570 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:11:26.255625 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:26.305130 32625 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:11:26.330364 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:26.290802 32302 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:26.331725 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:26.341681 32496 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:26.342254 32496 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.344833 32496 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.322005 32627 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.345619 31813 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.346670 24521 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:26.347760 32627 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.349443 32567 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:11:26.350524 32188 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 13:11:26.350589 32249 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.351061 32188 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.326052 32452 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:11:26.353758 24416 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.354419 24521 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:26.355489 24416 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 17 to 21, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 21 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:26.316146 32181 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.285621 32433 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.362028 32181 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:26.362893 24665 raft_consensus.cc:1240] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:26.363044 32433 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.200309 32631 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.369529 24668 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:26.371327 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:26.367978 24416 catalog_manager.cc:5697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:26.379391 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.380060 32310 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:26.247247 32448 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:26.389607 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:26.254470 32426 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:26.392452 24637 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:26.352984 32188 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.399680 32496 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:26.405007 32580 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:26.405457 32302 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.406677 32631 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.407784 32581 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.408794 32310 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:26.331496 32633 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.412793 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:26.312229 32571 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.393390 32624 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21.
I20260709 13:11:26.254142 32554 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.418263 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:26.431908 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 113144us
I20260709 13:11:26.417126 24416 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.393301 32558 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:26.399166 32448 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:26.387198 32566 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:11:26.419531 32598 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:26.389421 32181 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:26.422173 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:26.427943 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 97664.2us
I20260709 13:11:26.403640 32426 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:26.412560 25182 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:26.426692 32433 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:26.461094 32433 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.462069 32554 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.463367 32433 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.242411 32623 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.466856 32623 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.471939 32448 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.473445 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.474270 32443 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.474654 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.475597 32566 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:26.475970 32566 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:26.476087 24674 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:11:26.245950 32621 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.401330 32627 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:26.456943 24669 raft_consensus.cc:2368] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:26.457604 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:26.484031 24673 raft_consensus.cc:2368] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:26.459388 24671 raft_consensus.cc:2368] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
W20260709 13:11:26.477284 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 64815.5us
I20260709 13:11:26.432773 32548 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.485055 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:26.459854 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:26.477759 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44394.2us
I20260709 13:11:26.480926 24416 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 16, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 16 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:26.433735 32310 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.501595 32310 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.502221 32310 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:26.503242 24416 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 24. New cstate: current_term: 24 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:26.505568 24416 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:26.507143 24416 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:26.504245 32548 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.509550 32548 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.510545 24416 catalog_manager.cc:5697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 10 to 18, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 18 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:26.512274 32551 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.000s
I20260709 13:11:26.512224 24416 catalog_manager.cc:5697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 14 to 19, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 19 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:26.522437 32621 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.523787 32372 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.479779 32637 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:26.527880 32615 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.460s	user 0.001s	sys 0.000s
I20260709 13:11:26.427953 32496 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:26.486793 32641 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:11:26.538738 24673 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:26.436046 32635 raft_consensus.cc:2764] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:11:26.434598 32619 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:26.484723 32448 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.532788 31926 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.480187 32498 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:26.486755 32627 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.497969 32181 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:26.480602 32598 raft_consensus.cc:697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:26.559206 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.571215 24673 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:26.551520 32627 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:26.580129 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.581017 24673 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
I20260709 13:11:26.591884 32598 consensus_queue.cc:237] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.593465 32152 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:26.593932 32152 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:26.594791 32152 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.596493 32152 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.610704 24521 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:26.618489 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.625568 32518 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.627705 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.604719 24518 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 20. (term mismatch)
I20260709 13:11:26.551045 32498 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.670179 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:26.674770 24524 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:26.665617 24518 pending_rounds.cc:85] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Aborting all ops after (but not including) 19
I20260709 13:11:26.537601 32566 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.680711 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.675995 24518 pending_rounds.cc:107] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Aborting uncommitted NO_OP operation due to leader change: 26.20
I20260709 13:11:26.692459 24518 raft_consensus.cc:2889] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:26.697980 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:26.695551 32581 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.678182 32051 raft_consensus.cc:2764] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 13:11:26.689181 32479 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:26.705817 24672 raft_consensus.cc:1240] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:11:26.706735 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2574) took 1056 ms. Trace:
I20260709 13:11:26.713344 24665 rpcz_store.cc:276] 0709 13:11:25.650178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.650337 (+   159us) service_pool.cc:224] Handling call
0709 13:11:25.678482 (+ 28145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.363486 (+685004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.704312 (+340826us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54001392d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:26.706658 (+  2346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573512064}
I20260709 13:11:26.751564 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.759330 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.760334 24673 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
W20260709 13:11:26.764712 32177 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.600s	user 0.014s	sys 0.000s
I20260709 13:11:26.767551 32571 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.804265 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.761790 32479 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:26.812456 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 327462us
I20260709 13:11:26.797063 32496 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.825131 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:26.849900 32649 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:11:26.866580 32646 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:11:26.869043 32639 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:26.869575 32639 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:26.870009 32498 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:26.870448 32639 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.871560 32639 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:26.874461 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 4009) took 1163 ms. Trace:
I20260709 13:11:26.874852 24671 rpcz_store.cc:276] 0709 13:11:25.711127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.768870 (+ 57743us) service_pool.cc:224] Handling call
0709 13:11:26.874278 (+1105408us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b5400407254. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:26.874406 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561394048}
W20260709 13:11:26.885488 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.886271 32426 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:26.839485 32647 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:11:26.894356 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:26.895454 24673 raft_consensus.cc:2368] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24.
W20260709 13:11:26.887904 32650 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.178s	user 0.003s	sys 0.000s
I20260709 13:11:26.903857 32564 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.912372 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:26.913861 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.914901 32302 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.905958 32479 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.915812 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.916720 24674 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:26.917153 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.918388 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:26.906049 24668 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 27.
I20260709 13:11:26.908329 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:26.904441 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 79415.9us
W20260709 13:11:26.911435 32552 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.000s
I20260709 13:11:26.914952 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.925151 24521 raft_consensus.cc:2393] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 27: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:26.920866 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:26.934958 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:26.935254 32656 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:11:26.941102 32634 log.cc:927] Time spent T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.873s	user 0.001s	sys 0.001s
I20260709 13:11:26.943133 32496 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:26.943871 32496 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.944883 32623 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:26.945501 32623 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.947826 32623 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.949303 32430 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.948558 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:26.948343 32496 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:26.954735 32302 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:26.955299 32302 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.957511 32302 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.957840 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:53028 (request call id 14) took 1916 ms. Trace:
I20260709 13:11:26.958425 24517 rpcz_store.cc:276] 0709 13:11:25.041456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.041909 (+   453us) service_pool.cc:224] Handling call
0709 13:11:26.957592 (+1915683us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400441e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf40853 00007f17c0f0e60a 00007f17ba4947d4 00007f17ba494762 00007f17ba494691 00007f17ba49460c 00007f17ba4938c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:26.957736 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797205760}
W20260709 13:11:26.961804 32614 log.cc:927] Time spent T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.705s	user 0.002s	sys 0.002s
I20260709 13:11:26.961958 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:26.958022 32302 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.963032 25212 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:26.962913 32302 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.963308 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:26.963722 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:26.963971 25219 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:26.964216 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:26.964891 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:26.965495 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:26.965713 25211 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 19: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:26.966113 25216 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:26.966233 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:26.966833 25218 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:26.965020 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:26.971684 25210 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:26.971913 24593 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:11:26.974259 32579 raft_consensus.cc:3055] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:26.974629 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:26.974663 32579 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:26.976565 32579 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:26.977615 32579 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:26.980967 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.981408 32496 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:26.981967 32496 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:26.982297 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:26.982860 24593 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.984136 32496 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.985041 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:26.986028 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:26.986585 24596 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:26.985426 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:26.985647 24519 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:26.988793 32565 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:26.989825 32426 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:26.993420 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:26.965641 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:26.994448 25215 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:26.994936 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:26.996016 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:27.001507 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.003032 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.004976 25212 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:27.006378 24593 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:27.008451 24596 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:26.997272 25182 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:27.012187 25215 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:27.015030 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.015823 24591 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:27.016052 24563 leader_election.cc:400] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:27.012913 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:26.934686 32580 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.022576 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.023190 25213 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 27.
I20260709 13:11:27.023054 32580 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.014295 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.017858 24595 raft_consensus.cc:1240] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:26.926604 32552 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.027915 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:27.028683 25216 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:27.019855 24598 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:11:27.016837 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.020539 24563 leader_election.cc:403] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:11:27.021155 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.015683 24600 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 26.
I20260709 13:11:27.019289 32637 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:27.022392 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:26.974282 32302 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.021893 24639 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:27.033461 24599 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:11:27.033793 24566 leader_election.cc:400] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:27.033061 25218 raft_consensus.cc:2410] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:11:27.036988 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:27.022392 32664 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:11:27.046823 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.015290 32551 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.013443 32430 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.041266 32623 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:27.016067 31926 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:27.015358 32656 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:27.045970 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:27.059687 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.071285 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.078402 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.079376 25218 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:27.043967 32565 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:11:27.051208 32302 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:27.065778 32479 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:27.092525 32181 consensus_queue.cc:1059] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:27.093468 24665 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:27.094245 32181 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:27.094816 32181 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:27.076504 32656 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.058864 32430 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.092628 32479 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 23 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:27.102270 32479 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.103590 32430 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:27.105916 32630 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.696s	user 0.002s	sys 0.000s
W20260709 13:11:27.108021 32663 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:27.109690 32404 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:27.110105 32404 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:27.110630 32656 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:27.110937 32404 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.111933 32404 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:27.103782 32561 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:27.113754 32561 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:27.114485 32561 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.115824 32561 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:27.117414 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 91616.7us
I20260709 13:11:27.118300 24566 leader_election.cc:400] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
W20260709 13:11:27.118716 32654 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260709 13:11:27.121342 32656 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:27.121878 32656 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.125402 32430 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:27.125907 32430 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.084481 32580 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.128731 32656 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:27.052037 32564 consensus_queue.cc:1048] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:11:27.129683 32430 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.135576 25218 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 13:11:27.135967 25218 pending_rounds.cc:85] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 16
I20260709 13:11:27.135689 25219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2451462dc894ec98db5932996a9e329"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48926
I20260709 13:11:27.136214 25218 pending_rounds.cc:107] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 13:11:27.136443 25219 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:27.136500 32566 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.136950 25219 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.141356 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:27.141517 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.142182 24666 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:27.048362 32637 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.057585 32448 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:11:27.144726 25219 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.146162 25213 raft_consensus.cc:2410] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:11:27.146651 32637 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.147023 25219 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:27.147383 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.146124 25217 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:27.069514 31926 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.151257 25212 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:27.153393 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.157511 25211 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:27.158707 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.152029 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.160316 24665 raft_consensus.cc:2393] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:27.136510 25218 raft_consensus.cc:2889] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.156270 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.151651 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.162206 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:27.163234 25218 raft_consensus.cc:2368] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:27.165201 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.165872 25212 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
W20260709 13:11:27.167060 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 47972.7us
I20260709 13:11:27.170275 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.172564 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.173466 25217 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:27.171914 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.175560 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.175778 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:27.176935 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 140865us
I20260709 13:11:27.177747 24563 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.167867 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:27.187014 24563 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.187280 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:27.187886 24666 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:11:27.188156 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.187043 24566 leader_election.cc:400] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24.
I20260709 13:11:27.189327 24566 leader_election.cc:403] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:11:27.189726 24516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2653) took 1073 ms. Trace:
I20260709 13:11:27.190119 24516 rpcz_store.cc:276] 0709 13:11:26.116704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.163771 (+ 47067us) service_pool.cc:224] Handling call
0709 13:11:26.164074 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.164267 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:26.295930 (+131663us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.478629 (+182699us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.991433 (+512804us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b18004d2d80. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:27.189186 (+197753us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b18004d2d80. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8dd3c0a 00007f17c2513219 00007f17b8e5ba40 00007f17b8e564e4 00007f17b8e56455 00007f17bbf3e060 00007f17bbf50716 00007f17bbf61287 00007f17bbf61208
0709 13:11:27.189363 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:27.189414 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:27.189473 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.189546 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.189673 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53411,"prepare.queue_time_us":242135,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":51244,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":43855,"spinlock_wait_cycles":26433280,"thread_start_us":269902,"threads_started":2,"wal-append.queue_time_us":275133}
I20260709 13:11:27.191254 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.192818 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:27.193246 24637 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:27.194955 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.195297 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.195582 24665 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 27.
I20260709 13:11:27.196503 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:27.197314 32657 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:11:27.198361 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:27.197839 32430 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:27.189443 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 702785us
I20260709 13:11:27.204159 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.207016 24519 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:27.204998 25210 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:27.207381 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:27.208678 25215 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:27.198920 25185 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:27.210165 24520 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:27.210748 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:27.211515 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 176399us
I20260709 13:11:27.197482 32531 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:27.212704 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.213908 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:27.216163 32637 raft_consensus.cc:2804] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:27.216429 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:27.216755 32551 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:27.197587 32428 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:27.217178 32551 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.216894 32648 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:27.217588 32551 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.218266 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:27.171401 32302 raft_consensus.cc:697] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:27.215145 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:27.221977 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:27.224078 24519 raft_consensus.cc:1240] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:11:27.224014 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.199939 32580 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:27.202086 32567 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:27.207839 32452 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.208779 32639 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:27.177304 32177 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:11:27.233747 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.175473 32554 consensus_queue.cc:1059] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:11:27.230329 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.241561 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.246973 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.247665 24519 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:27.247790 31926 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.248159 32302 consensus_queue.cc:237] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.252393 24519 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:27.256304 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.228682 32428 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:27.264420 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:27.236752 32639 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:27.226711 32181 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.266733 32639 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:27.267267 32181 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:27.240020 32567 raft_consensus.cc:697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:27.269001 32567 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.258147 32581 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.015s
W20260709 13:11:27.273468 32665 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:11:27.238998 32598 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:27.228188 32656 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:11:27.277523 32660 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:11:27.279490 32491 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:27.279971 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.280687 32672 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:27.281754 32580 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:11:27.282277 32372 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:27.284530 32581 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:11:27.282292 32580 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 27 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:27.286511 32580 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.288878 32552 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.227391 32637 raft_consensus.cc:697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:27.285035 32581 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:27.290370 32637 consensus_queue.cc:237] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.291666 32581 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:27.294009 32627 consensus_meta.cc:287] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.003s
I20260709 13:11:27.294411 32627 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.295517 24517 raft_consensus.cc:2368] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20.
I20260709 13:11:27.296358 32627 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.297400 24523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50164 (request call id 3906) took 1105 ms. Trace:
W20260709 13:11:27.298496 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 83421.1us
I20260709 13:11:27.299582 24523 rpcz_store.cc:276] 0709 13:11:26.192385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.315461 (+123076us) service_pool.cc:224] Handling call
0709 13:11:26.318341 (+  2880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:26.318695 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:11:26.650124 (+331429us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.121370 (+471246us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18004667e0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:27.244773 (+123403us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.245151 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.245294 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:27.245342 (+    48us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:27.245417 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.245497 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.297341 (+ 51844us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":453617,"prepare.queue_time_us":121327,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":512972,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":12134,"spinlock_wait_cycles":158592256,"thread_start_us":366972,"threads_started":2,"wal-append.queue_time_us":148208}
I20260709 13:11:27.324401 32623 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:27.326049 32652 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:27.326681 32652 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:27.327239 32652 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:27.329864 32452 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.296947 32627 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:27.265009 32673 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:27.333501 32627 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.333689 32428 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.336117 32627 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.316686 32554 raft_consensus.cc:3055] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:27.337806 32554 raft_consensus.cc:740] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:27.338923 32554 consensus_queue.cc:260] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.340281 32554 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:27.343523 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 79188.9us
W20260709 13:11:27.350283 24638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.351214 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 152917us
I20260709 13:11:27.352275 24566 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.358445 25216 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:27.293668 32581 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:27.364698 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2575) took 1714 ms. Trace:
W20260709 13:11:27.365916 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.366215 24670 rpcz_store.cc:276] 0709 13:11:25.650566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.650688 (+   122us) service_pool.cc:224] Handling call
0709 13:11:25.677524 (+ 26836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:26.983587 (+1306063us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b180043fba0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17bbaee4bc 00007f17b8e3c48b 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e56455 00007f17bbf3e060 00007f17bbf3ebfb 00007f17bbf4964b
0709 13:11:26.983727 (+   140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:26.983758 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:26.984226 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.070757 (+ 86531us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:27.070805 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.070888 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.357364 (+286476us) raft_consensus.cc:1685] finished
0709 13:11:27.357384 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.364640 (+  7256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165063,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":18048,"spinlock_wait_cycles":9792256,"thread_start_us":279200,"threads_started":2,"wal-append.queue_time_us":255862}
I20260709 13:11:27.325023 32623 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:27.363044 32559 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:27.364753 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 173583us
W20260709 13:11:27.373482 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 160835us
I20260709 13:11:27.363312 32565 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24.
I20260709 13:11:27.364995 32656 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:27.406770 24667 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:11:27.369621 32531 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:27.403802 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:27.409750 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 65272.6us
I20260709 13:11:27.423964 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:27.427670 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.448060 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:27.449052 32548 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:27.454680 32548 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.450228 32564 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:27.457774 32564 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:27.458822 32564 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.451336 32570 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.462281 32570 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.464764 32570 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.451531 32252 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.453739 32558 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:27.466945 32558 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:27.467453 32558 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:27.453894 32188 consensus_queue.cc:1059] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:11:27.470551 32188 raft_consensus.cc:3055] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:27.470968 32188 raft_consensus.cc:740] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:27.471923 32188 consensus_queue.cc:260] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.465895 32252 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.439911 32551 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.475878 32252 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.450022 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:27.476742 32673 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:11:27.477275 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:27.480549 32548 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.483122 32188 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.484566 32639 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.485029 25182 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.486079 32430 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:27.402921 32559 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:27.444792 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 142207us
I20260709 13:11:27.476356 32551 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.497665 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:27.499926 32559 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:27.510373 32552 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.510874 32552 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.513733 24592 raft_consensus.cc:1240] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:27.514051 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.514895 24599 raft_consensus.cc:1240] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:27.496415 32430 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:27.495586 32566 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:27.495455 32676 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:27.498607 32621 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:27.496603 32673 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:27.527170 24591 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: []
W20260709 13:11:27.520910 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 299021us
I20260709 13:11:27.512943 32552 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:27.522235 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 238628us
I20260709 13:11:27.535503 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.538667 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.540622 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:27.541450 24665 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.546483 24599 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:27.560750 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.519927 32252 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:27.521070 32430 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:27.551601 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:27.568606 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.583456 25216 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:27.526701 32621 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.570466 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.571169 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:27.584606 24667 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.573830 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:27.574867 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 77136.3us
I20260709 13:11:27.572852 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:27.580569 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:27.585938 24671 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:27.579097 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.587234 24666 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:27.495316 32623 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.603410 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.556656 32637 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:27.597646 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:27.547271 32616 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:27.635053 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.609406 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.644181 24519 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:27.608536 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.580210 32561 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:11:27.637468 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 64700.6us
I20260709 13:11:27.637923 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:27.650110 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.600776 32621 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:27.651139 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.641654 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.576188 32252 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.645408 24517 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:27.635708 24665 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:27.654008 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.602437 32571 consensus_queue.cc:1059] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:11:27.550027 32566 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.609863 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:27.669468 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:27.669811 24516 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:27.670323 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.671425 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:27.653192 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 150048us
I20260709 13:11:27.675602 24637 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:27.560971 32676 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.672006 25211 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:27.645411 32570 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.641856 32598 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.645216 32573 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:27.679728 24667 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:27.676482 32181 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:27.686539 32498 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:27.686582 32624 raft_consensus.cc:3055] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:27.700565 32498 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:27.687847 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.701170 32498 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.690577 32691 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.686884 31926 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.004s
I20260709 13:11:27.702095 32691 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.692485 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.695920 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.704078 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.672644 32252 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:27.700610 32624 raft_consensus.cc:740] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:27.683537 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.699101 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.642421 32555 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:11:27.675818 32428 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:27.719204 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:27.723016 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:27.723373 25218 raft_consensus.cc:2393] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:27.683107 32625 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:27.648984 32616 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.693186 31813 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.588382 32567 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 13:11:27.730134 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.696976 32676 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.673156 32551 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.039s
I20260709 13:11:27.732012 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.731758 25214 raft_consensus.cc:1275] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:27.742728 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.709949 32496 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:27.717420 32628 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.721057 32428 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:27.789645 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66703.1us
I20260709 13:11:27.705323 32570 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.707201 32598 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.745690 32639 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:27.808943 32674 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
W20260709 13:11:27.851094 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 60349.3us
I20260709 13:11:27.851651 32656 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:27.853138 32551 consensus_queue.cc:1243] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 24.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 13:11:27.743029 31813 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.796525 32428 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:27.860353 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:27.864326 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.864970 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.731410 32625 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:27.887957 32686 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:11:27.888230 32625 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:27.861032 32668 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:11:27.708156 32673 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.903748 32696 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:27.904198 32696 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.904574 32696 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:27.908159 32616 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.796252 32624 consensus_queue.cc:260] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.912130 32559 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.914271 32691 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.752336 32628 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.916531 32628 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:27.896653 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 192688us
I20260709 13:11:27.865320 32491 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:27.903524 32688 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:11:27.896721 24594 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:27.939118 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:27.941305 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:27.863119 32656 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:27.950883 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:27.955017 32570 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.955386 31813 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:27.956022 32682 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:11:27.957113 32581 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.002s
W20260709 13:11:27.964676 32652 consensus_meta.cc:287] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.002s
I20260709 13:11:27.901736 32051 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:27.965401 32051 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.938364 32181 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:11:27.967715 32051 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:27.968781 32672 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:27.969250 32672 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:27.970113 32672 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:27.971406 32672 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:27.973332 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 550299us
I20260709 13:11:27.953595 32625 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:27.936534 32616 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:27.974872 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.979655 24563 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:27.980432 24637 leader_election.cc:400] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20.
I20260709 13:11:27.981367 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.980929 24637 leader_election.cc:403] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:11:27.985790 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.986948 25212 raft_consensus.cc:2410] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 27 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:11:27.984622 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.988685 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:27.989192 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.989910 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.985322 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:27.990485 24593 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:27.989297 24516 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:27.982515 24594 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 27.
I20260709 13:11:27.952636 32598 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:27.976661 32625 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.977165 32051 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.980455 32181 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:27.975872 32656 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:28.012712 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:28.014366 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.013290 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.022938 24592 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:28.022980 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.024072 24673 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:11:28.024968 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.014833 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.015941 24667 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:28.016072 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:27.980320 32676 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.016925 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.018668 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:28.019234 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.025882 24597 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:11:28.026981 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.031613 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.032188 24667 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:28.027254 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.025519 24673 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:28.028719 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.033152 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.029599 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:27.977700 32567 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 13:11:28.009603 32152 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.009932 32581 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343) with higher term. Message: Invalid argument: T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20.
I20260709 13:11:28.023996 24674 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:27.985183 32692 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:28.027123 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.033150 24596 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:28.039108 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.040011 24596 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:28.035843 24671 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:28.035650 24673 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:28.041325 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.029853 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.011557 32580 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.037029 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.016820 32625 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:28.072263 24594 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:28.039073 24522 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:11:28.039310 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.042397 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.044498 32177 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:28.073783 24593 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 25: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:28.049715 32697 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:11:28.050665 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:27.984148 32616 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.053040 32567 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:11:28.053781 32554 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.713s	user 0.014s	sys 0.001s
I20260709 13:11:28.033532 32551 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:28.056192 32252 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:27.984117 32652 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.071445 24596 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.085037 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:28.085547 24596 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.085711 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:28.035300 32566 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.043236 32152 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.058727 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.060298 24519 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:28.061745 32559 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:28.064698 32188 consensus_meta.cc:287] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.001s
I20260709 13:11:28.071632 24563 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:28.074328 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.066295 32696 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.057474 31926 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:28.108238 32696 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:28.023002 32430 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.111137 32430 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:28.092651 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.087688 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:28.114147 24491 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:28.102881 24596 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
W20260709 13:11:28.101496 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73454.5us
I20260709 13:11:28.115602 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.116919 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:28.116113 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:28.118301 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46743us
I20260709 13:11:28.102710 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.114223 32188 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:28.105371 32428 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.116056 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.121549 24592 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
W20260709 13:11:28.121667 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.084837 32177 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.129263 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:28.131201 24521 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:28.084131 32567 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:28.102133 32051 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:28.127614 32559 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:28.154871 32181 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:28.155095 32559 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:28.155705 32559 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.155840 32152 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.078016 32580 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.157907 32580 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.158627 24598 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:28.125381 32402 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:28.127516 32177 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:28.163995 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
W20260709 13:11:28.164016 32558 consensus_meta.cc:287] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260709 13:11:28.166121 32558 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.164870 24519 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:28.168937 32558 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.135936 31813 consensus_queue.cc:1059] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 13:11:28.196929 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.183111 32551 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:28.130420 32680 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:28.130920 32621 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.186090 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:28.186872 32656 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.188338 32252 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.125209 32703 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:28.194942 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.141227 32188 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:28.138688 32051 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.197876 24669 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:28.198863 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.285197 24672 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 27.
W20260709 13:11:28.199982 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 78498.7us
I20260709 13:11:28.204948 24519 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:28.131475 32696 consensus_queue.cc:1059] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.063s
I20260709 13:11:28.291793 24522 raft_consensus.cc:1240] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:11:28.289661 24516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
W20260709 13:11:28.290688 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 169423us
I20260709 13:11:28.192761 32402 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:28.299198 25217 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
I20260709 13:11:28.297281 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:28.303581 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.304198 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.192122 32565 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:11:28.291203 32712 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:28.275530 32188 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:28.341645 32188 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.293371 32051 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.345752 32712 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.348176 32712 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:28.303328 32498 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.003s
I20260709 13:11:28.282893 32404 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:28.305408 32554 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.349442 32404 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.349685 32554 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.351794 32404 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:28.310180 32428 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.348984 32498 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.310472 25218 raft_consensus.cc:3055] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:28.360605 25218 raft_consensus.cc:740] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:28.361495 25218 consensus_queue.cc:260] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.311923 32623 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:28.312708 24521 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:28.317909 32652 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.319101 32616 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.319299 32566 consensus_queue.cc:1059] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:28.320385 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:28.335284 32402 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.364042 32566 raft_consensus.cc:3055] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:11:28.364487 32566 raft_consensus.cc:740] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:28.365481 32566 consensus_queue.cc:260] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:28.366528 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 46226us
I20260709 13:11:28.366761 32566 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:28.367530 32677 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:28.367699 24565 leader_election.cc:400] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23.
I20260709 13:11:28.368063 32677 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.368489 32677 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.369127 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:28.369167 32703 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:28.369877 32531 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.370924 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:28.338696 32621 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.341034 32181 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.377856 32181 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.379987 32181 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.323701 32656 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:28.340162 32559 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.376456 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:28.387308 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.351794 32554 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.392976 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.378391 32703 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.394652 24565 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:28.396924 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.399372 32531 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:28.400925 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 194618us
I20260709 13:11:28.379176 32498 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.416056 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.416733 24672 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:28.406721 24516 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:11:28.401051 24521 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 27.
I20260709 13:11:28.391258 24669 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 28.
I20260709 13:11:28.414142 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:28.421741 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:28.421002 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.423733 32621 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:28.424202 32621 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.424578 32621 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:28.419677 32616 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.426162 32616 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.429059 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:28.428241 32616 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.431696 24491 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:28.438832 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.390019 32672 consensus_queue.cc:1059] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:11:28.441706 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:28.411749 32531 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:28.443624 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.416982 32554 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.436328 32483 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:28.391126 32177 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.449399 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.436383 32152 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.454653 24670 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:28.422413 32679 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.028s
I20260709 13:11:28.445196 32551 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:28.449713 32531 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.450271 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.448770 32552 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:28.464030 24672 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:28.468572 24599 raft_consensus.cc:2393] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 26: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:28.449978 32616 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:28.459581 32152 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.480885 32551 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:28.481889 32551 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.483964 32188 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.485379 32616 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 28 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:28.486357 32616 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.471364 32552 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.495641 24524 raft_consensus.cc:1240] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:11:28.496183 32552 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:28.459275 32696 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:28.458527 32721 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.511600 32625 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.513113 24520 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:11:28.450616 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:28.517812 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 67298.2us
I20260709 13:11:28.524204 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.526924 24597 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:28.535588 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.521378 32672 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:28.534303 32670 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.432s	user 0.003s	sys 0.000s
I20260709 13:11:28.526546 32679 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:28.542555 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.543594 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.542963 25211 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:28.544203 25215 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 27.
I20260709 13:11:28.526582 32051 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.549582 25215 raft_consensus.cc:1240] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260709 13:11:28.550216 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 106676us
I20260709 13:11:28.576790 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:28.551110 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:28.581904 24565 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:28.583700 32672 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:28.584329 32672 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:28.584587 32177 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.559453 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:28.593230 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.534106 32677 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.594480 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.595834 32551 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:28.596246 32551 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:28.596289 32677 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.596704 32551 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:28.597183 31926 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:28.588366 32491 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:28.598366 32491 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:28.606511 32721 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:28.607107 32721 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:28.572715 32621 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.587944 32565 consensus_queue.cc:1059] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:11:28.610662 32565 raft_consensus.cc:3055] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:28.611091 32565 raft_consensus.cc:740] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:28.611909 32565 consensus_queue.cc:260] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.612985 32188 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.614012 32565 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:28.568337 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.628360 24669 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:11:28.568975 24670 raft_consensus.cc:1240] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:28.568842 32548 raft_consensus.cc:3055] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:11:28.570183 24674 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 11. (term mismatch)
I20260709 13:11:28.630276 24674 pending_rounds.cc:85] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 10
I20260709 13:11:28.631187 24674 pending_rounds.cc:107] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 22.11
I20260709 13:11:28.631739 24674 raft_consensus.cc:2889] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:28.556614 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:28.571678 24672 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:28.572674 24521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.584658 32672 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.545074 32625 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:28.562822 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.606072 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.590353 24523 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 28 LEADER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 27. Current term is 28. Ops: []
I20260709 13:11:28.620079 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.621025 24671 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:28.565412 32559 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.622220 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.629264 32548 raft_consensus.cc:740] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:28.633440 24669 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:11:28.614540 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:28.637749 24673 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:28.639813 24665 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 27: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:28.623390 24520 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:28.608021 32567 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.636737 32672 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:28.634442 32498 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.586061 32483 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260709 13:11:28.652794 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:28.651238 32621 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.656740 32430 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.547170 32679 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.666541 32679 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.667155 32679 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:28.667680 32679 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.644841 32673 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:28.669636 31926 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:28.670310 32051 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.670255 31926 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.663805 32548 consensus_queue.cc:260] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.672276 32452 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:28.675139 31926 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.642514 32448 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:28.680920 32448 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.683437 32448 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.676774 32551 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.694643 32551 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.690364 32621 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.645823 32566 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:28.689245 32531 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.608026 32721 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.725095 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2682) took 1181 ms. Trace:
I20260709 13:11:28.725497 24591 rpcz_store.cc:276] 0709 13:11:27.543285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.544406 (+  1121us) service_pool.cc:224] Handling call
0709 13:11:27.577256 (+ 32850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.695233 (+117977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.695264 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:27.695304 (+    40us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:27.695342 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.724812 (+1029470us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540025f3d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:28.724870 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.724999 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270875392}
W20260709 13:11:28.729755 32724 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:11:28.731454 32727 log.cc:927] Time spent T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:28.651798 32554 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.064s
I20260709 13:11:28.661463 32498 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.736692 32679 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:28.738127 32552 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.739215 32548 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:28.740387 32552 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.740757 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:28.741925 32690 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 1.016s	user 0.002s	sys 0.003s
I20260709 13:11:28.711361 32448 consensus_queue.cc:1059] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 13:11:28.743114 32448 raft_consensus.cc:3055] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:28.743474 32448 raft_consensus.cc:740] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:28.744211 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.745362 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.745349 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.746132 25219 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:28.747140 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.747246 24665 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 13:11:28.747880 24673 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:28.751325 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.752106 24597 raft_consensus.cc:2410] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:11:28.752574 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.723773 32566 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.757897 32491 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.758112 32448 consensus_queue.cc:260] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.759436 32448 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:28.759955 32566 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.706511 32483 consensus_queue.cc:1243] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 25.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:11:28.716104 32621 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.763013 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.763244 32621 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.764883 32152 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:28.765319 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4038) took 1360 ms. Trace:
I20260709 13:11:28.765707 24668 rpcz_store.cc:276] 0709 13:11:27.405004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.409247 (+  4243us) service_pool.cc:224] Handling call
0709 13:11:27.409582 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.409779 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.409804 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.415586 (+  5782us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.590114 (+174528us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:27.590149 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.590215 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.741406 (+1151191us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:28.746902 (+  5496us) raft_consensus.cc:1685] finished
0709 13:11:28.746921 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.765256 (+ 18335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5555456,"thread_start_us":116228,"threads_started":1,"wal-append.queue_time_us":176180}
I20260709 13:11:28.768689 32531 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.760011 32491 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.773890 24673 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:28.775174 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.779932 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:28.782625 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 108196us
I20260709 13:11:28.786048 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.786677 24597 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:28.794346 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.796805 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.797598 25216 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:28.797940 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.798990 24592 raft_consensus.cc:2393] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:28.797881 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.799853 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.800403 24598 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.801451 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.802887 24597 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:11:28.808321 24598 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:28.809583 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.764907 32498 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:28.832500 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:28.833478 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 48135.7us
I20260709 13:11:28.834473 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:28.838410 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.839139 24665 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:28.839890 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:28.847867 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.848289 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.849172 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.779742 32181 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.851244 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.847873 24668 raft_consensus.cc:1275] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:28.848551 25213 raft_consensus.cc:2376] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24. Re-sending same reply.
I20260709 13:11:28.851364 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.852584 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.852824 25215 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:28.853724 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.854317 25216 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:28.855358 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.855818 25216 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:28.856798 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.858235 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:28.851956 25212 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 17.
I20260709 13:11:28.860236 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.860435 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.850751 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.794766 32684 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.869982 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:28.871217 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:28.885268 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:28.886907 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:28.898307 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.902897 32736 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.903524 32736 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.846455 32712 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:28.905632 32712 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.849839 32672 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.910795 32672 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:28.911795 24600 raft_consensus.cc:2368] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 27. Current term is 28.
I20260709 13:11:28.914499 32559 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:28.847316 32252 consensus_queue.cc:1059] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:11:28.916916 32252 raft_consensus.cc:3055] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:28.917333 32252 raft_consensus.cc:740] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:28.850648 32729 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.067s
I20260709 13:11:28.918264 32252 consensus_queue.cc:260] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.850947 32678 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:28.919370 32678 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.920257 32618 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.847497 32679 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.074s
I20260709 13:11:28.921871 32679 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:28.922245 32679 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:28.923271 32679 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.859757 32548 consensus_queue.cc:1059] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:11:28.947955 32716 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:28.948526 32716 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:28.919680 32252 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:28.872864 32621 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:28.960039 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:28.899353 32051 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:28.850063 32430 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:28.869864 32570 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 13:11:28.873332 32181 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:28.919837 32684 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.961059 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:28.972860 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.977420 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:28.977746 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:28.967931 24525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53446 (request call id 1761) took 1359 ms. Trace:
I20260709 13:11:28.989781 24518 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:28.978055 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.991043 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.991345 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.991372 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:28.992532 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.992730 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.993285 24520 raft_consensus.cc:2393] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 24: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:28.964076 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:28.978129 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:28.993041 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.993887 24523 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 17.
I20260709 13:11:28.994186 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.993914 24667 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:28.996843 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:28.997022 25214 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 27.
I20260709 13:11:28.997485 24669 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.998920 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:29.009066 25215 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:28.989960 24525 rpcz_store.cc:276] 0709 13:11:27.608610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.609806 (+  1196us) service_pool.cc:224] Handling call
0709 13:11:27.644699 (+ 34893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:27.855130 (+210431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.855169 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:27.855229 (+    60us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:27.855282 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.967692 (+1112410us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000baed4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:28.967741 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.967872 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239105280}
I20260709 13:11:28.996127 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:28.992434 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:29.004814 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:29.016803 25216 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
W20260709 13:11:29.136756 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 139954us
I20260709 13:11:29.233951 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:29.261751 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:29.262992 24519 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:29.047773 24520 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:29.161376 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:29.159137 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:29.143949 24669 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
W20260709 13:11:28.974443 32705 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.961s	user 0.005s	sys 0.004s
I20260709 13:11:29.269855 24669 raft_consensus.cc:1240] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 26. Current term is 27. Ops: []
W20260709 13:11:29.270123 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 368513us
W20260709 13:11:29.190841 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.272114 24671 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:29.044888 24597 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:29.264930 24594 raft_consensus.cc:2393] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 22: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:29.273690 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:29.203119 24518 raft_consensus.cc:2468] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 26.
I20260709 13:11:29.273706 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:29.136389 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 172373us
W20260709 13:11:29.244892 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.205195 32426 consensus_queue.cc:1059] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:11:29.294792 24595 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:29.159021 32552 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.190308 32566 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:29.275274 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:29.160964 24525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc"
I20260709 13:11:29.325397 24525 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:29.277822 32736 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:29.278440 24522 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:29.279711 24523 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 27. Current term is 28. Ops: []
I20260709 13:11:29.282666 32684 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:29.283298 32567 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:29.284503 24519 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:29.286224 24666 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:29.235433 32618 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:29.271508 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:29.332975 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 61586.2us
I20260709 13:11:29.333966 24518 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:28.967185 32430 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:28.919725 32678 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:29.360896 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:29.320369 24524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0131806e3b9647128f32db1ab8d314fc" is_pre_election: true
I20260709 13:11:29.185815 24667 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 28.
I20260709 13:11:28.976739 32181 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:29.312209 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:29.324767 25215 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:29.379303 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:29.379971 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 67869us
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
I20260709 13:11:29.364218 24524 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:29.380713 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:29.382311 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:29.052296 32676 consensus_queue.cc:1059] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.339s
I20260709 13:11:29.335155 24523 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:29.046525 32531 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.283s
I20260709 13:11:29.337837 32498 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.324656 32491 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.966210 32051 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:29.118438 32717 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.289s
I20260709 13:11:29.388640 32547 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:29.418399 25215 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 28.
I20260709 13:11:29.389024 32684 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:11:29.345320 32616 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:29.051911 32570 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:29.235641 32716 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.328580 32552 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:29.379077 32623 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.394939 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:29.522189 32684 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:29.388370 32559 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:29.332487 32428 consensus_queue.cc:1048] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.161s
I20260709 13:11:29.388792 32548 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:29.327172 32561 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:11:29.510679 32051 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.505441 24525 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 28.
I20260709 13:11:29.512940 32737 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.541621 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:29.541774 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 146934us
I20260709 13:11:29.544019 32552 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:29.543027 31926 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:29.573374 24665 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
W20260709 13:11:29.543515 32732 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.662s	user 0.013s	sys 0.009s
I20260709 13:11:29.527706 32616 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:29.532815 32672 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:29.531139 32570 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:29.514401 32491 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.513180 32498 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.540230 32684 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:29.601202 32051 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:29.565704 32548 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:29.555019 32559 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:29.539953 32430 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:29.618717 24517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50178 (request call id 2672) took 1424 ms. Trace:
I20260709 13:11:29.532493 32623 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.616951 32740 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.630511 24667 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:29.631018 24517 rpcz_store.cc:276] 0709 13:11:28.205917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.206074 (+   157us) service_pool.cc:224] Handling call
0709 13:11:28.206481 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:28.541341 (+334860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.541369 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:28.542312 (+   943us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.848436 (+306124us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:28.848497 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.848588 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:29.541523 (+692935us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:29.614680 (+ 73157us) raft_consensus.cc:1685] finished
0709 13:11:29.614707 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:29.618658 (+  3951us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6276,"raft.queue_time_us":82633,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5191,"spinlock_wait_cycles":6671744,"thread_start_us":549216,"threads_started":2,"wal-append.queue_time_us":257089}
I20260709 13:11:29.610221 32672 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:29.620122 32448 consensus_meta.cc:287] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.860s	user 0.008s	sys 0.004s
I20260709 13:11:29.627574 32548 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:29.630623 32559 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:29.628047 32684 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:29.608920 32737 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:29.691870 24672 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.026s	sys 0.024s
W20260709 13:11:29.696007 24672 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.026s	sys 0.024s
I20260709 13:11:29.673380 32430 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:11:29.675414 25183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.021s	sys 0.006s
W20260709 13:11:29.699011 25183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.021s	sys 0.006s
W20260709 13:11:29.700045 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.692301 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 302887us
W20260709 13:11:29.701326 24670 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.840s	user 0.011s	sys 0.000s
I20260709 13:11:29.702677 24670 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:29.675398 32531 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:29.719300 32531 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:29.674624 32740 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.717588 32430 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:29.685685 32448 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.694401 32566 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:29.757848 23430 tablet_server.cc:179] TabletServer@127.22.225.129:0 shutting down...
I20260709 13:11:29.771770 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:29.774076 25215 raft_consensus.cc:1240] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:29.772680 25211 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:29.701582 24490 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:29.778726 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.017s
W20260709 13:11:29.780047 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.008s	sys 0.017s
W20260709 13:11:29.781203 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 506940us
W20260709 13:11:29.783843 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.793522 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 92045us
I20260709 13:11:29.793563 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:29.795511 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:29.696375 32684 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.795665 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:29.799497 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:29.797938 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:29.796257 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 471926us
I20260709 13:11:29.811033 24490 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:29.811829 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.812363 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.812631 25185 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:29.778770 32745 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:29.809688 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:29.820609 32181 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:29.698642 32570 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.822381 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:29.796969 32152 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:11:29.762149 32448 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.800556 32751 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:29.721587 32616 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:29.794839 32717 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260709 13:11:29.812166 32623 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:29.817552 32547 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:29.824086 32561 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:29.821300 32181 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:29.892421 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.836377 32531 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:29.856545 32751 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.821310 32051 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.898669 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:29.792975 32672 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.855958 32719 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:29.898118 32746 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.902720 32717 consensus_queue.cc:1243] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer 0131806e3b9647128f32db1ab8d314fc log is divergent from this leader: its last log entry 28.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
W20260709 13:11:29.904606 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 105198us
I20260709 13:11:29.886384 32152 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:29.926870 32717 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:29.928050 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:29.927925 32717 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.929625 24563 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:29.930749 32717 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:29.931432 32717 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.886240 32747 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:29.925392 32498 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:29.890894 32749 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:29.896018 32676 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:29.931979 32717 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:29.831440 32745 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.905965 32751 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:29.946133 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 135175us
I20260709 13:11:29.853418 32566 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.893460 32561 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:29.967417 32684 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:29.934180 32748 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:29.962776 32746 consensus_queue.cc:1175] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0131806e3b9647128f32db1ab8d314fc" responder_term: 18 status { last_received { term: 18 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 18 index: 12 } }
I20260709 13:11:29.854422 32430 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:29.972803 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.972083 32748 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:29.946020 32752 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:29.944691 32676 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:29.947450 32531 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:30.007838 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:29.977895 32567 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.008s
W20260709 13:11:29.971117 32252 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.022s	user 0.002s	sys 0.019s
W20260709 13:11:29.971989 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 149551us
I20260709 13:11:29.961434 32758 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:29.969481 32749 raft_consensus.cc:2804] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:30.013731 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:29.977778 32672 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:29.970077 32428 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:30.019258 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:30.001394 32737 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.020897 24599 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:30.007282 32676 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:30.024168 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 92198us
I20260709 13:11:30.023871 32740 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:30.010823 32757 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.009099 32498 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:29.934893 32719 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.004189 32684 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:11:30.004146 32753 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:11:30.029295 32758 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:29.945336 32747 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.033473 24563 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:30.036010 32737 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:11:30.029660 32428 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.032078   304 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:11:30.038780 32498 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:30.118286 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 85128.2us
I20260709 13:11:30.033337 32252 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:30.037830 32749 raft_consensus.cc:697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 26 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:30.063196 32756 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:11:30.110559 32761 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:30.040369 32748 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:30.109696 32763 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:11:30.132813 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 320245us
I20260709 13:11:30.064989 32448 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:30.121835 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 102696us
W20260709 13:11:30.119624 32678 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.005s
I20260709 13:11:30.080140 31926 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:30.109187   305 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.081310 32181 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:30.135216 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.118706 32051 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.136569 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.155522 25211 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:30.156033 32747 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:30.157263 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2703) took 1406 ms. Trace:
I20260709 13:11:30.157663 24600 rpcz_store.cc:276] 0709 13:11:28.750705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.752373 (+  1668us) service_pool.cc:224] Handling call
0709 13:11:30.157047 (+1404674us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540025b054. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:30.157205 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364507392}
I20260709 13:11:30.158782 32719 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:30.126104 32498 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:30.138212 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:30.080132 32548 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:30.125952 32177 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:30.136646 32762 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:30.144531   305 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:30.141188 32678 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.127976 32756 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:30.149712 32758 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.150756   313 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:30.142104   301 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.154183 32552 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:11:30.136916 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.165283 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.165951 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:30.166906 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.138399 32684 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.041683 32757 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.206223   305 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:30.176887 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:30.201788 32552 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:30.179188 32717 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:30.208061 32757 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.208251 32767 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:30.208695 32767 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:30.209067 32767 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:30.209745 32684 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.211258 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1679) took 1215 ms. Trace:
I20260709 13:11:30.211627 24599 rpcz_store.cc:276] 0709 13:11:28.996100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.133686 (+137586us) service_pool.cc:224] Handling call
0709 13:11:30.211098 (+1077412us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b540018fe54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:30.211201 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671757824}
I20260709 13:11:30.212023 32684 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.167878 32703 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:30.212692 32703 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.214803 32703 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.180341   303 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.215385   303 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:30.217403   303 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:30.181525 32561 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:30.141469 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 133686us
I20260709 13:11:30.218290 32548 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:30.218681 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:30.157754 32745 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:30.195477 32751 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:30.207790 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:30.220115 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:30.200882 32756 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:30.183967 32746 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:30.237193 32491 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.237309 32746 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.238551 32751 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:30.239548 32746 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.204172 32749 consensus_queue.cc:237] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:30.240182 32750 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.422s	user 0.003s	sys 0.000s
I20260709 13:11:30.242606 24591 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:11:30.204792   313 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.205466 32678 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:30.205660   301 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.174069 32753 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:30.207767 32552 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:30.193049 32762 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.199064 32177 raft_consensus.cc:697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 28 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:30.204588 32559 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.006s
I20260709 13:11:30.229271   314 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:30.249373   305 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:30.234565 32676 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.235237 32723 raft_consensus.cc:3055] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:30.243196 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2321) took 1253 ms. Trace:
I20260709 13:11:30.244108 24600 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:30.243956 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:30.248701 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 119264us
W20260709 13:11:30.354091 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 110218us
I20260709 13:11:30.354951 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:30.354988 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:30.247813 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:30.258740 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:30.259684 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:30.260512 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:30.262638 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:30.356923 24665 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:30.357113 24674 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:30.263478 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:30.358265 24671 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:30.264305 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:30.286018 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:30.199884 32719 consensus_queue.cc:1048] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:11:30.225863 32561 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:30.292603 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:30.351953 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.317953 24591 rpcz_store.cc:276] 0709 13:11:28.989858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.989987 (+   129us) service_pool.cc:224] Handling call
0709 13:11:30.242027 (+1252040us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f1ffc0 00007f17c0f0a929 00007f17c0f0a3d2 00007f17ba481bd4
0709 13:11:30.242257 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.242955 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.243144 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3135232}
W20260709 13:11:30.415665 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 60780.7us
W20260709 13:11:30.412236 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 164514us
W20260709 13:11:30.416213 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.416908 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:30.421952 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:30.422578 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:30.423713 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:30.424372 24594 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:30.347860 32703 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:30.432350 32703 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.317869 32723 raft_consensus.cc:740] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:30.428838   313 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:30.414901 32616 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:30.347069 32684 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.429630 32448 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.415591 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:30.435966 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 81095.2us
I20260709 13:11:30.430672 24596 raft_consensus.cc:1275] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:30.423198 24592 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:30.356604   303 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:30.414909 32717 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.439239 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:30.437736 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.444958 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.310637   307 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.441543 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:30.434764 32723 consensus_queue.cc:260] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:30.318153 32552 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:30.346714 32757 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:30.453696 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:30.450176 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:30.455576 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.456492 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 288270us
I20260709 13:11:30.456552 25216 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:30.455163 24597 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:30.292145 32559 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.458962 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.461604 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:30.462759 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:30.463367 25215 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:30.427090 32491 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:30.438742   305 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:30.460126 24490 leader_election.cc:400] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 27. Current term is 28.
I20260709 13:11:30.475026 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.475672 25211 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:30.475916 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:30.447956 32551 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:30.448161   314 raft_consensus.cc:2764] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:11:30.442385   304 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:30.439071 32498 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.446979 32684 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.449148 32448 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.448884   303 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:30.926541 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:30.506325 24637 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.526s (SENT) [suppressed 12 similar messages]
I20260709 13:11:30.928833 24591 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:30.486688 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:30.655586 25215 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:30.517609 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:30.923521 25218 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:30.660385 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 188269us
I20260709 13:11:30.457608 32561 raft_consensus.cc:2764] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader election decision vote started in defunct term 27: won
I20260709 13:11:30.930984 24597 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:30.524389 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 67062.9us
I20260709 13:11:30.939770 25185 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:30.540509 32531 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.587042 32764 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:30.893144   323 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 13:11:30.577055   319 log.cc:927] Time spent T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
W20260709 13:11:30.550601   317 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:11:30.461827 32624 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:30.928714   304 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:30.986907 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.963718 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.965715 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.988792 25212 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:30.967164 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.989485 25218 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:11:30.475445 32748 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.551925 32559 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.577719   315 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.451983 32717 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.540299 32749 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:30.816061   322 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260709 13:11:30.708817   301 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:30.907045 32762 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:30.938369 32756 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.002s
W20260709 13:11:30.801208 32767 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:11:30.458194 32616 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:30.927521 32758 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:30.950330 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:30.552150   309 consensus_queue.cc:1048] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.608s
I20260709 13:11:31.013633 32554 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:30.466334 32757 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.992327 25211 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:30.457715   307 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:31.015151 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.037s	sys 0.033s
I20260709 13:11:30.972918   306 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:30.664502 32753 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:30.795989 32426 raft_consensus.cc:3055] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:30.945928 32764 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:30.577296   302 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:30.549234 32755 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.528s
I20260709 13:11:30.688665 32548 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.324s
I20260709 13:11:30.979121 32561 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.993688   304 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:30.487089 32737 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:30.568708 32428 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:31.076474 24640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.033s	sys 0.060s
W20260709 13:11:31.330928 24640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.033s	sys 0.060s
I20260709 13:11:30.941707 32531 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:30.554634 32177 consensus_queue.cc:237] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:30.970569 24595 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:31.135469 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.989954 25218 pending_rounds.cc:85] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 17
I20260709 13:11:31.342362 25218 pending_rounds.cc:107] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 13:11:31.342674 25218 raft_consensus.cc:2889] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:31.343524 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1772) took 3619 ms. Trace:
I20260709 13:11:31.136401 24597 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
W20260709 13:11:31.343861   324 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:11:31.079906   326 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:31.139798 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:30.978296 32551 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:31.351090 32551 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:31.344648 32531 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:31.070834   315 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.075664 32749 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:31.242424 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.006s	sys 0.025s
I20260709 13:11:31.077782 32756 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.080246 32767 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.136463 32616 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.193272 32554 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.237730 32656 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.240238 32426 raft_consensus.cc:740] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:31.240146 32753 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.344707 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:31.190461 32758 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.063349 32748 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:31.236059 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.043s	sys 0.035s
W20260709 13:11:31.384112 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 922532us
I20260709 13:11:31.384859 24673 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 27: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:31.385702 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1728) took 2539 ms. Trace:
I20260709 13:11:31.386116 25219 rpcz_store.cc:276] 0709 13:11:28.846500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.846604 (+   104us) service_pool.cc:224] Handling call
0709 13:11:28.846826 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.929657 (+ 82831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:28.929696 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:28.929744 (+    48us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:28.929790 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.385477 (+2455687us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x7b54007b6bd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:31.385527 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.385646 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189957888}
I20260709 13:11:31.343879 25218 rpcz_store.cc:276] 0709 13:11:27.724268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.724391 (+   123us) service_pool.cc:224] Handling call
0709 13:11:27.724622 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:28.310375 (+585753us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54001b7220. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebddc0 00007f17bbf481c0 00007f17bbf49231 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c
0709 13:11:30.578506 (+2268131us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b58005309d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbea20aa 00007f17bbf24447 00007f17bbf3cfe7 00007f17bbf3e7de 00007f17bbf48b49 00007f17bbf49416 00007f17bbf45d8f 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4
0709 13:11:31.343162 (+764656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.343426 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3055979008}
I20260709 13:11:31.331346 32561 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:31.359298 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 373271us
I20260709 13:11:31.339190 32677 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.330523   306 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:31.365903 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:31.366951 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.006s	sys 0.026s
I20260709 13:11:31.368547 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:31.369998 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.345155 32430 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.351472   327 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.381640 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:31.294941   302 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:31.390949 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.392019 25211 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:31.390456 24667 raft_consensus.cc:2393] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:31.419792 25182 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:31.424638 24591 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
W20260709 13:11:31.391067 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 445453us
I20260709 13:11:31.370784 32570 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.376430   301 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.374162 32531 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:31.388878 32684 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.414393 24565 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:31.398039   303 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:31.389205 32753 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:31.394157   309 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:31.437908 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:31.497654 24591 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:31.498209 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1685) took 1055 ms. Trace:
I20260709 13:11:31.498682 24591 rpcz_store.cc:276] 0709 13:11:30.443305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.437637 (+994332us) service_pool.cc:224] Handling call
0709 13:11:31.498133 (+ 60496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:31.500285 24591 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:11:31.438448 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:31.398267 32498 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:31.396447 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 890107us
I20260709 13:11:31.447295 32426 consensus_queue.cc:260] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:31.526087 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:31.448649 32554 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.448572 32531 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.449865 32684 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:31.462931 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 4064) took 1206 ms. Trace:
I20260709 13:11:31.436269 32717 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.468268 32181 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:31.468899   328 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.447319   318 consensus_queue.cc:1059] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:11:31.469761 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.389267 32656 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.474031 32712 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:31.415248   327 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.475117 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1680) took 1309 ms. Trace:
I20260709 13:11:31.476060 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:31.476250 24666 raft_consensus.cc:1240] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 27. Current term is 28. Ops: [27.20-27.20]
I20260709 13:11:31.414567 32677 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.476833 32561 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.477998 32757 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.478547 24670 raft_consensus.cc:1240] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:31.478588 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.479434 32616 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.481587 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:31.481684 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.482677 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.483196 32559 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:31.483642 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.610040 24674 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:31.484169 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:31.484599 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:31.501789 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 63441.9us
I20260709 13:11:31.611559 24665 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:31.611979 24491 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:31.501053 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2710) took 1047 ms. Trace:
I20260709 13:11:31.432996 32746 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.358083   326 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.432530 32762 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:31.535216 24637 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:31.527244 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:31.403002 32751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.005s	sys 0.025s
W20260709 13:11:31.551340 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 105403us
I20260709 13:11:31.642817 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:31.441221 32570 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.550596 24673 rpcz_store.cc:276] 0709 13:11:30.256467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.259400 (+  2933us) service_pool.cc:224] Handling call
0709 13:11:31.462669 (+1203269us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540017f554. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:31.462850 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364215680}
I20260709 13:11:31.643625 24593 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:31.644449 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.565333 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.646835 24672 raft_consensus.cc:2393] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 23: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:31.647912 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.648625 24672 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:31.572917 24600 rpcz_store.cc:276] 0709 13:11:30.165527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.165729 (+   202us) service_pool.cc:224] Handling call
0709 13:11:31.474960 (+1309231us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b54001caf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:31.475061 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94115200}
I20260709 13:11:31.573534 24599 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:11:31.397251 32430 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.369769 32764 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:31.592510 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.444599 32691 consensus_queue.cc:1059] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.120s
I20260709 13:11:31.612900 24591 rpcz_store.cc:276] 0709 13:11:30.453380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.499611 (+1046231us) service_pool.cc:224] Handling call
0709 13:11:31.500001 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:31.500749 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.500974 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:31.618278 24598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 2323) took 2592 ms (client timeout 1941 ms). Trace:
I20260709 13:11:31.445742   301 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:31.718407   347 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:31.719069   347 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 28 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:31.720268   301 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:31.720043   347 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.550179 32755 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:31.721345 32755 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:31.562311 32554 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:31.722862 32554 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:31.723062 32656 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:31.723337 32554 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:31.568137 32181 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:31.552369   303 consensus_queue.cc:1175] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "148dc963cec64232ad3b248abad6f36d" responder_term: 20 status { last_received { term: 20 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 20 index: 12 } }
W20260709 13:11:31.623934 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 88841.3us
I20260709 13:11:31.624461 25215 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:31.727188   332 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.727411 32737 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:31.727694   332 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:31.626784 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 99636.3us
I20260709 13:11:31.627170 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51506 (request call id 1683) took 1189 ms. Trace:
I20260709 13:11:31.729584 24566 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:31.649694 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1684) took 1208 ms. Trace:
I20260709 13:11:31.731221 24599 rpcz_store.cc:276] 0709 13:11:30.441005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.475842 (+1034837us) service_pool.cc:224] Handling call
0709 13:11:31.649625 (+173783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:31.731930   315 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:31.732941 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2712) took 1279 ms. Trace:
I20260709 13:11:31.733420 24599 rpcz_store.cc:276] 0709 13:11:30.453899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.732064 (+1278165us) service_pool.cc:224] Handling call
0709 13:11:31.732413 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.732588 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.732616 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:31.732660 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:31.732697 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.732758 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.732879 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:31.650899 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.653833 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:31.654048 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.735451 24672 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
W20260709 13:11:31.736272 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 82490.4us
I20260709 13:11:31.686587 25213 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 26.
I20260709 13:11:31.577719   333 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.578109 32428 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.692781 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:31.743227 24666 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:31.614441 32716 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:31.695242 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:31.695514 24665 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:31.747931 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:31.748729 24591 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:31.623364 32559 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:31.686275   336 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:31.696038 32749 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.701722   344 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:31.643850 32561 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:31.702503 32548 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:31.707798 32552 consensus_meta.cc:287] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.248s	user 0.012s	sys 0.000s
W20260709 13:11:31.709519   305 consensus_meta.cc:287] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.218s	user 0.011s	sys 0.000s
I20260709 13:11:31.533669   309 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:31.572496   328 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:31.652583 32757 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:31.716375   327 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:31.717166 32637 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:11:31.655786   307 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:31.718029 32748 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:31.652220 32751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.005s	sys 0.026s
W20260709 13:11:31.694876 24598 rpcz_store.cc:269] 0709 13:11:28.990591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.990714 (+   123us) service_pool.cc:224] Handling call
0709 13:11:31.481444 (+2490730us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:11:31.582601 (+101157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17048320}
I20260709 13:11:31.712895 32677 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.641989 32746 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:31.618750   306 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:32.226703 23430 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 24541)
I20260709 13:11:32.487582 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2713) took 2033 ms. Trace:
I20260709 13:11:32.488024 25210 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 25 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:11:32.049224 24591 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 28.
W20260709 13:11:32.088625 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 362106us
I20260709 13:11:32.487926 24490 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:32.483953 24673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.012s	sys 0.045s
W20260709 13:11:32.520057 24673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.013s	sys 0.047s
I20260709 13:11:31.747063 32717 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:32.520596 32717 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.271018 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1737) took 1320 ms. Trace:
I20260709 13:11:32.525713   359 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:31.887820 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.385215 24565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.004s	sys 0.004s
W20260709 13:11:32.531028 24565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.004s	sys 0.008s
I20260709 13:11:32.489553 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1872) took 1003 ms. Trace:
I20260709 13:11:32.526562   362 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:32.487599 24672 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:32.534235 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1868) took 1049 ms. Trace:
I20260709 13:11:32.534711 24672 rpcz_store.cc:276] 0709 13:11:31.485234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.736266 (+251032us) service_pool.cc:224] Handling call
0709 13:11:32.487453 (+751187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.533925 (+ 46472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.534169 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:32.536156 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:32.537380 24672 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:32.488137 24599 rpcz_store.cc:276] 0709 13:11:30.454120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.734410 (+1280290us) service_pool.cc:224] Handling call
0709 13:11:32.487101 (+752691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.487285 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.487308 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.487346 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:32.487382 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.487428 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.487527 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:32.544886 24597 raft_consensus.cc:2410] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 29 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 13:11:32.532764 24666 rpcz_store.cc:276] 0709 13:11:31.486210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.743889 (+257679us) service_pool.cc:224] Handling call
0709 13:11:32.489041 (+745152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.489237 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.489269 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.489307 (+    38us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:32.489343 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.489388 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.489504 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:31.735332 32736 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:32.525256 25216 rpcz_store.cc:276] 0709 13:11:30.950476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.961355 (+ 10879us) service_pool.cc:224] Handling call
0709 13:11:30.961815 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.974269 (+ 12454us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:31.370996 (+396727us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.736524 (+365528us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:31.869541 (+133017us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.869756 (+   215us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:31.878133 (+  8377us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.887386 (+  9253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.887497 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.270792 (+383295us) raft_consensus.cc:1685] finished
0709 13:11:32.270813 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.270951 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":311212,"prepare.queue_time_us":741157,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":95,"raft.queue_time_us":189079,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":235868,"spinlock_wait_cycles":33994240,"thread_start_us":454009,"threads_started":2,"wal-append.queue_time_us":750996}
I20260709 13:11:31.727211 32498 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.746912   337 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:32.555637 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:32.299817 32551 consensus_meta.cc:287] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.933s	user 0.010s	sys 0.000s
W20260709 13:11:32.486317   340 log.cc:927] Time spent T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.597s	user 0.001s	sys 0.000s
W20260709 13:11:32.468267 32753 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.917s	user 0.010s	sys 0.000s
I20260709 13:11:31.793140   336 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:32.317322 32404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.006s
I20260709 13:11:32.573272 24672 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:32.242687 32767 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:32.445089 32570 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:31.825345 32616 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:32.517760   344 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.823568 32684 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.311909   332 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:32.528258 32531 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:32.052232 32624 consensus_meta.cc:287] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 1.059s	user 0.010s	sys 0.001s
I20260709 13:11:32.172881 32177 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:32.540465 32717 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:32.520622   358 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:32.544826   305 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:32.560629   337 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:32.575306 32404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.002s	sys 0.012s
W20260709 13:11:32.737790 24489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.019s
W20260709 13:11:32.845654 24489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.009s	sys 0.020s
W20260709 13:11:32.738675 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.560993 24564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.017s	sys 0.012s
W20260709 13:11:32.850492 24564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.018s	sys 0.012s
W20260709 13:11:32.851678 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.852756   368 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.853637   368 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.857419   360 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:32.739161 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 251110us
I20260709 13:11:32.567463 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2715) took 2112 ms. Trace:
W20260709 13:11:32.739363 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.006s	sys 0.013s
I20260709 13:11:32.568042 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:32.574491 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:32.793535 25182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.034s	sys 0.062s
W20260709 13:11:32.880360 25182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.389s	user 0.035s	sys 0.063s
I20260709 13:11:31.822600 32428 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.891072 32740 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.893399 32555 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.894441 32555 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.544993 32548 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.899629 32548 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:32.564010 32559 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:32.630802 32621 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.906080 32621 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:32.644311 32624 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:32.672392 32716 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.849s	user 0.008s	sys 0.002s
I20260709 13:11:32.677188 32723 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:32.563294 32736 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.572654 32753 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:32.637542 32755 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:32.914584 32753 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:32.557713 32757 raft_consensus.cc:697] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:32.917233 32757 consensus_queue.cc:237] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.626156 32758 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:32.576236   302 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:32.566537   304 consensus_meta.cc:287] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.228s	user 0.003s	sys 0.008s
I20260709 13:11:32.670099   309 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:32.664625   328 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:32.600710   327 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.792189   333 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:32.573465   336 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:32.636159   337 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:32.622997   344 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:32.664438   346 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:11:32.625440   349 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.634476   358 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:32.558133   359 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:32.564213 32498 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.625114   356 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.555955   362 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:32.565337 32551 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.624261 32616 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.632774 32684 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.837350 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2171) took 1862 ms. Trace:
W20260709 13:11:32.838074 24639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.001s	sys 0.012s
I20260709 13:11:32.843050   305 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:32.844306 32177 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.856840   368 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:32.858364   360 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:32.865605 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.006s	sys 0.014s
I20260709 13:11:32.873608   363 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:32.872418 24490 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:32.914525   374 log.cc:927] Time spent T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:32.892278 32740 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:32.951781 24639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.002s	sys 0.013s
I20260709 13:11:32.625274 32188 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:32.942113   358 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:32.953828 32616 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:32.950639   350 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.947570 32498 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:32.940471 32566 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.955847 32177 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:32.948503   362 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:32.951445 32684 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:32.945465   359 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:32.947688 24599 rpcz_store.cc:276] 0709 13:11:30.454584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.545672 (+2091088us) service_pool.cc:224] Handling call
0709 13:11:32.566929 (+ 21257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.567109 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.567139 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:32.567184 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:32.567215 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.567277 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.567402 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:32.926144   333 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:32.951593 25213 rpcz_store.cc:276] 0709 13:11:30.974729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.352036 (+377307us) service_pool.cc:224] Handling call
0709 13:11:32.836674 (+1484638us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400680e54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:32.836958 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677873408}
I20260709 13:11:32.992295   360 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.008570 32559 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:33.009306 32555 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.009390 32559 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.011977 32559 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.012823 32188 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.015842 32188 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.018884   368 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.029237   368 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.030496 32448 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:33.021934 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.020855 32561 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:33.033150 32561 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.019925 32624 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:33.036901 32676 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.036710 32624 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:32.952251   305 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.046586   305 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.047590 32756 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.044274 32746 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.049938 32762 raft_consensus.cc:3055] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:11:32.946333   356 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.050385 32762 raft_consensus.cc:740] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:33.051358 24672 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 22: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:33.051656 32762 consensus_queue.cc:260] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.052474   356 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:33.055759   360 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:33.056429   314 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.056638   360 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.058485   326 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:33.059191 32559 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.059475 32548 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:33.059900 32559 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.060333 32548 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.062885 32618 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:33.063268 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2716) took 2608 ms. Trace:
I20260709 13:11:33.063628 32618 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.063719 24599 rpcz_store.cc:276] 0709 13:11:30.454791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.061837 (+2607046us) service_pool.cc:224] Handling call
0709 13:11:33.062398 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.062885 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.062912 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.062970 (+    58us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:33.063008 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.063062 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.063175 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:33.058974 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 186843us
I20260709 13:11:33.055073 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:33.065498   314 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.055347   357 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:33.065510   332 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:32.923220   327 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.071445   357 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.028185 32430 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:33.067764 25182 connection.cc:256] RPC call timeout handler was delayed by -1.3557451110000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:11:33.023134   350 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.025943 32736 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.087656 24666 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:33.088961 24597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 2333) took 2630 ms (client timeout 2012 ms). Trace:
W20260709 13:11:33.145295 24597 rpcz_store.cc:269] 0709 13:11:30.458146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.344457 (+886311us) service_pool.cc:224] Handling call
0709 13:11:33.088516 (+1744059us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001caa54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.088752 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2669644672}
W20260709 13:11:33.146492   369 log.cc:927] Time spent T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:11:33.147632 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2334) took 1758 ms. Trace:
I20260709 13:11:33.148033 24597 rpcz_store.cc:276] 0709 13:11:31.389309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.146526 (+1757217us) service_pool.cc:224] Handling call
0709 13:11:33.146984 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.147294 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.147325 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.147384 (+    59us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:33.147421 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.147483 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.147581 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.028235 32181 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:33.090703 32712 raft_consensus.cc:3055] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:33.149638 32712 raft_consensus.cc:740] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:33.150985 32712 consensus_queue.cc:260] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.151974 32703 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.152251 32712 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:33.154913 24490 connection.cc:256] RPC call timeout handler was delayed by -1.0937519970000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 13:11:33.155628 32762 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:33.156162   357 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.091148 24600 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 18. (term mismatch)
I20260709 13:11:33.157364 24600 pending_rounds.cc:85] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 17
I20260709 13:11:33.157655 24600 pending_rounds.cc:107] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 27.18
I20260709 13:11:33.157927 24600 raft_consensus.cc:2889] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:31.729988 24594 rpcz_store.cc:276] 0709 13:11:30.438184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.488847 (+1050663us) service_pool.cc:224] Handling call
0709 13:11:31.489198 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.489449 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:31.489792 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 13:11:31.626735 (+136943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:31.626800 (+    65us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:31.626867 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.626967 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.627104 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37098,"prepare.queue_time_us":7783,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":54301,"raft.run_cpu_time_us":4939,"raft.run_wall_time_us":42134,"thread_start_us":99410,"threads_started":1}
I20260709 13:11:33.022768 32426 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:33.159646   303 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.160233 24594 raft_consensus.cc:1240] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:33.160413   303 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.160964 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2337) took 1685 ms. Trace:
I20260709 13:11:33.122185 32618 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:33.124480 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 1.39305e+06us
I20260709 13:11:33.161391 24594 rpcz_store.cc:276] 0709 13:11:31.475513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.159397 (+1683884us) service_pool.cc:224] Handling call
0709 13:11:33.159837 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.160711 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.160901 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.163064   303 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:33.121218 25215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2173) took 2107 ms (client timeout 2051 ms). Trace:
W20260709 13:11:33.163738 25215 rpcz_store.cc:269] 0709 13:11:31.013903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.139524 (+125621us) service_pool.cc:224] Handling call
0709 13:11:33.120828 (+1981304us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400532354. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.121028 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628663680}
W20260709 13:11:33.125851 24667 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 4063) took 2869 ms (client timeout 2036 ms). Trace:
W20260709 13:11:33.164829 24667 rpcz_store.cc:269] 0709 13:11:30.256141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.258451 (+  2310us) service_pool.cc:224] Handling call
0709 13:11:33.125345 (+2866894us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000474d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.125601 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377576192}
I20260709 13:11:33.166427 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:33.167183 24667 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:33.128072 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:33.168942 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.169798   303 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.170368   303 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.172020 24594 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:33.020249 32566 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.129195 24665 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:33.129779 32740 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.131937   327 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:33.135043 24592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2718) took 2679 ms (client timeout 1941 ms). Trace:
W20260709 13:11:33.137607 25184 connection.cc:256] RPC call timeout handler was delayed by -2.5583524050000506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 13:11:33.139786 32428 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:33.141369 24593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1677) took 4145 ms (client timeout 2107 ms). Trace:
I20260709 13:11:33.141997 24672 raft_consensus.cc:2368] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
I20260709 13:11:33.156052 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:33.170094 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:33.172490 24566 connection.cc:256] RPC call timeout handler was delayed by -1.145604538999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 13:11:33.128940   368 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.128424 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2717) took 2673 ms. Trace:
I20260709 13:11:32.940277   349 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:32.921065   304 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.160837 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2711) took 2707 ms. Trace:
W20260709 13:11:33.086900 25182 connection.cc:256] RPC call timeout handler was delayed by -1.287345111000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:11:33.702001 25182 connection.cc:256] RPC call timeout handler was delayed by -1.2810280219999868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 13:11:33.533447   357 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.703313 24672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2638) took 1147 ms. Trace:
W20260709 13:11:33.253147 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:33.708326 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.236804 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2338) took 1698 ms. Trace:
W20260709 13:11:33.710196 24566 connection.cc:256] RPC call timeout handler was delayed by -1.0781045389999235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
I20260709 13:11:33.703706 24672 rpcz_store.cc:276] 0709 13:11:32.555474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.053933 (+498459us) service_pool.cc:224] Handling call
0709 13:11:33.703218 (+649285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.169026 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4070) took 1644 ms. Trace:
W20260709 13:11:33.719825 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.710649 24599 rpcz_store.cc:276] 0709 13:11:30.455010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.064986 (+2609976us) service_pool.cc:224] Handling call
0709 13:11:33.127602 (+ 62616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.127999 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.128032 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.128102 (+    70us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:33.128144 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.128196 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.128332 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.489018 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2714) took 2723 ms. Trace:
I20260709 13:11:33.710923 24594 rpcz_store.cc:276] 0709 13:11:31.479246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.162284 (+1683038us) service_pool.cc:224] Handling call
0709 13:11:33.171581 (+  9297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.172848 (+  1267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.177898 (+  5050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.721285 24667 rpcz_store.cc:276] 0709 13:11:31.524824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.167895 (+1643071us) service_pool.cc:224] Handling call
0709 13:11:33.168312 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.168660 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.168690 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.168735 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:33.168793 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.168846 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.168947 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:33.709777 24592 rpcz_store.cc:269] 0709 13:11:30.455229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.134639 (+2679410us) service_pool.cc:211] Skipping call since client already timed out
0709 13:11:33.134829 (+   190us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:11:33.074555   332 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 28 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:33.701562 24600 rpcz_store.cc:276] 0709 13:11:30.453659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.655542 (+1201883us) service_pool.cc:224] Handling call
0709 13:11:33.090375 (+1434833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.158530 (+ 68155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.160634 (+  2104us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001caa50. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.160761 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3209196288}
I20260709 13:11:33.716944 32628 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:33.709561 32426 consensus_meta.cc:287] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.006s
I20260709 13:11:33.170006 32679 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:33.701400 24593 rpcz_store.cc:269] 0709 13:11:28.995407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.995521 (+   114us) service_pool.cc:224] Handling call
0709 13:11:31.484044 (+2488523us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b58001e3998. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e21a22 00007f17c1d3ac09 00007f17c0e94ee0 00007f17c0f5e0ab 00007f17c0f5e131 00007f17c0f0c0a0 00007f17c0f0b984 00007f17ba4866d4 00007f17ba486662
0709 13:11:33.140945 (+1656901us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b540025e9d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.141153 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77739136}
I20260709 13:11:33.381095   314 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.148037 32551 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:33.751936 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.585569 32561 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:33.424329   363 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.759567 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:33.727382 32628 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.703590   357 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:33.770715 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.465710   337 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.767449 24672 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:33.261986 32703 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:33.741626   303 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:33.779273 25184 connection.cc:256] RPC call timeout handler was delayed by -2.1607044600000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:11:33.765522 32762 consensus_meta.cc:287] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.609s	user 0.007s	sys 0.005s
I20260709 13:11:33.736428 32740 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:33.771951 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.786520 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.753758 32746 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.722548 24591 rpcz_store.cc:276] 0709 13:11:30.454367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.546582 (+2092215us) service_pool.cc:224] Handling call
0709 13:11:32.547012 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:32.563967 (+ 16955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.564014 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:32.741889 (+177875us) log.cc:844] Serialized 52 byte log entry
0709 13:11:32.838431 (+ 96542us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:32.996252 (+157821us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.002189 (+  5937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.017302 (+ 15113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.066206 (+ 48904us) raft_consensus.cc:1685] finished
0709 13:11:33.066262 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.177255 (+110993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22839,"prepare.queue_time_us":242686,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":68,"raft.queue_time_us":30678,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":60731,"thread_start_us":245522,"threads_started":2,"wal-append.queue_time_us":274700}
I20260709 13:11:33.796507 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:33.772558 32628 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:33.800024 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1873) took 2313 ms. Trace:
W20260709 13:11:33.801822 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 645940us
I20260709 13:11:33.801678 24665 rpcz_store.cc:276] 0709 13:11:31.486450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.748304 (+261854us) service_pool.cc:224] Handling call
0709 13:11:33.128697 (+1380393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.732349 (+603652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.799668 (+ 67319us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000474d0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.799912 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173609344}
I20260709 13:11:33.803100 24490 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:33.803757 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:33.805207 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:33.805645   378 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:33.807034 25210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48926 (request call id 2170) took 2838 ms. Trace:
I20260709 13:11:33.807648 25210 rpcz_store.cc:276] 0709 13:11:30.968005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.381327 (+413322us) service_pool.cc:224] Handling call
0709 13:11:33.806444 (+2425117us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001b7454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.806752 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512471424}
I20260709 13:11:33.808823 32561 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:33.809610 24595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51506 (request call id 1687) took 3357 ms (client timeout 1864 ms). Trace:
I20260709 13:11:33.809995 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:33.810118 24595 rpcz_store.cc:269] 0709 13:11:30.452412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.458499 (+  6087us) service_pool.cc:224] Handling call
0709 13:11:33.809206 (+3350707us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b540021bbd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.809390 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85749120}
I20260709 13:11:33.810753 24671 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:33.811286 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.811527 32561 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.812003 24595 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:33.805060   314 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:33.813611   314 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:33.813985 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2629) took 1296 ms. Trace:
I20260709 13:11:33.814371 24670 rpcz_store.cc:276] 0709 13:11:32.517172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.812831 (+1295659us) service_pool.cc:224] Handling call
0709 13:11:33.813230 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.813540 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.813570 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.813635 (+    65us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:33.813673 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.813727 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.813833 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.815341   349 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.816222   314 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.817365 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:33.818308 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2631) took 1300 ms. Trace:
I20260709 13:11:33.818732 24668 rpcz_store.cc:276] 0709 13:11:32.517667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.817270 (+1299603us) service_pool.cc:224] Handling call
0709 13:11:33.817596 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.817874 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.817898 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.817940 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:33.817973 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.818023 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.818126 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.819542 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:33.820030 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.820608 24668 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:11:33.820976 24595 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:33.822170 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.823463 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.824285 24595 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
W20260709 13:11:33.825515 24666 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44436 (request call id 2635) took 1306 ms (client timeout 1734 ms). Trace:
W20260709 13:11:33.825959 24666 rpcz_store.cc:269] 0709 13:11:32.518682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.546302 (+ 27620us) service_pool.cc:224] Handling call
0709 13:11:33.825314 (+1279012us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b540040a454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:33.825435 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184600832}
I20260709 13:11:33.826412 24665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2639) took 1267 ms. Trace:
I20260709 13:11:33.826783 24665 rpcz_store.cc:276] 0709 13:11:32.558718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.825487 (+1266769us) service_pool.cc:224] Handling call
0709 13:11:33.825839 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.826105 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.826132 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.826186 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:33.826215 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.826263 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.826355 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.811612 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:33.829862 24671 raft_consensus.cc:2410] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 23 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:11:33.831130 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2636) took 1285 ms. Trace:
I20260709 13:11:33.831635 24668 rpcz_store.cc:276] 0709 13:11:32.545863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.819635 (+1273772us) service_pool.cc:224] Handling call
0709 13:11:33.820016 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.830779 (+ 10763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.831033 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.816139 24670 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:33.833209 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2630) took 1315 ms. Trace:
I20260709 13:11:33.833531 24670 rpcz_store.cc:276] 0709 13:11:32.517436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.815401 (+1297965us) service_pool.cc:224] Handling call
0709 13:11:33.815726 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.832878 (+ 17152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.833134 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.834448   337 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.835448 32566 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.805986 24674 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:33.844714 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.503621   344 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:33.849565 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44465.5us
I20260709 13:11:33.778913   363 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.853402 32426 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:33.853685 32551 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.854440 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:33.854720 32551 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.855419 32566 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:33.855579 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:33.856096 32566 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:33.856590 32566 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:33.857275 32740 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.858464   304 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:33.858796 32554 consensus_meta.cc:287] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 2.135s	user 0.011s	sys 0.010s
I20260709 13:11:33.859392   304 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:33.859632 32740 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.853869 32426 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.860349 32426 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:33.861300   303 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:33.855309   363 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.863243   332 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.865557 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1870) took 2379 ms. Trace:
I20260709 13:11:33.865936 24673 rpcz_store.cc:276] 0709 13:11:31.485784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.742184 (+256400us) service_pool.cc:224] Handling call
0709 13:11:31.742510 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:32.520632 (+778122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:32.520675 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:32.547892 (+ 27217us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.082348 (+534456us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:33.086029 (+  3681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.121548 (+ 35519us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.862723 (+741175us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b540029caa0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbebbdbe 00007f17bbec6930 00007f17bbec68d8 00007f17bbec6858 00007f17bbec6813 00007f17bbec5a9c 00007f17c1db1626 00007f17c1dabdd8 00007f17bbf027cb 00007f17bbf052c0
0709 13:11:33.865145 (+  2422us) raft_consensus.cc:1685] finished
0709 13:11:33.865163 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.865370 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":776510,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":47123840,"thread_start_us":1140651,"threads_started":2,"wal-append.queue_time_us":251412}
I20260709 13:11:33.837097 32548 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.859863   304 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.848827 24672 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:33.794641 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.849180 24669 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:33.856892 24566 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:33.859314 32554 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.853070 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:33.840073 32746 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.880496 32740 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.881230 32740 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.882419 24595 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:11:33.881776 24598 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:33.873147   379 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:11:33.879712 32548 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.852706 32703 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:33.870672 32624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.061s	sys 0.051s
I20260709 13:11:33.872846   356 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.873205   304 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:33.871786 32551 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:33.919708 24600 raft_consensus.cc:2393] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 18: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:33.907374   350 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:33.916227 32624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.062s	sys 0.051s
I20260709 13:11:33.919258   337 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:33.922122 32717 consensus_meta.cc:287] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 1.271s	user 0.008s	sys 0.011s
I20260709 13:11:33.931959 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2339) took 2302 ms. Trace:
W20260709 13:11:33.926638   336 consensus_meta.cc:287] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.911s	user 0.010s	sys 0.005s
I20260709 13:11:33.934465 24591 rpcz_store.cc:276] 0709 13:11:31.630036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.845180 (+2215144us) service_pool.cc:224] Handling call
0709 13:11:33.906658 (+ 61478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.931558 (+ 24900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.931582 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.931636 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:33.931675 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.931745 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.931876 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:33.939982 32762 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:33.926846 32548 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.927248   356 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.940344   336 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:33.965014   357 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.966586 32740 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.967263 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2335) took 2574 ms. Trace:
I20260709 13:11:33.967332 32746 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.938833 32717 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:33.974937 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 118171us
I20260709 13:11:33.967764 24597 rpcz_store.cc:276] 0709 13:11:31.392372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.178286 (+1785914us) service_pool.cc:224] Handling call
0709 13:11:33.426518 (+248232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.458307 (+ 31789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:33.458333 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:33.465712 (+  7379us) log.cc:844] Serialized 26 byte log entry
0709 13:11:33.840124 (+374412us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:33.840178 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.840271 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:33.967033 (+126762us) raft_consensus.cc:1685] finished
0709 13:11:33.967052 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.967210 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":382,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":15470,"thread_start_us":373903,"threads_started":1,"wal-append.queue_time_us":459535}
I20260709 13:11:33.986023 24596 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:11:33.970345 32762 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.980962 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:33.994443 32621 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:33.996727 32548 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:33.996498 32628 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:33.997997 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:33.998936 32628 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:34.010203 24565 leader_election.cc:336] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.906s (SENT)
I20260709 13:11:34.010970 32426 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.014003 32491 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:34.014465 32491 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.014842 32491 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.016441   337 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:34.017493 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.021601 24673 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:34.001302 32554 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:34.035806 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 210103us
I20260709 13:11:34.037947 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2336) took 2570 ms. Trace:
I20260709 13:11:34.038602 24596 rpcz_store.cc:276] 0709 13:11:31.467106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.158448 (+1691342us) service_pool.cc:224] Handling call
0709 13:11:33.158891 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:33.986470 (+827579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.037586 (+ 51116us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54003e8d54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:34.037867 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901162240}
I20260709 13:11:34.045944   360 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.049294 32757 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.049964 32757 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:34.050467   376 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:11:34.052459 32757 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.053716 32764 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:34.054291 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2721) took 2315 ms. Trace:
I20260709 13:11:34.054664 24598 rpcz_store.cc:276] 0709 13:11:31.738452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.488038 (+749586us) service_pool.cc:224] Handling call
0709 13:11:34.054058 (+1566020us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540033d454. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:34.054230 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3040444800}
I20260709 13:11:34.052832 32703 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.057219 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:34.018954   356 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.079339 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.079417 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:34.080657 25184 connection.cc:256] RPC call timeout handler was delayed by -1.0169979150000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
I20260709 13:11:34.081360 24673 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 28.
I20260709 13:11:34.084226 24674 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:11:34.063273   303 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:34.064340   344 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.089568 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.089570 24566 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.090744 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.064399 32757 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.075474 32426 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.092765 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:34.097536 32751 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.003s	sys 0.036s
W20260709 13:11:34.099679 32751 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.004s	sys 0.036s
I20260709 13:11:34.100656 32751 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:34.101043 32751 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:34.102411 32717 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.102165 32751 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.103276 32751 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:34.097847 24668 raft_consensus.cc:2410] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:11:34.098361 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.098619 24671 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:34.112141 24673 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:34.098094 32712 consensus_meta.cc:287] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.945s	user 0.008s	sys 0.007s
I20260709 13:11:34.111058 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.116328 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:34.123764 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 95031.3us
I20260709 13:11:34.123507 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:34.126787 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.115373   336 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.130456   303 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:34.139716 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:34.139439 32566 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:34.145464 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.119836 32703 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:11:34.139490 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.156476 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 248195us
W20260709 13:11:34.150801 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 230155us
I20260709 13:11:34.152855 24673 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:34.155175 24674 raft_consensus.cc:2468] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 27.
I20260709 13:11:34.156574 24667 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:11:34.139487   380 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.282s	user 0.001s	sys 0.001s
I20260709 13:11:34.163121 24670 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.163563 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.164198 24674 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:34.154141   303 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.174865   303 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.157227 32703 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:34.177647 32703 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.179471 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:34.186834 25185 connection.cc:256] RPC call timeout handler was delayed by -1.3654217800000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:11:34.187356 25185 connection.cc:256] RPC call timeout handler was delayed by -1.3456217799999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:11:34.187777 25185 connection.cc:256] RPC call timeout handler was delayed by -1.2961217800000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 13:11:34.188081 25185 connection.cc:256] RPC call timeout handler was delayed by -1.2547217799999544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
I20260709 13:11:34.186828   392 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:34.188478 25185 connection.cc:256] RPC call timeout handler was delayed by -1.0765217800000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 13:11:34.188879   392 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.189482   390 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.190135   390 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.191298   392 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:34.191848   392 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.192456   390 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:34.193463 24637 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.526s (SENT)
I20260709 13:11:34.168351 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.194731 25211 raft_consensus.cc:2468] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:34.195168 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.195272 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.196249 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.196346   336 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:34.196817   336 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.197036 32717 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:34.197201   336 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.197350 25219 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:11:34.197496 32717 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.197852 25219 pending_rounds.cc:85] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 16
I20260709 13:11:34.198149 25219 pending_rounds.cc:107] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:11:34.198103 32716 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.198515 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.198829 32716 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.200122 24598 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:34.168622 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.171217 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.170467 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.173060 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.170593 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.198654 25219 raft_consensus.cc:2889] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:34.192286   392 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:34.188854 25185 connection.cc:256] RPC call timeout handler was delayed by -1.0207217800000308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:11:34.206732 24596 raft_consensus.cc:1240] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 26 LEADER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:34.206681 32554 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:11:34.201646 24594 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:34.207231 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.207386 32762 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:34.207610 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.209364 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.210448 24597 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:11:34.211931 24600 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:11:34.186758 32566 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.212370 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.212915 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.197947 32717 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:34.217015 24639 connection.cc:256] RPC call timeout handler was delayed by -1.1066452189999154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
I20260709 13:11:34.257766 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.258067 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.258708 24600 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 25 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 13:11:34.226912 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:34.259761 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:34.247220 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 79726us
I20260709 13:11:34.260841 24595 raft_consensus.cc:2393] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:34.261448 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.261619 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.263549 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.264086 24597 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:34.202010 25216 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:34.220818 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44426 (request call id 4078) took 1051 ms. Trace:
I20260709 13:11:34.217839 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.212858 24593 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:34.217172 25218 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 17: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:34.227348 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.222342 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.265596 24669 rpcz_store.cc:276] 0709 13:11:33.169021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.169809 (+   788us) service_pool.cc:224] Handling call
0709 13:11:34.220675 (+1050866us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400404f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:34.220768 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313341312}
I20260709 13:11:34.266755 25214 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:34.260325 24600 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:34.271696 24598 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
W20260709 13:11:34.272799 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.237465 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.233251 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.227672 32757 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:11:34.272918   327 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:11:34.278888 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.258718 25211 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:34.279534 24597 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:34.282851 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56006 (request call id 2722) took 1002 ms. Trace:
I20260709 13:11:34.283362 24594 rpcz_store.cc:276] 0709 13:11:33.452107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.732737 (+280630us) service_pool.cc:224] Handling call
0709 13:11:34.279793 (+547056us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54003e8854. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:34.279888 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922060160}
I20260709 13:11:34.274093 25212 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
W20260709 13:11:34.285497 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 83356.2us
W20260709 13:11:34.285782 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 83611.9us
I20260709 13:11:34.290481 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:34.291282 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.271190 32554 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.221306 32559 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.291833 25219 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 27.
I20260709 13:11:34.220438 32716 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.312250 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.314879 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:34.310485 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.319697 25215 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:34.309598 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.316236 24598 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:34.316916 24566 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.323189 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4074) took 1146 ms. Trace:
I20260709 13:11:34.323362 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.325350 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.326884 24597 raft_consensus.cc:2393] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:34.327409 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.322999 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.218221   356 consensus_queue.cc:1059] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.093s
I20260709 13:11:34.251267   304 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.307108 32566 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:34.311594 32554 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:34.333105 24594 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 27: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:34.338981 24566 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.340174   344 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:34.341003   344 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:34.332932 25218 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:11:34.334877 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.218060 32491 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.328217 25212 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:34.337527 24670 raft_consensus.cc:2468] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:34.337980 24599 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
W20260709 13:11:34.335070 24637 leader_election.cc:336] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Timed out: RequestConsensusVote RPC to 127.22.225.129:45343 timed out after 1.531s (SENT)
I20260709 13:11:34.282426   303 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.346810 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.344753 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:34.345690 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 86410us
I20260709 13:11:34.350060 25216 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:34.350466 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.323578 24666 rpcz_store.cc:276] 0709 13:11:33.167676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:33.826776 (+659100us) service_pool.cc:224] Handling call
0709 13:11:33.827047 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:33.827341 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:34.033766 (+206425us) log.cc:844] Serialized 14 byte log entry
0709 13:11:34.313560 (+279794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:34.313627 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:34.313694 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:34.313790 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:34.313941 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3258,"prepare.queue_time_us":262390,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":7407,"thread_start_us":461235,"threads_started":2}
I20260709 13:11:34.351048 24600 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
W20260709 13:11:34.354569 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.347744 25214 raft_consensus.cc:2376] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22. Re-sending same reply.
I20260709 13:11:34.356074 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:34.357272 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.358327 24593 raft_consensus.cc:2368] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 23. Current term is 24.
I20260709 13:11:34.352358 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.359404 25211 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:34.338166 32566 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.360476 24597 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:34.361301 24665 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:34.361972 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.363742 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.355404 24566 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.365684 24596 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:34.353260 32716 raft_consensus.cc:2804] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:11:34.364794 24565 leader_election.cc:336] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.519s (SENT)
I20260709 13:11:34.364744 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.373373 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:34.385378 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.342895 32764 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:11:34.389783   327 raft_consensus.cc:3055] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:34.390216   327 raft_consensus.cc:740] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:34.391191 25215 raft_consensus.cc:3055] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:11:34.391575 25215 raft_consensus.cc:740] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:34.393070 24490 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:34.394625 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.396277   332 raft_consensus.cc:2804] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:34.396761   332 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.397159   332 raft_consensus.cc:3060] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:34.398072 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.401604   303 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.402181   314 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:34.392495 25215 consensus_queue.cc:260] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.403618 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.404352 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.362068 32566 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:34.408123 24598 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:11:34.408772 24599 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:34.409801 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:34.413116 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48624.8us
I20260709 13:11:34.413414 24600 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:34.408586 25218 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:34.363711   344 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.418478 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.419059 24669 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:34.421438 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:34.424434 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 69179.6us
I20260709 13:11:34.421434 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.425439 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.425971 32746 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:34.426121 24673 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:34.426651   337 raft_consensus.cc:2804] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:34.425595 24666 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:34.417757 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 55270.6us
I20260709 13:11:34.426183 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.431505 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:34.391132   327 consensus_queue.cc:260] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.427762 32716 raft_consensus.cc:697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 27 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:34.433221   392 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.434038 32716 consensus_queue.cc:237] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.439170 24596 raft_consensus.cc:2368] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23.
I20260709 13:11:34.429380 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.403249   304 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.442077 24594 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:11:34.420603   332 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.442795 24600 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:34.447577 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.396464 32628 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:11:34.446652 32624 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:34.453253 32624 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.453696 32624 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.457383   327 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:34.458767   336 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.460795   336 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.447878 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.450748 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.497521 24667 raft_consensus.cc:3060] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.497589 24592 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 27.
I20260709 13:11:34.444232   337 raft_consensus.cc:697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:34.452196 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.499228 24674 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.462704 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.462975 32703 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.465389 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.443430 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.473958 24666 raft_consensus.cc:2468] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:34.464851 24669 raft_consensus.cc:2468] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:34.480134 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:34.480811 32491 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.482076 24670 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:34.518335 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.485101   332 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:34.485261 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.485427 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.526098 24665 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.486758 25215 raft_consensus.cc:3060] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:34.486909 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:34.489054 24563 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.491335 24593 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:34.442468   392 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.494658 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:34.502723 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.506119 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.513206 24673 raft_consensus.cc:2468] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:34.517694 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.517900 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.483224 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.518625 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:34.533726 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 71005.9us
I20260709 13:11:34.537005 24597 raft_consensus.cc:2393] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:34.530246 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.529546 25212 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 24.
I20260709 13:11:34.537576 24600 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
W20260709 13:11:34.531277 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52126.6us
I20260709 13:11:34.528956 24566 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.541335 24671 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:34.541460 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.542501 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.529479 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.541592 25214 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
W20260709 13:11:34.546406 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.550848 24566 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.551210 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:34.551836 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:34.551968 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 62950.6us
I20260709 13:11:34.552063 24666 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:34.552961 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.553623 25212 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:34.554700   337 consensus_queue.cc:237] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.556159 24594 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:34.551872 25211 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:34.557579 24563 leader_election.cc:336] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.562474 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.561525   304 raft_consensus.cc:2804] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:34.560916 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.565006 24591 raft_consensus.cc:1240] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:34.592545 32703 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:34.597779 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44701.5us
I20260709 13:11:34.597952 32566 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:34.598968 24563 leader_election.cc:336] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.599357 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:34.601107 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.601744 25214 raft_consensus.cc:2468] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 28.
I20260709 13:11:34.591361   336 raft_consensus.cc:2804] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:34.600282 32566 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.602928 32764 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:34.603812   336 raft_consensus.cc:697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:34.605324 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 240592us
W20260709 13:11:34.606807 24563 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.607429 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:34.608386 32764 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:34.604954   336 consensus_queue.cc:237] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.568239 25215 raft_consensus.cc:1275] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 19. (term mismatch)
I20260709 13:11:34.611135 25215 pending_rounds.cc:85] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 18
I20260709 13:11:34.611393 25215 pending_rounds.cc:107] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 25.19
I20260709 13:11:34.611624 25215 raft_consensus.cc:2889] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:34.613111 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.544220   392 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:34.613679 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.613998 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.614434 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.615198   392 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.615638 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.616770 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.543953 32751 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:34.618150 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.622737 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.622900 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.623634 24671 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:34.623824 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.624529 24671 raft_consensus.cc:1240] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 24. Ops: []
I20260709 13:11:34.618989 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.628705 25211 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
W20260709 13:11:34.620433 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.633826 24674 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:34.641541 25218 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:34.640242 24665 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:34.642649 24670 raft_consensus.cc:1240] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:34.642958 32751 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:34.630002 24563 leader_election.cc:336] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.624558 24669 raft_consensus.cc:2410] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:11:34.646081 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.655193 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:34.662870 25219 raft_consensus.cc:2468] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 17.
I20260709 13:11:34.668736 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:34.674335 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.674947 25218 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:34.587531   304 raft_consensus.cc:697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:34.652382 32751 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.675616 24566 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.672202   332 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:34.688354 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:34.689528 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59598.5us
I20260709 13:11:34.679426   314 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:34.705880 24416 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 350) took 17083 ms (client timeout 15000 ms). Trace:
I20260709 13:11:34.685050   344 raft_consensus.cc:2804] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:34.707113   344 raft_consensus.cc:697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:34.708120   344 consensus_queue.cc:237] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.708423 32717 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.709712 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:34.710654 32717 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.711627 24595 raft_consensus.cc:2368] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
W20260709 13:11:34.690464 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:34.719864 24563 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.720300 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:34.721472 24566 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:34.721693 24563 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:34.722358 24563 leader_election.cc:336] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.722662 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:34.723248 24563 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.723012 32624 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.723541 32764 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:34.724300 32764 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:34.724747 32764 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:34.725528 24491 connection.cc:256] RPC call timeout handler was delayed by -1.0552878900000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:11:34.725668 32764 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.726644 32624 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.727836 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.728914 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.729648 32628 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:34.730044 32628 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.730389 32628 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:34.730548 32703 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:34.731127 32703 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:34.731964 32703 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.733467 24667 raft_consensus.cc:2468] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
W20260709 13:11:34.746531 24637 leader_election.cc:336] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.752424 32628 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:34.753234 24639 leader_election.cc:336] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Timed out: RequestConsensusVote RPC to 127.22.225.130:39455 timed out after 1.531s (SENT)
I20260709 13:11:34.753139 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:34.753410 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.735460 32624 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:34.764612 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.747014 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:34.765479 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.767211 25215 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:34.767647 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:34.768195 25214 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.761523 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:34.764678 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.761823 25210 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:34.761680 25212 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.767270 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:34.771749 24637 leader_election.cc:336] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.772246 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:34.772732 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.772617 32628 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.773209 24491 leader_election.cc:400] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
I20260709 13:11:34.773522 24491 leader_election.cc:403] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:34.773558 24637 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.774435 32628 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:34.774799 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:34.775408 25215 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:34.777398 32618 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:34.777726 32561 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:34.778469 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:34.779042 25211 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.778903 32618 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:34.779539 32762 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.780036   304 consensus_queue.cc:237] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:34.765306 32624 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.781406 32624 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:34.792721 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:34.793817 24490 leader_election.cc:400] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23.
I20260709 13:11:34.794232 24490 leader_election.cc:403] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:11:34.779996 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:34.796164 25217 raft_consensus.cc:1275] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 13:11:34.798611 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:34.801339 24593 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:11:34.801759 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:34.803784 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50225.9us
W20260709 13:11:34.806941 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.706343 24416 rpcz_store.cc:269] 0709 13:11:17.622345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.622597 (+   252us) service_pool.cc:224] Handling call
0709 13:11:19.647159 (+2024562us) spinlock_profiling.cc:243] Waited 90.4 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:11:34.705657 (+15058498us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:26.902087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:26.918190 (+ 16103us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:26.918241 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:11:26.918262 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:26.991517 (+ 73255us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:26.991592 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:26.991618 (+    26us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:11:27.219818 (+228200us) tablet.cc:701] Row locks acquired
0709 13:11:27.219895 (+    77us) write_op.cc:260] PREPARE: finished
0709 13:11:27.220078 (+   183us) write_op.cc:270] Start()
0709 13:11:27.220243 (+   165us) write_op.cc:276] Timestamp: P: 1783602687220012 usec, L: 0
0709 13:11:27.220263 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:11:27.247323 (+ 27060us) log.cc:844] Serialized 10809 byte log entry
0709 13:11:27.911305 (+663982us) op_driver.cc:464] REPLICATION: finished
0709 13:11:28.057237 (+145932us) write_op.cc:301] APPLY: starting
0709 13:11:28.057326 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:28.675371 (+618045us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:28.675476 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:30.083643 (+1408167us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:30.084005 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:11:30.084048 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:30.084499 (+   451us) log.cc:844] Serialized 236 byte log entry
0709 13:11:30.204074 (+119575us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:30.291727 (+ 87653us) write_op.cc:454] Released schema lock
0709 13:11:30.412714 (+120987us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:30.549921 (+137207us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:33.149584 (+2599663us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b1800401fe0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e59522 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:33.149857 (+   273us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:33.149897 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":838371,"reported_tablets":45,"spinlock_wait_cycles":207994752,"child_traces":[["op",{"apply.queue_time_us":125567,"apply.run_cpu_time_us":56923,"apply.run_wall_time_us":2394637,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116987,"num_ops":27,"prepare.queue_time_us":56658,"prepare.run_cpu_time_us":15827,"prepare.run_wall_time_us":526042,"raft.queue_time_us":215374,"raft.run_cpu_time_us":17866,"raft.run_wall_time_us":97898,"replication_time_us":690863,"spinlock_wait_cycles":53223040,"thread_start_us":422817,"threads_started":5,"wal-append.queue_time_us":519404,"wal-append.run_cpu_time_us":43503,"wal-append.run_wall_time_us":3048995}]]}
I20260709 13:11:34.813956 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:34.803041 24637 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:34.818835 24637 leader_election.cc:336] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.819222 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:34.819868 25215 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:34.820856 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.821267 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.822046 24598 raft_consensus.cc:2410] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:11:34.823007 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.823669 24594 raft_consensus.cc:1240] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 27. Current term is 28. Ops: []
I20260709 13:11:34.826572 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.795778   336 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.822494 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.828313 24595 raft_consensus.cc:2393] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:34.801980 32757 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:34.833405 25211 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:34.801740   356 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:34.801275   400 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:34.820704 32551 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
W20260709 13:11:34.842624 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 89411.2us
W20260709 13:11:34.843580 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.780025 32762 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.839843 32554 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:34.854095 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 78081.4us
I20260709 13:11:34.838798   392 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:34.829203 32561 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:11:34.854408 32628 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
I20260709 13:11:34.847507   360 raft_consensus.cc:3060] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:34.820844 32751 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.863914 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:34.869477 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 50634.1us
I20260709 13:11:34.870426 25212 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:34.874202 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:34.839466   336 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.852507 32491 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:34.887496 24597 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
W20260709 13:11:34.888573 24637 leader_election.cc:336] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:34.898743 24637 leader_election.cc:336] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:34.896795 24423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 348) took 105561 ms (client timeout 15000 ms). Trace:
W20260709 13:11:34.899489 24423 rpcz_store.cc:269] 0709 13:09:49.294400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.294653 (+   253us) service_pool.cc:224] Handling call
0709 13:11:34.847049 (+105552396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622865,"reported_tablets":46}
W20260709 13:11:34.901597 24637 leader_election.cc:336] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:34.907143 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 51366.9us
W20260709 13:11:34.911576 24637 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.859607   392 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:34.911412 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.916251 24595 raft_consensus.cc:2393] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:34.915231 24637 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:34.917703 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.918421 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.918990 24673 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 26
W20260709 13:11:34.919991 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.916986 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:34.931002 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:34.931895 24597 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 17.
I20260709 13:11:34.932699 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.933285 24665 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 27.
I20260709 13:11:34.933790 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:34.934424 24672 raft_consensus.cc:3060] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:34.937565 32551 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:34.938011 32551 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:34.938171   408 consensus_queue.cc:1059] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:34.938953 32551 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.940184 32551 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:34.941123 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.941879 32491 consensus_queue.cc:1059] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:34.942836 24639 leader_election.cc:400] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 23. Current term is 24.
I20260709 13:11:34.943037 32757 raft_consensus.cc:3055] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:34.943511 32757 raft_consensus.cc:740] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:34.915671   392 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:34.944617 32757 consensus_queue.cc:260] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.946686 32757 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:34.949400 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.950515 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.951205 24667 raft_consensus.cc:2393] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 27: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:34.952785 32762 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.953464   314 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:34.954244 32762 raft_consensus.cc:2764] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 13:11:34.955192 24670 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 13:11:34.969383 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.978293 32554 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:34.978785 25214 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:11:34.979897 32751 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.943179 24639 leader_election.cc:403] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:11:34.980700 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:34.981845 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.982683   327 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 23. Current term is 24.
I20260709 13:11:34.983119 32624 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.983639   327 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:11:34.984167 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:34.984339   327 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 27 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:34.985710 32491 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:34.986228 32491 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.986673 32491 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:34.989621   360 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23.
I20260709 13:11:34.989843   327 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:34.990965   336 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:34.996860 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:34.997519 24595 raft_consensus.cc:2376] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24. Re-sending same reply.
I20260709 13:11:35.002661   332 raft_consensus.cc:3055] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:35.003125   332 raft_consensus.cc:740] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:35.004067   332 consensus_queue.cc:260] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:35.007202 24668 raft_consensus.cc:2393] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:35.011134   332 raft_consensus.cc:3060] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:35.016573 24673 raft_consensus.cc:2468] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 26.
I20260709 13:11:35.018656 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:35.019413 24593 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:35.022159 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:35.022780 24593 raft_consensus.cc:2368] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:35.024158 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:35.024489 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:35.025269 24595 raft_consensus.cc:2410] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 25 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 13:11:35.026152 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:35.026759 24600 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:35.028064 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:35.028755 24593 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
W20260709 13:11:35.032387 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 45354.8us
I20260709 13:11:35.040963 24672 raft_consensus.cc:2468] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
W20260709 13:11:35.049767 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.050426 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:35.052510 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 135660us
W20260709 13:11:35.057591 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 183476us
W20260709 13:11:35.063072 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 264303us
I20260709 13:11:35.065785 24673 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:35.063606 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:35.004081 32491 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.067147   392 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.058230   360 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:35.059438 32624 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:35.072729 24672 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:35.078801 32762 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:35.079751   392 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:35.079983 32762 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:11:35.080401 32762 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:35.086931 25185 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:35.088703   415 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:35.090593 32491 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:35.090804   415 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:35.091275   415 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:35.091630   415 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:35.094904 32551 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:35.095319 32551 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:35.069728 32618 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:35.098229 32618 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:35.098595 32762 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.103401 32762 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:35.105229 32618 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:35.113282 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.113229 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 48276.7us
I20260709 13:11:35.116459 24566 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:35.117473 32717 raft_consensus.cc:2804] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:35.118085 32717 raft_consensus.cc:697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:35.125991 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.068563 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.134145 24639 leader_election.cc:400] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:35.134477 24639 leader_election.cc:403] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:35.140177 24563 leader_election.cc:336] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.132778 24566 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:35.147617 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 79132.8us
I20260709 13:11:35.149660 32717 consensus_queue.cc:237] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:35.112473 32551 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:35.230583 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.236034 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 106089us
W20260709 13:11:35.151165 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 64294.7us
W20260709 13:11:35.236734 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.151877 24671 raft_consensus.cc:1275] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:11:35.155779 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:35.238400 24665 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
W20260709 13:11:35.154179 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 328230us
W20260709 13:11:35.218919 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 86193.6us
I20260709 13:11:35.240262 24566 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:35.156491 24670 raft_consensus.cc:1275] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:11:35.155490 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.242156 24668 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:35.237263 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:35.243674 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:35.251775 24565 leader_election.cc:336] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 2.051s (SENT)
I20260709 13:11:35.252290 24673 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:35.252410 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:35.140908 24563 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.254594 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:35.146487   414 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:35.265401 24666 raft_consensus.cc:1275] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:11:35.146380 32751 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:35.256472 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 115599us
W20260709 13:11:35.264679 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 116342us
I20260709 13:11:35.268940 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:35.263761 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.249919   304 raft_consensus.cc:2804] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:35.154486 32757 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:35.276633 25185 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.174291   392 consensus_queue.cc:1059] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:11:35.261832 32764 raft_consensus.cc:2804] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:35.262100 32566 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:35.266306 32491 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:35.261845   390 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:35.287474 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:35.288619 24592 raft_consensus.cc:1240] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:35.289424 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:35.159389 32618 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:35.291392 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.155153   411 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.147s
I20260709 13:11:35.297921 24593 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 13:11:35.277048 32559 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:35.309485   411 consensus_queue.cc:1059] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:35.312086 32618 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:35.262331   360 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:11:35.313651 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:35.313943 32762 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:35.314203 24592 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:35.298228 32551 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:35.293254 32624 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:35.316581 32624 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:35.316942 32624 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:35.322235   420 raft_consensus.cc:3055] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:35.322721   420 raft_consensus.cc:740] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:35.323686   420 consensus_queue.cc:260] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.324008   415 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.301662 24594 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 13:11:35.302192 24596 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:35.327193 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:35.327713 24594 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:35.302243 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.330790 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.331887 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.277431   400 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:35.303172 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:35.303973 24563 leader_election.cc:336] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.331501 32559 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:35.333608   332 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:35.336344 24563 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.337291   400 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:35.337564 24563 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.337842   400 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:35.338380 24563 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.339073 32559 raft_consensus.cc:3060] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:35.339954   360 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:11:35.339201 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.341192 32751 consensus_queue.cc:1059] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:35.342056   410 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:35.343345 24491 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:35.346773 24563 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.347519 24563 leader_election.cc:336] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.349128   415 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:35.299032 32491 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:35.349828 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.350150 32491 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:35.350677 24563 leader_election.cc:336] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.351076   360 raft_consensus.cc:3055] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:35.351532   360 raft_consensus.cc:740] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:35.352381   360 consensus_queue.cc:260] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:35.301182   390 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.353468   390 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:35.353876   360 raft_consensus.cc:3060] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:35.358043 24596 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:35.364564 24668 raft_consensus.cc:2468] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 29.
I20260709 13:11:35.366170   410 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:35.366577   410 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.366878   410 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:35.360128 32559 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:35.369966 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 71950.9us
I20260709 13:11:35.371150 32559 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:35.373248 32559 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.362707 32624 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.371032 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:35.369844 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.379810 24594 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:35.320796 24592 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
W20260709 13:11:35.398757 24422 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 246) took 105053 ms (client timeout 15000 ms). Trace:
I20260709 13:11:35.405921 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:35.414335 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:35.418007 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 141459us
I20260709 13:11:35.396454 32559 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:35.413223 24422 rpcz_store.cc:269] 0709 13:09:50.345067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.345270 (+   203us) service_pool.cc:224] Handling call
0709 13:09:50.470109 (+124839us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:11:35.398558 (+104928449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2571,"reported_tablets":42,"spinlock_wait_cycles":110207104}
I20260709 13:11:35.417690 32751 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:11:35.430107 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 157748us
I20260709 13:11:35.434937 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.434909 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:35.363382 24563 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.404420 32618 raft_consensus.cc:3060] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:35.404313   332 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:11:35.436563 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 73202.7us
I20260709 13:11:35.405295   408 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:11:35.438732 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:35.430091   360 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:35.441533 24563 leader_election.cc:336] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.448765 24563 leader_election.cc:336] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.449281 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:35.449622 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.440622   304 raft_consensus.cc:697] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:35.451316 24670 raft_consensus.cc:1275] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:35.438522 32628 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:35.454522 24566 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:35.451954 24668 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:11:35.461735   425 consensus_queue.cc:1048] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:35.462025   304 consensus_queue.cc:237] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:35.463300   425 consensus_queue.cc:1048] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:35.463932   420 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:35.458137   336 consensus_queue.cc:1048] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:11:35.466571 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.467156 25214 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.467474 32762 raft_consensus.cc:3055] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:35.467882 32762 raft_consensus.cc:740] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:35.468838 32762 consensus_queue.cc:260] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.470057 32762 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.475782   410 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.446539   392 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:35.480276 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.480558 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.481853 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.482059 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.482601 25210 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:35.482692 25212 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:35.483484 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.484066 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.434813 32751 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:35.485601 32751 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:35.491058 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.493660 25217 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:35.460706   414 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:35.456070 32717 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:35.495194 32717 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.495662 32717 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.459311 32716 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:11:35.498519 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.498929 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.499183 24670 raft_consensus.cc:2376] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20. Re-sending same reply.
I20260709 13:11:35.499696 24673 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:35.499588 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.500572 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.501405 24671 raft_consensus.cc:2368] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23.
I20260709 13:11:35.503827   390 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:35.505379 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 50944us
I20260709 13:11:35.505987 32716 raft_consensus.cc:2804] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:11:35.460448 32566 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:35.511718 25215 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:35.552757 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.553581 25215 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:35.511965 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:35.513460 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 78706.1us
W20260709 13:11:35.451318 24563 leader_election.cc:336] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.450173 32764 raft_consensus.cc:697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:35.515276 32624 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:35.521793   410 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:35.522439 32491 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:35.525857 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.526554 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.527320 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.528927 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.564945 25216 raft_consensus.cc:2410] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 29 because replica has last-logged OpId of term: 27 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 19.
I20260709 13:11:35.565117 25218 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:35.529973 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.530911 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.531545 25219 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:11:35.492198   400 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:35.566313 25212 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 27.
I20260709 13:11:35.554909 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:35.554790 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 103500us
W20260709 13:11:35.567678 24563 leader_election.cc:336] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.568616 24563 leader_election.cc:336] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.555626 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:35.570530 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.571177 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.556069 24668 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 13:11:35.571857 24669 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:35.556336 24565 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.542s (SENT)
I20260709 13:11:35.573047 24565 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:35.559527 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.560830 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:35.562608 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.554194 25182 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 142 similar messages]
I20260709 13:11:35.540748 25214 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18.
I20260709 13:11:35.574043 24667 raft_consensus.cc:2393] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:35.574843 25211 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:35.578294 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.578944 24670 raft_consensus.cc:2468] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:35.584583 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.586010 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.586690 25218 raft_consensus.cc:2376] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 18. Re-sending same reply.
I20260709 13:11:35.564384 32762 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.019s
I20260709 13:11:35.593562 24671 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:35.559705 32716 raft_consensus.cc:697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 29 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:35.600737 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.597832   392 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:35.601406 25216 raft_consensus.cc:2376] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24. Re-sending same reply.
I20260709 13:11:35.577675 32628 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:35.560748   337 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 13:11:35.554764 32703 consensus_queue.cc:1048] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 13:11:35.603506 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 47192us
I20260709 13:11:35.566023   414 consensus_queue.cc:1059] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.032s
I20260709 13:11:35.602136 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:35.589375   426 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:35.595685   344 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:35.610817 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:35.614761 24668 raft_consensus.cc:1275] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:35.617017 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.618777 25215 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:35.628027 24670 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:35.629186   427 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:11:35.629946   432 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:35.631865   430 raft_consensus.cc:3055] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:11:35.632249   430 raft_consensus.cc:740] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:35.633000   430 consensus_queue.cc:260] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.634346   430 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:35.617841 32717 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.638962 32717 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:35.641446 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.641884 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.642604 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.643010 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.641875 25219 raft_consensus.cc:1240] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 23. Current term is 24. Ops: []
I20260709 13:11:35.648859 25210 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 27.
I20260709 13:11:35.686285 24671 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:35.616586   392 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:35.690371 25215 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:35.697170 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.698580 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.705713 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.706193 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.706883 25211 raft_consensus.cc:2368] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
I20260709 13:11:35.711270 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.711388 24669 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
W20260709 13:11:35.718592 24563 leader_election.cc:336] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.719817 24563 leader_election.cc:336] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.721464 24563 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.684401   427 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:35.728346 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.723309 24563 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:35.610800 32559 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.729682 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:35.732041 24598 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:35.732905 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.733693 24669 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.697386   392 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:35.737901 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:35.738500 24592 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:11:35.744753 24591 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 23. Current term is 24. Ops: []
W20260709 13:11:35.728017 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 173836us
W20260709 13:11:35.739153 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 283721us
I20260709 13:11:35.739799 24595 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
W20260709 13:11:35.747144 24563 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.747575 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:35.752498 24669 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:35.753511 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.754492 24566 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:35.615945 32764 consensus_queue.cc:237] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:35.759881 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.743251   392 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:35.776434 24563 leader_election.cc:336] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.778672 24563 leader_election.cc:336] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.781144 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.756012   337 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:11:35.783509 25182 leader_election.cc:336] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.776971 32703 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:35.730679 32716 consensus_queue.cc:237] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:35.739914 32717 consensus_queue.cc:1048] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:11:35.787443 32751 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.798187 32559 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:35.779963   304 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:35.800750 25182 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:35.824227 25217 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:35.753685   344 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.047s
I20260709 13:11:35.821318   427 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.833695 32751 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:35.834825 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.835279   337 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.009s
I20260709 13:11:35.844060 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.844310 25211 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:11:35.842578   304 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:35.845904   304 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:35.783365 24563 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.853395 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 70062.1us
W20260709 13:11:35.854423 24563 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.843292   400 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:35.864017 24598 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
W20260709 13:11:35.864524 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81032.9us
W20260709 13:11:35.870507 25182 leader_election.cc:336] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.777377 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.865676 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:35.856559   420 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:35.868512 24563 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:35.872728 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 122529us
W20260709 13:11:35.874233 25182 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.877511 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:35.878683 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:35.878986 25182 leader_election.cc:336] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.879276 24674 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:35.879403 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:35.874931 32624 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:35.880309 32624 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.880661 32624 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:35.908937 25182 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.907423 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 53015.9us
W20260709 13:11:35.912375 24563 leader_election.cc:336] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:35.915890 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.917420 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.917697 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.917937 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:35.918017 25219 raft_consensus.cc:2376] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25. Re-sending same reply.
I20260709 13:11:35.918360 25211 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 28.
I20260709 13:11:35.919615 25215 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:11:35.919973 25215 pending_rounds.cc:85] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 13
I20260709 13:11:35.920177 25215 pending_rounds.cc:107] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:11:35.920409 25215 raft_consensus.cc:2889] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:35.920637 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:35.871869 32618 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:35.921684 32764 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:35.925575 32491 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:35.876883   392 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.908594   420 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:35.929488 32491 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:35.930924 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:35.931833 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:35.932449   327 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:35.932705 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:35.932869   327 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:35.933326   454 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:35.908317 32762 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.951510 32624 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:35.952323   443 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:11:35.935779 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 52895.8us
I20260709 13:11:35.953567 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:35.954411   447 log.cc:927] Time spent T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:35.954746 24490 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:35.956236 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:35.956300 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:35.941597 24674 raft_consensus.cc:2468] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:35.957137 24667 raft_consensus.cc:2393] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 18: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:35.957480 32491 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:35.957906 32491 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.958002 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:35.958410 32491 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:35.962881 32624 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:35.967350   440 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.002s
I20260709 13:11:35.971151 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:35.971493 24674 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
W20260709 13:11:35.974184   455 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:11:35.976183   453 log.cc:927] Time spent T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:11:35.979133   444 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:11:35.984261   449 raft_consensus.cc:2804] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:11:35.984730   449 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.985105   449 raft_consensus.cc:3060] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:11:35.985613 24565 leader_election.cc:336] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.865s (SENT)
W20260709 13:11:35.988078   458 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:11:35.989490 24565 leader_election.cc:336] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Timed out: RequestConsensusVote RPC to 127.22.225.132:34125 timed out after 1.895s (SENT)
I20260709 13:11:35.989804 32559 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:35.990468 32559 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:35.991329 32559 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:35.991827 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:35.992740   344 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:35.993281 32618 raft_consensus.cc:2804] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:35.993422 32751 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.993752 32618 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:35.994234 32618 raft_consensus.cc:3060] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:35.994025 32751 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:35.995393   459 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:11:35.997534 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:35.996248 32751 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:35.941605 24563 leader_election.cc:336] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:35.945847 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:36.000939 24490 leader_election.cc:400] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 17 pre-election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18.
W20260709 13:11:36.001151 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 59579.4us
I20260709 13:11:35.945884 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:35.946022 25182 leader_election.cc:336] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.002208 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:35.948213   392 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:35.948331   390 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:35.949155   327 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:35.989908 24670 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:35.942286 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:36.013255 24669 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 27.
W20260709 13:11:36.002365 24563 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.006695 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:36.018581 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 72818.9us
W20260709 13:11:36.017498 24563 leader_election.cc:336] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:36.020495 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.022792 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.022814 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:36.033772 24673 raft_consensus.cc:1275] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:36.034930 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.035146 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.035516 25215 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.037292 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:36.038259 25214 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 18: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:36.040124 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:36.018231   344 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.032229   304 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:36.050079 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:36.050684 24596 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:36.044963 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.045118 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:36.042312 25185 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:36.045562 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 99572.4us
I20260709 13:11:36.046663 25211 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:11:36.048161 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:36.047079 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:36.022047   427 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:36.059970 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.051218 24639 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.051783 25210 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:36.048941 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:36.053320 24598 raft_consensus.cc:2368] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22.
W20260709 13:11:36.061678 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.041477 24637 leader_election.cc:336] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.057811 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:36.058130 24591 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: [21.17-22.18]
I20260709 13:11:36.058864 25219 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:11:36.057823 25215 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:36.059535 25217 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:36.064649 24491 leader_election.cc:400] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Vote denied by peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451) with higher term. Message: Invalid argument: T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23.
I20260709 13:11:36.033385   454 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:11:36.062642 24637 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.032656 32762 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.066358 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:36.070132 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 47401.5us
W20260709 13:11:36.071182 24637 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.046739 32554 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:36.044648   425 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.005172 32624 consensus_queue.cc:1059] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:11:36.017264 32703 consensus_queue.cc:1048] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.035s
I20260709 13:11:36.085408 25218 raft_consensus.cc:2376] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20. Re-sending same reply.
I20260709 13:11:36.054387 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:36.086337 24490 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.096870 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.084743 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:36.075757 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.132375 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.057554   390 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:36.102305 24596 raft_consensus.cc:2468] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
W20260709 13:11:36.157932 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 71682us
W20260709 13:11:36.158742 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 107584us
W20260709 13:11:36.157131 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 102807us
W20260709 13:11:36.119958 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.159957 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:36.160539 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.162173 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.162642 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.162767 25217 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:36.165719 25214 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 20. (term mismatch)
I20260709 13:11:36.166414 25214 pending_rounds.cc:85] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 19
I20260709 13:11:36.166657 25214 pending_rounds.cc:107] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 27.20
I20260709 13:11:36.166882 25214 raft_consensus.cc:2889] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:36.069031   408 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:11:36.155157 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 87143.6us
I20260709 13:11:36.158111   450 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:36.067123   392 raft_consensus.cc:2804] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:36.171510 25213 raft_consensus.cc:1240] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
W20260709 13:11:36.176859 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 136793us
I20260709 13:11:36.177668 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.070906   454 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.178161 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:36.181233 25214 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:36.182024 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.177630 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:36.178566 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 107403us
W20260709 13:11:36.183224 24637 leader_election.cc:336] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:36.184038 24637 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.184674 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:36.184849 24637 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.185349 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.191322 25217 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:36.192896 25217 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:36.193989 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:36.195338 24419 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 247) took 83431 ms (client timeout 15000 ms). Trace:
W20260709 13:11:36.195787 24419 rpcz_store.cc:269] 0709 13:10:12.763507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.763774 (+   267us) service_pool.cc:224] Handling call
0709 13:11:36.195123 (+83431349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113,"reported_tablets":43}
I20260709 13:11:36.198833 25210 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 13:11:36.199066 25211 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:36.199867 25216 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:36.187592 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.200867 25213 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:36.118120 32751 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.085s
I20260709 13:11:36.158356   427 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:36.160871   410 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:36.096273 32554 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.067219 32757 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.110s
I20260709 13:11:36.117669   448 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:36.067302   414 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.110s
W20260709 13:11:36.214206 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44228.5us
I20260709 13:11:36.118160   420 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.180956   450 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:36.197250   454 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:36.185889   356 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.213989   427 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:36.237017 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63642.8us
W20260709 13:11:36.241541 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 144748us
W20260709 13:11:36.236721 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 51885.7us
I20260709 13:11:36.162963   425 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:36.212723   418 log.cc:927] Time spent T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:36.242223 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:36.198005   430 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 13:11:36.219266 32554 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:36.185454 32762 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 13:11:36.237598   450 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:36.246987 24491 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:36.248579 24418 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.249584   425 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:36.237609   408 raft_consensus.cc:2804] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:36.250025   421 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:36.251425   456 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:11:36.256246   451 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:11:36.258234   465 log.cc:927] Time spent T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:11:36.259822   469 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 13:11:36.198299 32628 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.040s
I20260709 13:11:36.266969   448 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.262437   410 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:36.245975   390 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.087s
I20260709 13:11:36.328660   410 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:36.305174   408 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
W20260709 13:11:36.262830 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 85216.2us
I20260709 13:11:36.329924   408 raft_consensus.cc:3060] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:36.237325   420 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.262907   429 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:36.331801   420 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:36.332024 24666 raft_consensus.cc:1240] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:36.267604 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.332731 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65192.6us
I20260709 13:11:36.304581   356 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:36.333446   332 raft_consensus.cc:3055] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:36.333613 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 86744.5us
I20260709 13:11:36.333890   332 raft_consensus.cc:740] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:36.334898   438 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:11:36.335070 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.268604 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 91048.3us
I20260709 13:11:36.280939 25213 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
I20260709 13:11:36.336613 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:36.337201 25213 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
W20260709 13:11:36.242434 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.349507 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 107106us
W20260709 13:11:36.350292 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.311765 24418 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 12 to 14, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 14 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.265730   414 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:36.239658   314 consensus_queue.cc:1059] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.068s
I20260709 13:11:36.318975   411 raft_consensus.cc:3055] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:11:36.321311   360 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.244774   427 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:36.334734   332 consensus_queue.cc:260] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.268555 24490 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
W20260709 13:11:36.360440 24637 leader_election.cc:336] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.362730 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.363670   449 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:36.364751 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.275781 32703 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:36.333465   356 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:11:36.372102 24637 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.389752 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 54553.8us
W20260709 13:11:36.391338 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 231422us
I20260709 13:11:36.392596 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.393910   448 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:36.386049 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 193441us
W20260709 13:11:36.388008 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.396481 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:36.365265   411 raft_consensus.cc:740] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:36.402575 24565 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:36.398255 24637 leader_election.cc:336] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.403378 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.403820   332 raft_consensus.cc:3060] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:36.329666   410 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:36.404568 24637 leader_election.cc:336] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.405894 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.406644 24565 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.395068   392 raft_consensus.cc:697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:36.410574 24637 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:36.411504 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 143022us
I20260709 13:11:36.412401 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.357827 32618 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.368278   360 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:36.412755 24490 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:36.416316 24565 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:36.417726 24637 leader_election.cc:336] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.418272 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.380713 32566 consensus_queue.cc:1048] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.039s
I20260709 13:11:36.409843   448 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.410022   337 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:36.410230   304 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:36.395731 32703 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:36.424504 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.425499 32491 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.426131   429 raft_consensus.cc:2764] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 13:11:36.420516   336 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:36.426769   327 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:36.432770 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.425978   356 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.454874 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.455528   479 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:36.455323 32764 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:36.455813 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.455974   411 consensus_queue.cc:260] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:36.462451 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 243490us
I20260709 13:11:36.419423 32559 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:36.421753   438 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:36.461686   400 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:36.481985 32618 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:36.415310 32554 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:36.483390 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 65723.8us
W20260709 13:11:36.487522 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 88367.8us
I20260709 13:11:36.491767 24666 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: [22.18-22.18]
W20260709 13:11:36.479984 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.492408 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:36.433228 32757 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:36.493233 24637 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.494840 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.492013 24565 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:36.507189   454 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.508122 32554 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:36.493829 25182 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:36.509927 25182 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.510336 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.493850   336 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.017s
I20260709 13:11:36.511380 32491 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:36.511088   438 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.515543 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:36.517890 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:36.518594 24637 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:36.519688 24637 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.522053 24673 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 28: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:36.523283 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 104124us
I20260709 13:11:36.485404 32717 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:36.528384 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:36.528829 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.529016 25213 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:36.529772 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.530488 25214 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 25: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:11:36.523924 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.531914 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:36.532742 24672 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:36.460842   408 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.534994 24666 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: []
W20260709 13:11:36.536123 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.494014   421 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:11:36.532521 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:36.540531 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.544260 25212 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:36.531440   414 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:36.528026   479 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:36.550700 24666 raft_consensus.cc:1240] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:36.533631 32566 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:36.553804 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:36.550434 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:36.514019   337 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
W20260709 13:11:36.550861 25182 leader_election.cc:336] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.535599   411 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:36.559109 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:36.655905 25182 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.554404   356 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:36.539729 32757 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:36.667685 25182 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:36.669776 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:36.558034   448 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:36.681974 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:36.670053 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:36.682881 24594 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:36.683877 24591 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:36.527343   474 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.146s
W20260709 13:11:36.684902 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 131185us
I20260709 13:11:36.516929   392 consensus_queue.cc:237] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.656304 32559 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:36.694249 32559 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:36.688165 25182 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.688416 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:36.657681   454 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:36.688898 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:36.700009 25182 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.659789   421 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:36.668884   449 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 29 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:36.667270 32566 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:36.716102 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.700362 24598 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:36.700937 24592 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 25: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:36.718870 24666 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:36.658232   488 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:36.549522   480 consensus_queue.cc:1059] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.165s
I20260709 13:11:36.687820   425 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:36.690639   360 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:36.740852 25182 leader_election.cc:336] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:36.741497 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:36.697732   473 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:36.698370   414 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.710472   492 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:36.733474   425 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.735980   430 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:36.755991 25212 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:36.698695 32716 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:11:36.748100 32624 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.753455   490 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.765736   425 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:36.764958   327 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:36.759160   304 raft_consensus.cc:3055] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:36.927091 24673 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 13:11:36.922269 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:36.763784   477 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:36.921139 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:36.913223 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.961474 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.968014 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:36.979610 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 227216us
W20260709 13:11:36.905297   486 log.cc:927] Time spent T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:11:36.983274 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:36.983785 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45003.1us
I20260709 13:11:36.984447   481 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:11:36.989144 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:36.772876 32703 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:36.877398   426 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:36.880175 32762 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:36.767843   488 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 25 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:36.839710   408 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:36.880812 32757 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:36.769516 32554 consensus_queue.cc:1059] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.224s
I20260709 13:11:36.800985 32624 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.865525   491 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:37.000617   487 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:36.816620   490 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:36.854964 32566 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.993851   476 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 13:11:36.955511   304 raft_consensus.cc:740] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:37.052898 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 69692.1us
I20260709 13:11:36.981096   474 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:11:37.053469 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45663.3us
I20260709 13:11:36.860155   427 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.005519   426 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:37.060341   491 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.061733 32624 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.063072   502 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:37.062642   304 consensus_queue.cc:260] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:36.824180   450 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.005414 32762 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:37.009301   489 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:11:37.064515 32628 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:37.061753   490 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:37.098788 25215 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 28: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:37.075351   408 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.834893   421 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.140067   304 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:37.132514 32628 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.094033 32618 consensus_queue.cc:1059] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.054s
W20260709 13:11:37.153360 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 93304.7us
I20260709 13:11:37.158181   504 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.158727   504 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.074693   487 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.096042   502 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.148715 32628 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:37.164911 24490 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:37.141680   408 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:37.162405 32717 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.003s
W20260709 13:11:37.187547 23430 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 24550)
W20260709 13:11:37.188341   510 log.cc:927] Time spent T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:11:37.191890   487 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.164737   426 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.195327   426 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:37.197418   504 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.200584 24673 raft_consensus.cc:1275] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:37.202004   427 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:37.202545   392 consensus_queue.cc:1048] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:37.202953 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:37.203817 24673 raft_consensus.cc:2393] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 28: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:37.203150   464 log.cc:927] Time spent T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.003s	user 0.000s	sys 0.005s
I20260709 13:11:37.157021   488 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:37.208737   411 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.004s
I20260709 13:11:37.213722   504 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:37.214257   504 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.216300   504 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:37.218604   502 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:37.222277   491 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:37.165613 32762 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.223886 32762 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:37.185719 32717 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:37.178046 32618 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:37.230317 32618 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:37.231158 32618 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.233096   484 raft_consensus.cc:3055] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:37.233469   484 raft_consensus.cc:740] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:37.234266   484 consensus_queue.cc:260] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.235345   484 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:37.222303   408 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:37.237609 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 546747us
I20260709 13:11:37.239852 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:37.241734 32491 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:37.241487   448 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:37.244349 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:37.245347 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 60654.9us
I20260709 13:11:37.242134 32491 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:37.249353 32491 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:37.251120   503 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:11:37.254515   450 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.255142   504 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:37.255928   491 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.002s
W20260709 13:11:37.259009   517 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:11:37.259625   473 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:37.260577   473 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.261178   327 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.261722   327 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.264187 24667 raft_consensus.cc:1240] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:37.264783 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.272890 24668 raft_consensus.cc:1275] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:37.275134 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:37.288352 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.291723 24669 raft_consensus.cc:1275] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:11:37.293807 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.294569 24670 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:37.298022 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:37.300276 24490 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:37.301710 24665 raft_consensus.cc:1275] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:37.284986   450 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:37.341363 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:37.373612 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:37.375662 24668 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
W20260709 13:11:37.351517 25182 leader_election.cc:336] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.376962 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:37.377707 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 137912us
W20260709 13:11:37.381498 25182 leader_election.cc:336] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.381973 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:37.349843   526 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:11:37.394794 25182 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.345968   408 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:11:37.385560 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 44305.8us
I20260709 13:11:37.396474 24665 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:11:37.451824 24665 pending_rounds.cc:85] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 13
I20260709 13:11:37.452121 24665 pending_rounds.cc:107] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:11:37.452373 24665 raft_consensus.cc:2889] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.454222 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:37.396394 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:37.395552 25182 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:37.302845   491 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 13:11:37.419521   492 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.420771   501 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.426836 32757 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:37.427781 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:37.348990   400 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:37.463850 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 69081.4us
W20260709 13:11:37.473454 25182 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.474056 25182 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:37.464365 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:37.374852   527 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:37.337553   420 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:37.373142 32751 raft_consensus.cc:3055] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 28 LEADER]: Stepping down as leader of term 28
W20260709 13:11:37.477846 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 50157.1us
W20260709 13:11:37.479615 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.480583 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.486415 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:37.385037   426 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:37.346485   327 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.393778   493 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:11:37.487916 25182 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.488538 24639 leader_election.cc:400] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22.
I20260709 13:11:37.489197 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.499567 24639 leader_election.cc:403] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:11:37.468446   356 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.493384 24596 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:37.435216   526 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 25 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:37.464275   487 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.468218   411 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:37.501240 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.541718 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:37.491520 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.529760 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:37.531605 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 46444.9us
W20260709 13:11:37.532181 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44296.1us
I20260709 13:11:37.372555   450 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:37.540525 24637 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:37.490741   425 consensus_meta.cc:287] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:11:37.486641 32751 raft_consensus.cc:740] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:37.488933   479 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:37.555660 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:37.499907   524 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:37.553891 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:37.500033   495 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.544422 24639 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:37.482512   400 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.567806 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:37.569155 24491 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:37.573367 25211 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:37.490000 32491 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.549835   514 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.569350 24596 raft_consensus.cc:2468] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:37.545173   327 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 21. Current term is 22.
I20260709 13:11:37.554979   421 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:37.549944   473 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:37.479148   501 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.585575 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.477427   492 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.499348   420 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.396067   502 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:37.543753   356 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.592835 24668 raft_consensus.cc:1240] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 13:11:37.551100   487 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.577692   479 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:11:37.599576 24637 leader_election.cc:336] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.586712   477 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:37.594784   449 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:11:37.557309   431 consensus_queue.cc:1048] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.304s
I20260709 13:11:37.580221   489 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:37.591315   448 raft_consensus.cc:2804] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:37.587239 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 236365us
I20260709 13:11:37.607303 24665 raft_consensus.cc:2393] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 26: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:37.574980   493 consensus_queue.cc:1059] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.027s
W20260709 13:11:37.607062 24637 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.567488   425 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.578760   495 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.590701   454 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:37.673840 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66808.7us
I20260709 13:11:37.673940 25211 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:37.684473 24669 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:37.686393 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:37.691982 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:37.672770   531 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:11:37.595583   421 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.703930 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:37.604368   473 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.704706 25211 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:37.677021   448 raft_consensus.cc:697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:11:37.698262   506 log.cc:927] Time spent T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:37.591506   514 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.719645 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:37.725113 25211 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:37.705361   327 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:37.726052 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:37.603729 32751 consensus_queue.cc:260] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.712592   547 raft_consensus.cc:3055] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:37.731693 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:37.741801 25211 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:37.732798   421 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:37.734712   532 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:11:37.738380 25182 leader_election.cc:336] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.749719 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:37.696555   454 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.713065 32566 consensus_queue.cc:1048] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.019s
I20260709 13:11:37.739321 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:37.740432 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:37.709913 32716 consensus_queue.cc:1048] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:11:37.607031   526 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.736012   450 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.765795 24490 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:37.741492   547 raft_consensus.cc:740] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
W20260709 13:11:37.764909 25182 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.769114 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:37.757664   524 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:37.770948 24490 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:37.776000 25211 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:37.744778   332 consensus_queue.cc:1059] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:11:37.739387   327 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:37.796324 24674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.017s
W20260709 13:11:37.796671 24674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.000s	sys 0.017s
I20260709 13:11:37.768491   420 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:37.785987   535 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:11:37.786232   411 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.767957   493 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:37.782747   356 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.775115 32751 raft_consensus.cc:3060] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:11:37.810868   536 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:11:37.813506 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:37.814419   501 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:37.797333   487 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.789186 24490 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:37.768169   314 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 13:11:37.779193   304 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.002s
W20260709 13:11:37.780086 25182 leader_election.cc:336] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.799957   473 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:37.781834   502 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:37.795527   408 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:37.805754   548 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:37.806993   534 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:11:37.807677 25215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48942 (request call id 1835) took 1645 ms (client timeout 1853 ms). Trace:
I20260709 13:11:37.808701   514 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.809044   429 raft_consensus.cc:3055] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:37.816802   493 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:37.851616 32628 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.000s
I20260709 13:11:37.818737 25210 raft_consensus.cc:1275] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:11:37.816735 32566 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:11:37.822521 25182 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:37.721892   479 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.848090   449 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:37.810571   552 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:37.667490   477 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.844555 24490 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:37.852770 25215 rpcz_store.cc:269] 0709 13:11:36.162092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.162411 (+   319us) service_pool.cc:224] Handling call
0709 13:11:37.807475 (+1645064us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54005d02d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:37.807619 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150963456}
I20260709 13:11:37.810132   492 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:37.818404   495 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:37.804704   411 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.845892   425 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.855557   548 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.895171   548 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.860538 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:37.810633   337 consensus_queue.cc:1048] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:11:37.897941 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:37.855643   429 raft_consensus.cc:740] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:37.898598 25215 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
W20260709 13:11:37.865734 32762 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 13:11:37.865943   327 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:37.868439   484 consensus_meta.cc:287] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
I20260709 13:11:37.860333 32628 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:37.871356   540 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:11:37.791482   448 consensus_queue.cc:237] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:37.786001   547 consensus_queue.cc:260] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.900127   493 raft_consensus.cc:2804] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:37.863334   552 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:37.892446 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:37.923066 24596 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:37.893226 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:37.879037 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.902977 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:37.903662 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81158.3us
I20260709 13:11:37.911829   427 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:37.878453 25214 raft_consensus.cc:1240] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 24. Current term is 25. Ops: []
W20260709 13:11:37.905289 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:37.937579 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:37.938076 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:37.934890   544 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:11:37.939416 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:37.940675 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:37.943181 25214 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:37.943421 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:37.918537   454 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:37.921631   493 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:37.961747   493 raft_consensus.cc:3060] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:37.953754 25214 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:37.951835   484 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.959359   472 raft_consensus.cc:493] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.964962 24490 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:37.965409 24639 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:37.925952   552 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:37.944811   429 consensus_queue.cc:260] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.973878 32757 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:37.974293   429 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:37.974398 32757 raft_consensus.cc:697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 25 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:37.975313 32757 consensus_queue.cc:237] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:37.945308   547 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:37.972294 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:37.972987   411 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:37.973204   551 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:11:37.981323 25210 raft_consensus.cc:1240] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:37.954020   426 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.998126 25217 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 17. (term mismatch)
I20260709 13:11:38.003664 25217 pending_rounds.cc:85] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 16
I20260709 13:11:38.003997 25217 pending_rounds.cc:107] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 25.17
I20260709 13:11:38.004277 25217 raft_consensus.cc:2889] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:37.979210   484 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.000087   548 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:38.011224 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:38.012470 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:37.982252   472 raft_consensus.cc:515] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.001940 32628 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.007727 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:38.015239 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:37.957609   488 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:37.969929   474 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:37.971052   449 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:38.019311   560 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:11:37.972939   477 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:38.021235 25210 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:38.032157 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.014494 32751 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:38.010576   548 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.021914   356 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:38.056797 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.020653   314 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:38.032948   449 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.073388 25210 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:38.075053 24669 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:11:38.048460 32628 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:11:38.061551   314 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.077682   314 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.058307   548 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:38.020435   514 consensus_queue.cc:1048] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:11:38.089951 25217 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:11:38.094730   493 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.095958   400 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:38.018026   426 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.025306   495 consensus_queue.cc:1059] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:11:38.084642   552 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.096278   449 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.158330   483 raft_consensus.cc:3055] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:38.158875   483 raft_consensus.cc:740] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:38.164453 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.108577   526 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.167577 24669 raft_consensus.cc:2410] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:11:38.043546   474 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.066067   356 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.112984   488 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:38.173063 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:38.154724   568 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:11:38.176530   562 log.cc:927] Time spent T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:11:38.178113   356 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:38.178535   426 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.179514   472 leader_election.cc:290] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.168138   484 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.181644   400 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:38.182242   400 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.184247   400 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:38.184731   552 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.154618   431 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:38.188019 23430 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 24550)
I20260709 13:11:38.154498   425 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.189442   488 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:38.170529 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 148429us
I20260709 13:11:38.190747 24669 raft_consensus.cc:2393] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 20: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
W20260709 13:11:38.192934   513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.013s	sys 0.010s
I20260709 13:11:38.199728 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:38.200495 25210 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.173528   479 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:38.206383 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.221715 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.222013   494 raft_consensus.cc:3055] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:38.222494   494 raft_consensus.cc:740] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:38.172848   526 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:38.205461   513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.013s	sys 0.011s
I20260709 13:11:38.226217 25210 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:38.226996 24669 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:38.202755   360 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.217142   421 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.316340 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.322398   426 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:38.322819   426 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.323154   426 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:38.196702   425 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.195187   431 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:38.328709 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 99261.5us
I20260709 13:11:38.315321   356 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:38.338949 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.337045 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:38.331190   493 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.331539   474 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.255266   479 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.372538   552 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.328198   421 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.367738 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:38.362107   572 log.cc:927] Time spent T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:11:38.237639   494 consensus_queue.cc:260] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.393586   495 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.396126   494 raft_consensus.cc:3060] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.396471   495 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.386124   400 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:38.383351   493 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:38.401620 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.394040   573 log.cc:927] Time spent T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:11:38.341436   360 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.373172   552 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.403677 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.344779   356 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:38.402711   580 log.cc:927] Time spent T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:11:38.411777   449 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.419365   360 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.423651   314 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.425836   431 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.428548   356 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.432266   552 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.435277   479 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:38.436460   425 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.443008   360 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.443503   360 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.444098   548 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.405954   493 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:38.445628   360 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.398954   400 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.445966   493 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.447811   400 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.449674   526 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.450325   474 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.450856   474 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.452423   314 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.452911   474 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.454280 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.454785 24666 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:38.465153 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.459671   431 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:38.457522   530 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:38.466097 24666 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:38.458539   552 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:38.458386   474 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:38.473600   520 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.283s	user 0.000s	sys 0.009s
W20260709 13:11:38.474255 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.474004   474 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:38.475543   521 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.265s	user 0.000s	sys 0.003s
I20260709 13:11:38.472501   581 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:38.477288   426 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.478482 25210 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:11:38.477777   581 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.459879   400 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:38.479305   400 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.473636   552 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:38.483163   552 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:38.477782   529 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.923s	user 0.002s	sys 0.001s
I20260709 13:11:38.468364   431 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.478122 25216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2227) took 1566 ms. Trace:
I20260709 13:11:38.485599   495 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.487723   431 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.487056 25216 rpcz_store.cc:276] 0709 13:11:36.911359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.911498 (+   139us) service_pool.cc:224] Handling call
0709 13:11:36.911916 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.963116 (+ 51200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.963145 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:36.979309 (+ 16164us) log.cc:844] Serialized 26 byte log entry
0709 13:11:37.072716 (+ 93407us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:37.072775 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:37.072864 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:38.474898 (+1402034us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:38.477836 (+  2938us) raft_consensus.cc:1685] finished
0709 13:11:38.477857 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.478048 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98724,"raft.queue_time_us":42740,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":14592,"spinlock_wait_cycles":141772032,"thread_start_us":65229,"threads_started":1,"wal-append.queue_time_us":181675}
I20260709 13:11:38.488708   426 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.470546   530 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.489573 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.490131 25216 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:38.491056   530 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.493688 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.494483 25213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1785) took 1109 ms. Trace:
I20260709 13:11:38.494884 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.494851 25213 rpcz_store.cc:276] 0709 13:11:37.384763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.385274 (+   511us) service_pool.cc:224] Handling call
0709 13:11:37.385520 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.604979 (+219459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:37.605011 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:37.605061 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:37.605125 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.494294 (+889169us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540066bf54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:38.494335 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.494429 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504264576}
W20260709 13:11:38.496012 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.497656 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.502411 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.510462 24667 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:38.511572 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.512295 24667 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:38.496225 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.499056 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.515620 25216 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:38.516454 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:38.517272 25216 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.513852 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.525197 24591 raft_consensus.cc:1240] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:38.528101 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:38.529045 25213 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:38.501099   449 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.532346 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:38.533514 24597 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:38.533882 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:38.534505 24666 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:38.542006 24591 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:11:38.547089 24596 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:38.500005   548 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.508057   495 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:38.521920 32559 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:38.561906 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.523288   474 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.531443   426 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:38.566035 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.566862 24599 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:38.566941 24591 raft_consensus.cc:1240] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:38.573648   581 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.575016 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:38.575906 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.576591 32703 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:38.559141   513 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.577781 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:38.578469 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:38.579353   563 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:38.579799 24565 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:38.580675   563 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:11:38.580332 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.581269   563 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:38.582247 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:38.582659 25210 raft_consensus.cc:3055] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:38.584808 25210 raft_consensus.cc:740] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:38.585629 25210 consensus_queue.cc:260] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.586539 25210 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:38.586867 32491 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:38.587604   509 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.360s	user 0.001s	sys 0.002s
I20260709 13:11:38.589840   314 consensus_queue.cc:1059] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:38.590530 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2226) took 1788 ms. Trace:
I20260709 13:11:38.591138   314 raft_consensus.cc:3055] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:11:38.592011   314 raft_consensus.cc:740] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:38.590961 25212 rpcz_store.cc:276] 0709 13:11:36.802502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.802636 (+   134us) service_pool.cc:224] Handling call
0709 13:11:36.802940 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.815686 (+ 12746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.815738 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:36.816449 (+   711us) log.cc:844] Serialized 26 byte log entry
0709 13:11:36.948782 (+132333us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:36.948847 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.948936 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:38.586598 (+1637662us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:38.590231 (+  3633us) raft_consensus.cc:1685] finished
0709 13:11:38.590255 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.590471 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12295,"raft.queue_time_us":13397,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":14114,"spinlock_wait_cycles":87840512,"thread_start_us":88676,"threads_started":1,"wal-append.queue_time_us":321467}
W20260709 13:11:38.597064   516 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 1.409s	user 0.000s	sys 0.005s
I20260709 13:11:38.598697   483 consensus_queue.cc:260] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.599967   483 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:38.577466   513 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.583487 32703 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:38.601609 25219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2218) took 2074 ms. Trace:
I20260709 13:11:38.602881   513 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:38.581192   579 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:11:38.602023 25219 rpcz_store.cc:276] 0709 13:11:36.527665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.527776 (+   111us) service_pool.cc:224] Handling call
0709 13:11:36.545184 (+ 17408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:36.946298 (+401114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:36.946342 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:36.946969 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:11:36.985255 (+ 38286us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:36.985294 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:36.985501 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:38.584950 (+1599449us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:38.601306 (+ 16356us) raft_consensus.cc:1685] finished
0709 13:11:38.601330 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.601547 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12994,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":2801,"spinlock_wait_cycles":192863488,"thread_start_us":438372,"threads_started":2,"wal-append.queue_time_us":240849}
I20260709 13:11:38.582442   563 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:38.610610   528 log.cc:927] Time spent T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 1.417s	user 0.004s	sys 0.000s
I20260709 13:11:38.613528 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:38.614213 24593 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:38.614694 24597 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:38.618638 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.625880 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:38.626610 24597 raft_consensus.cc:2393] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 25: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:38.626515 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.626448 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:38.625154 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.628842 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.630882 24667 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:38.631702 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.632562 24596 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:38.634109 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.621358 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.634807 25210 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 13:11:38.635188 25210 pending_rounds.cc:85] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 17
I20260709 13:11:38.630086 25213 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:38.564143 32559 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.563751   344 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.639855 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.635233 24599 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:38.643915 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.645182 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:38.627920 24597 raft_consensus.cc:1240] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 19. Current term is 20. Ops: [18.10-19.11]
I20260709 13:11:38.650779 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.650977 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.650882   314 consensus_queue.cc:260] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.566746   426 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:38.565498   425 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.651481 24600 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:38.635524 25210 pending_rounds.cc:107] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 13:11:38.638366 24490 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.566112   495 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.651721 25219 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:38.928256   421 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:38.928655   524 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:38.921558 32757 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:38.928920 25184 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:38.929420 32757 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.930053 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.931226   425 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.931648 32757 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.932297   430 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:38.932700 25219 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:38.898725 24668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4151) took 1076 ms. Trace:
I20260709 13:11:38.922441 24671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4145) took 1110 ms. Trace:
I20260709 13:11:38.933311   425 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:38.701632 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 61865.9us
W20260709 13:11:38.935520 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 297215us
W20260709 13:11:38.936097 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.771849 25183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.707713 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.777433 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.934471 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:38.814002 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.766479 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:38.767799 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.738590 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.797678 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:38.786760   592 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:38.779390   400 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.732309 24666 raft_consensus.cc:2468] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:38.944566 24665 raft_consensus.cc:1240] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:11:38.763976 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.947568   495 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:38.829130 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:38.782680 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:38.707008 25216 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:38.830849 25211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1850) took 1374 ms. Trace:
I20260709 13:11:38.951089 25184 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:38.952464   420 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:38.720103 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.952817 32762 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.771272   553 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:38.989534 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4157) took 1018 ms. Trace:
I20260709 13:11:38.956328   392 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:38.771773 25182 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:38.757884   575 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
W20260709 13:11:38.824945   522 log.cc:927] Time spent T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 1.595s	user 0.000s	sys 0.005s
I20260709 13:11:38.997779 25218 raft_consensus.cc:1240] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:38.990568 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.957660 24673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4154) took 1055 ms. Trace:
I20260709 13:11:39.001014 24673 rpcz_store.cc:276] 0709 13:11:37.901896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.393488 (+491592us) service_pool.cc:224] Handling call
0709 13:11:38.393798 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.395341 (+  1543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.395361 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.403407 (+  8046us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.628877 (+225470us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:38.628916 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.913964 (+285048us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5400409f54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:38.914029 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:38.957301 (+ 43272us) raft_consensus.cc:1685] finished
0709 13:11:38.957328 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.957589 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":2750720,"thread_start_us":169230,"threads_started":1,"wal-append.queue_time_us":511126}
W20260709 13:11:39.003000 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:38.990103 24667 rpcz_store.cc:276] 0709 13:11:37.971612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.632018 (+660406us) service_pool.cc:224] Handling call
0709 13:11:38.632473 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.632930 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:38.717220 (+ 84290us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.989094 (+271874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.989161 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:38.989231 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.989317 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.989467 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30376,"prepare.queue_time_us":73466,"spinlock_wait_cycles":37254400,"thread_start_us":241018,"threads_started":1,"wal-append.queue_time_us":241385}
W20260709 13:11:38.967885 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 383534us
I20260709 13:11:38.867700 24593 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:38.973420 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.004573 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:39.005337 24593 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:38.933462 24668 rpcz_store.cc:276] 0709 13:11:37.822488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.047096 (+224608us) service_pool.cc:224] Handling call
0709 13:11:38.057197 (+ 10101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.181399 (+124202us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:11:38.181691 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.333381 (+151690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:38.333448 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:11:38.333513 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.898436 (+564923us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400048dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:38.898494 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.898650 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":624,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1291,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":2349,"spinlock_wait_cycles":285119232,"thread_start_us":150405,"threads_started":1,"wal-append.queue_time_us":218034}
I20260709 13:11:38.977706 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:38.978822 25217 raft_consensus.cc:3060] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:38.979832 25210 raft_consensus.cc:2889] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:39.010362 24565 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.970468 25185 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.604200   488 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:38.638202 32491 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.985836 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.979254 25211 rpcz_store.cc:276] 0709 13:11:37.456838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.789842 (+333004us) service_pool.cc:224] Handling call
0709 13:11:37.790072 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:37.857579 (+ 67507us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 13:11:37.874359 (+ 16780us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.042891 (+168532us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.043479 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.043617 (+   138us) raft_consensus.cc:1645] Marking committed up to 20
0709 13:11:38.045455 (+  1838us) log.cc:844] Serialized 14 byte log entry
0709 13:11:38.045828 (+   373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.162691 (+116863us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18003754c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:38.451896 (+289205us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b18003754c0. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17c1d21de1 00007f17c1d2e5b1 00007f17b8e593f3 00007f17b8e5b7c1 00007f17b8e5b779 00007f17b8e5b709 00007f17b8e5b6d1 00007f17b8e5a9cd 000000000038f354 000000000038f199 00007f17b8e3c83a
0709 13:11:38.830466 (+378570us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b54005780d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:38.830531 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:38.830594 (+    63us) raft_consensus.cc:1685] finished
0709 13:11:38.830614 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.830781 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17975,"prepare.queue_time_us":29821,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":75,"raft.queue_time_us":18342,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":12588,"spinlock_wait_cycles":155164416,"thread_start_us":125382,"threads_started":1,"wal-append.queue_time_us":249012}
W20260709 13:11:38.987387 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 204826us
W20260709 13:11:38.787587   589 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:38.994866   524 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:38.995122 24665 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:11:38.997349 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:39.004678 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.052843 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:38.933549 24671 rpcz_store.cc:276] 0709 13:11:37.811573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.812326 (+   753us) service_pool.cc:224] Handling call
0709 13:11:37.812609 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:37.898997 (+ 86388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:37.899027 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:37.899065 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:37.899104 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.922152 (+1023048us) spinlock_profiling.cc:243] Waited 86.1 ms on lock 0x7b5400404a54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:38.922206 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:38.922370 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198045440}
I20260709 13:11:38.938107 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.921815   356 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:39.054215 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 116174us
I20260709 13:11:38.974161   426 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:39.045780 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 70303us
I20260709 13:11:38.651897 32559 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:38.933696 32757 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:39.026443 25211 raft_consensus.cc:1275] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:11:39.036808 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 66410.7us
I20260709 13:11:39.044770 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:38.981320   472 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:39.059020 25211 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:11:38.986588   476 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:39.067889 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.068679 24597 raft_consensus.cc:2410] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:11:39.070071 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.074091 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.060968 24490 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:38.998049   492 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.089090 24593 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:38.988734 32717 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.077091 25217 raft_consensus.cc:2468] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:38.998287   548 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.091131 24595 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:39.013952   411 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:39.045388   448 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.095361 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.061043   429 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:39.060894   513 raft_consensus.cc:2804] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:39.096100 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "869c3dc61dc04d64adba5e6ab84e5d83" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.054708   524 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:39.105726 25182 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.119004 25182 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:39.100792 24563 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.119699 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:39.110097 24669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4156) took 1151 ms. Trace:
I20260709 13:11:39.064386   400 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:39.075680   554 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:38.988487   420 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.980613   344 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:38.996665 32762 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.043598   392 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.064145 32757 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:39.090780 32618 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:39.079588   479 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.094288   492 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.094209   332 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 13:11:39.124272   581 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:39.013581   553 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:39.122802 25182 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.066428   504 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.142753 25214 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 18. (term mismatch)
I20260709 13:11:39.094437   472 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:39.125842 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:39.143150 25214 pending_rounds.cc:85] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 17
I20260709 13:11:39.114533 32717 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.127430 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:39.114883   548 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.117816 24595 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 22. Current term is 23. Ops: [21.17-22.18]
I20260709 13:11:39.073873   356 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.161660 24592 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:11:39.118448   429 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.118522   448 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:39.122714   554 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.128963   481 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:11:39.165676   429 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:39.173017   356 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.178829   344 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.184527   553 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:39.189851   314 raft_consensus.cc:3060] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:39.190507   492 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:39.190789 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.194262 24674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4149) took 1373 ms. Trace:
I20260709 13:11:39.195669 32559 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.199208   429 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.122514   400 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:39.141352 25210 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:11:39.141726 25182 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:39.143450 25214 pending_rounds.cc:107] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:11:39.214044 25214 raft_consensus.cc:2889] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:39.061193 32491 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.128690   513 raft_consensus.cc:697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:39.145942   420 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.148804   390 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:39.152410 32762 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.118110   411 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.155224 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:39.156049 24600 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:39.134858   530 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:39.160950 24595 raft_consensus.cc:1275] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:11:39.120297 24669 rpcz_store.cc:276] 0709 13:11:37.958618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.422478 (+463860us) service_pool.cc:224] Handling call
0709 13:11:38.422784 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.423610 (+   826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.423642 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.424135 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.532086 (+107951us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:38.532128 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.532194 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.109896 (+577702us) raft_consensus.cc:1685] finished
0709 13:11:39.109916 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.110043 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":311,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":107572,"threads_started":1,"wal-append.queue_time_us":207614}
I20260709 13:11:39.137975   337 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:39.166401 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:39.216070   400 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:39.166621 25184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.202311   392 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.140853 32618 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:39.205534   548 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.206236   472 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.209179   554 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:39.211133 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:39.237524 24671 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
W20260709 13:11:39.211796 24563 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.140080 24593 raft_consensus.cc:1240] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:39.194664 24674 rpcz_store.cc:276] 0709 13:11:37.820440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.043632 (+223192us) service_pool.cc:224] Handling call
0709 13:11:38.493255 (+449623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:38.493733 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:38.493776 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:38.494386 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:11:38.629273 (+134887us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:38.629330 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:38.629458 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:39.192427 (+562969us) raft_consensus.cc:1685] finished
0709 13:11:39.192482 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.193977 (+  1495us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540044e150. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:39.194182 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3052,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":1033255680,"thread_start_us":134427,"threads_started":1,"wal-append.queue_time_us":640138}
I20260709 13:11:39.188417   476 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:39.215586 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:39.216499 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 93715.7us
W20260709 13:11:39.252476 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:39.218845 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.137701   479 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.225379 24672 raft_consensus.cc:2410] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:11:39.159097   504 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:39.219301   497 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:39.220208   390 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.253185 24596 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:39.240463 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:39.230908   481 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.262593 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:39.278859 25212 raft_consensus.cc:1240] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:39.267163   390 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:39.268383 32566 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.397872 24666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44436 (request call id 2709) took 1226 ms. Trace:
I20260709 13:11:39.401420 24666 rpcz_store.cc:276] 0709 13:11:38.171908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.993124 (+821216us) service_pool.cc:224] Handling call
0709 13:11:39.062047 (+ 68923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.204788 (+142741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.204833 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.204883 (+    50us) raft_consensus.cc:1645] Marking committed up to 20
0709 13:11:39.204932 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.397571 (+192639us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540017eb54. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:39.397631 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.397794 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327735680}
I20260709 13:11:39.264484   420 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:39.403185   420 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.403712   420 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:39.404735   483 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.003s
I20260709 13:11:39.406093   430 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.406996   430 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.413123 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:39.414072   497 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.414601   476 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:39.414593   497 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.415198   483 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.415827   483 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.418138   483 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.416764   430 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.416837   497 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.422467 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:39.423269 24672 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:39.425450 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:39.426769 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:39.428170   497 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:39.428709   497 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.429219   497 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:39.266871   504 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.268926   429 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.396055   480 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:39.471549   590 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.459s	user 0.000s	sys 0.002s
I20260709 13:11:39.475920 32717 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.477524 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:39.478183 25214 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:39.280874   481 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.445233 32559 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.480808 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:39.483124 25214 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:39.482218 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:39.485530 32757 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:39.485788   504 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:39.486783 25185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:39.284759 24563 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.488094 24563 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:39.493201 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:39.494654 24491 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:39.496158 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:39.499847 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:39.265513 32618 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.442904 32566 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.513839 25214 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
W20260709 13:11:39.514262 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 229519us
I20260709 13:11:39.503489   314 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:39.515275 24490 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:39.286374   513 consensus_queue.cc:237] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.491926   504 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.491545   483 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.527812 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:39.467178   480 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.506856   490 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:39.512475 32559 raft_consensus.cc:3060] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:39.534647 24670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52138 (request call id 1904) took 1436 ms. Trace:
I20260709 13:11:39.641916 24670 rpcz_store.cc:276] 0709 13:11:38.098692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.775502 (+676810us) service_pool.cc:224] Handling call
0709 13:11:38.948767 (+173265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:38.949064 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:39.128911 (+179847us) log.cc:844] Serialized 14 byte log entry
0709 13:11:39.534210 (+405299us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:39.534281 (+    71us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:39.534356 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.534440 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:39.534579 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":446725,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":53,"raft.queue_time_us":104,"raft.run_cpu_time_us":1172,"raft.run_wall_time_us":5209,"thread_start_us":577130,"threads_started":2}
W20260709 13:11:39.535148 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 421160us
I20260709 13:11:39.519763   429 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:11:39.535753 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 443090us
W20260709 13:11:39.536550 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 473414us
I20260709 13:11:39.528527 32491 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.520179   332 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:11:39.531517   411 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:39.534354   448 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:39.573755   481 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.574220 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:39.575461 32566 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:39.584792   602 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:11:39.586199   426 consensus_meta.cc:287] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.001s
I20260709 13:11:39.554973   524 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.599419   476 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:39.537385 24563 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:39.676589 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 139246us
I20260709 13:11:39.613045   497 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:39.677300 24563 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:39.678257 24563 leader_election.cc:336] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.678673 24563 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:39.611932   479 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:39.634420 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 119224us
W20260709 13:11:39.638042 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 110314us
I20260709 13:11:39.657030 25216 raft_consensus.cc:1240] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:11:39.657557 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:39.688439 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:39.661161 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:39.689159 24563 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:39.661295 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:39.662487 24637 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:39.664328 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 411492us
I20260709 13:11:39.635798   504 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:39.696136 24639 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:39.592984   360 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.696920   448 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:39.639936   449 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:39.697393   611 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:39.697593   448 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:39.698071   449 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:39.698264   448 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:39.698954   449 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.699249   448 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.700309   497 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:39.689733 24563 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.694240 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:39.694947 25182 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:39.720726 24637 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.720979 25182 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:39.697361   360 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.641515   605 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:39.724248   411 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:11:39.724992   360 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.724887   411 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.725616   411 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.727643   411 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:39.723161 25182 leader_election.cc:336] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.728781 25182 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:39.729481 25212 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:39.687336 23430 tablet_replica.cc:333] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
W20260709 13:11:39.721961 24563 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.736658 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:39.736886 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:39.737310 25216 raft_consensus.cc:2468] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 25.
I20260709 13:11:39.737694   563 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:39.738284 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:39.739351 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:39.740453   497 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:39.739351 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:39.741969 25216 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:39.640460   483 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.692863   332 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.675884   426 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.745750 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:39.722501 24637 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:39.764197 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:39.744377   598 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:11:39.773545 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 52858.3us
W20260709 13:11:39.774441 24637 leader_election.cc:336] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:39.784180 32491 consensus_queue.cc:1059] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:39.690869   476 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.789956   411 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:39.793745   411 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:39.794090   411 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:39.797591 23430 raft_consensus.cc:2243] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:39.798466 23430 pending_rounds.cc:70] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:39.798628   426 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.798806 23430 pending_rounds.cc:77] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 21 index: 11 } timestamp: 7305636585154940928 op_type: NO_OP noop_request { }
I20260709 13:11:39.799445 23430 raft_consensus.cc:2889] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:39.799589 25213 raft_consensus.cc:2368] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:39.799925 23430 raft_consensus.cc:2272] T 869c3dc61dc04d64adba5e6ab84e5d83 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:39.787282   605 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:11:39.777813   479 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:39.802546   476 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.813128 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.813158   607 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.814973   607 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.815541   337 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:39.815992   337 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:39.785233 32491 raft_consensus.cc:3055] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:39.817343 32491 raft_consensus.cc:740] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:39.817502   607 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.818158 32491 consensus_queue.cc:260] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:39.818676 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.818813   527 consensus_queue.cc:1059] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:39.819391 32491 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:39.830257   483 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:39.830840   483 raft_consensus.cc:3055] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:39.831158   483 raft_consensus.cc:740] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:39.831939   483 consensus_queue.cc:260] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:39.842953 25211 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:39.782421 24639 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:39.852658 24418 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 248) took 63828 ms (client timeout 15000 ms). Trace:
I20260709 13:11:39.861927 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:39.868670 24666 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:39.862128 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:39.847597 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 58009.3us
I20260709 13:11:39.870049 24670 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:39.863003 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:39.863866 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:39.865396 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 83048.2us
W20260709 13:11:39.874174 25213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48918 (request call id 1809) took 1250 ms (client timeout 1570 ms). Trace:
W20260709 13:11:39.874723 25213 rpcz_store.cc:269] 0709 13:11:38.623473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.644956 (+ 21483us) service_pool.cc:224] Handling call
0709 13:11:39.873959 (+1229003us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400570dd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:39.874109 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651456384}
I20260709 13:11:39.880191 25216 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:39.833034   483 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:39.917681 24594 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:39.917460 24593 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260709 13:11:39.918254 24593 pending_rounds.cc:85] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 16
I20260709 13:11:39.918550 24593 pending_rounds.cc:107] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:11:39.918794 24593 raft_consensus.cc:2889] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:39.885115   554 consensus_meta.cc:287] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
W20260709 13:11:39.890169   612 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:11:39.925299 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.883564   479 raft_consensus.cc:2804] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:11:39.912431   390 consensus_meta.cc:287] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.003s
I20260709 13:11:39.781391   332 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:39.872380   614 log.cc:927] Time spent T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:11:39.931273 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48899.5us
I20260709 13:11:39.928874 24666 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:39.942057 25185 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:39.790793   481 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.128s
I20260709 13:11:39.917202   344 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:39.847227   314 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.083s
I20260709 13:11:39.950717 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.950801 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.963840 24594 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 18.
I20260709 13:11:39.979127 24670 raft_consensus.cc:2468] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:39.983405 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cd2633e79fe4d3498a4412c062bf875" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:39.990481 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:39.896178   548 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:11:40.000036 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.005962 25216 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:40.009028 24565 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:39.961968   472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.015s	sys 0.038s
I20260709 13:11:39.920496   492 consensus_queue.cc:1048] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:11:40.015038 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:39.949728   426 raft_consensus.cc:2804] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:40.015103 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:40.017050 24593 raft_consensus.cc:3060] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:39.994619 24419 catalog_manager.cc:5697] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.927810   554 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:40.019310 24419 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 23 to 24, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 24 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:39.948840   479 raft_consensus.cc:697] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 25 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:40.030016 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.030882 24666 raft_consensus.cc:2410] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:11:40.031864 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:39.995592   524 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:39.945801   552 consensus_queue.cc:1059] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 13:11:39.997499   476 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.017864   472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.015s	sys 0.038s
I20260709 13:11:40.035358 24593 raft_consensus.cc:2468] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:40.036013 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.051685 24672 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:40.037209 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.053185 24599 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 22: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:40.053041 23430 tablet_replica.cc:333] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:40.027062 24419 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:39.868371 24418 rpcz_store.cc:269] 0709 13:10:36.024422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.024682 (+   260us) service_pool.cc:224] Handling call
0709 13:11:39.852555 (+63827873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:37.149560 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:37.189885 (+ 40325us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:37.189957 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:11:37.189984 (+    27us) tablet.cc:662] Decoding operations
0709 13:11:37.190606 (+   622us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:37.190702 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:37.190741 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:37.191279 (+   538us) tablet.cc:701] Row locks acquired
0709 13:11:37.191335 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:11:37.191539 (+   204us) write_op.cc:270] Start()
0709 13:11:37.191721 (+   182us) write_op.cc:276] Timestamp: P: 1783602697191463 usec, L: 0
0709 13:11:37.191751 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:11:37.192622 (+   871us) log.cc:844] Serialized 925 byte log entry
0709 13:11:37.434812 (+242190us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17b8e3c0ac 00007f17c1c96ab9 00007f17b8e5869b 00007f17b8e5693f 00007f17b8e58c02 00007f17bbae020b
0709 13:11:38.013556 (+578744us) op_driver.cc:464] REPLICATION: finished
0709 13:11:38.077010 (+ 63454us) write_op.cc:301] APPLY: starting
0709 13:11:38.077133 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:38.079573 (+  2440us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:38.079616 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:38.080990 (+  1374us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:38.084719 (+  3729us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:11:38.084773 (+    54us) write_op.cc:312] APPLY: finished
0709 13:11:38.085050 (+   277us) log.cc:844] Serialized 33 byte log entry
0709 13:11:38.085903 (+   853us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.085992 (+    89us) write_op.cc:454] Released schema lock
0709 13:11:38.086052 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:38.086467 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.086499 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":63177,"apply.run_cpu_time_us":5426,"apply.run_wall_time_us":9434,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":363565,"prepare.run_cpu_time_us":36047,"prepare.run_wall_time_us":460738,"raft.queue_time_us":225440,"raft.run_cpu_time_us":2868,"raft.run_wall_time_us":29306,"replication_time_us":821645,"spinlock_wait_cycles":164391808,"thread_start_us":727708,"threads_started":4,"wal-append.queue_time_us":481797,"wal-append.run_cpu_time_us":15346,"wal-append.run_wall_time_us":1410879}]]}
I20260709 13:11:40.057863 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.058995 24666 raft_consensus.cc:2410] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 13:11:40.055886 24419 catalog_manager.cc:5697] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 22 to 26, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 26 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.027458 32717 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:40.018409   615 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:39.950218   605 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.079s
I20260709 13:11:39.947904   390 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.001405   429 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 13:11:39.981472   344 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:40.047523 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.066157 23430 raft_consensus.cc:2243] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:40.061697 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.101682 24672 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:40.026075   548 consensus_queue.cc:1243] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer 96002c98f2d142e4b67dc5105a06079c log is divergent from this leader: its last log entry 25.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:11:40.063742 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:40.068831 24419 catalog_manager.cc:5697] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 22, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 22 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.072551 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:40.073539 24668 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:40.073040 32566 raft_consensus.cc:3055] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:11:40.091840 24491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.015s
W20260709 13:11:40.110991 24491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.016s
I20260709 13:11:40.071645   615 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.096529 24671 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:11:40.096674 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 342024us
W20260709 13:11:40.061323   400 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.002s
W20260709 13:11:40.108363 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 44740.4us
W20260709 13:11:40.051831   420 consensus_meta.cc:287] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.646s	user 0.012s	sys 0.001s
I20260709 13:11:40.118816   420 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.077826 24592 raft_consensus.cc:1240] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:40.077414 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56014 (request call id 2394) took 1298 ms. Trace:
I20260709 13:11:40.072937 32559 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:40.121321 24599 rpcz_store.cc:276] 0709 13:11:38.778900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.073889 (+294989us) service_pool.cc:224] Handling call
0709 13:11:40.077168 (+1003279us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54001ed2d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf4a2fa 00007f17c0f0bb17 00007f17ba4866d4 00007f17ba486662 00007f17ba486591 00007f17ba48650c 00007f17ba4857c2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:40.077341 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245119232}
I20260709 13:11:40.112145 25215 raft_consensus.cc:1240] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 26. Current term is 27. Ops: []
I20260709 13:11:40.113662 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:40.123396 24666 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:11:40.115067 23430 raft_consensus.cc:2272] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.117098 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.116509 24419 catalog_manager.cc:5697] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.075428 32717 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.118040   400 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.125765 24671 raft_consensus.cc:2410] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 30 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 18.
I20260709 13:11:40.092036   552 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:40.052994   476 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.128437 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.126973 24419 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.145742   420 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:40.155418   619 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:40.157286 32717 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:40.157758 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.159264   400 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:40.136273   472 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:40.160046   608 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.087s	user 0.002s	sys 0.002s
I20260709 13:11:40.161826   332 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:40.111155   480 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:40.114655   430 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:40.160879 23430 tablet_replica.cc:333] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:40.183629 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.124485   615 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:40.124867   548 raft_consensus.cc:3055] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:11:40.187929 24489 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.012s	sys 0.024s
W20260709 13:11:40.206692 24489 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.012s	sys 0.025s
W20260709 13:11:40.189409 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.110577 32566 raft_consensus.cc:740] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:40.195488 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.210137 25214 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 18.
I20260709 13:11:40.188444 24419 catalog_manager.cc:5697] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 26 to 29, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 29 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.204402 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.170183   552 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:40.122854   479 consensus_queue.cc:237] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.239084 25217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48942 (request call id 1879) took 1080 ms. Trace:
I20260709 13:11:40.242319 24419 catalog_manager.cc:5697] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 26 to 28, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 28 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.205206 25216 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:11:40.115274   504 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.233644 23430 raft_consensus.cc:2243] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:40.202622 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 409923us
I20260709 13:11:40.176865 24666 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
W20260709 13:11:40.232311 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 316091us
I20260709 13:11:40.241925 25217 rpcz_store.cc:276] 0709 13:11:39.158198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.158341 (+   143us) service_pool.cc:224] Handling call
0709 13:11:39.158652 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.158988 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.159016 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.159418 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:11:39.616715 (+457297us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:39.616769 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.616862 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.152602 (+535740us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8d7fc85 00007f17b8d806a2 00007f17bbaf21db 00007f17bbaedaaf 00007f17bbae186e 00007f17bbae0bb6 00007f17bbae07d8 00007f17bbaea221 00007f17bbaea1d9 00007f17bbaea169
0709 13:11:40.230936 (+ 78334us) raft_consensus.cc:1685] finished
0709 13:11:40.230956 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.239021 (+  8065us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6113,"spinlock_wait_cycles":60418944,"thread_start_us":456942,"threads_started":1,"wal-append.queue_time_us":874378}
I20260709 13:11:40.246925 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.248144 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.253774 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:40.256698 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:40.256382 24419 catalog_manager.cc:5697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 21, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 21 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:40.259300 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:40.259980 24593 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 20: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:40.266780 24665 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 26: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:40.195508   472 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:40.271085 24491 leader_election.cc:304] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:40.272837 24419 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:40.215518 32618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.028s
W20260709 13:11:40.276225 24563 leader_election.cc:336] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.276206 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:40.280469 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:40.278697 24419 catalog_manager.cc:5697] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 23, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 23 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.280902 24674 raft_consensus.cc:3055] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:40.281270 24674 raft_consensus.cc:740] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:40.282737 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:40.282003 24419 catalog_manager.cc:5697] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 24, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 24 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.283885 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:40.284574 24670 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:40.206364   548 raft_consensus.cc:740] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:40.329798 23430 raft_consensus.cc:2272] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.330328 24419 catalog_manager.cc:5697] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:40.272045 24490 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:40.312384 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:40.281939 24674 consensus_queue.cc:260] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.336591 24674 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:40.313527   490 consensus_meta.cc:287] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.004s
I20260709 13:11:40.313645   554 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:40.314163 32566 consensus_queue.cc:260] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.315009   480 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:40.322918 24491 raft_consensus.cc:2686] T 8cd2633e79fe4d3498a4412c062bf875 P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:11:40.280303 32618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.006s	sys 0.033s
W20260709 13:11:40.346830   624 log.cc:927] Time spent T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:11:40.348008 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56014 (request call id 2377) took 1778 ms. Trace:
I20260709 13:11:40.348343 24597 rpcz_store.cc:276] 0709 13:11:38.569417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.092547 (+523130us) service_pool.cc:224] Handling call
0709 13:11:39.092832 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:39.540381 (+447549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:39.540415 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:39.540839 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:11:39.946088 (+405249us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:11:39.946130 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:39.946191 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:40.347816 (+401625us) raft_consensus.cc:1685] finished
0709 13:11:40.347837 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.347953 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34824,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3508,"thread_start_us":818382,"threads_started":2,"wal-append.queue_time_us":622222}
I20260709 13:11:40.324980 24667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44426 (request call id 4159) took 2100 ms. Trace:
W20260709 13:11:40.351423   623 log.cc:927] Time spent T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:40.350726 24667 rpcz_store.cc:276] 0709 13:11:38.224209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.047343 (+823134us) service_pool.cc:224] Handling call
0709 13:11:39.047667 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.047905 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:11:39.540935 (+493030us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.324574 (+783639us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.324638 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:40.324706 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.324786 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.324917 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":393426,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3506,"raft.queue_time_us":147304,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":7177,"spinlock_wait_cycles":2987776,"thread_start_us":1243601,"threads_started":3,"wal-append.queue_time_us":655757}
I20260709 13:11:40.221537 32554 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:40.358116 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 86136.3us
I20260709 13:11:40.363786 32618 raft_consensus.cc:2804] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:11:40.389197 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 118190us
I20260709 13:11:40.332769   524 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.332710 32757 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:40.390029 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:40.341573   490 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:40.332247 24419 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.310722 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:40.277110   449 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.111s
W20260709 13:11:40.415469 24563 leader_election.cc:336] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.422676 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:40.287047   400 consensus_queue.cc:1059] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.078s
I20260709 13:11:40.426530 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.429548 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.432533 25213 raft_consensus.cc:1240] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:40.433902 24563 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:40.389642 32618 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:40.424347 25218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1801) took 1802 ms. Trace:
I20260709 13:11:40.415473 24419 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 24. New cstate: current_term: 24 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:40.450453 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.451133 25214 raft_consensus.cc:2468] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 26.
I20260709 13:11:40.415477   430 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.444720 24419 catalog_manager.cc:5697] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 13 to 21. New cstate: current_term: 21 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:40.421440   390 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:40.431238 32559 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:40.461449 24419 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.441730 25218 rpcz_store.cc:276] 0709 13:11:38.621495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:38.998506 (+377011us) service_pool.cc:224] Handling call
0709 13:11:39.065492 (+ 66986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.065673 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:11:39.548324 (+482651us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.423727 (+875403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.423789 (+    62us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:11:40.423846 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.424063 (+   217us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.424264 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15880,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":35084,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4495,"thread_start_us":1294394,"threads_started":3,"wal-append.queue_time_us":673038}
W20260709 13:11:40.459164 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 43722.3us
I20260709 13:11:40.424314   497 raft_consensus.cc:2749] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:40.442706 32618 raft_consensus.cc:3060] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:40.466759 24419 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 24. New cstate: current_term: 24 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.416087   524 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:40.463536   488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.027s
I20260709 13:11:40.458153   476 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:40.435715   420 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:40.480830   504 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:40.394057 32554 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.475934 24419 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 19, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 19 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:40.440364   621 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
W20260709 13:11:40.478719   488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.027s
I20260709 13:11:40.469492 24670 raft_consensus.cc:2468] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:40.460985   400 consensus_queue.cc:1048] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:11:40.512527 24419 catalog_manager.cc:5697] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 26. New cstate: current_term: 26 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:40.513345 25212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.008s	sys 0.012s
W20260709 13:11:40.539536 25212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.009s	sys 0.012s
I20260709 13:11:40.461980   430 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:40.492352   629 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:11:40.478262   332 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:40.540000 24419 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:40.467779   632 consensus_queue.cc:1059] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.076s
I20260709 13:11:40.541491 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.482097   627 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.479012 32559 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.547856 24419 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 20, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 20 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:40.507745   426 raft_consensus.cc:697] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:40.505396   552 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:40.569744   648 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:40.570119   524 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:40.570259   648 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.573423   648 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:40.574743   483 consensus_meta.cc:287] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.002s
W20260709 13:11:40.555346 24637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:40.555601 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 238094us
I20260709 13:11:40.556641 24419 catalog_manager.cc:5697] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.579648 24419 catalog_manager.cc:5697] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:40.561667   635 log.cc:927] Time spent T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:11:40.562974   628 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:11:40.338678   448 consensus_queue.cc:1175] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "983693721af6486c97ece1410a90cf30" responder_term: 19 status { last_received { term: 16 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:40.566493   390 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:40.605384 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:40.606155 24673 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:40.607681 23430 tablet_replica.cc:333] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:40.608737 23430 raft_consensus.cc:2243] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:11:40.603659 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.613360 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.613955 24666 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:40.614686 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:40.617828 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 195299us
I20260709 13:11:40.619211 24491 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:40.567556 32554 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:40.567960   633 log.cc:927] Time spent T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:11:40.509044   472 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:40.490778   420 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.588008 24639 leader_election.cc:400] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:40.631242 24639 leader_election.cc:403] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:11:40.549824   639 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:40.625629 24672 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:40.575127 32559 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:40.609230   337 consensus_meta.cc:287] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.793s	user 0.007s	sys 0.015s
W20260709 13:11:40.634052 24491 raft_consensus.cc:2686] T 1cd63fe151734a9daa9146d5e744d8be P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:40.590049   450 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:11:40.638290 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 50464.5us
W20260709 13:11:40.669945 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 50811.2us
I20260709 13:11:40.670751 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:40.675284 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.677227 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:40.556514   627 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:40.594340 32757 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.070s
I20260709 13:11:40.692855 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.696692 24673 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:40.636973   621 raft_consensus.cc:493] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.693367 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:40.667377   472 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.685853   504 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:40.633213   632 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.664902   488 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.639928   653 raft_consensus.cc:493] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:40.623113   390 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.741590 24599 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:11:40.665628   649 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125) with higher term. Message: Invalid argument: T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for earlier term 25. Current term is 26.
I20260709 13:11:40.747385 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.748333 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.751425 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.767354 25219 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:40.752935 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:40.754997 25212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48926 (request call id 2250) took 1085 ms. Trace:
W20260709 13:11:40.758520 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.756333 25185 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:40.775132 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:40.771966 25212 rpcz_store.cc:276] 0709 13:11:39.669593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:39.835921 (+166328us) service_pool.cc:224] Handling call
0709 13:11:39.836244 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:39.836428 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:11:39.836721 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:11:40.754693 (+917972us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:40.754743 (+    50us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:11:40.754782 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:40.754842 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:40.754946 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3970,"prepare.queue_time_us":1287,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":7004,"raft.queue_time_us":30763,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":913565,"threads_started":2,"wal-append.queue_time_us":828262}
I20260709 13:11:40.776182 25211 raft_consensus.cc:2393] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:40.776170 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:40.783645 24563 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.782680   632 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.788424 25210 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:40.789552 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.789592 25213 raft_consensus.cc:2393] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:40.790753 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:40.791769 25215 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 26: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:40.684330   337 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:40.737227   642 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
W20260709 13:11:40.745607   411 consensus_meta.cc:287] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.951s	user 0.007s	sys 0.004s
I20260709 13:11:40.639461   639 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:40.796046 24563 leader_election.cc:336] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.818452 24563 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:40.818387 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 141243us
I20260709 13:11:40.820003 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:40.802446 25185 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:40.828454 24563 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 115 similar messages]
W20260709 13:11:40.829850 24563 leader_election.cc:336] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.830235 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:40.834939 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 55237.5us
W20260709 13:11:40.839056   625 log.cc:927] Time spent T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.719s	user 0.002s	sys 0.003s
I20260709 13:11:40.840195   658 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:11:40.840914   631 raft_consensus.cc:932] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Unable to handle notification of new term (27): Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:11:40.827998   654 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:40.841543   631 raft_consensus.cc:2804] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:40.841619   658 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.842049   631 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:40.842501   631 raft_consensus.cc:3060] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:40.844480 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.845409 23430 raft_consensus.cc:2272] T 28c13259bf74484588e0fb08995091cc P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:40.845801 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:40.685688   426 consensus_queue.cc:237] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.789319   431 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:40.848896 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:40.845602   647 log.cc:927] Time spent T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:11:40.740942   621 raft_consensus.cc:515] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:40.816833   524 raft_consensus.cc:2804] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:40.746085   472 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.856148   480 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:40.861610   644 log.cc:927] Time spent T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:11:40.862224   336 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:40.849574   658 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.777510   483 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 13:11:40.866261   430 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:40.862690   645 log.cc:927] Time spent T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:40.775285   488 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:40.900875 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 45405.1us
I20260709 13:11:40.854983   450 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:40.775873   653 raft_consensus.cc:515] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.880702   648 raft_consensus.cc:2804] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:40.825121   411 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:40.909336   661 log.cc:927] Time spent T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:11:40.824895   642 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.904289   524 raft_consensus.cc:697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:40.933661   655 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:40.858685   654 consensus_queue.cc:1059] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:11:40.946964   337 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:40.981787   654 raft_consensus.cc:3055] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:11:40.982235   620 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.863s	user 0.003s	sys 0.002s
I20260709 13:11:40.982327   654 raft_consensus.cc:740] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:40.983348   654 consensus_queue.cc:260] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.984637   654 raft_consensus.cc:3060] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:40.986518   648 raft_consensus.cc:697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:40.991992 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 143211us
W20260709 13:11:40.950481   626 log.cc:927] Time spent T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.831s	user 0.000s	sys 0.004s
W20260709 13:11:40.955559   622 log.cc:927] Time spent T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.734s	user 0.000s	sys 0.003s
I20260709 13:11:41.005586   666 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:40.954541   344 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.016575   488 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.017598   621 leader_election.cc:290] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.019141   642 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:40.954282   420 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:40.944401   548 consensus_queue.cc:260] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:40.948989 32566 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:40.958328   611 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Stepping down as leader of term 25
W20260709 13:11:41.011234 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 181403us
I20260709 13:11:41.012660 24566 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:41.022460 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:41.024331 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.006072 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 150624us
I20260709 13:11:41.036556 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:41.015290 24637 leader_election.cc:336] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:40.992601   431 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.004503   513 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:41.045606 24637 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.021219   390 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.028038   621 raft_consensus.cc:493] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.047658   670 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:41.054037   670 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.054420   670 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:41.054963   431 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.055269   658 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.062717 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.048296   524 consensus_queue.cc:237] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.011601   337 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.038s
W20260709 13:11:41.076330 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 61056.5us
I20260709 13:11:41.034672   611 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:41.072198 32491 consensus_meta.cc:287] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 1.252s	user 0.023s	sys 0.011s
I20260709 13:11:41.073580 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:41.065591   513 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.126748   653 leader_election.cc:290] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.134060   627 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.134806   643 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.136270   632 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.038002   648 consensus_queue.cc:237] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.180500   643 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.046365   548 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:11:41.077584 24637 leader_election.cc:336] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.185339 24637 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.185453   670 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:41.186204 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 108748us
W20260709 13:11:41.186853 24637 leader_election.cc:336] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.186897   639 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.137651   472 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.153263   479 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:11:41.148164   615 consensus_meta.cc:287] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.933s	user 0.005s	sys 0.024s
I20260709 13:11:41.070554   563 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:11:41.148401 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.128439   652 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:41.127660   680 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:11:41.150988 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 77516.5us
W20260709 13:11:41.161121 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.187479   670 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.188002   615 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.207965   643 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.208729 24592 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:41.170135 23430 tablet_replica.cc:333] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:41.148981 32559 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.153473   642 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:41.246338 25182 leader_election.cc:336] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:41.184819 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 148878us
I20260709 13:11:41.073839   621 raft_consensus.cc:515] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:41.248090 25182 leader_election.cc:336] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.239420 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:41.249310 25213 raft_consensus.cc:3060] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:41.201713 25214 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:11:41.199338 25219 raft_consensus.cc:1240] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:11:41.256258 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:41.261586 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:41.261974 25182 leader_election.cc:336] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.262506 25182 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:41.255963 24563 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.266723 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:41.204916 32618 consensus_meta.cc:287] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.004s
W20260709 13:11:41.274952 24490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.013s	sys 0.036s
W20260709 13:11:41.272753 25182 leader_election.cc:336] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:41.261847 24639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.188104   479 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:41.187305 24637 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.274010 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.188302   563 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:41.279554 24490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.013s	sys 0.040s
W20260709 13:11:41.285643 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 601592us
I20260709 13:11:41.286271 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.286841 24490 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:41.286958 25216 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
W20260709 13:11:41.283478 25182 leader_election.cc:336] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:41.288546 25182 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.290297 25182 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.271786   658 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:41.291407 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.292129 25213 raft_consensus.cc:2468] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:41.196395 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:41.293612 25182 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:41.299263 24563 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:41.299731 25182 leader_election.cc:336] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.299696 24563 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:41.300908 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 114079us
W20260709 13:11:41.301321 24563 leader_election.cc:336] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:41.301784 24637 leader_election.cc:336] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.301719 24563 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.300247 25182 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.302105 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.303404   390 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:41.304004   476 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:41.304992   479 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:11:41.307325   611 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.313925   680 consensus_queue.cc:1059] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:41.314934   670 raft_consensus.cc:3055] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:41.315303   670 raft_consensus.cc:740] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:41.316156 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:41.316087   670 consensus_queue.cc:260] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.317752   670 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:41.318895 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.322764   488 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:41.323550 32559 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:41.325583 24639 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:41.326335   682 raft_consensus.cc:2804] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:41.326807   682 raft_consensus.cc:697] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:41.326843   429 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:41.327800   682 consensus_queue.cc:237] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.328617 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:41.281491   411 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.330190   643 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:41.330291   607 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:41.330593   643 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.331004   643 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:41.332520   621 leader_election.cc:290] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.274892   337 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:41.295854   666 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:41.283121 32618 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.347894 32618 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.336501 25213 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:41.291244   450 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260709 13:11:41.349355   563 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.353046   513 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:41.338002 25210 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:41.355554   658 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:41.356082   658 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.358196   658 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:41.342535   652 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:41.361163   615 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:41.336714 24637 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.285965 32566 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:41.341570   420 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:41.345388   337 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.255004   642 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:41.353888   631 consensus_meta.cc:287] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:11:41.354979   611 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:41.362002 24667 raft_consensus.cc:2410] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 26 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
W20260709 13:11:41.378665 24640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.290016   426 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:41.303042 25182 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.362483 24637 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.363008 23430 raft_consensus.cc:2243] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:41.363698 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:41.365162 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 73820.3us
W20260709 13:11:41.372714 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 46115.1us
W20260709 13:11:41.382278 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 79248.9us
W20260709 13:11:41.385829 25182 leader_election.cc:336] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:41.386034 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 49369.9us
I20260709 13:11:41.382603 25213 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 24: Already voted for candidate 148dc963cec64232ad3b248abad6f36d in this term.
I20260709 13:11:41.386504 25182 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.364684   621 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:41.384294 24563 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.396543 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.392004 24596 raft_consensus.cc:1240] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 22. Current term is 23. Ops: []
I20260709 13:11:41.393497 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:41.397508 25213 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:41.369475 32566 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:41.411932 24637 leader_election.cc:336] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.413106 24637 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:41.414238 24637 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.414619 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.374006   615 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:41.431644   615 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.432482 24666 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260709 13:11:41.432875 24666 pending_rounds.cc:85] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 16
I20260709 13:11:41.323292   488 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:41.416531 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.437162 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.418826 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.419544 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:41.395488 32491 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:41.415599   480 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:41.420866 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.388748   666 consensus_queue.cc:1059] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:11:41.376091   420 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.389176   426 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.377065   548 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:11:41.452922 23430 raft_consensus.cc:2272] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.428712   337 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.430959   642 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.461167   426 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.469492 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:41.471240 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.433940 24666 pending_rounds.cc:107] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260709 13:11:41.473048   449 raft_consensus.cc:3055] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:41.473315 24666 raft_consensus.cc:2889] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.473687   449 raft_consensus.cc:740] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:41.474810   449 consensus_queue.cc:260] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:41.434170 24490 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:41.477445 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.477669 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:41.479059 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.479218 24490 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.439970   479 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:41.380347   631 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:41.472646 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.464790 25213 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:41.483364 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.435527 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:41.436290 24637 leader_election.cc:336] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.490711 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 30 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.491060 24637 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.439095   605 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:41.441164 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.438611 25214 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 28.
I20260709 13:11:41.495788 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:41.441820   448 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.444911 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:41.498289 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 62030us
I20260709 13:11:41.498313 24668 raft_consensus.cc:2410] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
W20260709 13:11:41.448494   684 log.cc:927] Time spent T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:11:41.499055 24637 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.445825 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 30 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.389448   658 raft_consensus.cc:2749] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:41.449697 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.416900 32566 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:41.438234   411 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:41.457194   420 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.458467 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:41.388172 25182 leader_election.cc:336] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:41.510555 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 122412us
W20260709 13:11:41.511480 25182 leader_election.cc:336] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.493027 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.431656   672 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.494010 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.482409 24592 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 27.
I20260709 13:11:41.496631 24599 raft_consensus.cc:3060] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:11:41.500090 24637 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.517906 24637 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.503880 24595 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:41.502106 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.504777 25211 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:11:41.505853 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.411865   621 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:41.507910 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.511333 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.381258   683 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:11:41.512426 25182 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.521673 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.522401 25216 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 25: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:41.488243   472 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:41.528925 24637 leader_election.cc:336] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.529489 24637 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:41.524880 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.526307 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:41.530652 24637 leader_election.cc:336] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.531304 24637 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.503353   479 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:41.517360 24490 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:41.495373 32618 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:41.539769 24637 leader_election.cc:336] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.510336   666 raft_consensus.cc:2804] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:11:41.544986 25182 leader_election.cc:336] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.527148 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:41.545493 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.543092 24637 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:41.535043   682 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:41.548556 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.551388 24599 raft_consensus.cc:2468] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:41.521552   642 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.558365 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.559922 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.560843 24599 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:41.560738 25211 raft_consensus.cc:2410] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c for term 26 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 13:11:41.554665 24637 leader_election.cc:336] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.527971   420 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:11:41.565510 24591 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:11:41.565887 24591 pending_rounds.cc:85] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Aborting all ops after (but not including) 15
I20260709 13:11:41.566114 24591 pending_rounds.cc:107] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:11:41.566371 24591 raft_consensus.cc:2889] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.562130 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:41.562700 24637 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:41.556587 24563 leader_election.cc:336] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.563115 25211 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:41.505339   448 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.535801   400 raft_consensus.cc:2749] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:41.570875 24599 raft_consensus.cc:2393] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 24: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:41.570446 24563 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.544900   666 raft_consensus.cc:493] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.547433   658 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:41.524780   411 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.557077   605 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:41.556864   683 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:41.529115   672 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.608191 24597 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:41.614657 25217 raft_consensus.cc:2410] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc for term 27 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
I20260709 13:11:41.610173 24598 raft_consensus.cc:1240] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 23. Current term is 24. Ops: [21.17-23.18]
W20260709 13:11:41.618021 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44179.8us
I20260709 13:11:41.620039 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:41.596735 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.566440   492 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:41.593058 23430 tablet_replica.cc:333] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:41.605399 24667 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:41.560712   481 consensus_queue.cc:1059] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:11:41.622239 25184 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.633478 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.622843 24592 raft_consensus.cc:1275] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:41.575320   610 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:41.613188 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:41.628254 24566 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:41.565596   642 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:41.637197 24490 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:41.612304   400 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:41.578159   666 raft_consensus.cc:3060] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:41.637034 24600 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
W20260709 13:11:41.636713 24563 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.577991   476 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:41.628031   683 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:41.644881   411 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:41.647688   642 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.623169   643 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.651943   672 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.658990   621 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.659837   488 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.621362   678 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:41.628266   659 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:41.661185   648 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:41.661580   691 log.cc:927] Time spent T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:41.662019   481 raft_consensus.cc:3055] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:11:41.662551 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.663750 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.723800 24596 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:41.664716 23430 raft_consensus.cc:2243] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.666427   615 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.641229   337 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:41.667722   426 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:41.635130   605 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:11:41.706662   659 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:41.714640 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:41.717201 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.719954 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.729163 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:41.744248 23430 raft_consensus.cc:2272] T c9f2117a17f2425cae9c436e59c94b96 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:41.760759 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:41.715245   648 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:41.715540   652 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:41.715229   680 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:41.722244   481 raft_consensus.cc:740] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:41.673452   632 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:11:41.760413   488 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:41.760895   659 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:41.706488   678 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.706512   642 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260709 13:11:41.781822 24672 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 25. Current term is 26. Ops: []
I20260709 13:11:41.769557   648 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:41.789356   632 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.794783   479 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.800747   448 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:41.820602 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 187223us
I20260709 13:11:41.821626 25184 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.773388   495 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:11:41.824923 23430 tablet_replica.cc:333] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
W20260709 13:11:41.825341 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 188229us
I20260709 13:11:41.775527   652 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:41.777894   680 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.826035 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:41.815896   632 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:41.837852 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.829186 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.834808 23430 raft_consensus.cc:2243] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:41.827504   411 raft_consensus.cc:2804] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:41.846042 24666 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:41.773265   683 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:41.853644   693 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:11:41.856525 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:41.861469 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.820528   479 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.869831 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:41.871197 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1f10582ce7411b8b3187da8ec646c8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.872041 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.866531 24665 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:41.812332   481 consensus_queue.cc:260] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:41.876528 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.882665 24669 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 28.
I20260709 13:11:41.882937 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:41.883327 24666 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:41.878293 24672 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 19.
I20260709 13:11:41.883502 24597 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 20.
I20260709 13:11:41.880424 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:41.899665 24674 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:11:41.902021 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
W20260709 13:11:41.882011   695 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:11:41.866381   699 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:11:41.906002 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2732386ac0bf488eb0fcc0893f0c9b0e" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:41.897390   688 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:11:41.916407   621 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.918480   479 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:41.909056   703 log.cc:927] Time spent T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
I20260709 13:11:41.896868   666 raft_consensus.cc:515] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:41.921722   666 leader_election.cc:290] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.914745   682 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:41.922103   611 consensus_meta.cc:287] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
I20260709 13:11:41.924023   488 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:41.892135   701 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 13:11:41.926961   678 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:41.903998   643 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:41.895439   702 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:41.896029   450 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:41.878938   411 raft_consensus.cc:697] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:41.959544 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 286674us
W20260709 13:11:41.947446 24490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.948448 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:41.954128 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee5aeb35a614558ad30ac67ec366dcf" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:41.927853   696 log.cc:927] Time spent T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 13:11:41.962435 25182 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.963348 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:41.964174 25182 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.964600 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:41.965685 25182 leader_election.cc:336] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.951421   513 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:41.966063 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:41.968022 24665 raft_consensus.cc:2393] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 25: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:41.960208   702 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:41.957683   701 consensus_queue.cc:1243] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 24.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
W20260709 13:11:41.972016 25182 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.977375 25182 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:41.979705 25182 leader_election.cc:336] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:41.980229 25182 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:41.917065   621 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:41.984051   621 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:41.985082   390 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:41.985949   390 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:41.989697 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:41.949599   710 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:11:41.987221 24490 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:41.969667   678 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:42.006839   680 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.012462   631 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.015420 24672 raft_consensus.cc:1275] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:42.016104 24669 raft_consensus.cc:1275] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:41.964447   450 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.017866   476 consensus_queue.cc:1048] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:42.018872 24674 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 13:11:42.020318   697 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:42.020983   476 consensus_queue.cc:1048] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:41.993369   411 consensus_queue.cc:237] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:42.021333   708 log.cc:927] Time spent T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:42.023937   476 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:42.028294 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.036003 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.037272 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.036211 24665 pending_rounds.cc:85] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 13
I20260709 13:11:42.039664 24665 pending_rounds.cc:107] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:11:42.040005 24665 raft_consensus.cc:2889] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:41.988003   702 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:42.043900 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57784.5us
I20260709 13:11:41.987751   707 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:42.051241 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bfcb1d6cfeb49dd83c1d2795dc046bb" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:42.038057 32566 consensus_meta.cc:287] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.003s
I20260709 13:11:41.972630   513 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.062647   481 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:42.056866   716 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:42.064508   716 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:42.051982   695 log.cc:927] Time spent T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:42.077437 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24de2d510450446080d67047a1f1eebe" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.078576 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:42.079563 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bac7b2b9c5456588833d44d3dff943" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:42.080647 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.081931 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.082540 24669 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 19.
I20260709 13:11:42.055380   652 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:42.086618 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:42.087034 24566 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.064872   716 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.088145 24566 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.088850   615 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:42.101775 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.104002 24566 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.096733 24491 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.106712 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.113605 24491 leader_election.cc:304] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.115795 25213 raft_consensus.cc:1240] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:11:42.116381 24491 leader_election.cc:304] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.076647   632 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:42.119949 25182 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.118839 25210 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:42.117008   701 raft_consensus.cc:2749] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:42.088907   672 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:42.124923 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.119275 24566 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.115679   488 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:42.133711 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.058028 32566 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.125402   429 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:42.135020 24491 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.125310 32559 raft_consensus.cc:2749] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.145856 24491 leader_election.cc:304] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.117554   710 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:11:42.135269   642 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:42.117681   666 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:11:42.155604 24593 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 19: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:42.136910   707 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:42.164595 25182 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.146502   654 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.172139   716 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:42.168079 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.136734   698 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.021s
W20260709 13:11:42.175868 25182 leader_election.cc:336] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.181983   449 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:42.156764   481 raft_consensus.cc:2749] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:42.187774 32566 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:42.191166 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 558748us
I20260709 13:11:42.204308 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:42.208634 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.206538 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 110144us
W20260709 13:11:42.215687 24637 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.216288 24637 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:42.217496 24637 leader_election.cc:336] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.217923 24637 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.219561   479 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:42.220814 24637 leader_election.cc:336] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.221280 24637 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.222078   479 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:42.223297 24637 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.224584   448 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:42.227154 25182 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.224781 24637 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.214658   682 consensus_queue.cc:1048] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 13:11:42.232590   720 log.cc:927] Time spent T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 13:11:42.233636   682 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:42.234393   450 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.238652   632 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 29 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:42.238377 24637 leader_election.cc:336] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.239346 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.242065 24490 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:42.258993 24637 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.259521 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:42.260646 24637 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.261456 24637 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:42.262874 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.265322 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:42.266752 25211 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:11:42.264799 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 131851us
I20260709 13:11:42.275339 24591 raft_consensus.cc:1275] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:42.276378 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.240437   707 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:42.274652 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:42.284795 24491 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.290280 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.290724 24491 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.291271 24597 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:42.293856 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.294042 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.294530 24600 raft_consensus.cc:2393] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:42.294433 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.253583   672 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:42.191706   659 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.254873   513 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:42.293634 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:42.300460 24672 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:42.295979 24491 leader_election.cc:304] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.263725   649 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:42.263506   682 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:42.274387   653 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:42.263636   448 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:42.265834 32566 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:42.296744 24591 raft_consensus.cc:1275] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:11:42.302927 24491 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.266912   698 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:42.258534   472 consensus_queue.cc:1059] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 13:11:42.311959 25211 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 29.
I20260709 13:11:42.293637   615 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:42.282049   707 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:42.338505 24639 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.341874 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.314114   524 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:42.336756   615 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.298452   481 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.318315 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.322690 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:42.326687 24563 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.327865 25212 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 27. Current term is 28. Ops: []
I20260709 13:11:42.298736   654 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:11:42.301594   666 raft_consensus.cc:2749] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:11:42.304881   672 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.340384   472 consensus_queue.cc:1243] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer 983693721af6486c97ece1410a90cf30 log is divergent from this leader: its last log entry 24.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
W20260709 13:11:42.358786 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 59764.7us
W20260709 13:11:42.315223 24491 raft_consensus.cc:2686] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:42.359863 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.365489 24490 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:42.328403 32566 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.335191   698 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.341056   707 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:42.343840 32491 consensus_queue.cc:1048] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 13:11:42.398093 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:42.394426 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 91567.8us
I20260709 13:11:42.401672 24672 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 29.
W20260709 13:11:42.404853 24563 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.359354   524 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.415158 24563 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.362112   615 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.405151   476 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:42.421657   733 log.cc:927] Time spent T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:42.422549   672 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.423827   702 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:42.363246   648 consensus_meta.cc:287] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.556s	user 0.002s	sys 0.009s
I20260709 13:11:42.412948 24600 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:42.351632   670 raft_consensus.cc:3060] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.405187   680 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:11:42.442063   730 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:42.442572 25218 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:42.408463   666 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:11:42.443776   666 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 29 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:42.444833   702 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.446440 32566 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.448293 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
W20260709 13:11:42.446492   726 log.cc:927] Time spent T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.261s	user 0.000s	sys 0.002s
I20260709 13:11:42.428906   682 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:42.455128   632 raft_consensus.cc:493] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.489527 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:42.489346 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 84520.8us
W20260709 13:11:42.491294 24563 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.440867   648 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.491823 24563 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:42.496421 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 44247.2us
I20260709 13:11:42.487248   699 raft_consensus.cc:3055] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:11:42.520237 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.521234 25213 raft_consensus.cc:2393] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 27: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:42.500142 32566 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:42.503913   429 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:42.504529   450 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:42.524976   654 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.490867   632 raft_consensus.cc:515] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:42.526116   698 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.526532   716 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.527092   632 leader_election.cc:290] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.493609   611 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.514467 23430 pending_rounds.cc:70] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:42.486707   666 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.527866   611 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:42.528584   737 log.cc:927] Time spent T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:11:42.515162 32618 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.530411   611 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:42.517570 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:42.530730 24490 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.527861 23430 pending_rounds.cc:77] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 19 index: 16 } timestamp: 7305636657295785984 op_type: NO_OP noop_request { }
I20260709 13:11:42.531363 23430 raft_consensus.cc:2889] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:42.531430   449 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.531754 23430 raft_consensus.cc:2272] T 72b8c4b638a5486c82fb2d3bb64ef503 P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.531932   449 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:42.534394 23430 tablet_replica.cc:333] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:42.520292   699 raft_consensus.cc:740] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:42.545509   699 consensus_queue.cc:260] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.546881   699 raft_consensus.cc:3060] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:42.518750 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.518102 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:42.536620   654 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.537158   653 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:42.502192   731 log.cc:927] Time spent T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:11:42.530674 32618 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:42.540323 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56006 (request call id 2821) took 1047 ms. Trace:
W20260709 13:11:42.544498 24563 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.549963 23430 raft_consensus.cc:2243] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.508491   448 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.550063 25211 raft_consensus.cc:2393] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 19: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
I20260709 13:11:42.550452 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:42.509639   736 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:11:42.555856 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 81920.5us
I20260709 13:11:42.619861 25214 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 20. Current term is 21. Ops: []
I20260709 13:11:42.566097 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:42.569339 25218 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:11:42.585119 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.624588 24595 raft_consensus.cc:2393] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
W20260709 13:11:42.610471 24563 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.625689 24563 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.629745 24566 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:42.585356 24599 rpcz_store.cc:276] 0709 13:11:41.492539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.573944 (+ 81405us) service_pool.cc:224] Handling call
0709 13:11:42.033828 (+459884us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:42.042444 (+  8616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:42.042473 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:42.054705 (+ 12232us) log.cc:844] Serialized 52 byte log entry
0709 13:11:42.156833 (+102128us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:11:42.206727 (+ 49894us) log.cc:844] Serialized 14 byte log entry
0709 13:11:42.206949 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.207014 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:42.230944 (+ 23930us) raft_consensus.cc:1685] finished
0709 13:11:42.230964 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:42.540115 (+309151us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54003e7950. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf458ad 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6 00007f17ba28026f
0709 13:11:42.540251 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":58059,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":7477,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":18179,"spinlock_wait_cycles":1058569856,"thread_start_us":55343,"threads_started":1,"wal-append.queue_time_us":118191}
I20260709 13:11:42.633055 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.633299 23430 raft_consensus.cc:2272] T eb1f10582ce7411b8b3187da8ec646c8 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.636756 24595 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:42.646167 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.648420 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:42.649439 24674 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.569471   495 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:42.648506 24563 consensus_peers.cc:597] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.655769 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:42.656569 24563 leader_election.cc:336] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.656958 24563 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:42.657908 24563 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.659353 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:42.662720 25214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48918 (request call id 1837) took 1011 ms. Trace:
I20260709 13:11:42.647259   431 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.671842 23430 tablet_replica.cc:333] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:42.672659 23430 raft_consensus.cc:2243] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:42.673352 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9c35412a4ad4729862392b77295639d" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.673571 24673 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:11:42.674273 24563 leader_election.cc:336] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.674609   710 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:11:42.674899 24563 leader_election.cc:336] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.677321 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.678767 23430 raft_consensus.cc:2272] T 90f5d915fb71474ab2b58063813a93a9 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:42.681928 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49438.9us
I20260709 13:11:42.682039   639 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:42.685672   411 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:42.686100   411 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:42.686465   411 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:42.694888 25211 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:42.694469   411 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.698292   390 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.698863   390 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.700413 23430 tablet_replica.cc:333] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:42.701041   390 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.701751 24591 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:11:42.701990 23430 raft_consensus.cc:2243] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.702375   710 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:42.704164 23430 raft_consensus.cc:2272] T e7ec39f0d4e04761ae598f1245692799 P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.707420 23430 tablet_replica.cc:333] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:42.707479 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.708709 23430 raft_consensus.cc:2243] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.708830   390 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:11:42.709837 23430 raft_consensus.cc:2272] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.710440 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.716054   524 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.718513 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.722640   411 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:42.723343   654 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.724074 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:42.585362   653 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.725492 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.727301   653 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.728258 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:42.750993   642 raft_consensus.cc:2749] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:42.753800 32618 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.755503 32757 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.756163 32757 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.757387   670 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:42.758644 32757 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.642881 32566 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:42.762352 32566 raft_consensus.cc:697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:42.763408 32566 consensus_queue.cc:237] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:42.661790   702 consensus_queue.cc:1048] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.113s
I20260709 13:11:42.769786 24665 raft_consensus.cc:2468] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:42.773778 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.774747 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:42.663363 25214 rpcz_store.cc:276] 0709 13:11:41.651497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.651643 (+   146us) service_pool.cc:224] Handling call
0709 13:11:41.651930 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:42.620335 (+968405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:42.662444 (+ 42109us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54007b6bd4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf46e01 00007f17bbf4583e 00007f17c0f0a419 00007f17ba481bd4 00007f17ba481b62 00007f17ba481a91 00007f17ba481a0c 00007f17ba480cc2 00007f17ba28148c 00007f17ba2808c6
0709 13:11:42.662653 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225648896}
I20260709 13:11:42.788084 24674 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:42.791601 24666 raft_consensus.cc:1275] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:11:42.792028 24666 pending_rounds.cc:85] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Aborting all ops after (but not including) 17
I20260709 13:11:42.792279 24666 pending_rounds.cc:107] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 13:11:42.792543 24666 raft_consensus.cc:2889] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:42.795027 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.795620 24669 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:42.799731 24565 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.792541 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:42.784785 24637 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.654652   643 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.709789   449 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.812525 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.710287   659 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.795073   495 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:42.818974 24637 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.824452 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:42.815361 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 381809us
I20260709 13:11:42.821574 24491 leader_election.cc:304] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.828176 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.834208 25185 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:42.860911 24637 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.861881 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:42.814152   718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.013s	sys 0.024s
I20260709 13:11:42.897267 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c8f0e3de4df592f498349e097d44" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.899960 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "524d0087b4074f61ad31e7ba78ee8b99" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.898025 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.834630   450 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:42.838341   653 raft_consensus.cc:2749] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:42.901556 24491 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
W20260709 13:11:42.896924   736 log.cc:927] Time spent T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:11:42.902257   718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.013s	sys 0.025s
I20260709 13:11:42.912802   666 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:42.862713   420 raft_consensus.cc:2804] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:42.913403   666 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Leader. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:42.827236   639 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:11:42.906180 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:42.837766   390 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:42.914263   666 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:42.914891   390 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:42.915289   390 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:42.909673 24491 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:42.918510 24491 raft_consensus.cc:2686] T e4b8c8f0e3de4df592f498349e097d44 P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:42.919425 24491 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.920219   701 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:42.921707 24491 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.922426   701 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.923657 24491 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:42.924386   701 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:42.925261   648 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.931388 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.931880   680 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:11:42.932524 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:42.934762   682 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:11:42.935143   682 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:11:42.936426   707 consensus_meta.cc:287] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.000s
I20260709 13:11:42.898231 32491 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:42.943922 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.937876   479 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:11:42.837347   495 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:42.945838 25182 leader_election.cc:336] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:42.960009 25182 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:42.936012   682 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.936822   707 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.947304   420 raft_consensus.cc:697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
W20260709 13:11:42.963820   615 consensus_meta.cc:287] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:11:42.963546   420 consensus_queue.cc:237] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.964242   615 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:42.823434   643 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.965422 24600 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 21: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:42.966514   615 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.966863   643 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:42.862143   658 consensus_queue.cc:1048] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.089s
I20260709 13:11:42.967531   495 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:42.968688 24591 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:42.909775   659 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:42.969734 32491 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:42.970149 32491 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:42.970460 25216 raft_consensus.cc:1240] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Rejecting Update request from peer 0131806e3b9647128f32db1ab8d314fc for earlier term 21. Current term is 22. Ops: []
I20260709 13:11:42.971025 32491 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:42.972066 32491 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:42.972592   707 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:42.959344 23430 tablet_replica.cc:333] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:42.974339 23430 raft_consensus.cc:2243] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.974992 23430 raft_consensus.cc:2272] T f6e02d1934244d5f93de764a08655a2c P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:42.975701   659 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:11:42.986171 23430 tablet_replica.cc:333] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:42.990769 23430 raft_consensus.cc:2243] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:42.993999 23430 pending_rounds.cc:70] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:42.995204 23430 pending_rounds.cc:77] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 22 index: 14 } timestamp: 7305636643212009472 op_type: NO_OP noop_request { }
I20260709 13:11:42.996356 23430 raft_consensus.cc:2889] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:43.000703 23430 raft_consensus.cc:2272] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:43.005736 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 188202us
W20260709 13:11:43.007056 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 184048us
W20260709 13:11:43.015314 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:43.016038 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.013072   450 raft_consensus.cc:2749] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:43.017805   450 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:43.020114 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:43.032806 24565 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:43.020879   682 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:11:43.081264 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 69327.5us
W20260709 13:11:43.088917 24563 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:43.098784 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 236963us
I20260709 13:11:43.104338 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:43.081265   707 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:43.087050   472 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.127981   707 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:43.191802 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 158979us
W20260709 13:11:43.193614 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 93263.3us
I20260709 13:11:43.200042 24565 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:43.185828 23430 tablet_replica.cc:333] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:43.206471 23430 raft_consensus.cc:2243] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:11:43.209645 23430 raft_consensus.cc:2272] T ba23ab1f03ef40238962f541c00081d1 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:43.214659 23430 tablet_replica.cc:333] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:43.216846 23430 raft_consensus.cc:2243] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:11:43.214471 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:43.218529 23430 raft_consensus.cc:2272] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:43.224895 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:43.227001 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:43.241581   337 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:43.243016   337 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.247121   337 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:43.130585   472 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:43.260391   431 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:43.249176   314 consensus_queue.cc:1059] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:11:43.279186   472 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:43.293145 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 97651.7us
W20260709 13:11:43.296537 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 93776us
I20260709 13:11:43.301224   756 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.302248   756 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.306653   314 raft_consensus.cc:3055] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:43.307288   314 raft_consensus.cc:740] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0131806e3b9647128f32db1ab8d314fc, State: Running, Role: LEADER
I20260709 13:11:43.307564   707 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:43.309952 23430 tablet_replica.cc:333] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:43.311702 23430 raft_consensus.cc:2243] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:43.312441 23430 pending_rounds.cc:70] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:43.312740 23430 pending_rounds.cc:77] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305636607190253568 op_type: NO_OP noop_request { }
I20260709 13:11:43.315322 23430 raft_consensus.cc:2889] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:43.315835 23430 raft_consensus.cc:2272] T e9c35412a4ad4729862392b77295639d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:43.316210 25211 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:11:43.317289 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:43.319478 23430 tablet_replica.cc:333] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:43.237671   390 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.255702 24674 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:43.257462   337 raft_consensus.cc:2749] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:43.321046 23430 raft_consensus.cc:2243] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:43.357286 25214 raft_consensus.cc:2393] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 27: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:43.321249   314 consensus_queue.cc:260] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.377095   742 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:43.379647   707 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:43.380426   707 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.381577 32566 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.382320 32566 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:43.385792 25185 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:43.389550   411 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:43.390130   411 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:43.391654   756 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:43.391497   411 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.395699 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:43.396786 24592 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 27.
I20260709 13:11:43.398615 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:43.401369 24598 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 28.
I20260709 13:11:43.411672 32566 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:43.412659 23430 raft_consensus.cc:2272] T 4430292826c34b99a8f9413e570e0ff3 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:43.413908 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 92859.2us
I20260709 13:11:43.414110   653 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:11:43.416872 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:43.417737 24665 raft_consensus.cc:2468] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:43.418946 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:43.419762 24669 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:43.422448   707 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:43.430121 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:43.431042 24671 raft_consensus.cc:2393] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 21: Already voted for candidate 0131806e3b9647128f32db1ab8d314fc in this term.
W20260709 13:11:43.431545 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 57717us
I20260709 13:11:43.432154 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:43.434440 24665 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 26.
I20260709 13:11:43.434866   718 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.435596   718 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:43.437450 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:43.433596 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 234506us
I20260709 13:11:43.507705 24597 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:11:43.508093 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.507616 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:43.508678 24600 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:43.509138 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:43.509536 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:43.510385 24595 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:43.518509 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:43.526281 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 77071.5us
I20260709 13:11:43.527539 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:43.541041 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 48122.6us
I20260709 13:11:43.539713 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:43.534132   739 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:11:43.561092 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.561235 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:43.561976 24667 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:43.563099 23430 tablet_replica.cc:333] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:43.568569 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:43.569379 24667 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:43.579197   776 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:43.579686   776 raft_consensus.cc:493] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:43.580039   776 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:43.540823   707 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:11:43.605634 24667 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 27.
I20260709 13:11:43.608832   776 raft_consensus.cc:515] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.609447 25185 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:43.590615 23430 raft_consensus.cc:2243] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:43.619413   524 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:43.619947   524 raft_consensus.cc:493] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.620329   524 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:43.625713 23430 raft_consensus.cc:2272] T 524d0087b4074f61ad31e7ba78ee8b99 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:43.630192 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:43.632974   698 raft_consensus.cc:2749] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:43.641880 23430 tablet_replica.cc:333] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:43.589354   756 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:11:43.657562   756 raft_consensus.cc:493] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:43.657960   756 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:11:43.658281   682 consensus_meta.cc:287] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.004s
I20260709 13:11:43.659018 24670 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 28.
I20260709 13:11:43.659598   426 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:11:43.661950   448 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:43.662654   448 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.591521 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:43.663935   718 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:43.664333 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 108495us
I20260709 13:11:43.665655   739 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:43.667589   314 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:43.667970 24566 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:43.672444 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 183938us
I20260709 13:11:43.675071   760 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:43.678691 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:43.679335 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:43.680198 25210 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 28: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:43.671995   426 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:43.683348 23430 raft_consensus.cc:2243] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:11:43.684221 23430 pending_rounds.cc:70] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:43.684501 23430 pending_rounds.cc:77] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 29 index: 18 } timestamp: 7305636669561401344 op_type: NO_OP noop_request { }
I20260709 13:11:43.684834 23430 raft_consensus.cc:2889] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 29 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:43.705065 23430 raft_consensus.cc:2272] T 243f0803aa8e4b9e938126e02e960e97 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:43.707545   448 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:43.704384   390 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:43.702258 24669 raft_consensus.cc:1275] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:11:43.682920   426 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.711988 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:43.714098 24669 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:11:43.726871 24670 raft_consensus.cc:1275] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:43.727926 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:43.746726 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:43.747344 24598 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:43.753539   390 consensus_queue.cc:1048] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:11:43.756111 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 55616.3us
I20260709 13:11:43.762393 24600 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 27.
I20260709 13:11:43.770274   729 raft_consensus.cc:2764] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 13:11:43.772521 24566 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:43.773345 23430 tablet_replica.cc:333] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:43.773644   615 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:43.774061   615 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.774398   615 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:43.775873 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:43.779076 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:43.779250 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 58039.4us
I20260709 13:11:43.801864 24491 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:43.774561 23430 raft_consensus.cc:2243] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:43.803642 23430 raft_consensus.cc:2272] T 27022900b12b4397b1677f3fb2326347 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:43.803728 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 
I20260709 13:11:43.805047   627 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:43.805450   627 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.805781   627 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:43.807507   718 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.808193   718 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.811477   718 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:43.791617   776 leader_election.cc:290] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:43.800058 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.802822   666 raft_consensus.cc:2804] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:43.813531   666 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.813963   666 raft_consensus.cc:3060] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:43.816350   627 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:43.818362 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f10dd13cd784e8cb8b1dba5b1d1892a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:43.821849 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:43.822213 24600 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:43.822759 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:43.830650 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72b8c4b638a5486c82fb2d3bb64ef503" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:43.876605 24597 raft_consensus.cc:3060] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:43.831408 24563 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:43.833268   760 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:43.833814   429 consensus_queue.cc:1048] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:43.794661   756 raft_consensus.cc:515] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.839672 23430 tablet_replica.cc:333] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
W20260709 13:11:43.886981 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 55705.9us
I20260709 13:11:43.876995 24490 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:43.900583 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:43.903719 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:43.891300   760 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:43.907774 23430 raft_consensus.cc:2243] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:43.885030   524 raft_consensus.cc:515] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:43.912104   760 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:43.832876   666 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:43.925714 24490 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:43.911478   718 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:11:43.930408   495 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:43.936789 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:43.938875 23430 pending_rounds.cc:70] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:43.939297 23430 pending_rounds.cc:77] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 19 index: 11 } timestamp: 7305636596126535680 op_type: NO_OP noop_request { }
I20260709 13:11:43.939747 23430 raft_consensus.cc:2889] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:43.947335 24668 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 0131806e3b9647128f32db1ab8d314fc: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:11:43.948552 32559 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:11:43.929304   653 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.961496 23430 raft_consensus.cc:2272] T 24de2d510450446080d67047a1f1eebe P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:43.959203 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:43.967025 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 186017us
I20260709 13:11:43.965296   615 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:43.955758   495 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:11:43.984094 24671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:43.984773 24671 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:43.987080 24592 raft_consensus.cc:2393] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0131806e3b9647128f32db1ab8d314fc in current term 23: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:43.977246   627 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:43.990329   666 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:43.993813   756 leader_election.cc:290] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:44.005811 24597 raft_consensus.cc:2468] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:11:43.984957   653 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.020620 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:44.025238   524 leader_election.cc:290] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:44.035849 24639 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:44.038902 25184 leader_election.cc:304] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:44.044255 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c13259bf74484588e0fb08995091cc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:44.044641 24673 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:44.044909 24598 raft_consensus.cc:3060] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:44.044303   756 raft_consensus.cc:2804] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:44.050298   756 raft_consensus.cc:697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:44.051323   756 consensus_queue.cc:237] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.051967 23430 tablet_replica.cc:333] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:44.052861 23430 raft_consensus.cc:2243] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.053340 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f2117a17f2425cae9c436e59c94b96" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:44.053948 24599 raft_consensus.cc:3060] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:44.060250 24598 raft_consensus.cc:2468] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 28.
I20260709 13:11:44.061590   615 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:44.063597 23430 pending_rounds.cc:70] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:44.063956 23430 pending_rounds.cc:77] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 19 index: 11 } timestamp: 7305636631018508288 op_type: NO_OP noop_request { }
I20260709 13:11:44.236266 23430 raft_consensus.cc:2889] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:44.236809 23430 raft_consensus.cc:2272] T 2732386ac0bf488eb0fcc0893f0c9b0e P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.240121 23430 tablet_replica.cc:333] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:44.064467   760 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.080549   682 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:44.103094   653 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:44.088449   426 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:11:44.082515 24597 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:44.097898 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:44.075485 24671 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:44.074299 25184 leader_election.cc:304] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:44.242951   760 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:44.243415 23430 raft_consensus.cc:2243] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.566931   653 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.754959   653 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:11:44.652962 24670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.015s	sys 0.011s
W20260709 13:11:44.757266 24670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.015s	sys 0.012s
W20260709 13:11:44.731308 24599 consensus_meta.cc:287] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: Time spent flushing consensus metadata: real 0.677s	user 0.015s	sys 0.003s
I20260709 13:11:44.758176 24599 raft_consensus.cc:2468] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 29.
I20260709 13:11:44.754985 23430 pending_rounds.cc:70] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:44.759117 23430 pending_rounds.cc:77] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 26 index: 17 } timestamp: 7305636604292251648 op_type: NO_OP noop_request { }
I20260709 13:11:44.760200 23430 raft_consensus.cc:2889] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:44.760547 23430 raft_consensus.cc:2272] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.765405 23430 tablet_replica.cc:333] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:44.771384   653 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:44.772652 23430 raft_consensus.cc:2243] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:44.783445 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 709234us
I20260709 13:11:44.781558   653 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.788578 24597 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:11:44.794023 23430 raft_consensus.cc:2272] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.793126   653 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.899134 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:44.905371 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:44.897446   615 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.910151   615 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.916527 23430 tablet_replica.cc:333] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:44.917410   801 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:44.921702   801 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.923707   801 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:44.917763   804 raft_consensus.cc:2804] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:44.930730 23430 raft_consensus.cc:2243] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.931548 23430 pending_rounds.cc:70] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:44.931787 23430 pending_rounds.cc:77] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 21 index: 11 } timestamp: 7305636671145689088 op_type: NO_OP noop_request { }
I20260709 13:11:44.932124 23430 raft_consensus.cc:2889] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:44.932497 23430 raft_consensus.cc:2272] T b1932202ddbe46b29ed12a1b38042652 P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.933182   653 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:44.936357 23430 tablet_replica.cc:333] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:44.937390 23430 raft_consensus.cc:2243] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:44.938444 23430 raft_consensus.cc:2272] T de2b0253cbb445a4bb49f874e70ea972 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.941530   801 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.942346   801 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.945063   682 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:44.945603   682 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.946086   801 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:44.947599   682 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:44.949476 23430 tablet_replica.cc:333] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:44.950502 23430 raft_consensus.cc:2243] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.951442 23430 pending_rounds.cc:70] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:44.951725 23430 pending_rounds.cc:77] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 28 index: 18 } timestamp: 7305636612049092608 op_type: NO_OP noop_request { }
I20260709 13:11:44.952139 23430 raft_consensus.cc:2889] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:44.954082 23430 raft_consensus.cc:2272] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:44.954612 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.957279   653 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.963449   653 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.965237 24672 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 28.
I20260709 13:11:44.966717   807 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.967257   807 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.969722   653 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:44.970964 24489 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.971565   802 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.981163 24566 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:44.972082   802 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:44.988757 23430 tablet_replica.cc:333] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:44.983314   804 raft_consensus.cc:697] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 28 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:44.997458   812 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:44.998615 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.006527 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:45.013919 23430 raft_consensus.cc:2243] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.029412   810 raft_consensus.cc:493] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.030282   810 raft_consensus.cc:515] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.012140   807 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.033335 23430 raft_consensus.cc:2272] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.022871   803 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.035254   803 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:45.013950   812 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.041551   804 consensus_queue.cc:237] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.042168   812 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.082945 23430 tablet_replica.cc:333] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.055199   810 leader_election.cc:290] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.075547   812 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:45.118708 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:45.121603 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 106081us
W20260709 13:11:45.128144 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 112276us
I20260709 13:11:45.129119 25184 leader_election.cc:304] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:45.134393 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.127089 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.136489 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.123070   805 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:45.142520 23430 raft_consensus.cc:2243] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.134403   808 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.123270   812 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.149832   804 raft_consensus.cc:2804] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:11:45.151137   816 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.151333   804 raft_consensus.cc:697] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 29 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:45.151799   816 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.152415   804 consensus_queue.cc:237] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 28.21, Last appended by leader: 21, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.153330 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.154024 24593 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 21.
I20260709 13:11:45.139171   813 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.169512 23430 raft_consensus.cc:2272] T 5a74983bd9b34474a7cd38346edf8a64 P 0131806e3b9647128f32db1ab8d314fc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.171993 24491 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:45.176544 24491 raft_consensus.cc:2686] T f1d76f2e8d504bd29a4d29e4926a9407 P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:45.166540   822 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.171705   809 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.148018   805 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.179427   827 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.191033 23430 tablet_replica.cc:333] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.192026 23430 raft_consensus.cc:2243] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.149403   808 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.173943   817 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:11:45.181392   822 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.182885   809 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.197047   805 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.198197   822 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.200631   822 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.201186   822 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.203771   822 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.205691 23430 raft_consensus.cc:2272] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.210238   808 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:45.210878   808 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.192058   827 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.169657   813 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.216786   805 raft_consensus.cc:493] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:44.985424   774 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:45.199083   812 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.235324   816 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.199582   809 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.211591   808 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.240846   808 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.234944   805 raft_consensus.cc:515] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.243407   805 leader_election.cc:290] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.244081   824 raft_consensus.cc:493] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:45.244700   824 raft_consensus.cc:515] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.246946   824 leader_election.cc:290] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.247895   774 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 28 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:45.251660 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.250813   774 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.256851   827 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:45.255663   809 raft_consensus.cc:493] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.259543   809 raft_consensus.cc:515] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.260556   827 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:45.261962 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 70093.8us
I20260709 13:11:45.268105 24491 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.267939   813 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:45.270117 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:45.271478   830 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:45.271492   773 raft_consensus.cc:493] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:45.272786   773 raft_consensus.cc:515] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.273897   760 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.274458   760 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.277061   760 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.277745   820 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.278328   820 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.281090   820 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.261137   827 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.283644   827 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.284364 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.284991 24598 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:45.285071   802 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.286278 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:45.298935 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.302781 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.305724   809 leader_election.cc:290] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.306758 23430 tablet_replica.cc:333] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.308166 23430 raft_consensus.cc:2243] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.310062   805 raft_consensus.cc:493] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:45.310729   805 raft_consensus.cc:515] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.314862   805 leader_election.cc:290] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.315702 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.316555 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 30 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.324930   804 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.325472   804 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.326530   773 leader_election.cc:290] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.326457 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.327236 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.327667   804 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.328164   803 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.328672 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.328202   804 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.328761   827 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:11:45.332983 24563 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.333482 24563 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:45.330359   827 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.336238   827 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:45.336704   804 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.339449   804 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.341696 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:45.331203 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 204981us
I20260709 13:11:45.351318   807 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:45.351895   807 raft_consensus.cc:493] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.352349   807 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:45.360873 24491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 71916.6us
I20260709 13:11:45.373741 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:45.385226   836 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:45.385878   836 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.386402 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.386946 24665 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:11:45.387665 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf920647a7842d49c08b2453da44143" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.388100   836 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.391180 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.391311 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:45.391764 24669 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 28.
I20260709 13:11:45.391970 25214 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 28: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:45.388799 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.395423 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.396677 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.397260 25219 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:45.398507   615 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.399694 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e02d1934244d5f93de764a08655a2c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.401814 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.366904   773 raft_consensus.cc:2749] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:11:45.373422   827 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:45.388006 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.411723   827 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.414022   827 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.414534   827 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.415040   827 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.364311   824 raft_consensus.cc:493] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:45.417785   824 raft_consensus.cc:515] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.420063   824 leader_election.cc:290] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.365780   809 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.420953   809 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:45.422796   838 log.cc:927] Time spent T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: Append to log took a long time: real 0.121s	user 0.002s	sys 0.001s
I20260709 13:11:45.422971 25214 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:45.437513 23430 raft_consensus.cc:2272] T cfe7903b435c45a4b85c164ecf24c14f P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.440204 23430 tablet_replica.cc:333] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.440850 23430 raft_consensus.cc:2243] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.426121   815 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:45.426777   810 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:45.429772 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.477985 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 48276.4us
I20260709 13:11:45.434185   807 raft_consensus.cc:515] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.423405   809 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:45.425801 24490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52154.3us
I20260709 13:11:45.442708 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.443440 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.444084 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e49b6f6ffd4dde98abdfd00821bc27" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.445158 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.446249 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.451725 24414 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:45.460000 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.461390 24665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.464334   827 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:45.468926 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 126032us
W20260709 13:11:45.475214 24491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.499572 24672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:45.475558 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 340134us
I20260709 13:11:45.464702 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.481760 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5644c0da536c49768827dfd20a9662e1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:45.477773 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 127303us
I20260709 13:11:45.485526 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf80704aefe74fbe81e575cc17508b9a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.483042 25219 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
I20260709 13:11:45.483572 25214 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 26.
I20260709 13:11:45.508315 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.478860   815 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.513860 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.511054 24490 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.517369 24666 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
W20260709 13:11:45.517786 24490 raft_consensus.cc:2686] T f689bef5c09a4f4caf91a81702cc7723 P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:45.519042 24490 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.528589 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.524662 25214 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 22.
I20260709 13:11:45.531734 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037c6a6c25cb4df5bc9bc7d29ad8347a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.518654   815 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:45.537914 23430 raft_consensus.cc:2272] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.537741 24491 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.532328   830 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:45.542418   818 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:45.543265 24419 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41426 (request call id 351) took 8656 ms. Trace:
I20260709 13:11:45.543761 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.544624 25218 raft_consensus.cc:2410] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 30 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 13:11:45.530989   812 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.549490   812 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:45.550292   807 leader_election.cc:290] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.551579   812 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:45.517472   810 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:45.554893 23430 tablet_replica.cc:333] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.555737 23430 raft_consensus.cc:2243] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.556164   810 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.557945 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.558166 24414 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:45.564059 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.556284 23430 raft_consensus.cc:2272] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 0131806e3b9647128f32db1ab8d314fc [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.565207 25182 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.543640 24419 rpcz_store.cc:276] 0709 13:11:36.887266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:36.887448 (+   182us) service_pool.cc:224] Handling call
0709 13:11:45.543069 (+8655621us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:41.298834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:41.324180 (+ 25346us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:41.324215 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:11:41.324232 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:41.425841 (+101609us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:41.425923 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:41.425955 (+    32us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:11:41.427928 (+  1973us) tablet.cc:701] Row locks acquired
0709 13:11:41.427947 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:41.428081 (+   134us) write_op.cc:270] Start()
0709 13:11:41.428190 (+   109us) write_op.cc:276] Timestamp: P: 1783602701428036 usec, L: 0
0709 13:11:41.428211 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:11:41.553472 (+125261us) log.cc:844] Serialized 9865 byte log entry
0709 13:11:41.914557 (+361085us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeaf571 00007f17bbf41e28 00007f17bf97c581 00007f17bf97bd58 00007f17bf9809f1 00007f17bf9809a9 00007f17bf980939 00007f17bf980901 00007f17bf97fb2d 000000000038f354 000000000038f199
0709 13:11:42.045186 (+130629us) op_driver.cc:464] REPLICATION: finished
0709 13:11:42.178238 (+133052us) write_op.cc:301] APPLY: starting
0709 13:11:42.178326 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:42.738370 (+560044us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:42.738410 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:43.339880 (+601470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:43.340407 (+   527us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:11:43.340450 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:43.362053 (+ 21603us) log.cc:844] Serialized 220 byte log entry
0709 13:11:43.537828 (+175775us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:43.599202 (+ 61374us) write_op.cc:454] Released schema lock
0709 13:11:43.599320 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:43.650143 (+ 50823us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:43.650172 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7,"reported_tablets":45,"spinlock_wait_cycles":8960,"child_traces":[["op",{"apply.queue_time_us":128748,"apply.run_cpu_time_us":48838,"apply.run_wall_time_us":1471793,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":439863,"prepare.run_cpu_time_us":25314,"prepare.run_wall_time_us":628067,"raft.queue_time_us":121247,"raft.run_cpu_time_us":9977,"raft.run_wall_time_us":102436,"replication_time_us":614075,"spinlock_wait_cycles":10209664,"thread_start_us":727511,"threads_started":5,"wal-append.queue_time_us":418642,"wal-append.run_cpu_time_us":35151,"wal-append.run_wall_time_us":2195323}]]}
I20260709 13:11:45.565649 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:45.568383 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.568923 25182 leader_election.cc:336] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.569732 25182 leader_election.cc:336] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.570497 25182 leader_election.cc:336] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.571230 25182 leader_election.cc:336] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.572345 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fa80994624487d980c9d3ef7a166ce" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.576429 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.576632 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.577831 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.578183 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27022900b12b4397b1677f3fb2326347" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.579027 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.579627 24593 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:11:45.580564 25210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.581734 24592 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:11:45.582623   817 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:11:45.581754   833 raft_consensus.cc:493] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:45.566569 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655be3d0d44f42a1aa683fd7271af488" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 30 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.583467   833 raft_consensus.cc:515] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.586433 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:45.587661 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:45.589215 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 47044.8us
W20260709 13:11:45.589905 24637 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.590477 24637 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.590760 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 49253.1us
I20260709 13:11:45.590936 23430 tablet_replica.cc:333] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
W20260709 13:11:45.591025 24637 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.591794 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:45.592144   833 leader_election.cc:290] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.591929 23430 raft_consensus.cc:2243] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.599937   810 raft_consensus.cc:493] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.600421   810 raft_consensus.cc:515] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:45.592347 24637 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.601536 24637 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.592489 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.602319   842 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:45.602836   810 leader_election.cc:290] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:45.603225 24637 leader_election.cc:336] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.603945 23430 raft_consensus.cc:2272] T 73880209aa174d609bf830ad4c666c8c P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.597359 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.560762 24414 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 15 to 19, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 19 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:45.618121 24414 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 17 to 18, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 18 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:45.622530 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.623797 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:45.625130 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.626262   739 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:45.626654   739 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:45.626992   739 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:45.604519   815 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.608667 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.631485 24592 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
W20260709 13:11:45.603453 24488 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.608974 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.632642 24593 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:45.609555 23430 tablet_replica.cc:333] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.633157 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:45.633721 24600 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:11:45.633936 23430 raft_consensus.cc:2243] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.634068 24490 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.634608 23430 raft_consensus.cc:2272] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.609810 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.635144   810 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:45.635778 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.636816 24490 leader_election.cc:304] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:45.637454 24490 raft_consensus.cc:2686] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:45.639740 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.640746 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:45.640834 24639 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.641638 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:45.641940 24639 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.642441   828 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:45.642635   842 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:45.642848   828 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.643277   828 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:45.643342   842 raft_consensus.cc:2749] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:11:45.644025   842 raft_consensus.cc:2749] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:11:45.645280   820 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:45.645684   820 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.646025   820 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:45.647353 24600 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
I20260709 13:11:45.651635   739 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.611158 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.611696 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a74983bd9b34474a7cd38346edf8a64" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.652688 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.653404 24565 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.654547 24600 raft_consensus.cc:1275] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 13:11:45.603956 24637 leader_election.cc:336] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.679621   833 raft_consensus.cc:2749] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:45.679986 24637 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 76044.2us
I20260709 13:11:45.680575 25185 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:45.681165 24565 leader_election.cc:304] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.682817 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.683094 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.658260 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.682476 24565 leader_election.cc:304] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.682511 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.684316   773 raft_consensus.cc:2749] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:11:45.685359 25182 leader_election.cc:336] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.685727 24490 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c; no voters: 
W20260709 13:11:45.686316 24490 raft_consensus.cc:2686] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:11:45.686393 25182 leader_election.cc:336] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.687350   837 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:11:45.658478 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.687753   837 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.687973 24594 raft_consensus.cc:1240] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Rejecting Update request from peer 148dc963cec64232ad3b248abad6f36d for earlier term 24. Current term is 25. Ops: []
I20260709 13:11:45.688138   837 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:45.685743 24639 leader_election.cc:304] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.690011   805 raft_consensus.cc:2749] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:45.690778   739 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.693383 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:45.658195   820 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.659328 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.659734 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ade31527164676867a5686444d0240" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:45.695091 24591 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:45.660885 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.704492   820 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.707098 24591 raft_consensus.cc:2468] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:45.663303   828 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:45.664268 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.708235 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44011.7us
W20260709 13:11:45.708858 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.709426 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.710186 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.711063 24563 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.711498 24563 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:45.710950   828 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.665413   817 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.666256   815 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 23 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.716713   817 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.718894   817 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:45.719276 23430 tablet_replica.cc:333] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.720260 23430 raft_consensus.cc:2243] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.720788 23430 raft_consensus.cc:2272] T c6328dd8c55f4742b015ea60e33773bc P 0131806e3b9647128f32db1ab8d314fc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.673759 25184 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.620499 24414 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 18 to 23, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 23 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:45.674718   827 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:11:45.712731 25182 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.712620   828 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.723865   817 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:45.713922   837 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:45.712575 24563 leader_election.cc:336] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.724748 25182 leader_election.cc:336] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.724884 24563 leader_election.cc:304] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
W20260709 13:11:45.725411 25182 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.726013 25182 leader_election.cc:336] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.726161   739 raft_consensus.cc:2749] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:45.726419 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:45.727145   827 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:45.727516 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.726014 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:45.728137 24414 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:45.729606 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.730263 25182 leader_election.cc:336] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.730315 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:45.730037 24414 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 15 to 18, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 18 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:45.730769 25182 leader_election.cc:304] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:45.731001 24563 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.733441 23430 tablet_replica.cc:333] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.734925   837 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:45.737531 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63855.2us
I20260709 13:11:45.742223 23430 raft_consensus.cc:2243] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.743310 23430 raft_consensus.cc:2272] T bf2646e18c7042728614c4bbf5b867aa P 0131806e3b9647128f32db1ab8d314fc [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.746130 23430 tablet_replica.cc:333] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.739223 24491 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:45.739548 24563 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.746824   815 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:45.750542   805 consensus_queue.cc:1059] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:45.751575   805 raft_consensus.cc:3055] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:11:45.751893   805 raft_consensus.cc:740] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:45.753542 24639 leader_election.cc:304] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:45.754475   807 raft_consensus.cc:2804] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:45.754910   807 raft_consensus.cc:697] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
W20260709 13:11:45.756166 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:45.758411 24598 raft_consensus.cc:1240] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
W20260709 13:11:45.758914 24637 leader_election.cc:336] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.759455 24596 raft_consensus.cc:1275] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
W20260709 13:11:45.739140 25182 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.755740   807 consensus_queue.cc:237] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:45.760905 25182 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.762163 25182 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.763505 23430 raft_consensus.cc:2243] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.752767   805 consensus_queue.cc:260] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.741353 24414 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 15 to 18, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 18 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.765244   827 raft_consensus.cc:2749] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:45.767300 24414 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 12 to 16, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 16 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:45.772626 24563 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.778748 24637 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:45.779871 24563 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.782238 25185 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:45.784586   817 raft_consensus.cc:2749] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.781574 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:45.780108 23430 pending_rounds.cc:70] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:45.779713 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.780576   833 raft_consensus.cc:2749] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:45.796630 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:45.797526   805 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:45.799602   812 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:45.800311   804 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:11:45.800712   804 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.801051   804 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:11:45.786171 23430 pending_rounds.cc:77] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 23 index: 11 } timestamp: 7305636607063810048 op_type: NO_OP noop_request { }
I20260709 13:11:45.797166 25185 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:45.804473 23430 raft_consensus.cc:2889] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:45.804913 23430 raft_consensus.cc:2272] T e6a2e9eb050b40f8b828d36d037224d8 P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.795518 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:45.807749 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:45.809487 25184 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.812386   808 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:45.812808   808 raft_consensus.cc:493] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.813174   808 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:11:45.814999 24668 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:11:45.816759   739 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:11:45.808220   837 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.014s
I20260709 13:11:45.824646 23430 tablet_replica.cc:333] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.812824 24414 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 14 to 18, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 18 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
W20260709 13:11:45.833505 24563 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 177 similar messages]
I20260709 13:11:45.807649   827 consensus_queue.cc:1059] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:11:45.835234   817 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:11:45.835677   817 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.836050   817 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:11:45.841786 25182 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.837853 24414 catalog_manager.cc:5697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 12 to 15, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 15 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:45.845548   804 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.852068   813 raft_consensus.cc:3055] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:11:45.852500   813 raft_consensus.cc:740] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:45.853567   804 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:45.853307   813 consensus_queue.cc:260] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.854521   813 raft_consensus.cc:3060] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:45.852119   805 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.857774   805 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.859884   805 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:45.861562 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52153.1us
I20260709 13:11:45.862043 23430 raft_consensus.cc:2243] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.866967 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:45.869246 24592 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 27.
I20260709 13:11:45.867530   837 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.873059 23430 pending_rounds.cc:70] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:45.874722 23430 pending_rounds.cc:77] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 21 index: 15 } timestamp: 7305636607150608384 op_type: NO_OP noop_request { }
I20260709 13:11:45.875114 23430 raft_consensus.cc:2889] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:45.875258 25184 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.877060   827 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:45.877954 23430 raft_consensus.cc:2272] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.878989 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:45.880429   842 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:45.890317   842 raft_consensus.cc:493] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.890645   842 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:45.890723 23430 tablet_replica.cc:333] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.891705 23430 raft_consensus.cc:2243] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.892669 23430 raft_consensus.cc:2272] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.866210   808 raft_consensus.cc:515] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:45.879884 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 82824.6us
W20260709 13:11:45.849859 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:45.894333 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 44549.4us
I20260709 13:11:45.895407 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.895948 24639 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.899148 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.899209 24639 leader_election.cc:304] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.900820   804 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:45.887413   837 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:45.885627   817 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.904922   817 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:45.906056   807 raft_consensus.cc:2749] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:45.910548   808 leader_election.cc:290] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:45.911276 24639 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:11:45.912891 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.913666   807 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:45.926198 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:45.926867 24673 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 29.
I20260709 13:11:45.927582 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:45.929615   817 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:45.911543   805 raft_consensus.cc:2749] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:45.936127 25184 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:45.937824   817 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:45.937673   808 consensus_queue.cc:1048] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:45.940925 23430 tablet_replica.cc:333] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.942359 23430 raft_consensus.cc:2243] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:45.941445 25182 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.935456   842 raft_consensus.cc:515] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.942970 23430 raft_consensus.cc:2272] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.960446 24667 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 13:11:45.946628 25219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.947520 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d76b8a93c540a2936fa04c6712e968" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.949612 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:45.949980 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:45.965655 25213 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 27: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:45.950662 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:45.966821 25212 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 25: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:45.958181 25216 raft_consensus.cc:1240] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Rejecting Update request from peer 96002c98f2d142e4b67dc5105a06079c for earlier term 28. Current term is 29. Ops: []
I20260709 13:11:45.943856 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:11:45.944811 25182 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.968586   813 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:11:45.969138 25182 leader_election.cc:336] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:45.969681   842 leader_election.cc:290] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:45.971186 24490 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.971668 23430 tablet_replica.cc:333] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
W20260709 13:11:45.971833 24490 raft_consensus.cc:2686] T 655be3d0d44f42a1aa683fd7271af488 P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:45.972610 23430 raft_consensus.cc:2243] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:11:45.973179   815 consensus_queue.cc:1175] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "983693721af6486c97ece1410a90cf30" responder_term: 19 status { last_received { term: 19 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 19 index: 14 } }
I20260709 13:11:45.970121   813 consensus_queue.cc:1048] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
W20260709 13:11:45.976214 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.981945 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:45.982746 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8b86e620fd64cf5b4c4a826cb95278a" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:45.984012   813 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:11:45.984520   813 raft_consensus.cc:493] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:45.984982   813 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:11:45.985481 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:45.985399   808 consensus_queue.cc:1059] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:11:45.986150 24591 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:45.986371   808 raft_consensus.cc:3055] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:11:45.986748   808 raft_consensus.cc:740] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:45.987521   808 consensus_queue.cc:260] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:45.990305 23430 raft_consensus.cc:2272] T 3f7e4efd4057430f8479100c05796bcf P 0131806e3b9647128f32db1ab8d314fc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.990489   808 raft_consensus.cc:3060] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:11:45.993160 23430 tablet_replica.cc:333] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:45.993624 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "0131806e3b9647128f32db1ab8d314fc" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:45.994187 25216 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:45.994287 24490 leader_election.cc:304] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0131806e3b9647128f32db1ab8d314fc; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
W20260709 13:11:45.994992 24490 raft_consensus.cc:2686] T b8b86e620fd64cf5b4c4a826cb95278a P 0131806e3b9647128f32db1ab8d314fc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:45.997710 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:45.999296 24565 leader_election.cc:304] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:46.000496 24565 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30
I20260709 13:11:45.994220 24591 raft_consensus.cc:2468] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 28.
W20260709 13:11:46.002707 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08000f67c0 after lost signal to thread 23433
I20260709 13:11:46.003178 24596 raft_consensus.cc:1275] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 28 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260709 13:11:46.003185   773 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:46.003628   760 raft_consensus.cc:2749] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:11:46.004290 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7ee2372084b4767aa79fc57a0c53278" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:46.002660 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:46.005713 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:46.005991   760 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:11:46.006506   773 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:11:46.006524 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff460 after lost signal to thread 24457
W20260709 13:11:46.007684 25240 debug-util.cc:398] Leaking SignalData structure 0x7b0800327260 after lost signal to thread 24549
W20260709 13:11:46.008721 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7800 after lost signal to thread 24624
W20260709 13:11:46.009960 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08001718a0 after lost signal to thread 24698
W20260709 13:11:46.010303 25240 debug-util.cc:398] Leaking SignalData structure 0x7b08001549e0 after lost signal to thread 24699
I20260709 13:11:46.010308 25216 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0131806e3b9647128f32db1ab8d314fc in term 23.
W20260709 13:11:46.011533 25240 debug-util.cc:398] Leaking SignalData structure 0x7b0800302260 after lost signal to thread 25243
W20260709 13:11:46.011890 25240 debug-util.cc:398] Leaking SignalData structure 0x7b0800109a00 after lost signal to thread 25244
I20260709 13:11:46.011116   773 consensus_queue.cc:1059] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:11:46.012696 24596 raft_consensus.cc:1240] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Rejecting Update request from peer 983693721af6486c97ece1410a90cf30 for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 13:11:46.012929   773 raft_consensus.cc:3055] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:11:46.013434   773 raft_consensus.cc:740] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:46.014482 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:46.014349   773 consensus_queue.cc:260] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.014730 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:46.015239 24592 raft_consensus.cc:2393] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 27: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:46.017676 24596 raft_consensus.cc:2393] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 in current term 25: Already voted for candidate 96002c98f2d142e4b67dc5105a06079c in this term.
I20260709 13:11:46.019474 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:46.021677 23430 raft_consensus.cc:2243] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:11:46.020946 24639 leader_election.cc:304] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:46.026897 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f5d915fb71474ab2b58063813a93a9" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:46.027236 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:46.027791 24591 raft_consensus.cc:3060] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:11:46.015934   773 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:46.013754   813 raft_consensus.cc:515] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.033210 23430 raft_consensus.cc:2272] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 0131806e3b9647128f32db1ab8d314fc [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:46.035598 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:46.024679   817 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:11:46.030697   811 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:11:46.026587   842 raft_consensus.cc:2804] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:46.026301   804 consensus_queue.cc:1048] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.011s
I20260709 13:11:46.041556   811 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:11:46.042490   842 raft_consensus.cc:697] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 28 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:46.043617   842 consensus_queue.cc:237] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.048080 24591 raft_consensus.cc:2468] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 27.
I20260709 13:11:46.057391 25184 leader_election.cc:304] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:46.061038   804 raft_consensus.cc:2804] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:11:46.086199 23430 tablet_replica.cc:333] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:46.082355   804 raft_consensus.cc:697] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:46.095762   804 consensus_queue.cc:237] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:46.109112 25182 leader_election.cc:336] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:46.107309 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:46.119760 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.120985 25212 raft_consensus.cc:2410] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d for term 28 because replica has last-logged OpId of term: 27 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
I20260709 13:11:46.126518 23430 raft_consensus.cc:2243] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:46.153029 23430 pending_rounds.cc:70] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:46.153335 23430 pending_rounds.cc:77] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 20 index: 11 } timestamp: 7305636618784305152 op_type: NO_OP noop_request { }
I20260709 13:11:46.153684 23430 raft_consensus.cc:2889] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:46.154001 23430 raft_consensus.cc:2272] T cf80704aefe74fbe81e575cc17508b9a P 0131806e3b9647128f32db1ab8d314fc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:46.156342 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243f0803aa8e4b9e938126e02e960e97" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:46.156966 24666 raft_consensus.cc:3060] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:11:46.171036 24666 raft_consensus.cc:2468] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 30.
I20260709 13:11:46.173136 25185 leader_election.cc:304] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:46.174265   827 raft_consensus.cc:2804] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:11:46.174767   827 raft_consensus.cc:697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 30 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:46.175598   827 consensus_queue.cc:237] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:46.188963 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.156654   813 leader_election.cc:290] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 30 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:46.194741 25212 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:11:46.199510 25212 pending_rounds.cc:85] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 15
I20260709 13:11:46.199846 25212 pending_rounds.cc:107] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:11:46.200934 25212 raft_consensus.cc:2889] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.204550   842 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:11:46.231503 23430 tablet_replica.cc:333] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:46.250440 23430 raft_consensus.cc:2243] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:46.259040 23430 pending_rounds.cc:70] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Trying to abort 1 pending ops.
I20260709 13:11:46.259322 23430 pending_rounds.cc:77] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc: Aborting op as it isn't in flight: id { term: 23 index: 18 } timestamp: 7305636646526496768 op_type: NO_OP noop_request { }
I20260709 13:11:46.261858 23430 raft_consensus.cc:2889] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:46.262323 23430 raft_consensus.cc:2272] T e2fa80994624487d980c9d3ef7a166ce P 0131806e3b9647128f32db1ab8d314fc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:46.295831 23430 tablet_replica.cc:333] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc: stopping tablet replica
I20260709 13:11:46.296540 23430 raft_consensus.cc:2243] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:46.297470 23430 raft_consensus.cc:2272] T 30a58475c1d54873be44217fc84b05ec P 0131806e3b9647128f32db1ab8d314fc [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:46.298825 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:46.321416 24593 raft_consensus.cc:1275] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:11:46.325728   807 consensus_queue.cc:1048] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:46.330168 24419 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 25, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 25 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.334189 24419 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.335632 24419 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 22, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 22 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:46.342140 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:46.352265 24419 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 20, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 20 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:46.354846 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.354668 24419 catalog_manager.cc:5697] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.356063 24419 catalog_manager.cc:5697] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.363065 24419 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 25, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 25 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.365608 24419 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 18 to 25. New cstate: current_term: 25 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:46.371618 24414 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 350) took 36945 ms (client timeout 15000 ms). Trace:
W20260709 13:11:46.387089 24563 consensus_peers.cc:597] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.374627 24419 catalog_manager.cc:5697] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.394871 24419 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 25 to 28. New cstate: current_term: 28 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.405982 24419 catalog_manager.cc:5697] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 22 to 24, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 24 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:46.385185 24414 rpcz_store.cc:269] 0709 13:11:09.425799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.426060 (+   261us) service_pool.cc:224] Handling call
0709 13:11:46.371522 (+36945462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:45.931319 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:45.932010 (+   691us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:45.932061 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:11:45.932086 (+    25us) tablet.cc:662] Decoding operations
0709 13:11:45.933300 (+  1214us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:45.933412 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:45.933431 (+    19us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:11:45.934306 (+   875us) tablet.cc:701] Row locks acquired
0709 13:11:45.934348 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:11:45.934472 (+   124us) write_op.cc:270] Start()
0709 13:11:45.934607 (+   135us) write_op.cc:276] Timestamp: P: 1783602705934422 usec, L: 0
0709 13:11:45.934623 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:11:45.935169 (+   546us) log.cc:844] Serialized 4410 byte log entry
0709 13:11:45.997355 (+ 62186us) op_driver.cc:464] REPLICATION: finished
0709 13:11:46.039079 (+ 41724us) write_op.cc:301] APPLY: starting
0709 13:11:46.039179 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:46.091418 (+ 52239us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:46.091537 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:46.222924 (+131387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:46.223178 (+   254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:11:46.223222 (+    44us) write_op.cc:312] APPLY: finished
0709 13:11:46.223515 (+   293us) log.cc:844] Serialized 105 byte log entry
0709 13:11:46.223680 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:46.223811 (+   131us) write_op.cc:454] Released schema lock
0709 13:11:46.223859 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:46.224285 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:46.224318 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":867821,"reported_tablets":46,"spinlock_wait_cycles":24192,"child_traces":[["op",{"apply.queue_time_us":37528,"apply.run_cpu_time_us":16943,"apply.run_wall_time_us":185184,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":75987,"prepare.run_cpu_time_us":8245,"prepare.run_wall_time_us":42579,"raft.queue_time_us":22288,"raft.run_cpu_time_us":10611,"raft.run_wall_time_us":35361,"replication_time_us":62583,"thread_start_us":160524,"threads_started":4,"wal-append.queue_time_us":37159}]]}
I20260709 13:11:46.409884 24419 catalog_manager.cc:5697] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 15 to 20, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 20 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:46.421049 24419 catalog_manager.cc:5697] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 19 to 21, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.423205 24419 catalog_manager.cc:5697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
W20260709 13:11:46.438903 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.449920 24419 catalog_manager.cc:5697] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.456101 24419 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 20, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 20 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.457841 24419 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 14 to 25, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 25 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.492491 25216 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 19. (term mismatch)
I20260709 13:11:46.492894 25216 pending_rounds.cc:85] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Aborting all ops after (but not including) 18
I20260709 13:11:46.493134 25216 pending_rounds.cc:107] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: Aborting uncommitted NO_OP operation due to leader change: 27.19
I20260709 13:11:46.493384 25216 raft_consensus.cc:2889] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.495061   842 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:11:46.532294 24593 raft_consensus.cc:1275] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:11:46.534222   842 consensus_queue.cc:1048] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:11:46.542938 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:46.547399 24637 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.558990 24591 raft_consensus.cc:1275] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:11:46.560549   836 consensus_queue.cc:1048] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:11:46.583487 24591 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.593335 24415 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 12 to 18, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 18 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:46.596721 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:46.597369 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:46.594847   831 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:46.598105   833 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:46.598263   831 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.598659   833 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.600718 24415 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.602216   831 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:46.604729 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:46.605470 25213 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 20.
I20260709 13:11:46.606575 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:46.612152 25213 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:46.612808 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:46.614529   831 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:46.617301 24667 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:11:46.621476   760 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:46.625855   812 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:46.626670   812 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.634240   812 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:46.634450 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:46.607626   833 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:46.636446 25213 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:46.644483 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:46.645274 24593 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
W20260709 13:11:46.646518 24563 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.647576 24563 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:46.649751   739 raft_consensus.cc:2749] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:46.650432   739 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:46.650899   739 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:46.652937   739 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:46.656764 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:46.657963   807 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:46.658492   807 raft_consensus.cc:493] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:46.658972   807 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:46.663800 24563 leader_election.cc:336] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.665485 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:46.666771   739 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:46.666496 24419 catalog_manager.cc:5697] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 22 to 28. New cstate: current_term: 28 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.668118 24673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:46.667999 24419 catalog_manager.cc:5697] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 25 to 28, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 28 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.668949 24673 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 21.
I20260709 13:11:46.669526 24419 catalog_manager.cc:5697] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 25 to 29. New cstate: current_term: 29 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:46.681191 24563 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.681824 24419 catalog_manager.cc:5697] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 16 to 20, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 20 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.683359 24419 catalog_manager.cc:5697] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.694769   760 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:46.695447   760 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.697886   760 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:46.700888 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:46.710498   739 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 9 to 16, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.713639 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:46.714560   773 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:11:46.714979   773 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:46.715375   773 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:46.718175 24637 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:46.726411 24563 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.722105 25216 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 9 to 16, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.726895 24563 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:46.732401   833 raft_consensus.cc:2749] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:46.728382 24674 raft_consensus.cc:2955] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 9 to 16, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:46.763921 24415 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 249) took 43161 ms (client timeout 15000 ms). Trace:
I20260709 13:11:46.771003   807 raft_consensus.cc:515] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.771653 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44024
I20260709 13:11:46.772334 24667 raft_consensus.cc:606] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Received request to transfer leadership
I20260709 13:11:46.774691   807 leader_election.cc:290] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:46.768941 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:46.777935 24667 raft_consensus.cc:1275] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 30 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 13:11:46.782457   773 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:46.786409   773 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:46.786337   813 consensus_queue.cc:1048] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:11:46.764365 24415 rpcz_store.cc:269] 0709 13:11:03.651401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.678553 (+ 27152us) service_pool.cc:224] Handling call
0709 13:11:46.763832 (+43085279us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:46.647795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:46.648331 (+   536us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:46.648374 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:11:46.648394 (+    20us) tablet.cc:662] Decoding operations
0709 13:11:46.648804 (+   410us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:46.648870 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:46.648899 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:46.649249 (+   350us) tablet.cc:701] Row locks acquired
0709 13:11:46.649276 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:11:46.649424 (+   148us) write_op.cc:270] Start()
0709 13:11:46.649545 (+   121us) write_op.cc:276] Timestamp: P: 1783602706649388 usec, L: 0
0709 13:11:46.649571 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:46.650175 (+   604us) log.cc:844] Serialized 925 byte log entry
0709 13:11:46.652100 (+  1925us) op_driver.cc:464] REPLICATION: finished
0709 13:11:46.652533 (+   433us) write_op.cc:301] APPLY: starting
0709 13:11:46.652610 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:46.653973 (+  1363us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:46.654065 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:46.655393 (+  1328us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:46.655565 (+   172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:11:46.655623 (+    58us) write_op.cc:312] APPLY: finished
0709 13:11:46.655817 (+   194us) log.cc:844] Serialized 33 byte log entry
0709 13:11:46.655965 (+   148us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:46.656050 (+    85us) write_op.cc:454] Released schema lock
0709 13:11:46.656088 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:46.656451 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:46.657031 (+   580us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6665,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":3864,"apply.run_wall_time_us":3864,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":2625,"prepare.run_wall_time_us":2638,"replication_time_us":2402}]]}
I20260709 13:11:46.809465 24409 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e7ec39f0d4e04761ae598f1245692799 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:46.821174 24673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44024
I20260709 13:11:46.821827 24673 raft_consensus.cc:606] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Received request to transfer leadership
W20260709 13:11:46.822723 24637 leader_election.cc:336] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.829996 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:46.830545 24666 raft_consensus.cc:3060] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:11:46.826798 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 63715.3us
I20260709 13:11:46.846329   842 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.849929   842 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:46.851173 24417 catalog_manager.cc:5697] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 18 to 22, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 22 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.853483   842 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:46.865871 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:46.865356 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:46.859724   879 raft_consensus.cc:993] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: : Instructing follower 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:11:46.864671 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:46.845050 24666 raft_consensus.cc:2468] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 22.
I20260709 13:11:46.855404 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2b0253cbb445a4bb49f874e70ea972" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:46.867825 24591 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:46.866715 24593 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:46.868255 25216 raft_consensus.cc:3060] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:46.868392 24563 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:46.869539 24637 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.869846 24566 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:46.870972   760 raft_consensus.cc:2804] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:46.871464   760 raft_consensus.cc:697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:46.872715 24666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08"
dest_uuid: "148dc963cec64232ad3b248abad6f36d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44024
I20260709 13:11:46.872370   760 consensus_queue.cc:237] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:46.875725 25216 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:46.879982   842 raft_consensus.cc:1081] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Signalling peer 983693721af6486c97ece1410a90cf30 to start an election
I20260709 13:11:46.880970 24666 raft_consensus.cc:606] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Received request to transfer leadership
I20260709 13:11:46.885185 25216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08"
dest_uuid: "983693721af6486c97ece1410a90cf30"
 from {username='slave'} at 127.0.0.1:48918
I20260709 13:11:46.885739 25216 raft_consensus.cc:493] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.886098 25216 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:46.897534 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:46.899286   879 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:46.899752   879 raft_consensus.cc:493] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.900242   879 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:46.906293 24593 raft_consensus.cc:2468] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 21.
I20260709 13:11:46.907928 25216 raft_consensus.cc:515] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.886943 24417 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 20 to 22, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 22 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:46.913489 24639 leader_election.cc:304] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:46.911548   842 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.916129   878 raft_consensus.cc:2804] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:46.916261   842 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.916651   878 raft_consensus.cc:697] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:46.917974 25216 leader_election.cc:290] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:46.918957 25182 leader_election.cc:336] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.919802 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:46.920280 24593 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:46.920647 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45fddcc6d2bc4726a21bdfe31a4cae08" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:46.921049 24667 raft_consensus.cc:3055] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:46.921380 24667 raft_consensus.cc:740] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:46.924216   878 consensus_queue.cc:237] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:46.926352 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:46.925556 24667 consensus_queue.cc:260] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:46.927794 24667 raft_consensus.cc:3060] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:46.930262   842 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:46.931433 24417 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 19 to 26. New cstate: current_term: 26 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.935900 24417 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:46.924800   879 raft_consensus.cc:515] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:46.939915 24593 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:46.941490 24667 raft_consensus.cc:2468] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:11:46.945007 25185 leader_election.cc:304] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:46.945850   827 raft_consensus.cc:2804] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:46.946328   827 raft_consensus.cc:697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:46.948269   827 consensus_queue.cc:237] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:46.962626 24637 leader_election.cc:336] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.965693   879 leader_election.cc:290] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:46.977514 24417 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 11 to 20. New cstate: current_term: 20 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:46.980753 24471 auto_rebalancer.cc:893] Removing replace marker failed: Replica 148dc963cec64232ad3b248abad6f36d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:46.982162 24471 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 45fddcc6d2bc4726a21bdfe31a4cae08 already in progress
W20260709 13:11:46.982525 24471 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 45fddcc6d2bc4726a21bdfe31a4cae08 already in progress
I20260709 13:11:46.985133 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:46.985924 24593 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:11:46.988116 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:46.990274 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d76f2e8d504bd29a4d29e4926a9407" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:46.990862 24593 raft_consensus.cc:3060] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:46.990530 24417 catalog_manager.cc:5697] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 16 to 17, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 17 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:47.009961 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.013571 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:47.003116 24593 raft_consensus.cc:2468] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 24.
I20260709 13:11:47.015936   878 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:47.016049 24639 leader_election.cc:304] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.016357   878 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.016702   878 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:47.017246   879 raft_consensus.cc:2804] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:47.017767   879 raft_consensus.cc:697] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:47.018589   879 consensus_queue.cc:237] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:47.038841   878 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.049399   827 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.050906   827 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.054280 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:47.054875 24593 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:47.057056 25182 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:47.057288 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:47.053035   827 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:47.057948 24596 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 19.
I20260709 13:11:47.058861 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:47.059392 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.061424   878 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:47.062736 24415 catalog_manager.cc:5697] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 25 to 27, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 27 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:47.062263   827 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:47.065605   827 raft_consensus.cc:493] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.066043   827 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:47.065286 24415 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index 9 to 16, VOTER 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) evicted. New cstate: current_term: 25 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.072444   813 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.073093   808 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.072981   813 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.073623   808 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.075050   813 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:47.075623   808 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:47.085145 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:47.086303   827 raft_consensus.cc:515] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.086692 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:47.088425   827 leader_election.cc:290] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:47.090515   804 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.091010   804 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.093699 24593 raft_consensus.cc:2468] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 26.
W20260709 13:11:47.093448 25182 leader_election.cc:336] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:47.095299 25182 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
W20260709 13:11:47.096800 25182 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:47.097409 25182 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:47.099550   808 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
W20260709 13:11:47.104319 25182 connection.cc:769] client connection to 127.22.225.129:45343 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:11:47.099798   827 raft_consensus.cc:2749] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:47.102422   836 raft_consensus.cc:2749] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:11:47.101735   804 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:47.113863 24417 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 250) took 20004 ms (client timeout 15000 ms). Trace:
W20260709 13:11:47.115861 24417 rpcz_store.cc:269] 0709 13:11:27.109797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.110256 (+   459us) service_pool.cc:224] Handling call
0709 13:11:27.442640 (+332384us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b54002265d4. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17bbeb0090 00007f17bbf4ef3a 00007f17c1d051cc 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:11:27.551315 (+108675us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b5400002490. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e22640 00007f17c1cf9b76 00007f17c1e03c3e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc 00007f17c02c3392 00007f17ba28148c 00007f17ba2808c6
0709 13:11:47.113735 (+19562420us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:47.009376 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:47.009914 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:47.009951 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:11:47.009963 (+    12us) tablet.cc:662] Decoding operations
0709 13:11:47.010705 (+   742us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:47.010761 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:47.010802 (+    41us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:47.011287 (+   485us) tablet.cc:701] Row locks acquired
0709 13:11:47.011301 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:11:47.011423 (+   122us) write_op.cc:270] Start()
0709 13:11:47.011531 (+   108us) write_op.cc:276] Timestamp: P: 1783602707011385 usec, L: 0
0709 13:11:47.011547 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:11:47.012193 (+   646us) log.cc:844] Serialized 2466 byte log entry
0709 13:11:47.021614 (+  9421us) op_driver.cc:464] REPLICATION: finished
0709 13:11:47.021914 (+   300us) write_op.cc:301] APPLY: starting
0709 13:11:47.022003 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:47.025534 (+  3531us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:47.025626 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:47.029336 (+  3710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:47.029520 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:11:47.029566 (+    46us) write_op.cc:312] APPLY: finished
0709 13:11:47.034233 (+  4667us) log.cc:844] Serialized 65 byte log entry
0709 13:11:47.034427 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.034527 (+   100us) write_op.cc:454] Released schema lock
0709 13:11:47.034572 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:47.034907 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.034931 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":840,"reported_tablets":43,"spinlock_wait_cycles":175884416,"child_traces":[["op",{"apply.queue_time_us":127,"apply.run_cpu_time_us":8607,"apply.run_wall_time_us":12953,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25080,"num_ops":6,"prepare.queue_time_us":2486,"prepare.run_cpu_time_us":3119,"prepare.run_wall_time_us":12048,"replication_time_us":9979}]]}
I20260709 13:11:47.100499   808 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:47.208684 25182 leader_election.cc:336] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:11:47.271431 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73880209aa174d609bf830ad4c666c8c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:47.272058 24596 raft_consensus.cc:3060] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:47.276705 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:47.276841 24639 leader_election.cc:304] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 983693721af6486c97ece1410a90cf30
I20260709 13:11:47.277369 24591 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 22.
I20260709 13:11:47.281476   807 raft_consensus.cc:2804] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:47.282056   807 raft_consensus.cc:697] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:47.282795   807 consensus_queue.cc:237] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.315346   879 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.315902   879 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.320189 24596 raft_consensus.cc:2468] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
W20260709 13:11:47.270246 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 164253us
I20260709 13:11:47.319197   879 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:47.334830 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 57188.5us
W20260709 13:11:47.354295 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 76403.1us
I20260709 13:11:47.355702 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:47.359335 25213 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 22.
I20260709 13:11:47.362706   739 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.363221   739 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.366598 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
W20260709 13:11:47.368498 24637 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.371073   804 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:47.382050 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.373919 25184 leader_election.cc:304] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.378955   804 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.378955   739 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:47.393740   892 raft_consensus.cc:2804] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:47.386116   879 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.389803   885 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:11:47.400460 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:47.403064 24668 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 28.
I20260709 13:11:47.407593 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:47.396225   804 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:47.405637   885 raft_consensus.cc:493] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.414958   892 raft_consensus.cc:697] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:47.410816   879 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.424769   885 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:47.444696   892 consensus_queue.cc:237] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.449472   899 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:11:47.449924   899 raft_consensus.cc:493] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.450251   899 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:47.454939   879 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:47.497404   808 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:47.502503   891 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:47.503150   891 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:47.508550 24563 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.510015   808 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.520164   808 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.522178   808 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:47.494081   904 raft_consensus.cc:493] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:47.524732   904 raft_consensus.cc:515] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.526736   904 leader_election.cc:290] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:47.537292   891 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:47.540093   804 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.548040 24596 raft_consensus.cc:1275] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:11:47.549289 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:47.549916 24591 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 29.
W20260709 13:11:47.513634 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 122218us
W20260709 13:11:47.564169 24637 leader_election.cc:336] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:47.564724 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:47.563479 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:47.567833 24666 raft_consensus.cc:1275] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:11:47.570839 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:47.572724 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:47.573549 24591 raft_consensus.cc:2368] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 25. Current term is 26.
I20260709 13:11:47.575768 24593 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:47.576735 25184 leader_election.cc:400] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 25. Current term is 26.
I20260709 13:11:47.577054 25184 leader_election.cc:403] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:47.584501   833 consensus_queue.cc:1048] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:47.586760 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:47.569155   805 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:11:47.587332   805 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:47.587749   805 raft_consensus.cc:3060] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:47.590348 24421 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.593386   897 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.593946   897 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.593895   899 raft_consensus.cc:515] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.596233   897 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:47.596648 24598 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
I20260709 13:11:47.598277   836 raft_consensus.cc:3060] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:11:47.566701   891 consensus_queue.cc:1048] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 13:11:47.606734 25182 leader_election.cc:336] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.606827   902 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:47.610033   805 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.611110   885 raft_consensus.cc:515] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.611979   804 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:47.596562   899 leader_election.cc:290] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:47.621381 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:47.636044 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:47.636569 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:47.637359 24598 raft_consensus.cc:3060] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:11:47.640656   901 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:11:47.646533 25185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 239125us
W20260709 13:11:47.654234 24563 consensus_peers.cc:597] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:47.660001 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:47.659301   836 raft_consensus.cc:2749] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455) with higher term. Message: Invalid argument: T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 983693721af6486c97ece1410a90cf30 for earlier term 25. Current term is 26.
I20260709 13:11:47.646457   901 raft_consensus.cc:493] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.665035   901 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:47.665405 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
W20260709 13:11:47.666275 24563 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:47.667917 25182 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.668751 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d807668edef41d5b0b7e311228f18c2" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:47.669406 25182 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:47.670328 25182 leader_election.cc:336] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.681479 24674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf2646e18c7042728614c4bbf5b867aa" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:11:47.682374 24674 raft_consensus.cc:3060] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:11:47.688683 24670 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:47.694662 24674 raft_consensus.cc:2468] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 29.
W20260709 13:11:47.707525 25182 leader_election.cc:336] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.721051 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:47.725509 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:47.726363 25213 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 23.
I20260709 13:11:47.729261 24599 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:11:47.730985   807 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:11:47.661856   805 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:47.738611 25216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:47.739487 25214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:47.745867 25213 raft_consensus.cc:1275] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:11:47.747666 25214 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 29: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:47.749334 24592 raft_consensus.cc:1275] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:47.739394 25216 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 19.
I20260709 13:11:47.753335 24591 raft_consensus.cc:2468] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 29.
I20260709 13:11:47.756858 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:47.757871   903 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:47.761220 25185 leader_election.cc:304] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.773228 24639 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c; no voters: 
I20260709 13:11:47.773416 25217 raft_consensus.cc:2393] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 148dc963cec64232ad3b248abad6f36d in current term 29: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:47.774114   812 raft_consensus.cc:2804] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader election won for term 29
W20260709 13:11:47.774178 24407 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 66189.4us
I20260709 13:11:47.774686   812 raft_consensus.cc:697] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 29 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:47.775547   812 consensus_queue.cc:237] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.792274 24598 raft_consensus.cc:2468] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 23.
I20260709 13:11:47.793548 25184 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.794859 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.800283 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.771633   906 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.808482   831 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:11:47.808947   831 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.809430   831 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:47.795405   904 raft_consensus.cc:2804] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:11:47.805194   902 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:47.814818   902 raft_consensus.cc:493] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0131806e3b9647128f32db1ab8d314fc)
I20260709 13:11:47.815174   902 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:47.806581   842 consensus_queue.cc:1048] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:11:47.799850   804 consensus_queue.cc:1048] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:11:47.818131   904 raft_consensus.cc:697] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 29 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:47.819128   904 consensus_queue.cc:237] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.813097   906 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.822609   906 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:47.802062   899 raft_consensus.cc:2804] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:47.823585   899 raft_consensus.cc:697] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:47.824760   899 consensus_queue.cc:237] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.828955   885 leader_election.cc:290] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:47.839865 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:47.843792 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:47.852648 25218 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 27.
I20260709 13:11:47.828621   831 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.867677 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6458c5ddfa4b4a4188e06ad9fc7d983d" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:47.868837 25217 raft_consensus.cc:3060] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:11:47.870637 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:47.841548 24407 catalog_manager.cc:4755] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7ec39f0d4e04761ae598f1245692799: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.876680 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:47.883944   833 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:11:47.892786   833 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.893169   833 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:11:47.896433 24637 leader_election.cc:336] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.882115   901 raft_consensus.cc:515] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.921384 25214 raft_consensus.cc:1275] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:11:47.942420   901 leader_election.cc:290] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:47.942544 25212 raft_consensus.cc:2393] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96002c98f2d142e4b67dc5105a06079c in current term 26: Already voted for candidate 983693721af6486c97ece1410a90cf30 in this term.
I20260709 13:11:47.944882   831 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:47.950276 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ca582b84fd4b4fa8344fc31bcb9c2a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c"
I20260709 13:11:47.950948 24596 raft_consensus.cc:3060] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:47.950244 25182 leader_election.cc:336] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:47.956074 24563 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.962347 24596 raft_consensus.cc:2468] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 26.
I20260709 13:11:47.976034 25184 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
W20260709 13:11:47.977012 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:47.977506 24563 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:47.978513 25213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "182cc63718a84173a76583588f193929" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:47.979297 25213 raft_consensus.cc:3060] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:11:47.990568 24565 leader_election.cc:304] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:47.974514   906 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.009326   831 raft_consensus.cc:2749] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:48.011368   902 raft_consensus.cc:515] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:47.990346   827 raft_consensus.cc:2804] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:48.018134   827 raft_consensus.cc:697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:11:48.024796 25217 raft_consensus.cc:2468] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:11:48.026777 24639 leader_election.cc:304] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:47.973963   878 consensus_queue.cc:1048] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 13:11:48.028355 25213 raft_consensus.cc:2468] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 24.
W20260709 13:11:48.034307 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 52371.9us
I20260709 13:11:48.029189 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7e4efd4057430f8479100c05796bcf" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:48.034984 25217 raft_consensus.cc:3060] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:48.040283 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 49799.4us
I20260709 13:11:48.044816 25217 raft_consensus.cc:2468] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 20.
I20260709 13:11:48.045945 24639 leader_election.cc:304] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:48.033310   902 leader_election.cc:290] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:48.049656 24565 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:48.037636   891 raft_consensus.cc:2804] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:11:48.058431   760 raft_consensus.cc:2804] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:11:48.045047   827 consensus_queue.cc:237] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.065572   760 raft_consensus.cc:697] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:48.066488   760 consensus_queue.cc:237] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.005136   906 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.051071   900 raft_consensus.cc:2804] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:11:48.075274 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.076122   921 log.cc:927] Time spent T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:11:48.076310 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:48.089053 24599 raft_consensus.cc:1275] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:11:48.069321   891 raft_consensus.cc:697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 23 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:48.101787   892 consensus_queue.cc:1048] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:11:48.083813   900 raft_consensus.cc:697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:11:48.117774   891 consensus_queue.cc:237] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.116446   833 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.151324   833 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:48.151851 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.152379 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.176808 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.178273 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:48.178450 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba23ab1f03ef40238962f541c00081d1" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:48.179085 25218 raft_consensus.cc:3060] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:11:48.193531 24637 leader_election.cc:336] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:48.206513 25218 raft_consensus.cc:2468] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 28.
I20260709 13:11:48.117833   900 consensus_queue.cc:237] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.207934 24565 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:48.212761 25218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:48.213595 25218 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 25.
I20260709 13:11:48.214566   895 raft_consensus.cc:2804] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:11:48.223107   895 raft_consensus.cc:697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 28 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
W20260709 13:11:48.224668 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.224897   895 consensus_queue.cc:237] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.212251   906 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:48.240020 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.242257 24563 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:48.250790 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.274423 24563 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:48.296579 25217 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:11:48.280949 24415 catalog_manager.cc:5697] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 22, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 22 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.300804 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc
I20260709 13:11:48.301121 24591 raft_consensus.cc:1275] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:11:48.301903   906 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:11:48.302392   906 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.311493   906 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:11:48.309360   889 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.007s
I20260709 13:11:48.331947 24591 raft_consensus.cc:1275] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:11:48.336445   910 consensus_queue.cc:1048] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:11:48.343709   906 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.320997   900 consensus_queue.cc:1048] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.031s
I20260709 13:11:48.350383 24674 raft_consensus.cc:1275] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 13:11:48.352883   925 consensus_queue.cc:1048] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 13:11:48.374012   906 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 election: Requested vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:11:48.375907 23430 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24546)
I20260709 13:11:48.386300 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b92ce30bcd84b2ca0734f9ebff2a43e" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:11:48.386970 25217 raft_consensus.cc:3060] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:11:48.418754 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.428854 25217 raft_consensus.cc:2468] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96002c98f2d142e4b67dc5105a06079c in term 26.
I20260709 13:11:48.438139 24565 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:11:48.444083   927 raft_consensus.cc:2804] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:11:48.444813   927 raft_consensus.cc:697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 26 LEADER]: Becoming Leader. State: Replica: 96002c98f2d142e4b67dc5105a06079c, State: Running, Role: LEADER
I20260709 13:11:48.445923   927 consensus_queue.cc:237] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:48.459933 24598 raft_consensus.cc:1275] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:11:48.476365   901 consensus_queue.cc:1048] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.010s
I20260709 13:11:48.527240 24420 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 20 to 22, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 22 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:48.529840 24563 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:48.538156 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.558137 24421 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 351) took 48326 ms (client timeout 15000 ms). Trace:
W20260709 13:11:48.538271 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:48.589118 25218 raft_consensus.cc:1275] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:11:48.592259   891 consensus_queue.cc:1048] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:11:48.599241 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.599812 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.558739 24421 rpcz_store.cc:269] 0709 13:11:00.231965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.257928 (+ 25963us) service_pool.cc:224] Handling call
0709 13:11:01.014906 (+756978us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400002490. stack: 00007f17b8e27343 00007f17b8e27240 00007f17b87b61d4 00007f17c24f4304 00007f17c24f4299 00007f17b8ce1db1 00007f17b8e21b71 00007f17b8e220b2 00007f17c1d9ba89 00007f17c1d33da6 00007f17c1d05088 00007f17c1e0337e 00007f17c02c42a4 00007f17c02c4232 00007f17c02c4161 00007f17c02c40dc
0709 13:11:48.558047 (+47543141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:47.885336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:47.890377 (+  5041us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:47.890416 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:11:47.890436 (+    20us) tablet.cc:662] Decoding operations
0709 13:11:47.890768 (+   332us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:47.890826 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:47.890856 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:47.891034 (+   178us) tablet.cc:701] Row locks acquired
0709 13:11:47.891050 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:11:47.891196 (+   146us) write_op.cc:270] Start()
0709 13:11:47.891317 (+   121us) write_op.cc:276] Timestamp: P: 1783602707891146 usec, L: 0
0709 13:11:47.891340 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:11:47.891974 (+   634us) log.cc:844] Serialized 539 byte log entry
0709 13:11:48.043711 (+151737us) op_driver.cc:464] REPLICATION: finished
0709 13:11:48.102154 (+ 58443us) write_op.cc:301] APPLY: starting
0709 13:11:48.102239 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:48.103285 (+  1046us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:48.103394 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:48.104214 (+   820us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:48.104404 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:11:48.104451 (+    47us) write_op.cc:312] APPLY: finished
0709 13:11:48.104635 (+   184us) log.cc:844] Serialized 25 byte log entry
0709 13:11:48.104812 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.104897 (+    85us) write_op.cc:454] Released schema lock
0709 13:11:48.104936 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:48.105331 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.105358 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20749,"reported_tablets":46,"spinlock_wait_cycles":31600000,"child_traces":[["op",{"apply.queue_time_us":58182,"apply.run_cpu_time_us":3046,"apply.run_wall_time_us":3165,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":228152,"prepare.run_cpu_time_us":2595,"prepare.run_wall_time_us":15095,"replication_time_us":152164,"thread_start_us":127713,"threads_started":2}]]}
W20260709 13:11:48.630429 24410 connection.cc:466] server connection from 127.0.0.1:41412 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 351) could send its response
I20260709 13:11:48.659433 24420 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 16 to 18, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 18 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.660992 25212 raft_consensus.cc:1275] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:11:48.664947   906 consensus_queue.cc:1048] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:11:48.682034 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.684047 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.684649 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.685043 24563 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.685848 24420 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 0131806e3b9647128f32db1ab8d314fc reported cstate change: term changed from 18 to 19, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 19 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:48.699123 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.709960 24593 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:11:48.729405 24670 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 13:11:48.734508 24565 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125): Couldn't send request to peer 983693721af6486c97ece1410a90cf30. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6a2e9eb050b40f8b828d36d037224d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.735378   773 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:48.739290 25213 raft_consensus.cc:1275] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:11:48.740809 25218 raft_consensus.cc:1275] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:48.745174   878 consensus_queue.cc:1048] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:11:48.745221   773 consensus_queue.cc:1048] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:11:48.745425 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.765650 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.767071 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.785007 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.791584 24563 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.790640 24415 catalog_manager.cc:5697] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 21 to 24, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 24 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } }
I20260709 13:11:48.797461   773 raft_consensus.cc:2955] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Committing config change with OpId 23.12: config changed from index -1 to 12, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:11:48.792814 24415 catalog_manager.cc:5697] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:48.808470 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.800469 24415 catalog_manager.cc:5697] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 20 to 21, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:48.810449 24670 raft_consensus.cc:2955] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Committing config change with OpId 23.12: config changed from index -1 to 12, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } } }
I20260709 13:11:48.836114 24415 catalog_manager.cc:5697] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 22 to 23, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 23 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:48.877475 24415 catalog_manager.cc:5697] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 14 to 24, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 24 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.879914 24415 catalog_manager.cc:5697] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 26 to 28, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 28 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:48.900385 24420 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 352) took 25753 ms (client timeout 15000 ms). Trace:
W20260709 13:11:48.900931 24420 rpcz_store.cc:269] 0709 13:11:23.147117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.147481 (+   364us) service_pool.cc:224] Handling call
0709 13:11:48.900312 (+25752831us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:48.719964 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:48.721892 (+  1928us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:48.722052 (+   160us) write_op.cc:435] Acquired schema lock
0709 13:11:48.722078 (+    26us) tablet.cc:662] Decoding operations
0709 13:11:48.723608 (+  1530us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:48.723667 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:48.723695 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:48.724002 (+   307us) tablet.cc:701] Row locks acquired
0709 13:11:48.724021 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:48.724155 (+   134us) write_op.cc:270] Start()
0709 13:11:48.724288 (+   133us) write_op.cc:276] Timestamp: P: 1783602708724110 usec, L: 0
0709 13:11:48.724311 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:11:48.724884 (+   573us) log.cc:844] Serialized 1311 byte log entry
0709 13:11:48.733716 (+  8832us) op_driver.cc:464] REPLICATION: finished
0709 13:11:48.734021 (+   305us) write_op.cc:301] APPLY: starting
0709 13:11:48.734112 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:48.735754 (+  1642us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:48.735849 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:48.744266 (+  8417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:48.744425 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:11:48.744469 (+    44us) write_op.cc:312] APPLY: finished
0709 13:11:48.744659 (+   190us) log.cc:844] Serialized 41 byte log entry
0709 13:11:48.744824 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.744910 (+    86us) write_op.cc:454] Released schema lock
0709 13:11:48.744951 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:48.745835 (+   884us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:48.745865 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":150867,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":4754,"apply.run_wall_time_us":11779,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":3053,"prepare.run_wall_time_us":6881,"replication_time_us":9276}]]}
I20260709 13:11:48.881747 24415 catalog_manager.cc:5697] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 19 to 20, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 20 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:48.921427 24410 connection.cc:466] server connection from 127.0.0.1:41412 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41412 (request call id 352) could send its response
I20260709 13:11:48.922254 24415 catalog_manager.cc:5697] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 20 to 21, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 21 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } attrs { replace: true } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:48.924099 24415 catalog_manager.cc:5697] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 28 to 29, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 29 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:48.941984 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:48.952355 24563 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.062285 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.078692 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.079877 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:49.084733 25212 raft_consensus.cc:1275] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:11:49.087347   773 consensus_queue.cc:1048] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:11:49.112874 24416 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 19 to 21, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 21 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:49.132886 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:49.216761 24407 catalog_manager.cc:4755] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7ec39f0d4e04761ae598f1245692799: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:49.228060 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:49.238330 24416 catalog_manager.cc:5697] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 21 to 26, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 26 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:49.298898 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.322667 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:49.330358 24420 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c reported cstate change: config changed from index -1 to 12, NON_VOTER 983693721af6486c97ece1410a90cf30 (127.22.225.132) added. New cstate: current_term: 23 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.332335 24420 catalog_manager.cc:5697] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 24 to 26, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 96002c98f2d142e4b67dc5105a06079c (127.22.225.130). New cstate: current_term: 26 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.334579 24420 catalog_manager.cc:5697] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c reported cstate change: term changed from 25 to 26, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 26 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
W20260709 13:11:49.376385 23430 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:49.410128 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:49.412621 24416 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41442 (request call id 351) took 15357 ms (client timeout 15000 ms). Trace:
W20260709 13:11:49.413038 24416 rpcz_store.cc:269] 0709 13:11:34.055494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:34.865108 (+809614us) service_pool.cc:224] Handling call
0709 13:11:49.316657 (+14451549us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.316684 (+    27us) write_op.cc:454] Released schema lock
0709 13:11:49.412524 (+ 95840us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:49.304597 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.305529 (+   932us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.305565 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:11:49.305582 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:49.305935 (+   353us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.305987 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.306012 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:49.306308 (+   296us) tablet.cc:701] Row locks acquired
0709 13:11:49.306325 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:11:49.306448 (+   123us) write_op.cc:270] Start()
0709 13:11:49.306566 (+   118us) write_op.cc:276] Timestamp: P: 1783602709306411 usec, L: 0
0709 13:11:49.306585 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.307150 (+   565us) log.cc:844] Serialized 925 byte log entry
0709 13:11:49.308996 (+  1846us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.309524 (+   528us) write_op.cc:301] APPLY: starting
0709 13:11:49.309608 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.310887 (+  1279us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.310979 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.312155 (+  1176us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.312312 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:11:49.312356 (+    44us) write_op.cc:312] APPLY: finished
0709 13:11:49.312547 (+   191us) log.cc:844] Serialized 33 byte log entry
0709 13:11:49.312707 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.312790 (+    83us) write_op.cc:454] Released schema lock
0709 13:11:49.312828 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":18522,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":316,"apply.run_cpu_time_us":3559,"apply.run_wall_time_us":3558,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8360,"num_ops":2,"prepare.queue_time_us":8320,"prepare.run_cpu_time_us":2449,"prepare.run_wall_time_us":2792,"replication_time_us":2305}]]}
I20260709 13:11:49.443393 24418 catalog_manager.cc:5697] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.454275 24418 catalog_manager.cc:5697] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 21 to 23, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 23 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.464957 24418 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 26 to 29. New cstate: current_term: 29 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:49.466620 24418 catalog_manager.cc:5697] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 18 to 21, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.468287 24418 catalog_manager.cc:5697] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 20 to 21, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.470238 24418 catalog_manager.cc:5697] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.473071 24418 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 23 to 28. New cstate: current_term: 28 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:49.474833 24418 catalog_manager.cc:5697] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 22 to 25, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 25 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:49.476485 24418 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:49.477882 24418 catalog_manager.cc:5697] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 20 to 21, leader changed from 983693721af6486c97ece1410a90cf30 (127.22.225.132) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 21 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:49.480204 24418 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 10 to 19, leader changed from 148dc963cec64232ad3b248abad6f36d (127.22.225.131) to 0131806e3b9647128f32db1ab8d314fc (127.22.225.129). New cstate: current_term: 19 leader_uuid: "0131806e3b9647128f32db1ab8d314fc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:49.474037   962 ts_tablet_manager.cc:933] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: Initiating tablet copy from peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:49.492820   962 tablet_copy_client.cc:323] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: tablet copy: Beginning tablet copy session from remote peer at address 127.22.225.130:39455
I20260709 13:11:49.501348 24610 tablet_copy_service.cc:140] P 96002c98f2d142e4b67dc5105a06079c: Received BeginTabletCopySession request for tablet e6a2e9eb050b40f8b828d36d037224d8 from peer 983693721af6486c97ece1410a90cf30 ({username='slave'} at 127.0.0.1:51506)
I20260709 13:11:49.501909 24610 tablet_copy_service.cc:161] P 96002c98f2d142e4b67dc5105a06079c: Beginning new tablet copy session on tablet e6a2e9eb050b40f8b828d36d037224d8 from peer 983693721af6486c97ece1410a90cf30 at {username='slave'} at 127.0.0.1:51506: session id = 983693721af6486c97ece1410a90cf30-e6a2e9eb050b40f8b828d36d037224d8
I20260709 13:11:49.512022 24610 tablet_copy_source_session.cc:215] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:49.534988   962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a2e9eb050b40f8b828d36d037224d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:49.568315 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:49.576422   962 tablet_copy_client.cc:806] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:49.593564   962 tablet_copy_client.cc:670] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:49.611426   962 tablet_copy_client.cc:538] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:49.596120 24415 catalog_manager.cc:5697] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 29 to 30, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 30 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:49.597164 24418 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49112 (request call id 251) took 4199 ms. Trace:
I20260709 13:11:49.623063 24415 catalog_manager.cc:5697] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 28 to 29, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 29 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:49.618541 24418 rpcz_store.cc:276] 0709 13:11:45.385970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.391487 (+  5517us) service_pool.cc:224] Handling call
0709 13:11:49.585042 (+4193555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:49.485536 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:49.486043 (+   507us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:49.486074 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:11:49.486091 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:49.487047 (+   956us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:49.487104 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:49.487130 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:11:49.488020 (+   890us) tablet.cc:701] Row locks acquired
0709 13:11:49.488038 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:49.488169 (+   131us) write_op.cc:270] Start()
0709 13:11:49.488274 (+   105us) write_op.cc:276] Timestamp: P: 1783602709488126 usec, L: 0
0709 13:11:49.488296 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:49.489682 (+  1386us) log.cc:844] Serialized 4396 byte log entry
0709 13:11:49.493312 (+  3630us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.494406 (+  1094us) write_op.cc:301] APPLY: starting
0709 13:11:49.494494 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.513378 (+ 18884us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.513538 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.522014 (+  8476us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.522221 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:11:49.522267 (+    46us) write_op.cc:312] APPLY: finished
0709 13:11:49.522760 (+   493us) log.cc:844] Serialized 105 byte log entry
0709 13:11:49.523496 (+   736us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.523630 (+   134us) write_op.cc:454] Released schema lock
0709 13:11:49.523679 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:49.527737 (+  4058us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.527767 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1877,"reported_tablets":43,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":862,"apply.run_cpu_time_us":13252,"apply.run_wall_time_us":33293,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45980,"num_ops":11,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":3739,"prepare.run_wall_time_us":6481,"replication_time_us":4867,"spinlock_wait_cycles":2304}]]}
I20260709 13:11:49.637210 24415 catalog_manager.cc:5697] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 22 to 23, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 23 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:49.645370   962 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: Bootstrap starting.
I20260709 13:11:49.654877 24415 catalog_manager.cc:5697] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 19 to 20, leader changed from 0131806e3b9647128f32db1ab8d314fc (127.22.225.129) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 20 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:49.701521 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 91898.9us
W20260709 13:11:49.916855 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:50.016024   962 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:50.017462   962 tablet_bootstrap.cc:492] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: Bootstrap complete.
W20260709 13:11:50.019960 24563 consensus_peers.cc:597] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:50.023557   962 ts_tablet_manager.cc:1403] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: Time spent bootstrapping tablet: real 0.378s	user 0.037s	sys 0.016s
I20260709 13:11:50.026836   962 raft_consensus.cc:359] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:11:50.041373   962 raft_consensus.cc:740] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 983693721af6486c97ece1410a90cf30, State: Initialized, Role: LEARNER
I20260709 13:11:50.042207   962 consensus_queue.cc:260] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: NON_VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: true } }
I20260709 13:11:50.054327   962 ts_tablet_manager.cc:1434] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 13:11:50.067199 24610 tablet_copy_service.cc:342] P 96002c98f2d142e4b67dc5105a06079c: Request end of tablet copy session 983693721af6486c97ece1410a90cf30-e6a2e9eb050b40f8b828d36d037224d8 received from {username='slave'} at 127.0.0.1:51506
I20260709 13:11:50.067720 24610 tablet_copy_service.cc:434] P 96002c98f2d142e4b67dc5105a06079c: ending tablet copy session 983693721af6486c97ece1410a90cf30-e6a2e9eb050b40f8b828d36d037224d8 on tablet e6a2e9eb050b40f8b828d36d037224d8 with peer 983693721af6486c97ece1410a90cf30
W20260709 13:11:50.084010 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.121928 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:50.170801 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.268642 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:50.385191 23430 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:50.457998 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 176831us
W20260709 13:11:50.515259 24407 catalog_manager.cc:4755] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7ec39f0d4e04761ae598f1245692799: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:50.547727 25212 raft_consensus.cc:1217] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.11->[23.12-23.12]   Dedup: 23.12->[]
W20260709 13:11:50.552794 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 45335.2us
W20260709 13:11:50.570391 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.587221 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.616027 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.650437 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:50.655316 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:50.658409 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:50.656450 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:50.660771 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:50.691622 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:50.851202 25182 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111) [suppressed 415 similar messages]
W20260709 13:11:51.278849 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:51.280392 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:51.404243 25182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 123901us
W20260709 13:11:51.456247 23430 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:51.771116 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:51.772073   985 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:51.774171   985 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:51.772445   910 raft_consensus.cc:493] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:51.777128   910 raft_consensus.cc:515] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:51.781644   910 leader_election.cc:290] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:51.785734   985 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:11:51.790207 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.794133 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:51.843315   994 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:51.843881   994 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:51.846066   994 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:51.854626   995 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:51.855248   995 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:51.856573   997 raft_consensus.cc:493] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 983693721af6486c97ece1410a90cf30)
I20260709 13:11:51.857143   997 raft_consensus.cc:515] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:51.858559   995 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:51.859467   997 leader_election.cc:290] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:51.873600 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:51.875278 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:11:51.875289 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:51.876977 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8aa20313ae2498e918eac40defe927c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:51.941160 25211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7903b435c45a4b85c164ecf24c14f" candidate_uuid: "96002c98f2d142e4b67dc5105a06079c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:11:51.971861 24563 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 93414.8us
W20260709 13:11:51.972955 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.973758 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:51.974251 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:51.977011  1006 raft_consensus.cc:1064] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: attempting to promote NON_VOTER 983693721af6486c97ece1410a90cf30 to VOTER
I20260709 13:11:51.979317  1006 consensus_queue.cc:237] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 10, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:11:51.983582 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:51.995594 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd63fe151734a9daa9146d5e744d8be" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:51.996945 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a58475c1d54873be44217fc84b05ec" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:52.001035  1004 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:52.019073  1004 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:52.002111  1005 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:52.000461 25184 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.020406  1005 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:52.021471 25184 leader_election.cc:304] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.002820   994 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:52.022262   994 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:52.022976  1005 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:52.005146   995 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:52.023718   995 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:52.024480   994 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:52.005633   980 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:52.025163   981 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:52.025938   981 raft_consensus.cc:2749] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:11:52.027226 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.027706 24563 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.028142 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:52.028757 24563 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:52.025455   980 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:52.031427   980 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:52.035658   995 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:11:52.036755  1004 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:11:52.053593 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.054194 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.054704 24563 leader_election.cc:336] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:52.055110 24563 leader_election.cc:304] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96002c98f2d142e4b67dc5105a06079c; no voters: 0131806e3b9647128f32db1ab8d314fc, 983693721af6486c97ece1410a90cf30
I20260709 13:11:52.056630   991 raft_consensus.cc:2749] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:11:52.052251 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.061967 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430292826c34b99a8f9413e570e0ff3" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:52.063503 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:52.071220   981 raft_consensus.cc:493] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:52.071818   981 raft_consensus.cc:515] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:52.073952   981 leader_election.cc:290] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:52.076565  1000 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:11:52.077183  1000 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:11:52.079327  1000 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:11:52.080575 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:52.082204 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:52.083643 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1932202ddbe46b29ed12a1b38042652" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:52.084268   975 raft_consensus.cc:493] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:52.085048 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f689bef5c09a4f4caf91a81702cc7723" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:52.084919   975 raft_consensus.cc:515] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:52.087996   975 leader_election.cc:290] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:52.092137 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
I20260709 13:11:52.093680 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96002c98f2d142e4b67dc5105a06079c" is_pre_election: true
W20260709 13:11:52.094684 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:52.110862 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:52.114450 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:52.118121 25217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:11:52.119956 24670 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:11:52.123745 25217 raft_consensus.cc:1275] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 LEARNER]: Refusing update from remote peer 96002c98f2d142e4b67dc5105a06079c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:11:52.130889 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:52.132332 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e96ae54f3a4631bcabb789d2c4146c" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:52.136523 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:52.138041 24670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0783d3a5f74b1c9adce43ebc457546" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:52.141680 24637 leader_election.cc:336] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:52.144518 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:52.145864  1000 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:52.146665 24637 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.147666 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:52.151343  1000 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:52.152576 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:11:52.153375  1000 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:52.154894  1000 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:52.158185   991 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:52.162743 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.163388 24637 leader_election.cc:336] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:52.171273 24637 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.174755 25185 leader_election.cc:304] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.175459  1000 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:11:52.179915   975 raft_consensus.cc:2749] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:11:52.181706 25185 leader_election.cc:304] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.189517   975 raft_consensus.cc:2749] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:11:52.195334   997 consensus_queue.cc:1048] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:52.195693 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.200273 24637 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:52.200744 24637 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.201563  1000 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:11:52.239892 24637 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:52.241055 24637 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.242748  1000 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:11:52.249269 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.250185 24637 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:52.251775 24637 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:11:52.254242  1008 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:11:52.262131   997 raft_consensus.cc:2955] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Committing config change with OpId 23.13: config changed from index 12 to 13, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:52.312656 24670 raft_consensus.cc:2955] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index 12 to 13, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:52.330864 25217 raft_consensus.cc:2955] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index 12 to 13, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:52.364359 24418 catalog_manager.cc:5697] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 reported cstate change: config changed from index 12 to 13, 983693721af6486c97ece1410a90cf30 (127.22.225.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "96002c98f2d142e4b67dc5105a06079c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } } }
I20260709 13:11:52.381809   984 raft_consensus.cc:493] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 148dc963cec64232ad3b248abad6f36d)
I20260709 13:11:52.382409   984 raft_consensus.cc:515] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:11:52.384503   984 leader_election.cc:290] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:11:52.387295 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6328dd8c55f4742b015ea60e33773bc" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:11:52.391875 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.404703 25182 leader_election.cc:336] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:11:52.406931 25182 leader_election.cc:304] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d
I20260709 13:11:52.414367   984 raft_consensus.cc:2749] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:52.456910 23430 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:52.459152 24563 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.459753 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:52.492127 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.499884 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.516212 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:52.626405 24407 catalog_manager.cc:4755] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7ec39f0d4e04761ae598f1245692799: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:52.810066 24695 debug-util.cc:398] Leaking SignalData structure 0x7b08003673c0 after lost signal to thread 23433
W20260709 13:11:52.811302 24695 debug-util.cc:398] Leaking SignalData structure 0x7b08003341e0 after lost signal to thread 24457
W20260709 13:11:52.812793 24695 debug-util.cc:398] Leaking SignalData structure 0x7b08001ad060 after lost signal to thread 24624
W20260709 13:11:52.814224 24695 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4260 after lost signal to thread 24698
W20260709 13:11:52.815665 24695 debug-util.cc:398] Leaking SignalData structure 0x7b080009f8e0 after lost signal to thread 25243
W20260709 13:11:52.888124 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:52.949846 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.080090 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:53.129992 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.133627 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.250944 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:53.273448 24412 maintenance_manager.cc:419] P 7c40b21f34414599bc4c7e2b5c7f524d: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033402
I20260709 13:11:53.391047 24411 maintenance_manager.cc:643] P 7c40b21f34414599bc4c7e2b5c7f524d: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.117s	user 0.029s	sys 0.005s Metrics: {"bytes_written":7589,"delete_count":0,"lbm_write_time_us":898,"lbm_writes_lt_1ms":7,"reinsert_count":0,"update_count":292}
I20260709 13:11:53.396683 24412 maintenance_manager.cc:419] P 7c40b21f34414599bc4c7e2b5c7f524d: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.367131
W20260709 13:11:53.407496 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:53.447125 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.449331 24563 consensus_peers.cc:597] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.486425 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.492146 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.519573 23430 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:53.592376 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:53.610949 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.626616 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:53.637243 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.660275 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:37451, user_credentials={real_user=slave}} blocked reactor thread for 103748us
W20260709 13:11:53.847970 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:53.884788 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:53.889479 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.905804 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.021121 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.046126 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:54.074294 24411 maintenance_manager.cc:643] P 7c40b21f34414599bc4c7e2b5c7f524d: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.677s	user 0.102s	sys 0.021s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":28919,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":16277,"dirs.run_cpu_time_us":571,"dirs.run_wall_time_us":2228,"lbm_read_time_us":2437,"lbm_reads_lt_1ms":26,"lbm_write_time_us":1796,"lbm_writes_lt_1ms":12,"peak_mem_usage":311716,"reinsert_count":0,"thread_start_us":22697,"threads_started":1,"update_count":309}
I20260709 13:11:54.077962 24412 maintenance_manager.cc:419] P 7c40b21f34414599bc4c7e2b5c7f524d: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:11:54.078935 24411 maintenance_manager.cc:643] P 7c40b21f34414599bc4c7e2b5c7f524d: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:11:54.135387 24563 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:54.143796 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:54.154227 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:54.186468 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.237126 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:54.337129 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.371114 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.421581 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.450309 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.465341 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.498320 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:54.521291 23430 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:54.550351 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:54.585763 24563 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:54.602407 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.655838 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.656369 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.669544 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.728142 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:54.739704 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.773039 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:54.802119 24563 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:54.886868 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:54.971941 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:55.118764 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.176518 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:55.446408 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:55.521797 23430 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:55.570431 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.670408 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:55.787272 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:55.790469 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.815284 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:55.853335 24563 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111) [suppressed 408 similar messages]
W20260709 13:11:55.856369 24563 consensus_peers.cc:597] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:55.878100 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:55.889027 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.029943 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.085336 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.163625 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.216714 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.240163 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.309497 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.349874 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.475397 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.522313 23430 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:56.536060 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.587764 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.649065 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.649354 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.692831 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.728588 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.784193 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.789786 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.800976 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.809017 24563 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.814463 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.815023 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.815675 24407 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.225.129:45343, user_credentials={real_user=slave}} blocked reactor thread for 52054.9us
W20260709 13:11:56.820691 24407 catalog_manager.cc:4755] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7ec39f0d4e04761ae598f1245692799: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:11:56.895000 24563 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.907640 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.936574 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:56.960350 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.993069 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:57.000303 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.008265 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.434962 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.470880 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:57.522796 23430 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:57.552261 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:57.566627 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.596163 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.603906 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:57.618533 24563 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:57.636363 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:57.795208 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:58.089020 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:58.181738 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800359140 after lost signal to thread 23433
W20260709 13:11:58.183077 24454 debug-util.cc:398] Leaking SignalData structure 0x7b08001409e0 after lost signal to thread 24457
W20260709 13:11:58.184588 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800035640 after lost signal to thread 24624
W20260709 13:11:58.194691 24454 debug-util.cc:398] Leaking SignalData structure 0x7b0800038be0 after lost signal to thread 24698
W20260709 13:11:58.197170 24454 debug-util.cc:398] Leaking SignalData structure 0x7b08003c42c0 after lost signal to thread 25243
W20260709 13:11:58.215549 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:58.224604 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:58.256523 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:58.293584 24563 consensus_peers.cc:597] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:58.350278 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:58.523334 23430 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:58.553038 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:58.598721 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:58.611617 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:58.687461 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:58.721493 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:58.771224 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:58.776368 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:58.798772 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:58.867548 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:58.955226 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.008302 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.021098 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.266947 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:59.330487 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.414248 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.420387 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:59.428135 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.462716 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.466534 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:59.487406 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.496073 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.505194 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.523851 23430 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 24546)
W20260709 13:11:59.526553 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.527560 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:59.533650 24563 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:59.663820 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.674808 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.693708 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:59.705307 24563 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:59.756618 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:59.786928 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.825423 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.836098 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:59.854871 24563 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:59.926378 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:59.945197 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:00.266970 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:00.269349 24639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 89759.2us
W20260709 13:12:00.303364 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:00.483074 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:00.524307 23430 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 24546)
W20260709 13:12:00.527261 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:00.600258 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:00.704761 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:00.803992 24563 consensus_peers.cc:597] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:00.857275 25182 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111) [suppressed 436 similar messages]
W20260709 13:12:00.874329 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.029035 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:01.039698 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:01.103371 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:01.117041 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.121361 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:01.182017 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:01.259491 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.308754 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.350714 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:01.360225 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:01.482928 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.523273 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.524789 23430 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 24546)
W20260709 13:12:01.545393 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.740734 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:01.879590 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:01.879817 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:01.930991 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:01.946417 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.006170 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.030591 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.044423 24563 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:02.092959 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.099617 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:02.122686 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:02.157511 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.173336 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.177621 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.183511 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.194532 24563 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:02.200785 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.241583 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:02.246694 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.285758 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.368645 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:02.394300 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.457230 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:02.525249 23430 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 24546)
W20260709 13:12:02.533713 24563 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:02.698870 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:02.921239 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:03.154124 24563 consensus_peers.cc:597] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:03.157662 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:03.171926 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:03.176275 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:03.415557 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:03.474347 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:03.526288 23430 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 24546)
W20260709 13:12:03.582507 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:03.636005 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.654814 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.827401 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:03.830735 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:03.838699 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:03.915411 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:03.916092 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:03.948807 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:04.036790 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.085202 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.099124 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.303543 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.352618 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:04.449867 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.451823 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:04.522584 24563 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:04.523391 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.526950 23430 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 24546)
W20260709 13:12:04.534032 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:04.560948 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:04.599642 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.610714 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:04.641228 24563 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:04.699942 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:04.703662 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.716380 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.745457 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.848771 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.862967 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.864039 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.865556 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.913466 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:04.917526 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:04.935773 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.011965 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:05.035449 24563 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:05.127370 24407 catalog_manager.cc:4755] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7ec39f0d4e04761ae598f1245692799: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:05.158625 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.258853 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:05.425354 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:05.527432 23430 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 24546)
W20260709 13:12:05.551963 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:05.619370 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:05.626914 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:05.817037 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:05.869626 24563 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111) [suppressed 437 similar messages]
W20260709 13:12:05.998282 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.022662 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:06.064523 24563 consensus_peers.cc:597] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:06.111935 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.146585 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:06.274886 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.289985 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:06.314628 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.465974 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:06.474601 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:06.502884 24563 consensus_peers.cc:597] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.528693 23430 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 24546)
W20260709 13:12:06.533160 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.727306 24563 consensus_peers.cc:597] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.767824 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.841677 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.841948 24563 consensus_peers.cc:597] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:06.844221 24563 consensus_peers.cc:597] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.879619 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:06.888095 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:06.892396 24563 consensus_peers.cc:597] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:06.922047 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:06.960624 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.053480 24563 consensus_peers.cc:597] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.063355 24563 consensus_peers.cc:597] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:07.113953 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.126299 24563 consensus_peers.cc:597] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.160080 24563 consensus_peers.cc:597] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.299968 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.324052 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:07.325129 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:07.369333 24563 consensus_peers.cc:597] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:07.451056 24563 consensus_peers.cc:597] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.533716 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.536239 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.579500 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.607888 24565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:34125, user_credentials={real_user=slave}} blocked reactor thread for 147747us
W20260709 13:12:07.614467 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:07.697278 24563 consensus_peers.cc:597] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.785205 24563 consensus_peers.cc:597] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.791606 25184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:39455, user_credentials={real_user=slave}} blocked reactor thread for 117999us
W20260709 13:12:07.802968 24563 consensus_peers.cc:597] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:07.829165 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:08.038225 24563 consensus_peers.cc:597] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:08.038837 24563 consensus_peers.cc:597] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:08.110968 24563 consensus_peers.cc:597] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:08.160818 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:08.173931 23430 tablet_server.cc:196] TabletServer@127.22.225.129:0 shutdown complete.
W20260709 13:12:08.246945 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:08.325716 23430 tablet_server.cc:179] TabletServer@127.22.225.130:0 shutting down...
W20260709 13:12:08.378985 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:08.402997 24639 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.411717 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:08.413177 23430 tablet_replica.cc:333] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.414101 23430 raft_consensus.cc:2243] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.415091 23430 raft_consensus.cc:2272] T de0783d3a5f74b1c9adce43ebc457546 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.422744 23430 tablet_replica.cc:333] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.423609 23430 raft_consensus.cc:2243] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.424253 23430 raft_consensus.cc:2272] T 28c13259bf74484588e0fb08995091cc P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.428640 23430 tablet_replica.cc:333] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.429630 23430 raft_consensus.cc:2243] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.432114 23430 raft_consensus.cc:2272] T 1cd63fe151734a9daa9146d5e744d8be P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.434911 23430 tablet_replica.cc:333] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.435765 23430 raft_consensus.cc:2243] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:12:08.436429 25184 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.436965 23430 raft_consensus.cc:2272] T 869c3dc61dc04d64adba5e6ab84e5d83 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.440001 25184 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.440003 23430 tablet_replica.cc:333] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
W20260709 13:12:08.440579 24639 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.441545 23430 raft_consensus.cc:2243] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.442202 23430 raft_consensus.cc:2272] T c9f2117a17f2425cae9c436e59c94b96 P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.443010 24639 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.445020 23430 tablet_replica.cc:333] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.445875 23430 raft_consensus.cc:2243] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.446527 23430 raft_consensus.cc:2272] T 90f5d915fb71474ab2b58063813a93a9 P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.449110 23430 tablet_replica.cc:333] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.449887 23430 raft_consensus.cc:2243] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.450935 23430 raft_consensus.cc:2272] T b2451462dc894ec98db5932996a9e329 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.453374 23430 tablet_replica.cc:333] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.454239 23430 raft_consensus.cc:2243] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.455374 23430 raft_consensus.cc:2272] T e4b8c8f0e3de4df592f498349e097d44 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.457911 23430 tablet_replica.cc:333] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.458762 23430 raft_consensus.cc:2243] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.459455 23430 raft_consensus.cc:2272] T f6e02d1934244d5f93de764a08655a2c P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.462107 23430 tablet_replica.cc:333] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
W20260709 13:12:08.461898 24639 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.463011 23430 raft_consensus.cc:2243] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.464201 23430 raft_consensus.cc:2272] T 7db7a15c9a7549a4a147a987f1362c09 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.466871 23430 tablet_replica.cc:333] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.467730 23430 raft_consensus.cc:2243] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.468691 23430 raft_consensus.cc:2272] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.471120 23430 tablet_replica.cc:333] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.471870 23430 raft_consensus.cc:2243] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.472921 23430 raft_consensus.cc:2272] T e7ec39f0d4e04761ae598f1245692799 P 96002c98f2d142e4b67dc5105a06079c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.475343 23430 tablet_replica.cc:333] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.476059 23430 raft_consensus.cc:2243] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.477274 23430 raft_consensus.cc:2272] T ba23ab1f03ef40238962f541c00081d1 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.479715 23430 tablet_replica.cc:333] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.481618 23430 raft_consensus.cc:2243] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.482184 23430 raft_consensus.cc:2272] T 14e96ae54f3a4631bcabb789d2c4146c P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.483991 23430 tablet_replica.cc:333] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.484550 23430 raft_consensus.cc:2243] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.485203 23430 raft_consensus.cc:2272] T 46d76b8a93c540a2936fa04c6712e968 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.487677 23430 tablet_replica.cc:333] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.488445 23430 raft_consensus.cc:2243] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.489190 23430 raft_consensus.cc:2272] T 72b8c4b638a5486c82fb2d3bb64ef503 P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.493574 23430 tablet_replica.cc:333] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.494153 23430 raft_consensus.cc:2243] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.495218 23430 raft_consensus.cc:2272] T 4430292826c34b99a8f9413e570e0ff3 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.495877 24639 consensus_peers.cc:597] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.497530 23430 tablet_replica.cc:333] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.498345 23430 raft_consensus.cc:2243] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.499379 23430 raft_consensus.cc:2272] T 524d0087b4074f61ad31e7ba78ee8b99 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.501838 23430 tablet_replica.cc:333] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.502600 23430 raft_consensus.cc:2243] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.503245 23430 raft_consensus.cc:2272] T f8aa20313ae2498e918eac40defe927c P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.505461 23430 tablet_replica.cc:333] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.506204 23430 raft_consensus.cc:2243] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.507285 23430 raft_consensus.cc:2272] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.509702 23430 tablet_replica.cc:333] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.510461 23430 raft_consensus.cc:2243] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.511096 23430 raft_consensus.cc:2272] T e9c35412a4ad4729862392b77295639d P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.513391 23430 tablet_replica.cc:333] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.514089 23430 raft_consensus.cc:2243] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.515123 23430 raft_consensus.cc:2272] T 24de2d510450446080d67047a1f1eebe P 96002c98f2d142e4b67dc5105a06079c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.517611 23430 tablet_replica.cc:333] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.518361 23430 raft_consensus.cc:2243] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.519140 23430 raft_consensus.cc:2272] T 2732386ac0bf488eb0fcc0893f0c9b0e P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.521669 23430 tablet_replica.cc:333] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.522472 23430 raft_consensus.cc:2243] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.523545 23430 raft_consensus.cc:2272] T f689bef5c09a4f4caf91a81702cc7723 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.524665 24639 consensus_peers.cc:597] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.525753 23430 tablet_replica.cc:333] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.526365 23430 raft_consensus.cc:2243] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.527637 23430 raft_consensus.cc:2272] T b1932202ddbe46b29ed12a1b38042652 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.529886 23430 tablet_replica.cc:333] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.530423 23430 raft_consensus.cc:2243] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.530920 23430 raft_consensus.cc:2272] T b6ade31527164676867a5686444d0240 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.533141 23430 tablet_replica.cc:333] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.533846 23430 raft_consensus.cc:2243] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.534655 23430 raft_consensus.cc:2272] T de2b0253cbb445a4bb49f874e70ea972 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.536998 23430 tablet_replica.cc:333] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.537685 23430 raft_consensus.cc:2243] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.538966 23430 raft_consensus.cc:2272] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 96002c98f2d142e4b67dc5105a06079c [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.540879 23430 tablet_replica.cc:333] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.541426 23430 raft_consensus.cc:2243] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.541949 23430 raft_consensus.cc:2272] T f1d76f2e8d504bd29a4d29e4926a9407 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.543682 23430 tablet_replica.cc:333] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.544214 23430 raft_consensus.cc:2243] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.545131 23430 raft_consensus.cc:2272] T 5a74983bd9b34474a7cd38346edf8a64 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.547117 23430 tablet_replica.cc:333] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.547631 23430 raft_consensus.cc:2243] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.548825 23430 raft_consensus.cc:2272] T e6a2e9eb050b40f8b828d36d037224d8 P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.551239 23430 tablet_replica.cc:333] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.551908 23430 raft_consensus.cc:2243] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.552861 23430 raft_consensus.cc:2272] T 90e49b6f6ffd4dde98abdfd00821bc27 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.555315 23430 tablet_replica.cc:333] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.555850 23430 raft_consensus.cc:2243] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.556336 23430 raft_consensus.cc:2272] T cfe7903b435c45a4b85c164ecf24c14f P 96002c98f2d142e4b67dc5105a06079c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.558398 23430 tablet_replica.cc:333] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.559026 23430 raft_consensus.cc:2243] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.559971 23430 raft_consensus.cc:2272] T 655be3d0d44f42a1aa683fd7271af488 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.561861 23430 tablet_replica.cc:333] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.562431 23430 raft_consensus.cc:2243] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.563315 23430 raft_consensus.cc:2272] T cf80704aefe74fbe81e575cc17508b9a P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.565483 23430 tablet_replica.cc:333] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.566157 23430 raft_consensus.cc:2243] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.566782 23430 raft_consensus.cc:2272] T 5644c0da536c49768827dfd20a9662e1 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.569249 23430 tablet_replica.cc:333] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.569870 23430 raft_consensus.cc:2243] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:12:08.569357 24639 consensus_peers.cc:597] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.570940 23430 raft_consensus.cc:2272] T c5d1c8994b3f41b286ae8a8f4a93b76a P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.573467 23430 tablet_replica.cc:333] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.574201 23430 raft_consensus.cc:2243] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.574741 23430 raft_consensus.cc:2272] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 96002c98f2d142e4b67dc5105a06079c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.576638 23430 tablet_replica.cc:333] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.577206 23430 raft_consensus.cc:2243] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.577821 23430 raft_consensus.cc:2272] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.579926 23430 tablet_replica.cc:333] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.580428 23430 raft_consensus.cc:2243] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.580874 23430 raft_consensus.cc:2272] T b7ee2372084b4767aa79fc57a0c53278 P 96002c98f2d142e4b67dc5105a06079c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.582617 23430 tablet_replica.cc:333] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.583114 23430 raft_consensus.cc:2243] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.583702 23430 raft_consensus.cc:2272] T 73880209aa174d609bf830ad4c666c8c P 96002c98f2d142e4b67dc5105a06079c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.585601 23430 tablet_replica.cc:333] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.586478 23430 raft_consensus.cc:2243] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.588037 23430 raft_consensus.cc:2272] T 182cc63718a84173a76583588f193929 P 96002c98f2d142e4b67dc5105a06079c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.590070 23430 tablet_replica.cc:333] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.590551 23430 raft_consensus.cc:2243] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:08.591041 23430 raft_consensus.cc:2272] T 8d807668edef41d5b0b7e311228f18c2 P 96002c98f2d142e4b67dc5105a06079c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.592762 23430 tablet_replica.cc:333] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.593286 23430 raft_consensus.cc:2243] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.594228 23430 raft_consensus.cc:2272] T eb1f10582ce7411b8b3187da8ec646c8 P 96002c98f2d142e4b67dc5105a06079c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:08.596330 23430 tablet_replica.cc:333] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c: stopping tablet replica
I20260709 13:12:08.596771 23430 raft_consensus.cc:2243] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:12:08.597683 23430 raft_consensus.cc:2272] T 30a58475c1d54873be44217fc84b05ec P 96002c98f2d142e4b67dc5105a06079c [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:08.638494 25184 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.640981 25184 consensus_peers.cc:597] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.642519 25184 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.655164 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:08.668152 24639 consensus_peers.cc:597] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.673496 24637 consensus_peers.cc:597] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:08.681169 25184 consensus_peers.cc:597] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.684759 25184 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.694659 25184 connection.cc:573] client connection to 127.22.225.130:39455 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:12:08.695204 25184 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.698558 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800241ae0 after lost signal to thread 23433
W20260709 13:12:08.699636 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800241880 after lost signal to thread 24457
W20260709 13:12:08.700996 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5e60 after lost signal to thread 24624
W20260709 13:12:08.702200 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800241040 after lost signal to thread 24698
W20260709 13:12:08.703365 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5640 after lost signal to thread 25243
W20260709 13:12:08.705826 24639 consensus_peers.cc:597] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.708755 25184 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.711454 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:08.735564 25184 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.743731 24639 consensus_peers.cc:597] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.776131 25184 consensus_peers.cc:597] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.783226 25184 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:08.795850 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:08.826113 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:08.893318 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:08.953060 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:08.958073 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:08.981026 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:09.142395 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:09.293102 24637 consensus_peers.cc:597] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:09.369875 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:09.375036 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:09.398362 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:09.447559 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:09.453887  1081 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.454888  1081 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.458534  1081 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:12:09.463160 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
W20260709 13:12:09.463845 25184 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.465415 25185 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.467474  1089 raft_consensus.cc:2749] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:12:09.517509  1074 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.518043  1074 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.520504  1074 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.525223 24637 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:09.529672 24639 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.531064  1074 raft_consensus.cc:493] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.532270  1074 raft_consensus.cc:515] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.531993 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.534426  1074 leader_election.cc:290] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:12:09.534922  1087 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:09.538779 24637 leader_election.cc:336] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:09.539568 24639 leader_election.cc:336] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.539904 24639 leader_election.cc:304] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.540581  1087 raft_consensus.cc:2749] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:09.547724  1087 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.548148  1087 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.550351  1087 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:12:09.551635 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
W20260709 13:12:09.554243 24639 leader_election.cc:336] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.554605 24639 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:12:09.555169  1087 raft_consensus.cc:2749] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:12:09.558748  1087 raft_consensus.cc:493] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.559250  1087 raft_consensus.cc:515] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.562299  1087 leader_election.cc:290] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.562615 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:09.571658 24637 leader_election.cc:336] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:09.574996 24639 leader_election.cc:336] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.575361 24639 leader_election.cc:304] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.575973  1087 raft_consensus.cc:2749] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:09.588831  1087 raft_consensus.cc:493] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.589418  1087 raft_consensus.cc:515] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.592002  1089 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.592552  1089 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.595700 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:12:09.597292  1089 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:12:09.598196  1087 leader_election.cc:290] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.598624 25184 leader_election.cc:336] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.599138 25184 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.600226  1089 raft_consensus.cc:2749] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:12:09.603649 24637 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:09.606241 24639 leader_election.cc:336] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.606604 24639 leader_election.cc:304] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.607169  1087 raft_consensus.cc:2749] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:09.632179  1089 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.632648  1089 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.634351  1089 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.638824 25182 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:09.639812 25184 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.640172 25184 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.640739  1089 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:12:09.643241  1087 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.644126  1087 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.646477  1087 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:12:09.648908  1087 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.649508  1087 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.651587  1087 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:12:09.652083 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:12:09.654722 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:12:09.655248 25215 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
I20260709 13:12:09.656616 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:12:09.657218  1087 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:12:09.657823  1087 raft_consensus.cc:493] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.658416  1087 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:12:09.661495 24639 leader_election.cc:336] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.662029 24639 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
I20260709 13:12:09.662735  1074 raft_consensus.cc:2749] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:12:09.663743 24639 leader_election.cc:336] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.665091  1074 raft_consensus.cc:493] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.665658  1074 raft_consensus.cc:515] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.667806  1074 leader_election.cc:290] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.673509 24637 leader_election.cc:336] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.673642  1089 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.674192  1089 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.681767 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:12:09.682307  1074 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.682811  1074 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.684864  1074 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:12:09.681887 25182 leader_election.cc:336] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:09.686544 25184 leader_election.cc:336] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.686969 25184 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 1 yes votes; 3 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 148dc963cec64232ad3b248abad6f36d, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.687951  1089 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:12:09.688522  1089 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:12:09.699765  1081 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.700326  1081 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.705338  1081 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:12:09.706305 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:12:09.709291 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:12:09.709717 24666 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:12:09.709322  1089 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.710857  1089 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.711711 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:12:09.712601  1085 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:09.713012  1085 raft_consensus.cc:493] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.713423  1085 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:12:09.717697 25184 leader_election.cc:336] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
W20260709 13:12:09.721053 25184 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
W20260709 13:12:09.722471 23430 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24621)
I20260709 13:12:09.713029  1089 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.708285 24639 leader_election.cc:336] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.724725  1087 raft_consensus.cc:515] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.723634 24639 leader_election.cc:304] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.732630  1092 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.733148  1074 raft_consensus.cc:2749] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:12:09.733268  1092 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:12:09.730679 25182 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.722473  1085 raft_consensus.cc:515] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.734905 25182 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.749415  1089 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:09.751358  1076 raft_consensus.cc:493] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.751929  1076 raft_consensus.cc:515] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
W20260709 13:12:09.753465 25184 leader_election.cc:336] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.754159  1076 leader_election.cc:290] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.760236 24637 leader_election.cc:336] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.761021  1074 raft_consensus.cc:493] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.734294  1087 leader_election.cc:290] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:12:09.761677  1074 raft_consensus.cc:515] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.766870  1092 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.768831 24637 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.774596 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7a15c9a7549a4a147a987f1362c09" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:12:09.779542 25215 raft_consensus.cc:3060] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:12:09.774893 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d1c8994b3f41b286ae8a8f4a93b76a" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:12:09.781363 24666 raft_consensus.cc:3060] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:12:09.788103 24666 raft_consensus.cc:2468] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:12:09.790141 25185 leader_election.cc:304] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.791085  1092 raft_consensus.cc:2804] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:09.792398  1092 raft_consensus.cc:697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:12:09.793182 25215 raft_consensus.cc:2468] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 26.
I20260709 13:12:09.775138  1085 leader_election.cc:290] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
W20260709 13:12:09.775621 25182 leader_election.cc:336] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.778728  1087 raft_consensus.cc:493] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.798525  1087 raft_consensus.cc:515] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.794342  1074 leader_election.cc:290] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:12:09.793510  1092 consensus_queue.cc:237] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:12:09.799969 25184 leader_election.cc:336] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.802767 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.806180  1089 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:12:09.801980  1087 leader_election.cc:290] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.815194 24639 leader_election.cc:336] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.819132 24639 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 96002c98f2d142e4b67dc5105a06079c, 983693721af6486c97ece1410a90cf30
W20260709 13:12:09.813457 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:12:09.820092 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:09.820717 24637 leader_election.cc:336] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.821972  1074 raft_consensus.cc:2749] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:09.833773 24420 catalog_manager.cc:5697] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 20 to 21, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.836508 24639 leader_election.cc:304] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:12:09.843256  1074 raft_consensus.cc:2804] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:12:09.844187  1074 raft_consensus.cc:697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:12:09.845636  1074 consensus_queue.cc:237] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:12:09.853191 24637 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:09.856117 24639 leader_election.cc:336] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
W20260709 13:12:09.857509 24639 leader_election.cc:336] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.857726  1088 raft_consensus.cc:493] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.857924 24639 leader_election.cc:304] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.858285  1088 raft_consensus.cc:515] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.861102  1076 raft_consensus.cc:2749] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:12:09.861492  1074 raft_consensus.cc:493] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.862169  1074 raft_consensus.cc:515] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.864238  1088 leader_election.cc:290] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:12:09.865166  1085 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.865694  1085 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.867769  1085 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:12:09.868750 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:12:09.869400 24666 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 20.
I20260709 13:12:09.869537 24415 catalog_manager.cc:5697] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 25 to 26, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 26 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.870724 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:12:09.871444  1088 raft_consensus.cc:493] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.871671  1092 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:12:09.872155  1092 raft_consensus.cc:493] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.872654  1092 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:12:09.873391 25184 leader_election.cc:336] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.871937  1088 raft_consensus.cc:515] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:09.877789  1087 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.878350  1087 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.879581  1074 leader_election.cc:290] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:12:09.880373  1087 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:12:09.885900  1088 leader_election.cc:290] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:12:09.886669 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:12:09.887516 25215 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 25.
W20260709 13:12:09.888584 24637 leader_election.cc:336] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:09.890231 24637 leader_election.cc:336] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.892107 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:12:09.893872  1087 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:12:09.894282  1087 raft_consensus.cc:493] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.894670  1087 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:12:09.894994  1092 raft_consensus.cc:515] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:12:09.893311 24639 leader_election.cc:336] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.903920 24639 leader_election.cc:304] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.904915  1074 raft_consensus.cc:2749] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:12:09.905341 24639 leader_election.cc:336] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.911401 24639 leader_election.cc:304] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.911495  1087 raft_consensus.cc:515] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.914644 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2451462dc894ec98db5932996a9e329" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:12:09.915556 24666 raft_consensus.cc:3060] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:12:09.917991 25184 leader_election.cc:336] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.920168  1087 leader_election.cc:290] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
I20260709 13:12:09.920723  1092 leader_election.cc:290] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:12:09.921289  1088 raft_consensus.cc:2749] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:12:09.921446 24639 leader_election.cc:336] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
W20260709 13:12:09.908910 24637 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.922335 24639 leader_election.cc:304] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.923774 24666 raft_consensus.cc:2468] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 21.
I20260709 13:12:09.928473 25185 leader_election.cc:304] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.929288  1085 raft_consensus.cc:2804] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:12:09.929885  1085 raft_consensus.cc:697] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:12:09.930855  1085 consensus_queue.cc:237] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:12:09.931775 24637 consensus_peers.cc:597] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:09.934310  1089 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.934613  1088 raft_consensus.cc:2749] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:12:09.935019  1089 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.940627 25212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7ec39f0d4e04761ae598f1245692799" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30"
I20260709 13:12:09.941231 25212 raft_consensus.cc:3060] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:12:09.945586 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d" is_pre_election: true
I20260709 13:12:09.946244 24666 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 24.
I20260709 13:12:09.948841 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:12:09.950115  1089 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:12:09.950994  1089 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:12:09.951421  1089 raft_consensus.cc:493] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.951853  1089 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:12:09.949024 25212 raft_consensus.cc:2468] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 26.
I20260709 13:12:09.952211  1081 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
W20260709 13:12:09.949676 24639 leader_election.cc:336] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.952796  1081 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.959151  1081 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:12:09.961465  1089 raft_consensus.cc:515] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.957383 24639 leader_election.cc:304] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.962826  1088 raft_consensus.cc:2749] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:12:09.966187 25182 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.966884 24415 catalog_manager.cc:5697] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 20 to 21, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 21 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:09.972450 25184 leader_election.cc:336] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.972707  1092 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.980003  1092 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.982283  1092 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:09.984206 24637 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:09.984290 25184 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.984858 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
W20260709 13:12:09.972777 24639 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
W20260709 13:12:09.986526 25182 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:09.986961  1081 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:09.991699 25184 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:09.992236 25184 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:09.993570  1081 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:12:09.993743  1088 raft_consensus.cc:493] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:09.994418  1088 raft_consensus.cc:515] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } attrs { replace: true } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:09.998459  1088 leader_election.cc:290] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 983693721af6486c97ece1410a90cf30 (127.22.225.132:34125)
W20260709 13:12:10.000701 24637 leader_election.cc:336] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:10.003501  1089 leader_election.cc:290] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Requested vote from peers 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455), 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451)
I20260709 13:12:10.002305 24639 leader_election.cc:304] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 
I20260709 13:12:10.005091 24666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff0c5b0ac6e4cc5b9d864a010ffdfe4" candidate_uuid: "983693721af6486c97ece1410a90cf30" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "148dc963cec64232ad3b248abad6f36d"
I20260709 13:12:10.005751 24666 raft_consensus.cc:3060] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:12:10.005973 24639 leader_election.cc:336] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:10.006412 24639 leader_election.cc:304] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:10.008034  1088 raft_consensus.cc:2749] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:12:10.009195 24639 leader_election.cc:336] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:10.005257  1087 raft_consensus.cc:2804] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:12:10.010691  1087 raft_consensus.cc:697] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Becoming Leader. State: Replica: 148dc963cec64232ad3b248abad6f36d, State: Running, Role: LEADER
I20260709 13:12:10.011580  1087 consensus_queue.cc:237] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:10.017647  1074 raft_consensus.cc:493] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:10.018272  1074 raft_consensus.cc:515] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:10.020467  1074 leader_election.cc:290] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:10.020985 25182 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:10.025326 24637 leader_election.cc:336] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:10.029481 24666 raft_consensus.cc:2468] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 983693721af6486c97ece1410a90cf30 in term 25.
W20260709 13:12:10.031319 25184 leader_election.cc:336] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
W20260709 13:12:10.035162 25182 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:10.037110 25185 leader_election.cc:304] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d, 983693721af6486c97ece1410a90cf30; no voters: 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:10.039018 25215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6a2e9eb050b40f8b828d36d037224d8" candidate_uuid: "148dc963cec64232ad3b248abad6f36d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "983693721af6486c97ece1410a90cf30" is_pre_election: true
I20260709 13:12:10.039610 25215 raft_consensus.cc:2468] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 148dc963cec64232ad3b248abad6f36d in term 23.
I20260709 13:12:10.038503  1081 raft_consensus.cc:2804] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:12:10.042397  1081 raft_consensus.cc:697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Becoming Leader. State: Replica: 983693721af6486c97ece1410a90cf30, State: Running, Role: LEADER
I20260709 13:12:10.043249  1081 consensus_queue.cc:237] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
W20260709 13:12:10.046304 24639 leader_election.cc:336] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:10.046775 24639 leader_election.cc:304] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:10.049438  1074 raft_consensus.cc:2749] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:12:10.058185 24639 leader_election.cc:336] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:10.058712 24639 leader_election.cc:304] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:10.059979  1087 raft_consensus.cc:2749] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:12:10.070681 24415 catalog_manager.cc:5697] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d reported cstate change: term changed from 25 to 26, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 148dc963cec64232ad3b248abad6f36d (127.22.225.131). New cstate: current_term: 26 leader_uuid: "148dc963cec64232ad3b248abad6f36d" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.073782 24420 catalog_manager.cc:5697] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 reported cstate change: term changed from 24 to 25, leader changed from 96002c98f2d142e4b67dc5105a06079c (127.22.225.130) to 983693721af6486c97ece1410a90cf30 (127.22.225.132). New cstate: current_term: 25 leader_uuid: "983693721af6486c97ece1410a90cf30" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:10.114337 24637 consensus_peers.cc:597] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:10.189680 25184 consensus_peers.cc:597] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.193982 24666 raft_consensus.cc:1275] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:12:10.195180  1089 consensus_queue.cc:1048] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:12:10.354159 25184 consensus_peers.cc:597] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.392267 25212 raft_consensus.cc:1275] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:12:10.394387  1087 consensus_queue.cc:1048] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:12:10.411661 24639 consensus_peers.cc:597] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.413141 25215 raft_consensus.cc:1275] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Refusing update from remote peer 148dc963cec64232ad3b248abad6f36d: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:12:10.415894  1087 consensus_queue.cc:1048] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [LEADER]: Connected to new peer: Peer: permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:12:10.444494 24639 consensus_peers.cc:597] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.446044 24666 raft_consensus.cc:1275] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:12:10.455390  1081 consensus_queue.cc:1048] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:12:10.596143 25184 consensus_peers.cc:597] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.652135 24666 raft_consensus.cc:1275] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Refusing update from remote peer 983693721af6486c97ece1410a90cf30: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:12:10.653529  1089 consensus_queue.cc:1048] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:12:10.657188 24639 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.738166 24637 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:10.753329 25182 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:10.813104 25184 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.833611 24639 consensus_peers.cc:597] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.870646 24639 consensus_peers.cc:597] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.872991 24639 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111) [suppressed 537 similar messages]
W20260709 13:12:10.899295 25184 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.920738 24637 consensus_peers.cc:597] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:10.944201 25184 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.960772 24639 consensus_peers.cc:597] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:10.994798 25184 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.008426 24637 consensus_peers.cc:597] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:11.026068 24639 consensus_peers.cc:597] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.059944 25184 consensus_peers.cc:597] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.120884 25182 consensus_peers.cc:597] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:11.127482 25184 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:11.150108  1108 raft_consensus.cc:493] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:11.150703  1108 raft_consensus.cc:515] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "148dc963cec64232ad3b248abad6f36d" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 37451 } }
I20260709 13:12:11.153811  1108 leader_election.cc:290] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:11.160120 24637 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:11.162729 24639 leader_election.cc:336] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:11.163086 24639 leader_election.cc:304] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 148dc963cec64232ad3b248abad6f36d; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:11.163671  1108 raft_consensus.cc:2749] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:11.163877 24639 consensus_peers.cc:597] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.189864 25184 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:11.192163 23430 tablet_server.cc:196] TabletServer@127.22.225.130:0 shutdown complete.
W20260709 13:12:11.201186 25182 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:11.238474 25184 consensus_peers.cc:597] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.269055 25184 consensus_peers.cc:597] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.272917 24639 consensus_peers.cc:597] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.279539 24639 consensus_peers.cc:597] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:11.290817 23430 tablet_server.cc:179] TabletServer@127.22.225.131:0 shutting down...
W20260709 13:12:11.298503 25185 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.307116 24639 consensus_peers.cc:597] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.310393 25185 consensus_peers.cc:597] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.312827 25184 consensus_peers.cc:597] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.317028 25185 consensus_peers.cc:597] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.345948 24637 consensus_peers.cc:597] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:11.351289 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:11.352456 23430 tablet_replica.cc:333] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.353682 23430 raft_consensus.cc:2243] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.354487 23430 raft_consensus.cc:2272] T 869c3dc61dc04d64adba5e6ab84e5d83 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.355813 25182 consensus_peers.cc:597] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:11.357372 23430 tablet_replica.cc:333] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.358328 23430 raft_consensus.cc:2243] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.359313 23430 raft_consensus.cc:2272] T de0783d3a5f74b1c9adce43ebc457546 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.362113 23430 tablet_replica.cc:333] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.362914 23430 raft_consensus.cc:2243] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.363632 23430 raft_consensus.cc:2272] T 1cd63fe151734a9daa9146d5e744d8be P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.366341 23430 tablet_replica.cc:333] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.367102 23430 raft_consensus.cc:2243] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:12:11.368218 25185 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.368287 23430 raft_consensus.cc:2272] T 8cd2633e79fe4d3498a4412c062bf875 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.371197 23430 tablet_replica.cc:333] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.372014 23430 raft_consensus.cc:2243] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.373155 23430 raft_consensus.cc:2272] T 4cf920647a7842d49c08b2453da44143 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.375880 23430 tablet_replica.cc:333] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.376624 23430 raft_consensus.cc:2243] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.377266 23430 raft_consensus.cc:2272] T eb1f10582ce7411b8b3187da8ec646c8 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.379803 23430 tablet_replica.cc:333] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.380793 23430 raft_consensus.cc:2243] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.381352 23430 raft_consensus.cc:2272] T b2451462dc894ec98db5932996a9e329 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.379741 25185 consensus_peers.cc:597] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.382932 25185 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.386754 25184 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:11.388967 25182 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:12:11.389112 23430 tablet_replica.cc:333] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.390966 23430 raft_consensus.cc:2243] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.391636 23430 raft_consensus.cc:2272] T 46d76b8a93c540a2936fa04c6712e968 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.394387 23430 tablet_replica.cc:333] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.395103 23430 raft_consensus.cc:2243] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.396104 23430 raft_consensus.cc:2272] T 14e96ae54f3a4631bcabb789d2c4146c P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.398566 23430 tablet_replica.cc:333] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.399360 23430 raft_consensus.cc:2243] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.400103 23430 raft_consensus.cc:2272] T 27022900b12b4397b1677f3fb2326347 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.402612 23430 tablet_replica.cc:333] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.403314 23430 raft_consensus.cc:2243] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.404505 23430 raft_consensus.cc:2272] T 7db7a15c9a7549a4a147a987f1362c09 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.406873 23430 tablet_replica.cc:333] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.407616 23430 raft_consensus.cc:2243] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.409142 23430 raft_consensus.cc:2272] T e7ec39f0d4e04761ae598f1245692799 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.411808 23430 tablet_replica.cc:333] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.412603 23430 raft_consensus.cc:2243] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.413260 23430 raft_consensus.cc:2272] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 148dc963cec64232ad3b248abad6f36d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.415962 23430 tablet_replica.cc:333] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.416754 23430 raft_consensus.cc:2243] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.417326 23430 raft_consensus.cc:2272] T e4b8c8f0e3de4df592f498349e097d44 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.419970 23430 tablet_replica.cc:333] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.420671 23430 raft_consensus.cc:2243] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.421357 23430 raft_consensus.cc:2272] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.422256 25182 consensus_peers.cc:597] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:11.423858 23430 tablet_replica.cc:333] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.424695 23430 raft_consensus.cc:2243] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.425705 23430 raft_consensus.cc:2272] T e9c35412a4ad4729862392b77295639d P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.428264 23430 tablet_replica.cc:333] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.429015 23430 raft_consensus.cc:2243] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.430017 23430 raft_consensus.cc:2272] T 57bac7b2b9c5456588833d44d3dff943 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.432514 23430 tablet_replica.cc:333] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.433285 23430 raft_consensus.cc:2243] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.434242 23430 raft_consensus.cc:2272] T f8aa20313ae2498e918eac40defe927c P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.436592 23430 tablet_replica.cc:333] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.437366 23430 raft_consensus.cc:2243] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.437996 23430 raft_consensus.cc:2272] T 4430292826c34b99a8f9413e570e0ff3 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.440428 23430 tablet_replica.cc:333] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.441123 23430 raft_consensus.cc:2243] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.441720 23430 raft_consensus.cc:2272] T 524d0087b4074f61ad31e7ba78ee8b99 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.444195 23430 tablet_replica.cc:333] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.444864 23430 raft_consensus.cc:2243] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.445499 23430 raft_consensus.cc:2272] T 243f0803aa8e4b9e938126e02e960e97 P 148dc963cec64232ad3b248abad6f36d [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.447871 23430 tablet_replica.cc:333] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.448522 23430 raft_consensus.cc:2243] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.449136 23430 raft_consensus.cc:2272] T 24de2d510450446080d67047a1f1eebe P 148dc963cec64232ad3b248abad6f36d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.451102  1081 raft_consensus.cc:493] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:11.451571 23430 tablet_replica.cc:333] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.451575  1081 raft_consensus.cc:515] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:11.452407 23430 raft_consensus.cc:2243] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.453730 23430 raft_consensus.cc:2272] T 2732386ac0bf488eb0fcc0893f0c9b0e P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.453837  1081 leader_election.cc:290] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
I20260709 13:12:11.456336 23430 tablet_replica.cc:333] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.457136 23430 raft_consensus.cc:2243] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.457813 23430 raft_consensus.cc:2272] T f689bef5c09a4f4caf91a81702cc7723 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.460007 25182 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:11.460273 23430 tablet_replica.cc:333] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.461052 23430 raft_consensus.cc:2243] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.461627 23430 raft_consensus.cc:2272] T b1932202ddbe46b29ed12a1b38042652 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.461898 25184 leader_election.cc:336] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:11.462312 25184 leader_election.cc:304] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:11.462904  1081 raft_consensus.cc:2749] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:12:11.464169 23430 tablet_replica.cc:333] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.464969 23430 raft_consensus.cc:2243] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.466008 23430 raft_consensus.cc:2272] T b6ade31527164676867a5686444d0240 P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.468518 23430 tablet_replica.cc:333] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.469352 23430 raft_consensus.cc:2243] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.471010 23430 raft_consensus.cc:2272] T de2b0253cbb445a4bb49f874e70ea972 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.473488 23430 tablet_replica.cc:333] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.474186 23430 raft_consensus.cc:2243] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.474725 23430 raft_consensus.cc:2272] T 5f10dd13cd784e8cb8b1dba5b1d1892a P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.477170 23430 tablet_replica.cc:333] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.477921 23430 raft_consensus.cc:2243] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.479192 23430 raft_consensus.cc:2272] T f1d76f2e8d504bd29a4d29e4926a9407 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.480268 25182 consensus_peers.cc:597] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:11.481907 23430 tablet_replica.cc:333] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.482745 23430 raft_consensus.cc:2243] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.483330 23430 raft_consensus.cc:2272] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 148dc963cec64232ad3b248abad6f36d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.485957 23430 tablet_replica.cc:333] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.486675 23430 raft_consensus.cc:2243] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:11.487207 25185 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.487339 25184 consensus_peers.cc:597] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 -> Peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Couldn't send request to peer 96002c98f2d142e4b67dc5105a06079c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:11.487450 23430 raft_consensus.cc:2272] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.490114 23430 tablet_replica.cc:333] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.490837 23430 raft_consensus.cc:2243] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.491775 23430 raft_consensus.cc:2272] T 8d807668edef41d5b0b7e311228f18c2 P 148dc963cec64232ad3b248abad6f36d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.494385 23430 tablet_replica.cc:333] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.495162 23430 raft_consensus.cc:2243] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.496176 23430 raft_consensus.cc:2272] T c6328dd8c55f4742b015ea60e33773bc P 148dc963cec64232ad3b248abad6f36d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.498731 23430 tablet_replica.cc:333] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.499521 23430 raft_consensus.cc:2243] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.500144 23430 raft_consensus.cc:2272] T bf2646e18c7042728614c4bbf5b867aa P 148dc963cec64232ad3b248abad6f36d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.502641 23430 tablet_replica.cc:333] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.503321 23430 raft_consensus.cc:2243] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.504076 23430 raft_consensus.cc:2272] T e6a2e9eb050b40f8b828d36d037224d8 P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.506551 23430 tablet_replica.cc:333] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.507256 23430 raft_consensus.cc:2243] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.508309 23430 raft_consensus.cc:2272] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 148dc963cec64232ad3b248abad6f36d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.510746 23430 tablet_replica.cc:333] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.511449 23430 raft_consensus.cc:2243] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.512003 23430 raft_consensus.cc:2272] T c5d1c8994b3f41b286ae8a8f4a93b76a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.514385 23430 tablet_replica.cc:333] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.515049 23430 raft_consensus.cc:2243] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.515616 23430 raft_consensus.cc:2272] T b8b86e620fd64cf5b4c4a826cb95278a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.517949 23430 tablet_replica.cc:333] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.518605 23430 raft_consensus.cc:2243] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.519081 23430 raft_consensus.cc:2272] T 90e49b6f6ffd4dde98abdfd00821bc27 P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.521591 23430 tablet_replica.cc:333] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.522293 23430 raft_consensus.cc:2243] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.522923 23430 raft_consensus.cc:2272] T cee5aeb35a614558ad30ac67ec366dcf P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.525272 23430 tablet_replica.cc:333] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.525918 23430 raft_consensus.cc:2243] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.526953 23430 raft_consensus.cc:2272] T 3f7e4efd4057430f8479100c05796bcf P 148dc963cec64232ad3b248abad6f36d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.529520 23430 tablet_replica.cc:333] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.530177 23430 raft_consensus.cc:2243] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.530831 23430 raft_consensus.cc:2272] T cf80704aefe74fbe81e575cc17508b9a P 148dc963cec64232ad3b248abad6f36d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.533316 23430 tablet_replica.cc:333] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.533967 23430 raft_consensus.cc:2243] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.534504 23430 raft_consensus.cc:2272] T 5644c0da536c49768827dfd20a9662e1 P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.536856 23430 tablet_replica.cc:333] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.537555 23430 raft_consensus.cc:2243] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.538157 23430 raft_consensus.cc:2272] T e2fa80994624487d980c9d3ef7a166ce P 148dc963cec64232ad3b248abad6f36d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.540750 23430 tablet_replica.cc:333] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.541407 23430 raft_consensus.cc:2243] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:12:11.542378 23430 raft_consensus.cc:2272] T b7ee2372084b4767aa79fc57a0c53278 P 148dc963cec64232ad3b248abad6f36d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:11.544755 23430 tablet_replica.cc:333] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d: stopping tablet replica
I20260709 13:12:11.545372 23430 raft_consensus.cc:2243] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:11.546021 23430 raft_consensus.cc:2272] T 30a58475c1d54873be44217fc84b05ec P 148dc963cec64232ad3b248abad6f36d [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:11.555380 25185 consensus_peers.cc:597] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.558491  1089 raft_consensus.cc:493] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:11.558992  1089 raft_consensus.cc:515] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:11.560896  1089 leader_election.cc:290] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:11.565290 25182 leader_election.cc:336] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:11.567178 25184 leader_election.cc:336] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:11.567612 25184 leader_election.cc:304] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:11.568244  1089 raft_consensus.cc:2749] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:12:11.574105 25182 consensus_peers.cc:597] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:12:11.577322 25185 consensus_peers.cc:597] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.625608 25185 consensus_peers.cc:597] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.633549  1081 raft_consensus.cc:493] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:11.634188  1081 raft_consensus.cc:515] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:11.636409  1081 leader_election.cc:290] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:11.641467 25184 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
W20260709 13:12:11.642349 25182 leader_election.cc:336] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:11.642802 25182 leader_election.cc:304] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:11.643740  1081 raft_consensus.cc:2749] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:12:11.653684 25182 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:12:11.657303  1081 raft_consensus.cc:493] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:11.657862  1081 raft_consensus.cc:515] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:11.659899  1081 leader_election.cc:290] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:11.664777 25182 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:12:11.666016 25184 leader_election.cc:336] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
I20260709 13:12:11.666436 25184 leader_election.cc:304] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:11.667446  1081 raft_consensus.cc:2749] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:11.669704 25185 consensus_peers.cc:597] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.680877 25185 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.743539 25185 consensus_peers.cc:597] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.785576 25185 consensus_peers.cc:597] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.819154 25182 consensus_peers.cc:597] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:11.827196 25182 consensus_peers.cc:597] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:12:11.906087 25185 consensus_peers.cc:597] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 -> Peer 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): Couldn't send request to peer 148dc963cec64232ad3b248abad6f36d. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:11.932854 25182 consensus_peers.cc:597] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:12:11.934319  1089 raft_consensus.cc:493] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96002c98f2d142e4b67dc5105a06079c)
I20260709 13:12:11.934895  1089 raft_consensus.cc:515] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0131806e3b9647128f32db1ab8d314fc" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45343 } } peers { permanent_uuid: "96002c98f2d142e4b67dc5105a06079c" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 39455 } } peers { permanent_uuid: "983693721af6486c97ece1410a90cf30" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 34125 } attrs { promote: false } }
I20260709 13:12:11.936961  1089 leader_election.cc:290] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343), 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455)
W20260709 13:12:11.940991 25184 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 96002c98f2d142e4b67dc5105a06079c (127.22.225.130:39455): Network error: Client connection negotiation failed: client connection to 127.22.225.130:39455: connect: Connection refused (error 111)
W20260709 13:12:11.942483 25182 leader_election.cc:336] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
I20260709 13:12:11.942867 25182 leader_election.cc:304] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 983693721af6486c97ece1410a90cf30; no voters: 0131806e3b9647128f32db1ab8d314fc, 96002c98f2d142e4b67dc5105a06079c
I20260709 13:12:11.943539  1089 raft_consensus.cc:2749] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:12:11.959318 25182 consensus_peers.cc:597] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:12:11.979013 24410 catalog_manager.cc:4755] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): ChangeConfig:REMOVE_PEER RPC failed for tablet de2b0253cbb445a4bb49f874e70ea972: Network error: Client connection negotiation failed: client connection to 127.22.225.131:37451: connect: Connection refused (error 111)
I20260709 13:12:12.121567 23430 tablet_server.cc:196] TabletServer@127.22.225.131:0 shutdown complete.
W20260709 13:12:12.218607 25182 consensus_peers.cc:597] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:12:12.236488 23430 tablet_server.cc:179] TabletServer@127.22.225.132:0 shutting down...
I20260709 13:12:12.294114 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:12.295015 23430 tablet_replica.cc:333] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.295825 23430 raft_consensus.cc:2243] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.296535 23430 raft_consensus.cc:2272] T de2b0253cbb445a4bb49f874e70ea972 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.299269 23430 tablet_replica.cc:333] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.300011 23430 raft_consensus.cc:2243] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.300746 23430 raft_consensus.cc:2272] T 57bac7b2b9c5456588833d44d3dff943 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.303278 23430 tablet_replica.cc:333] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.304024 23430 raft_consensus.cc:2243] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.304621 23430 raft_consensus.cc:2272] T b6ade31527164676867a5686444d0240 P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.307101 23430 tablet_replica.cc:333] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.307909 23430 raft_consensus.cc:2243] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.308421 23430 raft_consensus.cc:2272] T 655be3d0d44f42a1aa683fd7271af488 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.310917 23430 tablet_replica.cc:333] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.311645 23430 raft_consensus.cc:2243] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.312673 23430 raft_consensus.cc:2272] T 6ff0c5b0ac6e4cc5b9d864a010ffdfe4 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.317929 23430 tablet_replica.cc:333] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.318674 23430 raft_consensus.cc:2243] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.319247 23430 raft_consensus.cc:2272] T 4cf920647a7842d49c08b2453da44143 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.321820 23430 tablet_replica.cc:333] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.322621 23430 raft_consensus.cc:2243] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.323220 23430 raft_consensus.cc:2272] T e6a2e9eb050b40f8b828d36d037224d8 P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.325945 23430 tablet_replica.cc:333] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.326747 23430 raft_consensus.cc:2243] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.327857 23430 raft_consensus.cc:2272] T c9f2117a17f2425cae9c436e59c94b96 P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.330576 23430 tablet_replica.cc:333] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.331339 23430 raft_consensus.cc:2243] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:12.331777 25182 consensus_peers.cc:597] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 -> Peer 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): Couldn't send request to peer 0131806e3b9647128f32db1ab8d314fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:12:12.331911 23430 raft_consensus.cc:2272] T 8d807668edef41d5b0b7e311228f18c2 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.334643 23430 tablet_replica.cc:333] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.335378 23430 raft_consensus.cc:2243] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.337805 23430 raft_consensus.cc:2272] T cee5aeb35a614558ad30ac67ec366dcf P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.340327 23430 tablet_replica.cc:333] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.341149 23430 raft_consensus.cc:2243] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.342128 23430 raft_consensus.cc:2272] T 90e49b6f6ffd4dde98abdfd00821bc27 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.344587 23430 tablet_replica.cc:333] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.345319 23430 raft_consensus.cc:2243] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.346366 23430 raft_consensus.cc:2272] T 28c13259bf74484588e0fb08995091cc P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.348841 23430 tablet_replica.cc:333] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.349594 23430 raft_consensus.cc:2243] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.350159 23430 raft_consensus.cc:2272] T f8aa20313ae2498e918eac40defe927c P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.352499 23430 tablet_replica.cc:333] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.353228 23430 raft_consensus.cc:2243] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.354260 23430 raft_consensus.cc:2272] T bf2646e18c7042728614c4bbf5b867aa P 983693721af6486c97ece1410a90cf30 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.356554 23430 tablet_replica.cc:333] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.357254 23430 raft_consensus.cc:2243] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.357782 23430 raft_consensus.cc:2272] T 7db7a15c9a7549a4a147a987f1362c09 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.359942 23430 tablet_replica.cc:333] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.360668 23430 raft_consensus.cc:2243] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.361333 23430 raft_consensus.cc:2272] T e7ec39f0d4e04761ae598f1245692799 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.364845 23430 tablet_replica.cc:333] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.365572 23430 raft_consensus.cc:2243] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.366655 23430 raft_consensus.cc:2272] T 9bfcb1d6cfeb49dd83c1d2795dc046bb P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.371033 23430 tablet_replica.cc:333] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.371778 23430 raft_consensus.cc:2243] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.372763 23430 raft_consensus.cc:2272] T f6e02d1934244d5f93de764a08655a2c P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.375360 23430 tablet_replica.cc:333] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.376051 23430 raft_consensus.cc:2243] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.377506 23430 raft_consensus.cc:2272] T b5ca582b84fd4b4fa8344fc31bcb9c2a P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.379956 23430 tablet_replica.cc:333] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.380720 23430 raft_consensus.cc:2243] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.381392 23430 raft_consensus.cc:2272] T b7ee2372084b4767aa79fc57a0c53278 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.383746 23430 tablet_replica.cc:333] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.384428 23430 raft_consensus.cc:2243] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.385355 23430 raft_consensus.cc:2272] T 037c6a6c25cb4df5bc9bc7d29ad8347a P 983693721af6486c97ece1410a90cf30 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.387867 23430 tablet_replica.cc:333] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.388579 23430 raft_consensus.cc:2243] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.389333 23430 raft_consensus.cc:2272] T de0783d3a5f74b1c9adce43ebc457546 P 983693721af6486c97ece1410a90cf30 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.393257 23430 tablet_replica.cc:333] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.393944 23430 raft_consensus.cc:2243] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.394989 23430 raft_consensus.cc:2272] T c5d1c8994b3f41b286ae8a8f4a93b76a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.397601 23430 tablet_replica.cc:333] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.398358 23430 raft_consensus.cc:2243] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.399346 23430 raft_consensus.cc:2272] T b8b86e620fd64cf5b4c4a826cb95278a P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.401774 23430 tablet_replica.cc:333] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.402500 23430 raft_consensus.cc:2243] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.403151 23430 raft_consensus.cc:2272] T 3f7e4efd4057430f8479100c05796bcf P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.405447 23430 tablet_replica.cc:333] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.406150 23430 raft_consensus.cc:2243] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.407274 23430 raft_consensus.cc:2272] T 90f5d915fb71474ab2b58063813a93a9 P 983693721af6486c97ece1410a90cf30 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.409786 23430 tablet_replica.cc:333] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.410449 23430 raft_consensus.cc:2243] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.410996 23430 raft_consensus.cc:2272] T c6328dd8c55f4742b015ea60e33773bc P 983693721af6486c97ece1410a90cf30 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.413398 23430 tablet_replica.cc:333] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.414053 23430 raft_consensus.cc:2243] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.414683 23430 raft_consensus.cc:2272] T 14e96ae54f3a4631bcabb789d2c4146c P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.416999 23430 tablet_replica.cc:333] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.417701 23430 raft_consensus.cc:2243] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.418730 23430 raft_consensus.cc:2272] T e2fa80994624487d980c9d3ef7a166ce P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.421038 23430 tablet_replica.cc:333] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.421741 23430 raft_consensus.cc:2243] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.422684 23430 raft_consensus.cc:2272] T 5644c0da536c49768827dfd20a9662e1 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.425019 23430 tablet_replica.cc:333] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.425719 23430 raft_consensus.cc:2243] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.426311 23430 raft_consensus.cc:2272] T 182cc63718a84173a76583588f193929 P 983693721af6486c97ece1410a90cf30 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.428705 23430 tablet_replica.cc:333] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.429451 23430 raft_consensus.cc:2243] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.430723 23430 raft_consensus.cc:2272] T 73880209aa174d609bf830ad4c666c8c P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.433454 23430 tablet_replica.cc:333] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.434226 23430 raft_consensus.cc:2243] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.434859 23430 raft_consensus.cc:2272] T 6458c5ddfa4b4a4188e06ad9fc7d983d P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.437568 23430 tablet_replica.cc:333] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.438270 23430 raft_consensus.cc:2243] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.438815 23430 raft_consensus.cc:2272] T 8cd2633e79fe4d3498a4412c062bf875 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.441246 23430 tablet_replica.cc:333] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.441967 23430 raft_consensus.cc:2243] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.443133 23430 raft_consensus.cc:2272] T b2451462dc894ec98db5932996a9e329 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.445712 23430 tablet_replica.cc:333] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.446470 23430 raft_consensus.cc:2243] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.447535 23430 raft_consensus.cc:2272] T 27022900b12b4397b1677f3fb2326347 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.450204 23430 tablet_replica.cc:333] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.450939 23430 raft_consensus.cc:2243] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.451916 23430 raft_consensus.cc:2272] T 46d76b8a93c540a2936fa04c6712e968 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.454542 23430 tablet_replica.cc:333] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.455235 23430 raft_consensus.cc:2243] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.455889 23430 raft_consensus.cc:2272] T ba23ab1f03ef40238962f541c00081d1 P 983693721af6486c97ece1410a90cf30 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.458264 23430 tablet_replica.cc:333] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.459048 23430 raft_consensus.cc:2243] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.460086 23430 raft_consensus.cc:2272] T 72b8c4b638a5486c82fb2d3bb64ef503 P 983693721af6486c97ece1410a90cf30 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.462554 23430 tablet_replica.cc:333] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.463207 23430 raft_consensus.cc:2243] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.464340 23430 raft_consensus.cc:2272] T 243f0803aa8e4b9e938126e02e960e97 P 983693721af6486c97ece1410a90cf30 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.466857 23430 tablet_replica.cc:333] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.467566 23430 raft_consensus.cc:2243] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.469173 23430 raft_consensus.cc:2272] T 45fddcc6d2bc4726a21bdfe31a4cae08 P 983693721af6486c97ece1410a90cf30 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.471930 23430 tablet_replica.cc:333] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.472608 23430 raft_consensus.cc:2243] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:12:12.473817 23430 raft_consensus.cc:2272] T cfe7903b435c45a4b85c164ecf24c14f P 983693721af6486c97ece1410a90cf30 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.476225 23430 tablet_replica.cc:333] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.476935 23430 raft_consensus.cc:2243] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.477674 23430 raft_consensus.cc:2272] T 5a74983bd9b34474a7cd38346edf8a64 P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.480784 23430 tablet_replica.cc:333] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30: stopping tablet replica
I20260709 13:12:12.481333 23430 raft_consensus.cc:2243] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:12.481819 23430 raft_consensus.cc:2272] T 5b92ce30bcd84b2ca0734f9ebff2a43e P 983693721af6486c97ece1410a90cf30 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:12.875820 23430 tablet_server.cc:196] TabletServer@127.22.225.132:0 shutdown complete.
I20260709 13:12:12.942734 23430 master.cc:562] Master@127.22.225.190:40709 shutting down...
W20260709 13:12:12.973044 24471 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:12:12.973469 24471 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:12.973641 24471 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:21.535960 24407 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111) [suppressed 171 similar messages]
W20260709 13:12:21.539579 24407 catalog_manager.cc:4755] TS 0131806e3b9647128f32db1ab8d314fc (127.22.225.129:45343): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e7ec39f0d4e04761ae598f1245692799: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45343: connect: Connection refused (error 111)
W20260709 13:13:12.001991 24410 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.131:37451: connect: Connection refused (error 111)
W20260709 13:13:12.006006 24410 catalog_manager.cc:4755] TS 148dc963cec64232ad3b248abad6f36d (127.22.225.131:37451): ChangeConfig:REMOVE_PEER RPC failed for tablet de2b0253cbb445a4bb49f874e70ea972: Network error: Client connection negotiation failed: client connection to 127.22.225.131:37451: connect: Connection refused (error 111)
I20260709 13:13:14.433885 23430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.435114 23430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.435487 23430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7c40b21f34414599bc4c7e2b5c7f524d: stopping tablet replica
I20260709 13:13:14.632848 23430 master.cc:584] Master@127.22.225.190:40709 shutdown complete.
I20260709 13:13:14.682678 23430 test_util.cc:182] -----------------------------------------------
I20260709 13:13:14.682891 23430 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602441430441-23430-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (330000 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:13:14.685949 23430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.225.190:33845
I20260709 13:13:14.686982 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:14.692684  1128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:14.692801  1129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:14.694147 23430 server_base.cc:1061] running on GCE node
W20260709 13:13:14.694106  1131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:14.697626 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:14.697813 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:14.698025 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602794697989 us; error 0 us; skew 500 ppm
I20260709 13:13:14.698565 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:14.700819 23430 webserver.cc:533] Webserver started at http://127.22.225.190:41921/ using document root <none> and password file <none>
I20260709 13:13:14.701354 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:14.701510 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:14.701838 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:14.703063 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/master-0-root/instance:
uuid: "6ba8f4341cdd4818befb2cf3d81b43fb"
format_stamp: "Formatted at 2026-07-09 13:13:14 on dist-test-slave-fx0m"
I20260709 13:13:14.707297 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:14.710450  1136 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:14.711148 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:14.711431 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/master-0-root
uuid: "6ba8f4341cdd4818befb2cf3d81b43fb"
format_stamp: "Formatted at 2026-07-09 13:13:14 on dist-test-slave-fx0m"
I20260709 13:13:14.711709 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:14.756433 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:14.757664 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:14.796257 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.190:33845
I20260709 13:13:14.796358  1187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.190:33845 every 8 connection(s)
I20260709 13:13:14.800423  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.812155  1188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb: Bootstrap starting.
I20260709 13:13:14.817144  1188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.821275  1188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb: No bootstrap required, opened a new log
I20260709 13:13:14.823432  1188 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ba8f4341cdd4818befb2cf3d81b43fb" member_type: VOTER }
I20260709 13:13:14.823849  1188 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.824111  1188 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ba8f4341cdd4818befb2cf3d81b43fb, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.824766  1188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ba8f4341cdd4818befb2cf3d81b43fb" member_type: VOTER }
I20260709 13:13:14.825242  1188 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:14.825457  1188 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:14.825685  1188 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.830416  1188 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ba8f4341cdd4818befb2cf3d81b43fb" member_type: VOTER }
I20260709 13:13:14.830873  1188 leader_election.cc:304] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ba8f4341cdd4818befb2cf3d81b43fb; no voters: 
I20260709 13:13:14.831964  1188 leader_election.cc:290] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:14.832367  1191 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.833775  1191 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 1 LEADER]: Becoming Leader. State: Replica: 6ba8f4341cdd4818befb2cf3d81b43fb, State: Running, Role: LEADER
I20260709 13:13:14.834496  1191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ba8f4341cdd4818befb2cf3d81b43fb" member_type: VOTER }
I20260709 13:13:14.834926  1188 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:14.841275  1192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ba8f4341cdd4818befb2cf3d81b43fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ba8f4341cdd4818befb2cf3d81b43fb" member_type: VOTER } }
I20260709 13:13:14.841864  1192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:14.841691  1193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ba8f4341cdd4818befb2cf3d81b43fb. Latest consensus state: current_term: 1 leader_uuid: "6ba8f4341cdd4818befb2cf3d81b43fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ba8f4341cdd4818befb2cf3d81b43fb" member_type: VOTER } }
I20260709 13:13:14.842607  1193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:14.846312  1201 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:14.853766  1201 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:14.854746 23430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:14.862473  1201 catalog_manager.cc:1383] Generated new cluster ID: 1313e93ff4a64a69ad70e93ca00e82cb
I20260709 13:13:14.862746  1201 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:14.882578  1201 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:14.883807  1201 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:14.899983  1201 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb: Generated new TSK 0
I20260709 13:13:14.900533  1201 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:14.920876 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:14.926875  1209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:14.928443  1210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:14.929642  1212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:14.931154 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:14.933518 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:14.933715 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:14.933884 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602794933844 us; error 0 us; skew 500 ppm
I20260709 13:13:14.934432 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:14.936620 23430 webserver.cc:533] Webserver started at http://127.22.225.129:38085/ using document root <none> and password file <none>
I20260709 13:13:14.937152 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:14.937352 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:14.937628 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:14.938855 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/instance:
uuid: "e89740c5a5de48fd875c8b628616334c"
format_stamp: "Formatted at 2026-07-09 13:13:14 on dist-test-slave-fx0m"
I20260709 13:13:14.943116 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:14.946466  1217 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:14.947139 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:14.947413 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "e89740c5a5de48fd875c8b628616334c"
format_stamp: "Formatted at 2026-07-09 13:13:14 on dist-test-slave-fx0m"
I20260709 13:13:14.947664 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:14.966131 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:14.967370 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:14.968921 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:14.971422 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:14.971602 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:14.971917 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:14.972075 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.013152 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:44541
I20260709 13:13:15.013283  1279 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:44541 every 8 connection(s)
I20260709 13:13:15.018388 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:15.026449  1284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:15.030143 23430 server_base.cc:1061] running on GCE node
W20260709 13:13:15.030087  1285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:15.031612  1287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:15.033459 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:15.033756 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:15.033984 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602795033963 us; error 0 us; skew 500 ppm
I20260709 13:13:15.034651 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:15.036970  1280 heartbeater.cc:344] Connected to a master server at 127.22.225.190:33845
I20260709 13:13:15.037353  1280 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:15.037786 23430 webserver.cc:533] Webserver started at http://127.22.225.130:42671/ using document root <none> and password file <none>
I20260709 13:13:15.038305 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:15.038233  1280 heartbeater.cc:507] Master 127.22.225.190:33845 requested a full tablet report, sending...
I20260709 13:13:15.038611 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:15.038921 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:15.040462 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/instance:
uuid: "bbe86acd78454edfa45d9c095875cb2f"
format_stamp: "Formatted at 2026-07-09 13:13:15 on dist-test-slave-fx0m"
I20260709 13:13:15.040774  1153 ts_manager.cc:194] Registered new tserver with Master: e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:15.043363  1153 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57580
I20260709 13:13:15.046657 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:13:15.050374  1292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.051160 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:15.051434 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-1-root
uuid: "bbe86acd78454edfa45d9c095875cb2f"
format_stamp: "Formatted at 2026-07-09 13:13:15 on dist-test-slave-fx0m"
I20260709 13:13:15.051685 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:15.069980 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:15.071244 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:15.072650 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:15.074867 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:15.075037 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.075312 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:15.075474 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.115978 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.130:33279
I20260709 13:13:15.116070  1354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.130:33279 every 8 connection(s)
I20260709 13:13:15.120929 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:15.128729  1358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:15.129456  1359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:15.132889  1361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:15.133590 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:15.134646 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:15.134895 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:15.135100 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602795135081 us; error 0 us; skew 500 ppm
I20260709 13:13:15.135314  1355 heartbeater.cc:344] Connected to a master server at 127.22.225.190:33845
I20260709 13:13:15.135722  1355 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:15.135737 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:15.136636  1355 heartbeater.cc:507] Master 127.22.225.190:33845 requested a full tablet report, sending...
I20260709 13:13:15.138505 23430 webserver.cc:533] Webserver started at http://127.22.225.131:46341/ using document root <none> and password file <none>
I20260709 13:13:15.138912  1153 ts_manager.cc:194] Registered new tserver with Master: bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:15.139171 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:15.139456 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:15.139760 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:15.140754  1153 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57588
I20260709 13:13:15.141424 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/instance:
uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
format_stamp: "Formatted at 2026-07-09 13:13:15 on dist-test-slave-fx0m"
I20260709 13:13:15.146026 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:13:15.149010  1366 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.149804 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:15.150086 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-2-root
uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
format_stamp: "Formatted at 2026-07-09 13:13:15 on dist-test-slave-fx0m"
I20260709 13:13:15.150375 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:15.178383 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:15.179617 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:15.181329 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:15.183637 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:15.183876 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.184113 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:15.184284 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.233634 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.131:34201
I20260709 13:13:15.233775  1428 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.131:34201 every 8 connection(s)
I20260709 13:13:15.238929 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:15.247800  1432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:15.250487  1433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:15.251961  1435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:15.252951 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:15.254091 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:15.254361 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:15.254596 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602795254576 us; error 0 us; skew 500 ppm
I20260709 13:13:15.255330 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:15.258179  1429 heartbeater.cc:344] Connected to a master server at 127.22.225.190:33845
I20260709 13:13:15.258267 23430 webserver.cc:533] Webserver started at http://127.22.225.132:34021/ using document root <none> and password file <none>
I20260709 13:13:15.258527  1429 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:15.258953 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:15.259202 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:15.259418  1429 heartbeater.cc:507] Master 127.22.225.190:33845 requested a full tablet report, sending...
I20260709 13:13:15.259479 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:15.261044 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-3-root/instance:
uuid: "18c0de76f1804e98b0826423261536c9"
format_stamp: "Formatted at 2026-07-09 13:13:15 on dist-test-slave-fx0m"
I20260709 13:13:15.261593  1153 ts_manager.cc:194] Registered new tserver with Master: 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:15.263399  1153 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57604
I20260709 13:13:15.266611 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:15.270063  1440 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.270771 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:15.271044 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-3-root
uuid: "18c0de76f1804e98b0826423261536c9"
format_stamp: "Formatted at 2026-07-09 13:13:15 on dist-test-slave-fx0m"
I20260709 13:13:15.271374 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:15.298435 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:15.299600 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:15.300971 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:15.303107 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:15.303331 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.303572 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:15.303748 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.345826 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.132:33083
I20260709 13:13:15.345924  1502 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.132:33083 every 8 connection(s)
I20260709 13:13:15.359931  1503 heartbeater.cc:344] Connected to a master server at 127.22.225.190:33845
I20260709 13:13:15.360333  1503 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:15.361132  1503 heartbeater.cc:507] Master 127.22.225.190:33845 requested a full tablet report, sending...
I20260709 13:13:15.363057  1153 ts_manager.cc:194] Registered new tserver with Master: 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:15.363606 23430 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014598083s
I20260709 13:13:15.364364  1153 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57610
I20260709 13:13:15.397572  1153 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57616:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:13:15.635666  1468 tablet_service.cc:1511] Processing CreateTablet for tablet fbcbf94f9eb44b7f85be2c961b4d641e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:15.637144  1468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcbf94f9eb44b7f85be2c961b4d641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.646456  1394 tablet_service.cc:1511] Processing CreateTablet for tablet fbcbf94f9eb44b7f85be2c961b4d641e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:15.647969  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcbf94f9eb44b7f85be2c961b4d641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.649765  1393 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7de12179bb42a98b37bf18c8eb8591 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:15.651213  1393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7de12179bb42a98b37bf18c8eb8591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.651573  1392 tablet_service.cc:1511] Processing CreateTablet for tablet d7b91b4efbf841fbb8d25e87fef4b296 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:15.652882  1392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b91b4efbf841fbb8d25e87fef4b296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.656404  1245 tablet_service.cc:1511] Processing CreateTablet for tablet fbcbf94f9eb44b7f85be2c961b4d641e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:13:15.657770  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbcbf94f9eb44b7f85be2c961b4d641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.660482  1244 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7de12179bb42a98b37bf18c8eb8591 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:15.660949  1242 tablet_service.cc:1511] Processing CreateTablet for tablet 3aac3ebb386142cdaf24fffaf202c86e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:15.661837  1244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7de12179bb42a98b37bf18c8eb8591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.663328  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 58147dc2306b445bbc1134344d2d129d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:15.664700  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58147dc2306b445bbc1134344d2d129d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.667076  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 1d16cd36a26e44ed8084e41f237f1ad1 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:15.667887  1391 tablet_service.cc:1511] Processing CreateTablet for tablet 3aac3ebb386142cdaf24fffaf202c86e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:15.668394  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d16cd36a26e44ed8084e41f237f1ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.669340  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aac3ebb386142cdaf24fffaf202c86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.670173  1390 tablet_service.cc:1511] Processing CreateTablet for tablet d6d1cb4d3ccd49f9ac929224a0ad18b4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:15.670348  1389 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb045a1ea9c4a7d81082cfb9317cacc (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:15.671566  1390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d1cb4d3ccd49f9ac929224a0ad18b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.672348  1389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb045a1ea9c4a7d81082cfb9317cacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.673012  1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aac3ebb386142cdaf24fffaf202c86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.673223  1240 tablet_service.cc:1511] Processing CreateTablet for tablet d6d1cb4d3ccd49f9ac929224a0ad18b4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:15.675009  1240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d1cb4d3ccd49f9ac929224a0ad18b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.678503  1467 tablet_service.cc:1511] Processing CreateTablet for tablet 58147dc2306b445bbc1134344d2d129d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:15.679836  1467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58147dc2306b445bbc1134344d2d129d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.683095  1466 tablet_service.cc:1511] Processing CreateTablet for tablet d7b91b4efbf841fbb8d25e87fef4b296 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:15.684439  1466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b91b4efbf841fbb8d25e87fef4b296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.687047  1465 tablet_service.cc:1511] Processing CreateTablet for tablet 1d16cd36a26e44ed8084e41f237f1ad1 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:15.688362  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d16cd36a26e44ed8084e41f237f1ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.691511  1464 tablet_service.cc:1511] Processing CreateTablet for tablet d6d1cb4d3ccd49f9ac929224a0ad18b4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:13:15.695860  1463 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb045a1ea9c4a7d81082cfb9317cacc (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:15.696836  1239 tablet_service.cc:1511] Processing CreateTablet for tablet a11fac66d73d43d2ac8f1a4c97c78798 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:15.698027  1464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d1cb4d3ccd49f9ac929224a0ad18b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.698181  1239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11fac66d73d43d2ac8f1a4c97c78798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.700075  1388 tablet_service.cc:1511] Processing CreateTablet for tablet a11fac66d73d43d2ac8f1a4c97c78798 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:15.701550  1388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11fac66d73d43d2ac8f1a4c97c78798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.705557  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb045a1ea9c4a7d81082cfb9317cacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.742337  1320 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7de12179bb42a98b37bf18c8eb8591 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:13:15.743793  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7de12179bb42a98b37bf18c8eb8591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.746354  1319 tablet_service.cc:1511] Processing CreateTablet for tablet 58147dc2306b445bbc1134344d2d129d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:13:15.747777  1319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58147dc2306b445bbc1134344d2d129d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.750352  1318 tablet_service.cc:1511] Processing CreateTablet for tablet d7b91b4efbf841fbb8d25e87fef4b296 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:13:15.751739  1318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b91b4efbf841fbb8d25e87fef4b296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.752933  1317 tablet_service.cc:1511] Processing CreateTablet for tablet 3aac3ebb386142cdaf24fffaf202c86e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:13:15.754287  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aac3ebb386142cdaf24fffaf202c86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.759974  1315 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb045a1ea9c4a7d81082cfb9317cacc (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:13:15.763981  1462 tablet_service.cc:1511] Processing CreateTablet for tablet becaecefa770428abc9030aa88b4825e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:15.766291  1387 tablet_service.cc:1511] Processing CreateTablet for tablet cf505580e1d94688a182fbba553caf49 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:15.766731  1238 tablet_service.cc:1511] Processing CreateTablet for tablet becaecefa770428abc9030aa88b4825e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:15.767241  1316 tablet_service.cc:1511] Processing CreateTablet for tablet 1d16cd36a26e44ed8084e41f237f1ad1 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:13:15.768002  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becaecefa770428abc9030aa88b4825e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.751657  1524 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:15.778775  1314 tablet_service.cc:1511] Processing CreateTablet for tablet a11fac66d73d43d2ac8f1a4c97c78798 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:13:15.780877  1313 tablet_service.cc:1511] Processing CreateTablet for tablet becaecefa770428abc9030aa88b4825e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:13:15.782999  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf505580e1d94688a182fbba553caf49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.784171  1461 tablet_service.cc:1511] Processing CreateTablet for tablet cf505580e1d94688a182fbba553caf49 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:15.785668  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb045a1ea9c4a7d81082cfb9317cacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.792680  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d16cd36a26e44ed8084e41f237f1ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.785722  1461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf505580e1d94688a182fbba553caf49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.797538  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a11fac66d73d43d2ac8f1a4c97c78798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.801437  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becaecefa770428abc9030aa88b4825e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.805420  1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becaecefa770428abc9030aa88b4825e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.818085  1241 tablet_service.cc:1511] Processing CreateTablet for tablet cf505580e1d94688a182fbba553caf49 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:13:15.821853  1523 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:15.828418  1312 tablet_service.cc:1511] Processing CreateTablet for tablet bf601481d5614428aa1948ce5e0df02f (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:15.830070  1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf601481d5614428aa1948ce5e0df02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.834024  1391 tablet_service.cc:1511] Processing CreateTablet for tablet bf601481d5614428aa1948ce5e0df02f (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:15.834828  1311 tablet_service.cc:1511] Processing CreateTablet for tablet b7724e8025f442c084e2988c3de7cc75 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:15.835404  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf601481d5614428aa1948ce5e0df02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.836190  1311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7724e8025f442c084e2988c3de7cc75. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:15.845516  1200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:15.846120  1468 tablet_service.cc:1511] Processing CreateTablet for tablet bf601481d5614428aa1948ce5e0df02f (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:13:15.847378  1468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf601481d5614428aa1948ce5e0df02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.857434  1524 tablet_bootstrap.cc:654] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.858142  1242 tablet_service.cc:1511] Processing CreateTablet for tablet b7724e8025f442c084e2988c3de7cc75 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:15.879410  1394 tablet_service.cc:1511] Processing CreateTablet for tablet b7724e8025f442c084e2988c3de7cc75 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:13:15.880720  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7724e8025f442c084e2988c3de7cc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.881796  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 9c04006aa6c64fbd86fb7ff6b1f2b7ae (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:15.872949  1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7724e8025f442c084e2988c3de7cc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.900003  1463 tablet_service.cc:1511] Processing CreateTablet for tablet cb1be411e3cd45fab10d3ca9265e1696 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:15.901872  1523 tablet_bootstrap.cc:654] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.902804  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb1be411e3cd45fab10d3ca9265e1696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.902871  1526 tablet_bootstrap.cc:492] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:15.909828  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c04006aa6c64fbd86fb7ff6b1f2b7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.909631  1464 tablet_service.cc:1511] Processing CreateTablet for tablet 9c04006aa6c64fbd86fb7ff6b1f2b7ae (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:15.910626  1387 tablet_service.cc:1511] Processing CreateTablet for tablet cb1be411e3cd45fab10d3ca9265e1696 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:15.911477  1464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c04006aa6c64fbd86fb7ff6b1f2b7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.911973  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb1be411e3cd45fab10d3ca9265e1696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.914813  1525 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:15.915143  1238 tablet_service.cc:1511] Processing CreateTablet for tablet cb1be411e3cd45fab10d3ca9265e1696 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:13:15.916479  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb1be411e3cd45fab10d3ca9265e1696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.917414  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf505580e1d94688a182fbba553caf49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.922633  1524 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:15.923184  1524 ts_tablet_manager.cc:1403] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.000s
I20260709 13:13:15.926273  1524 raft_consensus.cc:359] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:15.926970  1524 raft_consensus.cc:385] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.927249  1524 raft_consensus.cc:740] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.928535  1524 consensus_queue.cc:260] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:15.931917  1315 tablet_service.cc:1511] Processing CreateTablet for tablet 9c04006aa6c64fbd86fb7ff6b1f2b7ae (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:13:15.933254  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c04006aa6c64fbd86fb7ff6b1f2b7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.937593  1316 tablet_service.cc:1511] Processing CreateTablet for tablet fdfb8ffcbef24e338137b942224f9ed8 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:15.939476  1525 tablet_bootstrap.cc:654] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.939667  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdfb8ffcbef24e338137b942224f9ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.942344  1526 tablet_bootstrap.cc:654] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.946573  1245 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9d052234b64c6c9657372e21b121af (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:15.945201  1390 tablet_service.cc:1511] Processing CreateTablet for tablet fdfb8ffcbef24e338137b942224f9ed8 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:15.953444  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9d052234b64c6c9657372e21b121af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.965183  1390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdfb8ffcbef24e338137b942224f9ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.949491  1462 tablet_service.cc:1511] Processing CreateTablet for tablet fdfb8ffcbef24e338137b942224f9ed8 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:13:15.969132  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdfb8ffcbef24e338137b942224f9ed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.982990  1467 tablet_service.cc:1511] Processing CreateTablet for tablet 146867b47b5b455fa5eab18fa30e09ae (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:15.984369  1467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146867b47b5b455fa5eab18fa30e09ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.985380  1524 ts_tablet_manager.cc:1434] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.018s
I20260709 13:13:15.989600  1311 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9d052234b64c6c9657372e21b121af (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:15.990689  1239 tablet_service.cc:1511] Processing CreateTablet for tablet 146867b47b5b455fa5eab18fa30e09ae (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:16.001870  1239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146867b47b5b455fa5eab18fa30e09ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.002641  1524 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:15.993757  1391 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9d052234b64c6c9657372e21b121af (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:13:15.994091  1530 raft_consensus.cc:493] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.994669  1280 heartbeater.cc:499] Master 127.22.225.190:33845 was elected leader, sending a full tablet report...
I20260709 13:13:16.017515  1530 raft_consensus.cc:515] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
W20260709 13:13:16.019515  1281 tablet.cc:2406] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:16.020368  1466 tablet_service.cc:1511] Processing CreateTablet for tablet 8a76b504d1f94cd18b99eddae689c4bb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:15.998844  1392 tablet_service.cc:1511] Processing CreateTablet for tablet f96429c9f69a43a898faaab20a0cc9d8 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:16.003409  1465 tablet_service.cc:1511] Processing CreateTablet for tablet f96429c9f69a43a898faaab20a0cc9d8 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:15.992748  1313 tablet_service.cc:1511] Processing CreateTablet for tablet 146867b47b5b455fa5eab18fa30e09ae (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:13:16.009775  1241 tablet_service.cc:1511] Processing CreateTablet for tablet f96429c9f69a43a898faaab20a0cc9d8 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:13:16.011555  1311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9d052234b64c6c9657372e21b121af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.021708  1530 leader_election.cc:290] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:16.035087  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9d052234b64c6c9657372e21b121af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.031572  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96429c9f69a43a898faaab20a0cc9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.032706  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96429c9f69a43a898faaab20a0cc9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.037395  1466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a76b504d1f94cd18b99eddae689c4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.037631  1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146867b47b5b455fa5eab18fa30e09ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.037150  1394 tablet_service.cc:1511] Processing CreateTablet for tablet 8a76b504d1f94cd18b99eddae689c4bb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:16.040885  1392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96429c9f69a43a898faaab20a0cc9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.017036  1317 tablet_service.cc:1511] Processing CreateTablet for tablet 8a76b504d1f94cd18b99eddae689c4bb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:13:16.042829  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a76b504d1f94cd18b99eddae689c4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.043638  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a76b504d1f94cd18b99eddae689c4bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.074121  1523 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:16.074671  1523 ts_tablet_manager.cc:1403] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.253s	user 0.017s	sys 0.013s
I20260709 13:13:16.089154  1387 tablet_service.cc:1511] Processing CreateTablet for tablet e6c6d73d03124b02976ae2b9126c2d7e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:16.089699  1524 tablet_bootstrap.cc:654] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.089761  1315 tablet_service.cc:1511] Processing CreateTablet for tablet e6c6d73d03124b02976ae2b9126c2d7e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:16.091677  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c6d73d03124b02976ae2b9126c2d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.090555  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c6d73d03124b02976ae2b9126c2d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.095503  1463 tablet_service.cc:1511] Processing CreateTablet for tablet 6561d58a0d984196a8f1edde7c628758 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:16.096797  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6561d58a0d984196a8f1edde7c628758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.098316  1239 tablet_service.cc:1511] Processing CreateTablet for tablet e6c6d73d03124b02976ae2b9126c2d7e (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:13:16.099565  1239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c6d73d03124b02976ae2b9126c2d7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.124332  1526 tablet_bootstrap.cc:492] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:16.131822  1526 ts_tablet_manager.cc:1403] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.229s	user 0.012s	sys 0.013s
I20260709 13:13:16.139680  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 6561d58a0d984196a8f1edde7c628758 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:16.140655  1390 tablet_service.cc:1511] Processing CreateTablet for tablet 6d59b30b44054b238642951881f89b66 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:16.143134  1355 heartbeater.cc:499] Master 127.22.225.190:33845 was elected leader, sending a full tablet report...
I20260709 13:13:16.143832  1316 tablet_service.cc:1511] Processing CreateTablet for tablet 6561d58a0d984196a8f1edde7c628758 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:13:16.144109  1390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d59b30b44054b238642951881f89b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.141089  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6561d58a0d984196a8f1edde7c628758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.149791  1468 tablet_service.cc:1511] Processing CreateTablet for tablet 6d59b30b44054b238642951881f89b66 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:16.154541  1526 raft_consensus.cc:359] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.150360  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6561d58a0d984196a8f1edde7c628758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.155280  1526 raft_consensus.cc:385] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.155680  1526 raft_consensus.cc:740] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.153600  1245 tablet_service.cc:1511] Processing CreateTablet for tablet 6d59b30b44054b238642951881f89b66 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:13:16.156744  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d59b30b44054b238642951881f89b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.159065  1468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d59b30b44054b238642951881f89b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.139453  1523 raft_consensus.cc:359] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.171147  1462 tablet_service.cc:1511] Processing CreateTablet for tablet d695ee04326f476498937637eb685d7b (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:16.174150  1391 tablet_service.cc:1511] Processing CreateTablet for tablet d695ee04326f476498937637eb685d7b (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:16.174240  1394 tablet_service.cc:1511] Processing CreateTablet for tablet 68c469e4ff0f4df4aa908546ef6482f2 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:16.175401  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d695ee04326f476498937637eb685d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.174240  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 68c469e4ff0f4df4aa908546ef6482f2 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:16.175652  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c469e4ff0f4df4aa908546ef6482f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.176384  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c469e4ff0f4df4aa908546ef6482f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.180847  1525 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:16.181396  1525 ts_tablet_manager.cc:1403] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.267s	user 0.022s	sys 0.016s
I20260709 13:13:16.181677  1315 tablet_service.cc:1511] Processing CreateTablet for tablet d695ee04326f476498937637eb685d7b (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:13:16.182991  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d695ee04326f476498937637eb685d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.184429  1525 raft_consensus.cc:359] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.185180  1525 raft_consensus.cc:385] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.185484  1525 raft_consensus.cc:740] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.186507  1524 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:16.186380  1525 consensus_queue.cc:260] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.187022  1524 ts_tablet_manager.cc:1403] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.185s	user 0.022s	sys 0.020s
I20260709 13:13:16.166108  1523 raft_consensus.cc:385] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.189489  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d695ee04326f476498937637eb685d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.189285  1523 raft_consensus.cc:740] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.189198  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7de12179bb42a98b37bf18c8eb8591" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:16.190474  1523 consensus_queue.cc:260] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
W20260709 13:13:16.191121  1220 leader_election.cc:343] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.166023  1526 consensus_queue.cc:260] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.211126  1503 heartbeater.cc:499] Master 127.22.225.190:33845 was elected leader, sending a full tablet report...
I20260709 13:13:16.214948  1238 tablet_service.cc:1511] Processing CreateTablet for tablet e568e879af50468085dbcfedb5005859 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:16.216310  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e568e879af50468085dbcfedb5005859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.211118  1464 tablet_service.cc:1511] Processing CreateTablet for tablet e568e879af50468085dbcfedb5005859 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:16.218499  1464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e568e879af50468085dbcfedb5005859. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.218580  1317 tablet_service.cc:1511] Processing CreateTablet for tablet 68c469e4ff0f4df4aa908546ef6482f2 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:13:16.218845  1314 tablet_service.cc:1511] Processing CreateTablet for tablet e568e879af50468085dbcfedb5005859 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:13:16.219877  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c469e4ff0f4df4aa908546ef6482f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.221237  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7de12179bb42a98b37bf18c8eb8591" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:16.221761  1388 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfaf2eb5ac94004b49869c3fb44246b (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:16.222954  1388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfaf2eb5ac94004b49869c3fb44246b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.225412  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e568e879af50468085dbcfedb5005859. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:16.225518  1221 leader_election.cc:343] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.226151  1221 leader_election.cc:304] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:16.228221  1530 raft_consensus.cc:2749] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.234491  1429 heartbeater.cc:499] Master 127.22.225.190:33845 was elected leader, sending a full tablet report...
I20260709 13:13:16.235564  1523 ts_tablet_manager.cc:1434] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.006s
I20260709 13:13:16.239032  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfaf2eb5ac94004b49869c3fb44246b (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:16.240175  1463 tablet_service.cc:1511] Processing CreateTablet for tablet 6bfaf2eb5ac94004b49869c3fb44246b (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:13:16.240715  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfaf2eb5ac94004b49869c3fb44246b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.240304  1523 tablet_bootstrap.cc:492] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:16.257817  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfaf2eb5ac94004b49869c3fb44246b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.272929  1537 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.273767  1537 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
W20260709 13:13:16.282656  1137 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 47659us
I20260709 13:13:16.287115  1537 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:16.293352  1536 raft_consensus.cc:493] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.293875  1536 raft_consensus.cc:515] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.296452  1536 leader_election.cc:290] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:16.302805  1523 tablet_bootstrap.cc:654] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.321059  1524 raft_consensus.cc:359] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:16.321889  1524 raft_consensus.cc:385] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.322214  1524 raft_consensus.cc:740] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.322960  1524 consensus_queue.cc:260] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:16.326057  1525 ts_tablet_manager.cc:1434] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.144s	user 0.010s	sys 0.003s
I20260709 13:13:16.327114  1525 tablet_bootstrap.cc:492] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:16.329320  1526 ts_tablet_manager.cc:1434] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.178s	user 0.011s	sys 0.003s
I20260709 13:13:16.330513  1526 tablet_bootstrap.cc:492] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:16.344681  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:16.345845  1316 tablet_service.cc:1511] Processing CreateTablet for tablet edb5ff6e1bd14308a0d214d7fcc8fecf (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
W20260709 13:13:16.346376  1370 leader_election.cc:343] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.347206  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb5ff6e1bd14308a0d214d7fcc8fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.338035  1524 ts_tablet_manager.cc:1434] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.138s	user 0.005s	sys 0.000s
I20260709 13:13:16.353749  1524 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:16.356137  1538 raft_consensus.cc:493] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.356846  1538 raft_consensus.cc:515] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.395814  1241 tablet_service.cc:1511] Processing CreateTablet for tablet b66f4c48f5f44fb7a7c683868e97d498 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:16.397110  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f4c48f5f44fb7a7c683868e97d498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.401933  1526 tablet_bootstrap.cc:654] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.403543  1523 tablet_bootstrap.cc:492] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:16.404098  1523 ts_tablet_manager.cc:1403] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.008s
I20260709 13:13:16.406589  1462 tablet_service.cc:1511] Processing CreateTablet for tablet edb5ff6e1bd14308a0d214d7fcc8fecf (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:16.408973  1525 tablet_bootstrap.cc:654] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.409274  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb5ff6e1bd14308a0d214d7fcc8fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.414904  1387 tablet_service.cc:1511] Processing CreateTablet for tablet edb5ff6e1bd14308a0d214d7fcc8fecf (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:13:16.416255  1530 raft_consensus.cc:493] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.416823  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb5ff6e1bd14308a0d214d7fcc8fecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.416738  1530 raft_consensus.cc:515] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:16.419106  1530 leader_election.cc:290] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:16.405510  1538 leader_election.cc:290] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:16.426414  1524 tablet_bootstrap.cc:654] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.427201  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:16.414861  1523 raft_consensus.cc:359] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
W20260709 13:13:16.428442  1221 leader_election.cc:343] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.428483  1523 raft_consensus.cc:385] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.430964  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:16.435885  1368 leader_election.cc:343] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.436352  1368 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:16.437940  1537 raft_consensus.cc:2749] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.438747  1392 tablet_service.cc:1511] Processing CreateTablet for tablet b66f4c48f5f44fb7a7c683868e97d498 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:16.440029  1392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f4c48f5f44fb7a7c683868e97d498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.433436  1523 raft_consensus.cc:740] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.441152  1523 consensus_queue.cc:260] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.453727  1316 tablet_service.cc:1511] Processing CreateTablet for tablet b66f4c48f5f44fb7a7c683868e97d498 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:13:16.454149  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:16.455142  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f4c48f5f44fb7a7c683868e97d498. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:16.455876  1442 leader_election.cc:343] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.455979  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:16.462071  1523 ts_tablet_manager.cc:1434] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:13:16.463106  1523 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
W20260709 13:13:16.482709  1443 leader_election.cc:343] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.483426  1443 leader_election.cc:304] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:16.484524  1536 raft_consensus.cc:2749] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.507182  1462 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec88e02ca274791a250e577eb123cdb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:16.508579  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec88e02ca274791a250e577eb123cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.512038  1526 tablet_bootstrap.cc:492] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:16.512610  1526 ts_tablet_manager.cc:1403] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.182s	user 0.015s	sys 0.006s
I20260709 13:13:16.512673  1525 tablet_bootstrap.cc:492] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:16.513301  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b91b4efbf841fbb8d25e87fef4b296" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:16.514036  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:16.513376  1525 ts_tablet_manager.cc:1403] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.186s	user 0.027s	sys 0.029s
W20260709 13:13:16.514941  1295 leader_election.cc:343] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:16.515278  1218 leader_election.cc:343] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.515784  1218 leader_election.cc:304] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:16.516775  1530 raft_consensus.cc:2749] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.518100  1525 raft_consensus.cc:359] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.522763  1525 raft_consensus.cc:385] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.523073  1525 raft_consensus.cc:740] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.523824  1525 consensus_queue.cc:260] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.525251  1523 tablet_bootstrap.cc:654] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.520709  1526 raft_consensus.cc:359] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.527771  1526 raft_consensus.cc:385] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.528187  1526 raft_consensus.cc:740] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.529181  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b91b4efbf841fbb8d25e87fef4b296" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:16.529342  1238 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec88e02ca274791a250e577eb123cdb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:16.529800  1478 raft_consensus.cc:2468] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:16.530134  1525 ts_tablet_manager.cc:1434] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:13:16.530645  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec88e02ca274791a250e577eb123cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.531551  1526 consensus_queue.cc:260] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.533782  1526 ts_tablet_manager.cc:1434] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:13:16.534029  1317 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec88e02ca274791a250e577eb123cdb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:13:16.534723  1526 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:16.535198  1525 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:16.536217  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec88e02ca274791a250e577eb123cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.537220  1293 leader_election.cc:304] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:16.538539  1538 raft_consensus.cc:2804] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:16.538939  1538 raft_consensus.cc:493] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.539268  1538 raft_consensus.cc:3060] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:16.541854  1525 tablet_bootstrap.cc:654] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.548015  1538 raft_consensus.cc:515] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.556651  1526 tablet_bootstrap.cc:654] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.558887  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b91b4efbf841fbb8d25e87fef4b296" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:16.559429  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b91b4efbf841fbb8d25e87fef4b296" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:16.560050  1478 raft_consensus.cc:3060] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:16.560633  1538 leader_election.cc:290] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:16.562072  1523 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:16.562582  1523 ts_tablet_manager.cc:1403] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.006s
I20260709 13:13:16.565660  1523 raft_consensus.cc:359] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.566378  1523 raft_consensus.cc:385] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.566666  1523 raft_consensus.cc:740] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.567432  1523 consensus_queue.cc:260] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.567754  1478 raft_consensus.cc:2468] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:16.569252  1523 ts_tablet_manager.cc:1434] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:13:16.570055  1523 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:16.576869  1523 tablet_bootstrap.cc:654] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.576748  1392 tablet_service.cc:1511] Processing CreateTablet for tablet 59ed770654a140988fd6e180dad119cc (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:16.578115  1392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ed770654a140988fd6e180dad119cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.582022  1293 leader_election.cc:304] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:16.582923  1538 raft_consensus.cc:2804] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:16.584347  1538 raft_consensus.cc:697] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:16.585224  1538 consensus_queue.cc:237] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
W20260709 13:13:16.598168  1295 leader_election.cc:343] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.597694  1153 catalog_manager.cc:5697] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.600349  1537 raft_consensus.cc:493] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.600904  1537 raft_consensus.cc:515] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.603184  1537 leader_election.cc:290] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:16.605181  1524 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:16.605686  1524 ts_tablet_manager.cc:1403] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.252s	user 0.018s	sys 0.004s
I20260709 13:13:16.605469  1238 tablet_service.cc:1511] Processing CreateTablet for tablet 59ed770654a140988fd6e180dad119cc (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:16.607041  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ed770654a140988fd6e180dad119cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.610358  1314 tablet_service.cc:1511] Processing CreateTablet for tablet f1b7143fae804b6db2eb33c3cc276f23 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:16.611050  1387 tablet_service.cc:1511] Processing CreateTablet for tablet f1b7143fae804b6db2eb33c3cc276f23 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:16.611765  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b7143fae804b6db2eb33c3cc276f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.612334  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b7143fae804b6db2eb33c3cc276f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.613711  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb045a1ea9c4a7d81082cfb9317cacc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:16.614367  1330 raft_consensus.cc:2468] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:16.615054  1462 tablet_service.cc:1511] Processing CreateTablet for tablet 59ed770654a140988fd6e180dad119cc (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:13:16.616272  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ed770654a140988fd6e180dad119cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.616765  1370 leader_election.cc:304] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:16.617666  1537 raft_consensus.cc:2804] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:16.618023  1537 raft_consensus.cc:493] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.618321  1537 raft_consensus.cc:3060] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:16.624650  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb045a1ea9c4a7d81082cfb9317cacc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:16.608772  1524 raft_consensus.cc:359] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.625595  1524 raft_consensus.cc:385] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.625924  1524 raft_consensus.cc:740] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
W20260709 13:13:16.626492  1367 leader_election.cc:343] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.626708  1524 consensus_queue.cc:260] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.635322  1463 tablet_service.cc:1511] Processing CreateTablet for tablet f1b7143fae804b6db2eb33c3cc276f23 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:13:16.636662  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b7143fae804b6db2eb33c3cc276f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.636551  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 38b311b738bf44b1abdf2cc9faeb4a19 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:16.637928  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b311b738bf44b1abdf2cc9faeb4a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.638038  1315 tablet_service.cc:1511] Processing CreateTablet for tablet 38b311b738bf44b1abdf2cc9faeb4a19 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:16.639247  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b311b738bf44b1abdf2cc9faeb4a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.645612  1537 raft_consensus.cc:515] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.647861  1388 tablet_service.cc:1511] Processing CreateTablet for tablet 38b311b738bf44b1abdf2cc9faeb4a19 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:13:16.648348  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb045a1ea9c4a7d81082cfb9317cacc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:16.649240  1388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b311b738bf44b1abdf2cc9faeb4a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.649295  1330 raft_consensus.cc:3060] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:16.649325  1526 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:16.652338  1526 ts_tablet_manager.cc:1403] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.006s
I20260709 13:13:16.662384  1524 ts_tablet_manager.cc:1434] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:13:16.663395  1524 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:16.671263  1330 raft_consensus.cc:2468] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:16.672441  1370 leader_election.cc:304] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:16.681895  1525 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:16.682415  1525 ts_tablet_manager.cc:1403] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.149s	user 0.037s	sys 0.024s
I20260709 13:13:16.682337  1526 raft_consensus.cc:359] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:16.683214  1526 raft_consensus.cc:385] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.683460  1468 tablet_service.cc:1511] Processing CreateTablet for tablet 88e6c0060fd34173a140bae79fbc0ed6 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:16.684792  1468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e6c0060fd34173a140bae79fbc0ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.687278  1530 raft_consensus.cc:493] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.687762  1530 raft_consensus.cc:515] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.688079  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb045a1ea9c4a7d81082cfb9317cacc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:16.688352  1317 tablet_service.cc:1511] Processing CreateTablet for tablet 88e6c0060fd34173a140bae79fbc0ed6 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:13:16.689563  1367 leader_election.cc:343] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.689742  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e6c0060fd34173a140bae79fbc0ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.683460  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 88e6c0060fd34173a140bae79fbc0ed6 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:13:16.692564  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88e6c0060fd34173a140bae79fbc0ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.692464  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:16.693171  1478 raft_consensus.cc:2468] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:16.689926  1530 leader_election.cc:290] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:16.695132  1218 leader_election.cc:304] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:16.695966  1530 raft_consensus.cc:2804] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:16.697047  1530 raft_consensus.cc:493] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.697396  1530 raft_consensus.cc:3060] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:16.701603  1523 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:16.683512  1526 raft_consensus.cc:740] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.693634  1524 tablet_bootstrap.cc:654] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.705003  1530 raft_consensus.cc:515] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.705219  1526 consensus_queue.cc:260] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:16.702797  1525 raft_consensus.cc:359] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.703316  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:16.706415  1525 raft_consensus.cc:385] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.706745  1525 raft_consensus.cc:740] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
W20260709 13:13:16.707379  1220 leader_election.cc:343] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.708314  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:16.709848  1562 raft_consensus.cc:2804] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:16.710362  1220 leader_election.cc:343] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.710841  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:16.713630  1478 raft_consensus.cc:3060] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:16.686766  1537 leader_election.cc:290] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:16.716382  1526 ts_tablet_manager.cc:1434] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 13:13:16.717235  1525 consensus_queue.cc:260] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.719712  1525 ts_tablet_manager.cc:1434] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:13:16.720674  1525 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:16.720901  1562 raft_consensus.cc:697] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:16.721853  1562 consensus_queue.cc:237] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:16.723762  1523 ts_tablet_manager.cc:1403] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.154s	user 0.017s	sys 0.031s
I20260709 13:13:16.726145  1523 raft_consensus.cc:359] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.726681  1523 raft_consensus.cc:385] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.711247  1530 leader_election.cc:290] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:16.729175  1387 tablet_service.cc:1511] Processing CreateTablet for tablet 80d272b7f7ba4b9aa358c6ab6b9c902c (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:16.731091  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d272b7f7ba4b9aa358c6ab6b9c902c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.732535  1526 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:16.720682  1478 raft_consensus.cc:2468] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:16.741099  1468 tablet_service.cc:1511] Processing CreateTablet for tablet 80d272b7f7ba4b9aa358c6ab6b9c902c (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:16.741681  1218 leader_election.cc:304] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:16.726994  1523 raft_consensus.cc:740] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.742801  1523 consensus_queue.cc:260] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.749521  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 80d272b7f7ba4b9aa358c6ab6b9c902c (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:13:16.750877  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d272b7f7ba4b9aa358c6ab6b9c902c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.745343  1530 raft_consensus.cc:2804] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:16.754223  1468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d272b7f7ba4b9aa358c6ab6b9c902c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.754245  1525 tablet_bootstrap.cc:654] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.746706  1524 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:16.747169  1315 tablet_service.cc:1511] Processing CreateTablet for tablet 39dbc9ed002b4e458021f97d435e9fff (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:16.758191  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dbc9ed002b4e458021f97d435e9fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.758526  1526 tablet_bootstrap.cc:654] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.762598  1524 ts_tablet_manager.cc:1403] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.012s
I20260709 13:13:16.766999  1524 raft_consensus.cc:359] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.767643  1523 ts_tablet_manager.cc:1434] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.000s
I20260709 13:13:16.768980  1523 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:16.776196  1388 tablet_service.cc:1511] Processing CreateTablet for tablet 39dbc9ed002b4e458021f97d435e9fff (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:16.777635  1388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dbc9ed002b4e458021f97d435e9fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.779711  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 96e6253c017e4c2aae09a2b069b190b7 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:16.781150  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e6253c017e4c2aae09a2b069b190b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.784020  1523 tablet_bootstrap.cc:654] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.777659  1463 tablet_service.cc:1511] Processing CreateTablet for tablet 39dbc9ed002b4e458021f97d435e9fff (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:13:16.786789  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dbc9ed002b4e458021f97d435e9fff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.787400  1314 tablet_service.cc:1511] Processing CreateTablet for tablet 96e6253c017e4c2aae09a2b069b190b7 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:16.788378  1537 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.788791  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e6253c017e4c2aae09a2b069b190b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.788888  1537 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.791085  1537 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:16.792584  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:16.792992  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:16.794277  1525 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:16.784220  1530 raft_consensus.cc:697] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
W20260709 13:13:16.794418  1368 leader_election.cc:343] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:16.796635  1370 leader_election.cc:343] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.794777  1525 ts_tablet_manager.cc:1403] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.007s
I20260709 13:13:16.799620  1370 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:16.800208  1392 tablet_service.cc:1511] Processing CreateTablet for tablet 96e6253c017e4c2aae09a2b069b190b7 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:13:16.799485  1530 consensus_queue.cc:237] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.803655  1537 raft_consensus.cc:2749] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.804527  1392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e6253c017e4c2aae09a2b069b190b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.785537  1524 raft_consensus.cc:385] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.808988  1526 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:16.809516  1526 ts_tablet_manager.cc:1403] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.009s
I20260709 13:13:16.809391  1462 tablet_service.cc:1511] Processing CreateTablet for tablet e231c21d5eac41b2822621361cb74cad (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:16.811225  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e231c21d5eac41b2822621361cb74cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.812505  1526 raft_consensus.cc:359] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.806658  1524 raft_consensus.cc:740] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.803738  1525 raft_consensus.cc:359] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.813091  1526 raft_consensus.cc:385] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.816955  1526 raft_consensus.cc:740] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.817862  1526 consensus_queue.cc:260] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.818222  1243 tablet_service.cc:1511] Processing CreateTablet for tablet e231c21d5eac41b2822621361cb74cad (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:16.819422  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e231c21d5eac41b2822621361cb74cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.820333  1526 ts_tablet_manager.cc:1434] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:16.815439  1525 raft_consensus.cc:385] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.833213  1525 raft_consensus.cc:740] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.835188  1525 consensus_queue.cc:260] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.822721  1526 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:16.825475  1524 consensus_queue.cc:260] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.831461  1537 raft_consensus.cc:493] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.836445  1537 raft_consensus.cc:515] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.838768  1537 leader_election.cc:290] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:16.839310  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7de12179bb42a98b37bf18c8eb8591" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:16.835376  1315 tablet_service.cc:1511] Processing CreateTablet for tablet e231c21d5eac41b2822621361cb74cad (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:13:16.840296  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7de12179bb42a98b37bf18c8eb8591" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:16.840687  1370 leader_election.cc:343] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.840878  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e231c21d5eac41b2822621361cb74cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.840919  1255 raft_consensus.cc:2468] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:16.842495  1368 leader_election.cc:304] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:16.843792  1537 raft_consensus.cc:2804] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:16.844305  1537 raft_consensus.cc:493] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.844614  1525 ts_tablet_manager.cc:1434] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
I20260709 13:13:16.844697  1537 raft_consensus.cc:3060] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:16.845757  1525 tablet_bootstrap.cc:492] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:16.856686  1388 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecd149ab31945ab9517f3ab5061847d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:16.858012  1388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecd149ab31945ab9517f3ab5061847d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.875350  1524 ts_tablet_manager.cc:1434] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.002s
I20260709 13:13:16.876505  1524 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:16.877619  1464 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecd149ab31945ab9517f3ab5061847d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:16.878947  1464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecd149ab31945ab9517f3ab5061847d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:16.880597  1200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:16.881479  1465 tablet_service.cc:1511] Processing CreateTablet for tablet 0697a4a227684a69982f353a21f6f91c (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:16.882727  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0697a4a227684a69982f353a21f6f91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.887722  1387 tablet_service.cc:1511] Processing CreateTablet for tablet 0697a4a227684a69982f353a21f6f91c (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:16.891484  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0697a4a227684a69982f353a21f6f91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.892495  1524 tablet_bootstrap.cc:654] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.891081  1314 tablet_service.cc:1511] Processing CreateTablet for tablet 0697a4a227684a69982f353a21f6f91c (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:13:16.893610  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0697a4a227684a69982f353a21f6f91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.893507  1537 raft_consensus.cc:515] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.894749  1536 raft_consensus.cc:493] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.877048  1150 catalog_manager.cc:5697] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.900486  1536 raft_consensus.cc:515] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.896601  1151 catalog_manager.cc:5697] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.906256  1536 leader_election.cc:290] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:16.907037  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 141e6a07df1a4244a64d1eb2bb0c66c9 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:16.908247  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141e6a07df1a4244a64d1eb2bb0c66c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.908560  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcbf94f9eb44b7f85be2c961b4d641e" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:16.914351  1443 leader_election.cc:343] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.909282  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcbf94f9eb44b7f85be2c961b4d641e" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:16.915987  1442 leader_election.cc:343] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.916440  1442 leader_election.cc:304] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:16.917629  1536 raft_consensus.cc:2749] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.919005  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7de12179bb42a98b37bf18c8eb8591" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:16.919687  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7de12179bb42a98b37bf18c8eb8591" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:16.920274  1255 raft_consensus.cc:3060] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:16.921415  1370 leader_election.cc:343] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.925187  1537 leader_election.cc:290] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:16.929980  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecd149ab31945ab9517f3ab5061847d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:13:16.931324  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecd149ab31945ab9517f3ab5061847d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.933207  1525 tablet_bootstrap.cc:654] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.939026  1317 tablet_service.cc:1511] Processing CreateTablet for tablet 141e6a07df1a4244a64d1eb2bb0c66c9 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:16.940268  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141e6a07df1a4244a64d1eb2bb0c66c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.944319  1392 tablet_service.cc:1511] Processing CreateTablet for tablet 141e6a07df1a4244a64d1eb2bb0c66c9 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:13:16.947175  1392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141e6a07df1a4244a64d1eb2bb0c66c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.945910  1463 tablet_service.cc:1511] Processing CreateTablet for tablet 57b6cfeddad84835825e5e204da91e99 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:16.948122  1526 tablet_bootstrap.cc:654] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.950644  1523 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:16.951134  1523 ts_tablet_manager.cc:1403] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.182s	user 0.005s	sys 0.017s
I20260709 13:13:16.928858  1255 raft_consensus.cc:2468] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:16.957499  1530 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.954097  1238 tablet_service.cc:1511] Processing CreateTablet for tablet 57b6cfeddad84835825e5e204da91e99 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:16.959672  1368 leader_election.cc:304] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:16.960477  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b6cfeddad84835825e5e204da91e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.961380  1537 raft_consensus.cc:2804] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:16.961966  1537 raft_consensus.cc:697] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:16.962805  1537 consensus_queue.cc:237] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.966897  1388 tablet_service.cc:1511] Processing CreateTablet for tablet 9058031903ea43fb9f534aa81f81ed7d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:16.968154  1388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9058031903ea43fb9f534aa81f81ed7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.965310  1530 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:16.970353  1316 tablet_service.cc:1511] Processing CreateTablet for tablet 57b6cfeddad84835825e5e204da91e99 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:13:16.971560  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b6cfeddad84835825e5e204da91e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.971707  1530 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:16.972684  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:16.973223  1523 raft_consensus.cc:359] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.973675  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:16.973994  1523 raft_consensus.cc:385] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.974314  1523 raft_consensus.cc:740] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
W20260709 13:13:16.974478  1221 leader_election.cc:343] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.975116  1523 consensus_queue.cc:260] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:16.975971  1404 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:16.977381  1220 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:16.978638  1530 raft_consensus.cc:2804] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:16.979019  1530 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.979360  1530 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:16.994604  1524 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:16.995303  1524 ts_tablet_manager.cc:1403] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.038s
I20260709 13:13:16.999615  1523 ts_tablet_manager.cc:1434] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.003s
I20260709 13:13:16.999504  1462 tablet_service.cc:1511] Processing CreateTablet for tablet 9058031903ea43fb9f534aa81f81ed7d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:17.000958  1523 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:17.003002  1524 raft_consensus.cc:359] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.003726  1524 raft_consensus.cc:385] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.003983  1524 raft_consensus.cc:740] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.004707  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b6cfeddad84835825e5e204da91e99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.006872  1530 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.016191  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:17.018257  1524 consensus_queue.cc:260] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.019609  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9058031903ea43fb9f534aa81f81ed7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.024704  1530 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:17.031764  1391 tablet_service.cc:1511] Processing CreateTablet for tablet 15e8d0036e5647809908799723c1a147 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:17.032855  1525 tablet_bootstrap.cc:492] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:17.033882  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
W20260709 13:13:17.030397  1221 leader_election.cc:343] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.045367  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e8d0036e5647809908799723c1a147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.045491  1404 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.040568  1538 consensus_queue.cc:1048] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:17.042456  1150 catalog_manager.cc:5697] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.049361  1525 ts_tablet_manager.cc:1403] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.204s	user 0.017s	sys 0.004s
I20260709 13:13:17.042382  1465 tablet_service.cc:1511] Processing CreateTablet for tablet 15e8d0036e5647809908799723c1a147 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:17.042369  1523 tablet_bootstrap.cc:654] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.058017  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e8d0036e5647809908799723c1a147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.065828  1538 raft_consensus.cc:493] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.066392  1538 raft_consensus.cc:515] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.067804  1241 tablet_service.cc:1511] Processing CreateTablet for tablet dd6b66c1551c438084e2d9766814c7d3 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:17.071975  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:17.072578  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6b66c1551c438084e2d9766814c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.058537  1238 tablet_service.cc:1511] Processing CreateTablet for tablet 9058031903ea43fb9f534aa81f81ed7d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:13:17.075106  1526 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:17.075765  1526 ts_tablet_manager.cc:1403] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.254s	user 0.017s	sys 0.034s
W20260709 13:13:17.077289  1293 leader_election.cc:343] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:17.078334  1295 consensus_peers.cc:597] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.079419  1526 raft_consensus.cc:359] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.080207  1526 raft_consensus.cc:385] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.080660  1526 raft_consensus.cc:740] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.080416  1315 tablet_service.cc:1511] Processing CreateTablet for tablet 15e8d0036e5647809908799723c1a147 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:13:17.081264  1538 leader_election.cc:290] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:17.083263  1316 tablet_service.cc:1511] Processing CreateTablet for tablet dd6b66c1551c438084e2d9766814c7d3 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:17.085609  1404 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:17.085690  1387 tablet_service.cc:1511] Processing CreateTablet for tablet dd6b66c1551c438084e2d9766814c7d3 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:13:17.086424  1238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9058031903ea43fb9f534aa81f81ed7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.106810  1462 tablet_service.cc:1511] Processing CreateTablet for tablet 1ced950a049249b1a6e0621dbb3de9d4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:17.107908  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ced950a049249b1a6e0621dbb3de9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.053048  1525 raft_consensus.cc:359] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.092818  1557 raft_consensus.cc:493] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.109777  1220 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:17.111966  1557 raft_consensus.cc:515] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.113973  1557 leader_election.cc:290] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:17.114569  1530 raft_consensus.cc:2804] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.115056  1530 raft_consensus.cc:697] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:17.115852  1530 consensus_queue.cc:237] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.118040  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 1ced950a049249b1a6e0621dbb3de9d4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:17.119261  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ced950a049249b1a6e0621dbb3de9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.096306  1526 consensus_queue.cc:260] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.122198  1526 ts_tablet_manager.cc:1434] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:13:17.122572  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:17.123361  1526 tablet_bootstrap.cc:492] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:17.095674  1524 ts_tablet_manager.cc:1434] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.001s
I20260709 13:13:17.122608  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6b66c1551c438084e2d9766814c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.128357  1315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e8d0036e5647809908799723c1a147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.129966  1314 tablet_service.cc:1511] Processing CreateTablet for tablet 1ced950a049249b1a6e0621dbb3de9d4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:13:17.139248  1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ced950a049249b1a6e0621dbb3de9d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:17.132633  1293 leader_election.cc:343] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.125859  1525 raft_consensus.cc:385] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.143435  1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6b66c1551c438084e2d9766814c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.142632  1462 tablet_service.cc:1511] Processing CreateTablet for tablet b19cd97df43d45fea5f71645e8ee8a04 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:17.147804  1392 tablet_service.cc:1511] Processing CreateTablet for tablet b19cd97df43d45fea5f71645e8ee8a04 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:17.149358  1392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19cd97df43d45fea5f71645e8ee8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.150573  1537 raft_consensus.cc:493] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.151153  1537 raft_consensus.cc:515] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.153766  1537 leader_election.cc:290] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:17.154063  1313 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc36900defe4c799e8a1639efcffd13 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:17.155510  1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc36900defe4c799e8a1639efcffd13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.155382  1388 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9c856f42e4d8aabac8f485922bac4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:17.156864  1388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9c856f42e4d8aabac8f485922bac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.159468  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcbf94f9eb44b7f85be2c961b4d641e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:17.162009  1394 tablet_service.cc:1511] Processing CreateTablet for tablet 38d77a5b6b9c4251a7ca4a132c0cddcb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:17.162143  1317 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9c856f42e4d8aabac8f485922bac4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:17.163256  1394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d77a5b6b9c4251a7ca4a132c0cddcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.163651  1317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9c856f42e4d8aabac8f485922bac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.164743  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19cd97df43d45fea5f71645e8ee8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.158344  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcbf94f9eb44b7f85be2c961b4d641e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:17.146394  1525 raft_consensus.cc:740] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.179740  1523 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:17.180286  1523 ts_tablet_manager.cc:1403] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.180s	user 0.016s	sys 0.005s
I20260709 13:13:17.181619  1463 tablet_service.cc:1511] Processing CreateTablet for tablet 21b9c856f42e4d8aabac8f485922bac4 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:13:17.182080  1465 tablet_service.cc:1511] Processing CreateTablet for tablet 73b8ca76daab4ec193441ebe56431bfb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:17.183209  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b9c856f42e4d8aabac8f485922bac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.183032  1242 tablet_service.cc:1511] Processing CreateTablet for tablet 189f636ed54445ea91f7f9411e1b7593 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:17.183594  1390 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc36900defe4c799e8a1639efcffd13 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:17.184309  1242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189f636ed54445ea91f7f9411e1b7593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.184861  1390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc36900defe4c799e8a1639efcffd13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.186071  1464 tablet_service.cc:1511] Processing CreateTablet for tablet 38d77a5b6b9c4251a7ca4a132c0cddcb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:17.187290  1464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d77a5b6b9c4251a7ca4a132c0cddcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.189185  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 8bc36900defe4c799e8a1639efcffd13 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:13:17.190258  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bc36900defe4c799e8a1639efcffd13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.190048  1243 tablet_service.cc:1511] Processing CreateTablet for tablet b19cd97df43d45fea5f71645e8ee8a04 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:13:17.187793  1239 tablet_service.cc:1511] Processing CreateTablet for tablet 38d77a5b6b9c4251a7ca4a132c0cddcb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:13:17.193610  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b8ca76daab4ec193441ebe56431bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.182080  1245 tablet_service.cc:1511] Processing CreateTablet for tablet 73b8ca76daab4ec193441ebe56431bfb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:17.193936  1468 tablet_service.cc:1511] Processing CreateTablet for tablet 701a3f41583a49c69e65971c4f0fc271 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:17.168584  1477 raft_consensus.cc:2468] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:17.195158  1468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701a3f41583a49c69e65971c4f0fc271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.197538  1564 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.198035  1564 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.200230  1564 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:17.201826  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:17.202507  1404 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:17.206509  1220 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:17.214440  1311 tablet_service.cc:1511] Processing CreateTablet for tablet 73b8ca76daab4ec193441ebe56431bfb (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:13:17.215642  1319 tablet_service.cc:1511] Processing CreateTablet for tablet 189f636ed54445ea91f7f9411e1b7593 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:17.216060  1311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b8ca76daab4ec193441ebe56431bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.216928  1319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189f636ed54445ea91f7f9411e1b7593. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:17.168313  1368 leader_election.cc:343] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.217465  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19cd97df43d45fea5f71645e8ee8a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.188316  1526 tablet_bootstrap.cc:654] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.214550  1320 tablet_service.cc:1511] Processing CreateTablet for tablet 701a3f41583a49c69e65971c4f0fc271 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:17.222711  1524 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:17.214639  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:17.223683  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701a3f41583a49c69e65971c4f0fc271. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:17.224256  1221 leader_election.cc:343] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:17.219170  1368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 50914.4us
I20260709 13:13:17.225871  1367 leader_election.cc:304] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:17.228137  1389 tablet_service.cc:1511] Processing CreateTablet for tablet 701a3f41583a49c69e65971c4f0fc271 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:13:17.221146  1564 raft_consensus.cc:2804] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.229562  1564 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.230028  1564 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.230084  1537 raft_consensus.cc:2804] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.230605  1537 raft_consensus.cc:493] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.231024  1537 raft_consensus.cc:3060] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.233527  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b8ca76daab4ec193441ebe56431bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.237112  1239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d77a5b6b9c4251a7ca4a132c0cddcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.229679  1389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701a3f41583a49c69e65971c4f0fc271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.262739  1462 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef816cc2381433d87915406a71a365d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:17.263978  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef816cc2381433d87915406a71a365d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.269014  1562 consensus_queue.cc:1048] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:17.275339  1536 raft_consensus.cc:493] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.276034  1536 raft_consensus.cc:515] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.279528  1536 leader_election.cc:290] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
W20260709 13:13:17.281035  1367 consensus_peers.cc:597] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Couldn't send request to peer 18c0de76f1804e98b0826423261536c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.287643  1387 tablet_service.cc:1511] Processing CreateTablet for tablet 189f636ed54445ea91f7f9411e1b7593 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:13:17.289450  1387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189f636ed54445ea91f7f9411e1b7593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.299926  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf505580e1d94688a182fbba553caf49" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:17.221691  1523 raft_consensus.cc:359] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.309419  1523 raft_consensus.cc:385] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.309746  1523 raft_consensus.cc:740] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.310469  1523 consensus_queue.cc:260] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.311142  1150 catalog_manager.cc:5697] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.312628  1523 ts_tablet_manager.cc:1434] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.132s	user 0.004s	sys 0.000s
W20260709 13:13:17.313597  1443 leader_election.cc:343] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.326995  1523 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:17.292266  1525 consensus_queue.cc:260] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.338869  1525 ts_tablet_manager.cc:1434] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.289s	user 0.004s	sys 0.003s
I20260709 13:13:17.340054  1525 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:17.341547  1523 tablet_bootstrap.cc:654] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.359583  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf505580e1d94688a182fbba553caf49" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:17.360882  1442 leader_election.cc:343] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.361367  1442 leader_election.cc:304] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:17.362780  1536 raft_consensus.cc:2749] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.363159  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:17.364804  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:17.366321  1370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 98535.2us
I20260709 13:13:17.369577  1581 consensus_queue.cc:1048] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:17.391786  1538 raft_consensus.cc:493] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.392385  1538 raft_consensus.cc:515] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.394562  1538 leader_election.cc:290] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:17.398168  1524 tablet_bootstrap.cc:654] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.400498  1564 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.406006  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:17.410670  1404 raft_consensus.cc:3060] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.412307  1526 tablet_bootstrap.cc:492] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:17.412878  1526 ts_tablet_manager.cc:1403] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.290s	user 0.013s	sys 0.009s
I20260709 13:13:17.417022  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:17.417689  1403 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.421980  1241 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef816cc2381433d87915406a71a365d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:17.423211  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef816cc2381433d87915406a71a365d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.434814  1403 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:17.436422  1581 consensus_queue.cc:1048] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.438627  1220 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:17.439491  1581 raft_consensus.cc:2804] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.439989  1581 raft_consensus.cc:697] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:17.445451  1537 raft_consensus.cc:515] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.447633  1537 leader_election.cc:290] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:17.448840  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcbf94f9eb44b7f85be2c961b4d641e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
W20260709 13:13:17.461419  1294 leader_election.cc:343] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.461977  1294 leader_election.cc:304] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
W20260709 13:13:17.462929  1294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 56110.6us
W20260709 13:13:17.463642  1294 leader_election.cc:343] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.464109  1294 leader_election.cc:304] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:17.463027  1526 raft_consensus.cc:359] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.464737  1526 raft_consensus.cc:385] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.465149  1526 raft_consensus.cc:740] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.465936  1526 consensus_queue.cc:260] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.468243  1526 ts_tablet_manager.cc:1434] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:13:17.469354  1526 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:17.472235  1320 tablet_service.cc:1511] Processing CreateTablet for tablet 7ef816cc2381433d87915406a71a365d (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:13:17.473698  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ef816cc2381433d87915406a71a365d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.476228  1526 tablet_bootstrap.cc:654] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:17.443740  1221 leader_election.cc:343] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.449474  1477 raft_consensus.cc:3060] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.481233  1538 raft_consensus.cc:2749] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.486130  1538 raft_consensus.cc:2749] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.491951  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:17.492282  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:17.492583  1525 tablet_bootstrap.cc:654] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.493003  1255 raft_consensus.cc:2468] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:17.440821  1581 consensus_queue.cc:237] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.494175  1391 tablet_service.cc:1511] Processing CreateTablet for tablet fed66ef7a02f46b699f94f562b334afd (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:17.496896  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed66ef7a02f46b699f94f562b334afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.497287  1294 leader_election.cc:304] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:17.498073  1538 raft_consensus.cc:2804] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.498445  1538 raft_consensus.cc:493] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.498761  1538 raft_consensus.cc:3060] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.519449  1538 raft_consensus.cc:515] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.526298  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcbf94f9eb44b7f85be2c961b4d641e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:17.527302  1537 raft_consensus.cc:493] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:17.524236  1293 leader_election.cc:343] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.532394  1241 tablet_service.cc:1511] Processing CreateTablet for tablet fed66ef7a02f46b699f94f562b334afd (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:17.534127  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed66ef7a02f46b699f94f562b334afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.529695  1537 raft_consensus.cc:515] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.537135  1468 tablet_service.cc:1511] Processing CreateTablet for tablet fed66ef7a02f46b699f94f562b334afd (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:13:17.537622  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:17.538370  1468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed66ef7a02f46b699f94f562b334afd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:17.533361  1368 leader_election.cc:343] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:17.542738  1221 consensus_peers.cc:597] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.551071  1523 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:17.551283  1564 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:17.551627  1523 ts_tablet_manager.cc:1403] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.225s	user 0.047s	sys 0.033s
I20260709 13:13:17.553308  1562 consensus_queue.cc:1048] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.566100  1538 leader_election.cc:290] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:17.540792  1537 leader_election.cc:290] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:17.578389  1477 raft_consensus.cc:2468] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:17.581441  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:17.581290  1523 raft_consensus.cc:359] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:17.547235  1370 consensus_peers.cc:597] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.586448  1524 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:17.586320  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:17.586705  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:17.587416  1254 raft_consensus.cc:3060] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:17.588394  1293 leader_election.cc:343] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.586997  1524 ts_tablet_manager.cc:1403] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.395s	user 0.027s	sys 0.010s
I20260709 13:13:17.591941  1524 raft_consensus.cc:359] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.592636  1524 raft_consensus.cc:385] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.592907  1524 raft_consensus.cc:740] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
W20260709 13:13:17.585515  1370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 53513.3us
I20260709 13:13:17.594625  1368 leader_election.cc:304] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:17.599526  1525 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:17.600039  1525 ts_tablet_manager.cc:1403] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.260s	user 0.009s	sys 0.008s
I20260709 13:13:17.600307  1562 raft_consensus.cc:2749] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:17.597962  1367 leader_election.cc:304] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:17.598479  1465 tablet_service.cc:1511] Processing CreateTablet for tablet 6958d3ba5e114d41a6b80c1c57ac0026 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:17.594388  1524 consensus_queue.cc:260] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.608325  1388 tablet_service.cc:1511] Processing CreateTablet for tablet 6958d3ba5e114d41a6b80c1c57ac0026 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:17.584676  1523 raft_consensus.cc:385] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.589978  1319 tablet_service.cc:1511] Processing CreateTablet for tablet 6958d3ba5e114d41a6b80c1c57ac0026 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:13:17.607089  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6958d3ba5e114d41a6b80c1c57ac0026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.607908  1537 raft_consensus.cc:2804] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.620498  1537 raft_consensus.cc:697] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:17.621630  1537 consensus_queue.cc:237] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.622947  1311 tablet_service.cc:1511] Processing CreateTablet for tablet acbe7a061fdd480e9dbf9bd9ec64cdd9 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:17.611220  1254 raft_consensus.cc:2468] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:17.610531  1525 raft_consensus.cc:359] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.626847  1525 raft_consensus.cc:385] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.613351  1388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6958d3ba5e114d41a6b80c1c57ac0026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.627205  1525 raft_consensus.cc:740] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.627439  1524 ts_tablet_manager.cc:1434] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:13:17.628553  1524 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:17.629181  1391 tablet_service.cc:1511] Processing CreateTablet for tablet acbe7a061fdd480e9dbf9bd9ec64cdd9 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:17.630371  1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbe7a061fdd480e9dbf9bd9ec64cdd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.618413  1319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6958d3ba5e114d41a6b80c1c57ac0026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.636474  1311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbe7a061fdd480e9dbf9bd9ec64cdd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.636225  1294 leader_election.cc:304] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:17.625303  1462 tablet_service.cc:1511] Processing CreateTablet for tablet 44c175554ac140ef8db4ae40ed5afc75 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:17.640435  1462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c175554ac140ef8db4ae40ed5afc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.641850  1245 tablet_service.cc:1511] Processing CreateTablet for tablet 44c175554ac140ef8db4ae40ed5afc75 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:17.643400  1245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c175554ac140ef8db4ae40ed5afc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.646531  1464 tablet_service.cc:1511] Processing CreateTablet for tablet 541fd181a6934377a1d38c9dc9db98a1 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:17.646951  1524 tablet_bootstrap.cc:654] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.647802  1464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541fd181a6934377a1d38c9dc9db98a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.616372  1523 raft_consensus.cc:740] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.650338  1523 consensus_queue.cc:260] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.652853  1392 tablet_service.cc:1511] Processing CreateTablet for tablet 541fd181a6934377a1d38c9dc9db98a1 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:17.653903  1523 ts_tablet_manager.cc:1434] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.102s	user 0.011s	sys 0.001s
I20260709 13:13:17.654187  1392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541fd181a6934377a1d38c9dc9db98a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.655212  1523 tablet_bootstrap.cc:492] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:17.657310  1538 raft_consensus.cc:2804] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.658151  1538 raft_consensus.cc:697] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:17.659204  1538 consensus_queue.cc:237] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.667976  1524 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:17.668548  1524 ts_tablet_manager.cc:1403] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 13:13:17.628108  1525 consensus_queue.cc:260] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.670272  1320 tablet_service.cc:1511] Processing CreateTablet for tablet 44c175554ac140ef8db4ae40ed5afc75 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:13:17.674108  1320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c175554ac140ef8db4ae40ed5afc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.674880  1525 ts_tablet_manager.cc:1434] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:13:17.675717  1524 raft_consensus.cc:359] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.613471  1526 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:17.676535  1524 raft_consensus.cc:385] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.676947  1526 ts_tablet_manager.cc:1403] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.041s
I20260709 13:13:17.615603  1241 tablet_service.cc:1511] Processing CreateTablet for tablet acbe7a061fdd480e9dbf9bd9ec64cdd9 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:13:17.685810  1241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbe7a061fdd480e9dbf9bd9ec64cdd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.687168  1536 raft_consensus.cc:493] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.687682  1536 raft_consensus.cc:515] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.672338  1243 tablet_service.cc:1511] Processing CreateTablet for tablet 541fd181a6934377a1d38c9dc9db98a1 (DEFAULT_TABLE table=test-workload [id=6e481cbbc1e1473a8b4605f6fbcdae23]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:13:17.689919  1243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541fd181a6934377a1d38c9dc9db98a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:17.690094  1536 leader_election.cc:290] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:17.676960  1524 raft_consensus.cc:740] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.692778  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb045a1ea9c4a7d81082cfb9317cacc" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:17.680754  1526 raft_consensus.cc:359] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.693562  1526 raft_consensus.cc:385] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.693883  1526 raft_consensus.cc:740] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.676174  1525 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:17.693681  1524 consensus_queue.cc:260] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.698734  1524 ts_tablet_manager.cc:1434] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 13:13:17.699697  1524 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:17.701617  1526 consensus_queue.cc:260] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.705276  1526 ts_tablet_manager.cc:1434] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 13:13:17.706358  1526 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:17.707005  1152 catalog_manager.cc:5697] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.711791  1524 tablet_bootstrap.cc:654] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.713482  1564 consensus_queue.cc:1048] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.717031  1477 raft_consensus.cc:3060] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.762354  1524 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:17.762876  1524 ts_tablet_manager.cc:1403] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.003s
I20260709 13:13:17.774792  1523 tablet_bootstrap.cc:654] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.783960  1525 tablet_bootstrap.cc:654] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.791059  1526 tablet_bootstrap.cc:654] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.800912  1524 raft_consensus.cc:359] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.804495  1524 raft_consensus.cc:385] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.805668  1524 raft_consensus.cc:740] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.799993  1152 catalog_manager.cc:5697] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.807358  1524 consensus_queue.cc:260] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.803498  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb045a1ea9c4a7d81082cfb9317cacc" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:17.793673  1538 raft_consensus.cc:493] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.818420  1524 ts_tablet_manager.cc:1434] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 13:13:17.812336  1538 raft_consensus.cc:515] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.819571  1524 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:17.820398  1530 raft_consensus.cc:493] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.821015  1530 raft_consensus.cc:515] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.822975  1530 leader_election.cc:290] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:17.824486  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:17.825256  1330 raft_consensus.cc:2468] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:17.826050  1524 tablet_bootstrap.cc:654] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.826612  1523 tablet_bootstrap.cc:492] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:17.827106  1523 ts_tablet_manager.cc:1403] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.004s
I20260709 13:13:17.829406  1221 leader_election.cc:304] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:17.830237  1523 raft_consensus.cc:359] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.831171  1523 raft_consensus.cc:385] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.831509  1523 raft_consensus.cc:740] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.831610  1564 raft_consensus.cc:2804] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.832118  1564 raft_consensus.cc:493] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.832491  1564 raft_consensus.cc:3060] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.834177  1526 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:17.834829  1526 ts_tablet_manager.cc:1403] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.129s	user 0.006s	sys 0.010s
I20260709 13:13:17.834048  1444 leader_election.cc:304] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:17.836880  1536 raft_consensus.cc:2749] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.837560  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf601481d5614428aa1948ce5e0df02f" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:17.837690  1526 raft_consensus.cc:359] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.838431  1526 raft_consensus.cc:385] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.838712  1526 raft_consensus.cc:740] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.838249  1150 catalog_manager.cc:5697] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:17.839366  1295 leader_election.cc:343] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.839661  1523 consensus_queue.cc:260] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.840739  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:17.841910  1523 ts_tablet_manager.cc:1434] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:13:17.843107  1523 tablet_bootstrap.cc:492] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
W20260709 13:13:17.843286  1218 leader_election.cc:343] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.839329  1526 consensus_queue.cc:260] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.845754  1538 leader_election.cc:290] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:17.846515  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf601481d5614428aa1948ce5e0df02f" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:17.847970  1526 ts_tablet_manager.cc:1434] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
W20260709 13:13:17.848886  1293 leader_election.cc:343] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.849745  1293 leader_election.cc:304] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:17.851089  1538 raft_consensus.cc:2749] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.852612  1526 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:17.860497  1523 tablet_bootstrap.cc:654] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.872157  1524 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:17.872659  1524 ts_tablet_manager.cc:1403] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.010s
I20260709 13:13:17.875516  1524 raft_consensus.cc:359] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.876209  1524 raft_consensus.cc:385] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.876474  1524 raft_consensus.cc:740] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.877386  1524 consensus_queue.cc:260] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.878641  1526 tablet_bootstrap.cc:654] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.880508  1524 ts_tablet_manager.cc:1434] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:13:17.881613  1524 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:17.883757  1564 raft_consensus.cc:515] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.887960  1523 tablet_bootstrap.cc:492] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:17.888492  1523 ts_tablet_manager.cc:1403] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.006s
I20260709 13:13:17.888553  1524 tablet_bootstrap.cc:654] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.889642  1564 leader_election.cc:290] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:17.876402  1525 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:17.891330  1525 ts_tablet_manager.cc:1403] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.215s	user 0.014s	sys 0.018s
I20260709 13:13:17.891705  1523 raft_consensus.cc:359] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.892449  1523 raft_consensus.cc:385] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.892722  1523 raft_consensus.cc:740] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.893533  1523 consensus_queue.cc:260] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:17.894865  1526 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:17.895349  1526 ts_tablet_manager.cc:1403] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:13:17.895222  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:17.895828  1523 ts_tablet_manager.cc:1434] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:17.895963  1330 raft_consensus.cc:3060] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.898340  1523 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:17.897953  1525 raft_consensus.cc:359] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.898264  1526 raft_consensus.cc:359] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.898841  1525 raft_consensus.cc:385] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.899174  1526 raft_consensus.cc:385] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.899252  1525 raft_consensus.cc:740] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.899525  1526 raft_consensus.cc:740] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.900306  1526 consensus_queue.cc:260] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.900303  1525 consensus_queue.cc:260] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.901803  1524 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:17.902271  1524 ts_tablet_manager.cc:1403] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:13:17.903168  1525 ts_tablet_manager.cc:1434] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:17.904261  1525 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
W20260709 13:13:17.904177  1221 consensus_peers.cc:597] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.904932  1524 raft_consensus.cc:359] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.905630  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:17.906032  1526 ts_tablet_manager.cc:1434] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:17.906325  1477 raft_consensus.cc:3060] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.907007  1526 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:17.910144  1523 tablet_bootstrap.cc:654] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.912091  1525 tablet_bootstrap.cc:654] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.913354  1526 tablet_bootstrap.cc:654] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:17.914737  1200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:17.921566  1523 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:17.921875  1525 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:17.922078  1523 ts_tablet_manager.cc:1403] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.005s
I20260709 13:13:17.922699  1526 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:17.923142  1526 ts_tablet_manager.cc:1403] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:13:17.923597  1330 raft_consensus.cc:2468] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:17.924887  1221 leader_election.cc:304] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:17.925427  1329 raft_consensus.cc:3060] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.925273  1523 raft_consensus.cc:359] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.925884  1564 raft_consensus.cc:2804] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.925736  1526 raft_consensus.cc:359] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.926107  1523 raft_consensus.cc:385] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.926501  1526 raft_consensus.cc:385] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.926573  1523 raft_consensus.cc:740] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.926703  1564 raft_consensus.cc:697] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:17.926891  1526 raft_consensus.cc:740] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.927577  1523 consensus_queue.cc:260] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.927814  1526 consensus_queue.cc:260] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:17.927990  1564 consensus_queue.cc:237] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.930105  1523 ts_tablet_manager.cc:1434] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:13:17.930190  1526 ts_tablet_manager.cc:1434] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:17.931164  1523 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:17.931336  1526 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:17.922441  1525 ts_tablet_manager.cc:1403] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.005s
I20260709 13:13:17.905629  1524 raft_consensus.cc:385] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.938270  1524 raft_consensus.cc:740] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.938560  1526 tablet_bootstrap.cc:654] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.942883  1477 raft_consensus.cc:2468] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:17.945412  1523 tablet_bootstrap.cc:654] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.948056  1525 raft_consensus.cc:359] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.948823  1525 raft_consensus.cc:385] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.949133  1525 raft_consensus.cc:740] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.949934  1525 consensus_queue.cc:260] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.952270  1525 ts_tablet_manager.cc:1434] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:13:17.953315  1525 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:17.956153  1150 catalog_manager.cc:5697] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.939966  1524 consensus_queue.cc:260] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:17.960690  1525 tablet_bootstrap.cc:654] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.970997  1601 raft_consensus.cc:493] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.971820  1601 raft_consensus.cc:515] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.975895  1601 leader_election.cc:290] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:17.976727  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf505580e1d94688a182fbba553caf49" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:17.977607  1477 raft_consensus.cc:2468] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:17.976771  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf505580e1d94688a182fbba553caf49" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:17.984211  1367 leader_election.cc:304] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:17.985236  1601 raft_consensus.cc:2804] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.985777  1601 raft_consensus.cc:493] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.986187  1601 raft_consensus.cc:3060] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.987601  1524 ts_tablet_manager.cc:1434] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:13:17.985301  1255 raft_consensus.cc:2468] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:17.995620  1525 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:17.996204  1525 ts_tablet_manager.cc:1403] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.028s
I20260709 13:13:17.996992  1524 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:17.996313  1601 raft_consensus.cc:515] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:17.998612  1526 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:17.999477  1601 leader_election.cc:290] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:18.000312  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf505580e1d94688a182fbba553caf49" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:18.000898  1477 raft_consensus.cc:3060] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.001232  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf505580e1d94688a182fbba553caf49" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:18.001855  1255 raft_consensus.cc:3060] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.002276  1526 ts_tablet_manager.cc:1403] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.007s
I20260709 13:13:18.004065  1524 tablet_bootstrap.cc:654] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.005532  1526 raft_consensus.cc:359] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.006271  1526 raft_consensus.cc:385] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.006587  1526 raft_consensus.cc:740] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.007380  1526 consensus_queue.cc:260] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.008114  1525 raft_consensus.cc:359] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.008800  1477 raft_consensus.cc:2468] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:18.008862  1525 raft_consensus.cc:385] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.009649  1538 raft_consensus.cc:493] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.009799  1255 raft_consensus.cc:2468] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:18.010273  1538 raft_consensus.cc:515] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.011148  1523 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:18.009799  1525 raft_consensus.cc:740] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.011058  1368 leader_election.cc:304] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:18.012768  1601 raft_consensus.cc:2804] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.013316  1601 raft_consensus.cc:697] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:18.013962  1538 leader_election.cc:290] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:18.014606  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7724e8025f442c084e2988c3de7cc75" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:18.015339  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7724e8025f442c084e2988c3de7cc75" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.016000  1404 raft_consensus.cc:2468] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:18.015872  1525 consensus_queue.cc:260] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.016733  1526 ts_tablet_manager.cc:1434] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:13:18.016997  1601 consensus_queue.cc:237] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.017704  1526 tablet_bootstrap.cc:492] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:18.021059  1525 ts_tablet_manager.cc:1434] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:13:18.022920  1525 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.023815  1526 tablet_bootstrap.cc:654] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.011935  1523 ts_tablet_manager.cc:1403] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.014s
I20260709 13:13:18.027724  1523 raft_consensus.cc:359] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.028313  1525 tablet_bootstrap.cc:654] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.028538  1523 raft_consensus.cc:385] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.028826  1523 raft_consensus.cc:740] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.029552  1523 consensus_queue.cc:260] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.031733  1523 ts_tablet_manager.cc:1434] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:18.031766  1564 raft_consensus.cc:493] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.032716  1564 raft_consensus.cc:515] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.032920  1523 tablet_bootstrap.cc:492] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:18.036839  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcbf94f9eb44b7f85be2c961b4d641e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:18.037730  1478 raft_consensus.cc:2393] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e89740c5a5de48fd875c8b628616334c in current term 1: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:18.038290  1525 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.038759  1525 ts_tablet_manager.cc:1403] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:13:18.039016  1564 leader_election.cc:290] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:18.040489  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbcbf94f9eb44b7f85be2c961b4d641e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.041385  1525 raft_consensus.cc:359] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.042042  1525 raft_consensus.cc:385] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.042299  1525 raft_consensus.cc:740] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.042239  1220 leader_election.cc:304] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
W20260709 13:13:18.027673  1294 leader_election.cc:343] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.042517  1523 tablet_bootstrap.cc:654] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.044247  1536 raft_consensus.cc:493] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.044826  1536 raft_consensus.cc:515] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.045643  1295 leader_election.cc:304] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:18.046581  1538 raft_consensus.cc:2804] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.047073  1538 raft_consensus.cc:493] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.047730  1538 raft_consensus.cc:3060] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.047453  1524 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:18.048659  1524 ts_tablet_manager.cc:1403] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.003s
I20260709 13:13:18.049340  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:18.050244  1255 raft_consensus.cc:2393] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 1: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:18.043365  1525 consensus_queue.cc:260] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.047108  1536 leader_election.cc:290] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:18.053823  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:18.055704  1524 raft_consensus.cc:359] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.056609  1524 raft_consensus.cc:385] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.057011  1524 raft_consensus.cc:740] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.057149  1530 raft_consensus.cc:3060] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.057490  1582 consensus_queue.cc:1048] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.057701  1538 raft_consensus.cc:515] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.057961  1524 consensus_queue.cc:260] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.060532  1538 leader_election.cc:290] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:18.062101  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7724e8025f442c084e2988c3de7cc75" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
W20260709 13:13:18.063726  1294 leader_election.cc:343] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.055994  1444 leader_election.cc:304] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:18.064800  1536 raft_consensus.cc:3060] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.070799  1530 raft_consensus.cc:2749] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.074460  1524 ts_tablet_manager.cc:1434] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:13:18.070644  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7724e8025f442c084e2988c3de7cc75" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:18.071317  1564 consensus_queue.cc:1048] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.076869  1404 raft_consensus.cc:3060] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.081529  1536 raft_consensus.cc:2749] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.075655  1524 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:18.075687  1526 tablet_bootstrap.cc:492] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:18.082640  1526 ts_tablet_manager.cc:1403] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.004s
I20260709 13:13:18.088472  1526 raft_consensus.cc:359] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.089536  1526 raft_consensus.cc:385] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.090807  1404 raft_consensus.cc:2468] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:18.091733  1564 raft_consensus.cc:493] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.092521  1564 raft_consensus.cc:515] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.089881  1526 raft_consensus.cc:740] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.094174  1526 consensus_queue.cc:260] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.096714  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:18.098191  1329 raft_consensus.cc:2468] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:18.099368  1538 consensus_queue.cc:1048] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.100087  1221 leader_election.cc:304] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:18.101539  1530 raft_consensus.cc:2804] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.101859  1526 ts_tablet_manager.cc:1434] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:13:18.101927  1530 raft_consensus.cc:493] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.102481  1530 raft_consensus.cc:3060] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.102870  1526 tablet_bootstrap.cc:492] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:18.113137  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:18.113837  1476 raft_consensus.cc:2468] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:18.114058  1525 ts_tablet_manager.cc:1434] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.075s	user 0.010s	sys 0.002s
I20260709 13:13:18.114245  1564 leader_election.cc:290] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.115096  1525 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.113862  1530 raft_consensus.cc:515] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.117166  1530 leader_election.cc:290] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.117660  1538 consensus_queue.cc:1048] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.118330  1530 raft_consensus.cc:493] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.118873  1530 raft_consensus.cc:515] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.120765  1295 leader_election.cc:304] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:18.126310  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:18.126904  1476 raft_consensus.cc:3060] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.128197  1153 catalog_manager.cc:5697] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.131770  1329 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.135066  1476 raft_consensus.cc:2468] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:18.129016  1538 raft_consensus.cc:2804] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.136062  1538 raft_consensus.cc:697] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:18.137163  1538 consensus_queue.cc:237] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.138062  1628 raft_consensus.cc:493] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.126533  1526 tablet_bootstrap.cc:654] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.138561  1628 raft_consensus.cc:515] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.143215  1218 leader_election.cc:304] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:18.144264  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:18.146358  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:18.147032  1330 raft_consensus.cc:3060] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.152190  1628 leader_election.cc:290] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:18.152501  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
W20260709 13:13:18.154300  1444 leader_election.cc:343] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.162058  1523 tablet_bootstrap.cc:492] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:18.162176  1524 tablet_bootstrap.cc:654] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.162707  1523 ts_tablet_manager.cc:1403] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.130s	user 0.022s	sys 0.005s
I20260709 13:13:18.164057  1583 raft_consensus.cc:2804] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.164623  1583 raft_consensus.cc:697] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:18.164716  1404 raft_consensus.cc:3060] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.165628  1583 consensus_queue.cc:237] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:18.175402  1442 leader_election.cc:343] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.176071  1442 leader_election.cc:304] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:18.179908  1530 leader_election.cc:290] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.179822  1562 consensus_queue.cc:1048] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.181099  1628 raft_consensus.cc:2749] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.183148  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:18.183817  1478 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:18.185112  1152 catalog_manager.cc:5697] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.190402  1525 tablet_bootstrap.cc:654] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.176695  1523 raft_consensus.cc:359] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.194983  1523 raft_consensus.cc:385] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.178896  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.195369  1523 raft_consensus.cc:740] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.195686  1403 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:18.196401  1523 consensus_queue.cc:260] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.197580  1330 raft_consensus.cc:2468] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:18.199949  1524 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:18.200589  1524 ts_tablet_manager.cc:1403] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.000s
I20260709 13:13:18.189851  1218 leader_election.cc:304] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:18.204339  1581 raft_consensus.cc:2804] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.204246  1524 raft_consensus.cc:359] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.204923  1581 raft_consensus.cc:493] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.205273  1524 raft_consensus.cc:385] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.205356  1581 raft_consensus.cc:3060] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.205742  1524 raft_consensus.cc:740] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.206705  1524 consensus_queue.cc:260] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.212705  1526 tablet_bootstrap.cc:492] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:18.213415  1526 ts_tablet_manager.cc:1403] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.111s	user 0.045s	sys 0.032s
I20260709 13:13:18.213492  1523 ts_tablet_manager.cc:1434] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:13:18.214459  1524 ts_tablet_manager.cc:1434] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:13:18.214598  1581 raft_consensus.cc:515] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.215394  1524 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:18.216285  1526 raft_consensus.cc:359] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.217224  1526 raft_consensus.cc:385] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.217525  1523 tablet_bootstrap.cc:492] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:18.217588  1526 raft_consensus.cc:740] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.219187  1530 raft_consensus.cc:493] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.218948  1526 consensus_queue.cc:260] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.219842  1530 raft_consensus.cc:515] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.222859  1530 leader_election.cc:290] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:18.224602  1524 tablet_bootstrap.cc:654] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.224983  1526 ts_tablet_manager.cc:1434] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:13:18.224694  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:18.225698  1328 raft_consensus.cc:2468] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:18.226047  1526 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:18.227226  1221 leader_election.cc:304] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:18.228350  1530 raft_consensus.cc:2804] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.228816  1530 raft_consensus.cc:493] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.229296  1530 raft_consensus.cc:3060] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.232102  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:18.245443  1218 leader_election.cc:343] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.246101  1526 tablet_bootstrap.cc:654] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.256285  1523 tablet_bootstrap.cc:654] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.266783  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:18.267545  1403 raft_consensus.cc:3060] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.267809  1530 raft_consensus.cc:515] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.260295  1525 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.273957  1525 ts_tablet_manager.cc:1403] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.159s	user 0.014s	sys 0.027s
I20260709 13:13:18.275067  1530 leader_election.cc:290] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:18.275633  1403 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:18.276968  1220 leader_election.cc:304] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:18.277138  1525 raft_consensus.cc:359] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.278106  1525 raft_consensus.cc:385] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.278460  1525 raft_consensus.cc:740] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.278924  1530 raft_consensus.cc:2804] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.279702  1530 raft_consensus.cc:697] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:18.279282  1525 consensus_queue.cc:260] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.280681  1530 consensus_queue.cc:237] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.282477  1525 ts_tablet_manager.cc:1434] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:18.259011  1526 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:18.283314  1526 ts_tablet_manager.cc:1403] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.005s
I20260709 13:13:18.286342  1525 tablet_bootstrap.cc:492] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.314270  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:18.300331  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:18.315276  1478 raft_consensus.cc:3060] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.315786  1330 raft_consensus.cc:3060] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.299180  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:18.317677  1477 raft_consensus.cc:3060] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.321368  1526 raft_consensus.cc:359] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.323639  1526 raft_consensus.cc:385] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.323890  1526 raft_consensus.cc:740] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.325726  1526 consensus_queue.cc:260] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.312147  1581 leader_election.cc:290] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.323377  1562 raft_consensus.cc:493] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.327963  1646 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.328164  1562 raft_consensus.cc:515] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.328552  1646 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.329412  1643 raft_consensus.cc:493] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.329911  1643 raft_consensus.cc:515] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.330878  1646 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:18.331341  1526 ts_tablet_manager.cc:1434] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:13:18.332665  1526 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:18.339673  1477 raft_consensus.cc:2468] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:18.341059  1523 tablet_bootstrap.cc:492] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:18.342221  1523 ts_tablet_manager.cc:1403] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.125s	user 0.022s	sys 0.012s
I20260709 13:13:18.344796  1526 tablet_bootstrap.cc:654] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.343462  1218 leader_election.cc:304] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:18.351586  1581 raft_consensus.cc:2804] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.351861  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.353837  1524 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:18.354358  1524 ts_tablet_manager.cc:1403] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.139s	user 0.038s	sys 0.026s
I20260709 13:13:18.352147  1581 raft_consensus.cc:697] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:18.344863  1150 catalog_manager.cc:5697] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.355394  1581 consensus_queue.cc:237] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.354147  1523 raft_consensus.cc:359] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.359727  1523 raft_consensus.cc:385] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.360078  1523 raft_consensus.cc:740] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.360822  1523 consensus_queue.cc:260] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.357231  1330 raft_consensus.cc:2468] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:18.362282  1643 leader_election.cc:290] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.361119  1478 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:18.365638  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:18.366309  1562 leader_election.cc:290] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
W20260709 13:13:18.377874  1294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 64173.6us
I20260709 13:13:18.383983  1525 tablet_bootstrap.cc:654] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.385746  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:18.364929  1524 raft_consensus.cc:359] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.367632  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf601481d5614428aa1948ce5e0df02f" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:18.368304  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.370180  1523 ts_tablet_manager.cc:1434] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:13:18.392225  1524 raft_consensus.cc:385] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:18.389551  1293 leader_election.cc:343] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.396929  1523 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:18.390815  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf601481d5614428aa1948ce5e0df02f" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:18.395624  1524 raft_consensus.cc:740] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.396323  1403 raft_consensus.cc:2468] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
W20260709 13:13:18.404862  1367 leader_election.cc:343] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.407336  1330 raft_consensus.cc:2468] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:18.410010  1524 consensus_queue.cc:260] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.412220  1295 leader_election.cc:304] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:18.413175  1524 ts_tablet_manager.cc:1434] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:13:18.414348  1524 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:18.416623  1538 raft_consensus.cc:2804] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.417018  1538 raft_consensus.cc:493] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.417341  1538 raft_consensus.cc:3060] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.420009  1524 tablet_bootstrap.cc:654] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.397531  1294 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:18.429219  1590 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:18.422574  1643 raft_consensus.cc:493] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.430212  1526 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:18.430117  1643 raft_consensus.cc:515] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.429302  1648 raft_consensus.cc:2749] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.429865  1590 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.430733  1526 ts_tablet_manager.cc:1403] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.006s
I20260709 13:13:18.434682  1643 leader_election.cc:290] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.435791  1370 leader_election.cc:304] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:18.437054  1590 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:18.437201  1537 raft_consensus.cc:2804] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.437640  1537 raft_consensus.cc:493] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.437985  1537 raft_consensus.cc:3060] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.438670  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.439699  1562 raft_consensus.cc:493] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.440143  1562 raft_consensus.cc:515] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.441124  1523 tablet_bootstrap.cc:654] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.444289  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:18.447103  1562 leader_election.cc:290] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.444895  1538 raft_consensus.cc:515] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
W20260709 13:13:18.447799  1367 leader_election.cc:343] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.451927  1525 tablet_bootstrap.cc:492] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.459266  1525 ts_tablet_manager.cc:1403] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.173s	user 0.015s	sys 0.009s
I20260709 13:13:18.451954  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:18.454079  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:18.460282  1526 raft_consensus.cc:359] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.451177  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.461681  1403 raft_consensus.cc:2468] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:18.462131  1525 raft_consensus.cc:359] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.458276  1538 leader_election.cc:290] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.462864  1295 leader_election.cc:304] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:18.463901  1538 raft_consensus.cc:2804] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.462872  1525 raft_consensus.cc:385] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.464800  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:18.465754  1538 raft_consensus.cc:493] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.465914  1525 raft_consensus.cc:740] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.466166  1538 raft_consensus.cc:3060] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.449862  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:18.466967  1404 raft_consensus.cc:3060] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.466737  1525 consensus_queue.cc:260] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.460973  1526 raft_consensus.cc:385] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.470492  1526 raft_consensus.cc:740] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.448838  1537 raft_consensus.cc:515] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.471204  1526 consensus_queue.cc:260] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.473284  1526 ts_tablet_manager.cc:1434] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:13:18.474222  1526 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:18.474931  1294 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:18.476557  1650 raft_consensus.cc:2749] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:18.475098  1538 raft_consensus.cc:515] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.480537  1523 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:18.495242  1523 ts_tablet_manager.cc:1403] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.011s
I20260709 13:13:18.476998  1404 raft_consensus.cc:2468] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:18.477497  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:18.495105  1537 leader_election.cc:290] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.477309  1476 raft_consensus.cc:2468] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:18.479532  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf601481d5614428aa1948ce5e0df02f" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
W20260709 13:13:18.502787  1367 leader_election.cc:343] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.479063  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf601481d5614428aa1948ce5e0df02f" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:18.503794  1329 raft_consensus.cc:3060] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.500044  1295 leader_election.cc:304] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:18.505106  1650 raft_consensus.cc:2804] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.505559  1650 raft_consensus.cc:697] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:18.505659  1523 raft_consensus.cc:359] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.506134  1525 ts_tablet_manager.cc:1434] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.005s
I20260709 13:13:18.506399  1523 raft_consensus.cc:385] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.506888  1523 raft_consensus.cc:740] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.501526  1328 raft_consensus.cc:2393] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:18.499773  1153 catalog_manager.cc:5697] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.507594  1524 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:18.508728  1524 ts_tablet_manager.cc:1403] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.008s
I20260709 13:13:18.507820  1525 tablet_bootstrap.cc:492] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.508976  1153 catalog_manager.cc:5697] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.512220  1524 raft_consensus.cc:359] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.511534  1538 leader_election.cc:290] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.513568  1330 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.513504  1523 consensus_queue.cc:260] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.516098  1523 ts_tablet_manager.cc:1434] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:13:18.512913  1524 raft_consensus.cc:385] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.517266  1524 raft_consensus.cc:740] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.509883  1526 tablet_bootstrap.cc:654] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.518651  1525 tablet_bootstrap.cc:654] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:18.508011  1293 leader_election.cc:343] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.520709  1370 leader_election.cc:304] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:18.528800  1537 raft_consensus.cc:3060] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.529522  1524 consensus_queue.cc:260] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.531531  1524 ts_tablet_manager.cc:1434] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:13:18.532449  1524 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:18.506435  1650 consensus_queue.cc:237] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.522637  1581 consensus_queue.cc:1048] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.536128  1530 consensus_queue.cc:1048] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.538570  1523 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:18.539206  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:18.542115  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:18.542732  1476 raft_consensus.cc:3060] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.548627  1562 raft_consensus.cc:493] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.549153  1562 raft_consensus.cc:515] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.551365  1562 leader_election.cc:290] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:18.554668  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9d052234b64c6c9657372e21b121af" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:18.563946  1327 raft_consensus.cc:2468] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:18.554975  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9d052234b64c6c9657372e21b121af" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:18.567263  1254 raft_consensus.cc:2468] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:18.567312  1370 leader_election.cc:304] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:18.568188  1562 raft_consensus.cc:2804] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.568581  1562 raft_consensus.cc:493] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.568897  1562 raft_consensus.cc:3060] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.557963  1476 raft_consensus.cc:2468] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:18.551589  1537 raft_consensus.cc:2749] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.582000  1523 tablet_bootstrap.cc:654] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.585807  1293 leader_election.cc:304] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:18.587860  1650 raft_consensus.cc:2804] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.589066  1650 raft_consensus.cc:697] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:18.589140  1329 raft_consensus.cc:2468] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:18.592554  1524 tablet_bootstrap.cc:654] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.593277  1370 leader_election.cc:304] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:18.594667  1152 catalog_manager.cc:5697] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.595958  1582 raft_consensus.cc:2804] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.596432  1582 raft_consensus.cc:697] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:18.596791  1525 tablet_bootstrap.cc:492] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.597298  1525 ts_tablet_manager.cc:1403] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.006s
I20260709 13:13:18.597258  1582 consensus_queue.cc:237] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.598937  1601 consensus_queue.cc:1048] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.600234  1525 raft_consensus.cc:359] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.600903  1525 raft_consensus.cc:385] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.601181  1525 raft_consensus.cc:740] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.601356  1562 raft_consensus.cc:515] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.601989  1525 consensus_queue.cc:260] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.591081  1650 consensus_queue.cc:237] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.604815  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9d052234b64c6c9657372e21b121af" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:18.605541  1255 raft_consensus.cc:3060] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.607441  1525 ts_tablet_manager.cc:1434] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:18.608114  1525 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.610404  1562 leader_election.cc:290] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:18.638003  1526 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:18.638554  1526 ts_tablet_manager.cc:1403] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.007s
I20260709 13:13:18.643378  1562 consensus_queue.cc:1048] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.645671  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9d052234b64c6c9657372e21b121af" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:18.646370  1328 raft_consensus.cc:3060] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.648545  1255 raft_consensus.cc:2468] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:18.650964  1526 raft_consensus.cc:359] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.651651  1526 raft_consensus.cc:385] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.651364  1368 leader_election.cc:304] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:18.651962  1526 raft_consensus.cc:740] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.652778  1526 consensus_queue.cc:260] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.652796  1562 raft_consensus.cc:2804] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:18.655172  1562 raft_consensus.cc:697] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:18.656097  1524 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:18.656607  1524 ts_tablet_manager.cc:1403] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.013s
I20260709 13:13:18.656713  1562 consensus_queue.cc:237] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.658409  1526 ts_tablet_manager.cc:1434] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:13:18.654012  1404 raft_consensus.cc:2468] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:18.660378  1526 tablet_bootstrap.cc:492] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
W20260709 13:13:18.661404  1659 log.cc:927] Time spent T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:13:18.659349  1524 raft_consensus.cc:359] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.665588  1524 raft_consensus.cc:385] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.665906  1524 raft_consensus.cc:740] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.670343  1524 consensus_queue.cc:260] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.673856  1524 ts_tablet_manager.cc:1434] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:13:18.678737  1526 tablet_bootstrap.cc:654] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.685012  1525 tablet_bootstrap.cc:654] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.686352  1524 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:18.688601  1564 consensus_queue.cc:1048] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.693670  1564 raft_consensus.cc:493] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.694242  1564 raft_consensus.cc:515] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.699045  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7724e8025f442c084e2988c3de7cc75" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:18.702346  1590 raft_consensus.cc:493] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.703022  1590 raft_consensus.cc:515] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.707966  1643 consensus_queue.cc:1048] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.710359  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:18.710592  1590 leader_election.cc:290] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
W20260709 13:13:18.711968  1294 leader_election.cc:343] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.712319  1564 leader_election.cc:290] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:18.713140  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7724e8025f442c084e2988c3de7cc75" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.713433  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:18.714815  1295 leader_election.cc:343] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.715240  1295 leader_election.cc:304] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:18.715328  1564 consensus_queue.cc:1048] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.716210  1590 raft_consensus.cc:2749] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.715158  1220 leader_election.cc:304] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:18.688601  1328 raft_consensus.cc:2468] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:18.719364  1583 raft_consensus.cc:2749] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:18.720146  1583 consensus_queue.cc:1048] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.734401  1524 tablet_bootstrap.cc:654] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.759123  1523 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:18.759806  1523 ts_tablet_manager.cc:1403] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.013s
I20260709 13:13:18.770577  1523 raft_consensus.cc:359] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.771348  1523 raft_consensus.cc:385] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.771607  1523 raft_consensus.cc:740] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.772257  1523 consensus_queue.cc:260] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.774626  1523 ts_tablet_manager.cc:1434] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:13:18.775545  1523 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:18.779174  1525 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.779852  1525 ts_tablet_manager.cc:1403] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.172s	user 0.008s	sys 0.002s
I20260709 13:13:18.780275  1153 catalog_manager.cc:5697] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.782765  1150 catalog_manager.cc:5697] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.787753  1583 consensus_queue.cc:1048] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.788523  1254 raft_consensus.cc:3060] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.792518  1525 raft_consensus.cc:359] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.793287  1525 raft_consensus.cc:385] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.793576  1525 raft_consensus.cc:740] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.783037  1523 tablet_bootstrap.cc:654] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.798048  1525 consensus_queue.cc:260] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.799191  1526 tablet_bootstrap.cc:492] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:18.799671  1526 ts_tablet_manager.cc:1403] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.139s	user 0.028s	sys 0.024s
I20260709 13:13:18.800384  1525 ts_tablet_manager.cc:1434] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:13:18.801354  1525 tablet_bootstrap.cc:492] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.802330  1526 raft_consensus.cc:359] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.803030  1526 raft_consensus.cc:385] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.803295  1526 raft_consensus.cc:740] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.803958  1526 consensus_queue.cc:260] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.805898  1526 ts_tablet_manager.cc:1434] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:13:18.806777  1526 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:18.807614  1525 tablet_bootstrap.cc:654] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.789927  1153 catalog_manager.cc:5697] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.809055  1650 consensus_queue.cc:1048] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.814671  1524 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:18.815148  1524 ts_tablet_manager.cc:1403] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.007s
I20260709 13:13:18.817322  1523 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:18.817785  1523 ts_tablet_manager.cc:1403] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.002s
I20260709 13:13:18.820369  1523 raft_consensus.cc:359] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.831630  1526 tablet_bootstrap.cc:654] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.821024  1523 raft_consensus.cc:385] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.835368  1523 raft_consensus.cc:740] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.836148  1523 consensus_queue.cc:260] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.838435  1525 tablet_bootstrap.cc:492] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.838532  1523 ts_tablet_manager.cc:1434] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:13:18.839102  1525 ts_tablet_manager.cc:1403] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.013s
I20260709 13:13:18.839622  1523 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:18.841787  1525 raft_consensus.cc:359] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.843058  1525 raft_consensus.cc:385] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.843425  1525 raft_consensus.cc:740] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.844173  1525 consensus_queue.cc:260] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.844784  1526 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:18.845351  1526 ts_tablet_manager.cc:1403] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 13:13:18.845889  1523 tablet_bootstrap.cc:654] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.846875  1525 ts_tablet_manager.cc:1434] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:18.836491  1524 raft_consensus.cc:359] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.847695  1524 raft_consensus.cc:385] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.848150  1525 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.847982  1524 raft_consensus.cc:740] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.849258  1524 consensus_queue.cc:260] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.850646  1524 ts_tablet_manager.cc:1434] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:13:18.851348  1524 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:18.847956  1526 raft_consensus.cc:359] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.853284  1526 raft_consensus.cc:385] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.853586  1526 raft_consensus.cc:740] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.854274  1526 consensus_queue.cc:260] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.856361  1524 tablet_bootstrap.cc:654] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.857040  1523 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:18.857589  1523 ts_tablet_manager.cc:1403] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.012s
I20260709 13:13:18.859925  1525 tablet_bootstrap.cc:654] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.860271  1523 raft_consensus.cc:359] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.860992  1523 raft_consensus.cc:385] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.861312  1523 raft_consensus.cc:740] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.862071  1523 consensus_queue.cc:260] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.864890  1523 ts_tablet_manager.cc:1434] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:18.866320  1523 tablet_bootstrap.cc:492] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:18.871649  1525 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.872201  1525 ts_tablet_manager.cc:1403] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 13:13:18.874815  1525 raft_consensus.cc:359] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.875608  1525 raft_consensus.cc:385] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.875934  1523 tablet_bootstrap.cc:654] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.875933  1525 raft_consensus.cc:740] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.856361  1526 ts_tablet_manager.cc:1434] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:13:18.886732  1525 consensus_queue.cc:260] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.889425  1525 ts_tablet_manager.cc:1434] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:13:18.892009  1526 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:18.893285  1525 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.895659  1523 tablet_bootstrap.cc:492] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:18.901535  1523 ts_tablet_manager.cc:1403] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.008s
I20260709 13:13:18.904353  1523 raft_consensus.cc:359] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.898310  1526 tablet_bootstrap.cc:654] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.900437  1524 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:18.905524  1524 ts_tablet_manager.cc:1403] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.054s	user 0.006s	sys 0.005s
I20260709 13:13:18.906575  1525 tablet_bootstrap.cc:654] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.905031  1523 raft_consensus.cc:385] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.907773  1523 raft_consensus.cc:740] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.908183  1524 raft_consensus.cc:359] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.908926  1524 raft_consensus.cc:385] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.909235  1524 raft_consensus.cc:740] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.910679  1524 consensus_queue.cc:260] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:18.909216  1523 consensus_queue.cc:260] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.912123  1525 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.912736  1524 ts_tablet_manager.cc:1434] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:13:18.913033  1525 ts_tablet_manager.cc:1403] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:13:18.911123  1526 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:18.913587  1523 ts_tablet_manager.cc:1434] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:18.914053  1526 ts_tablet_manager.cc:1403] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 13:13:18.914783  1523 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:18.916082  1525 raft_consensus.cc:359] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.916826  1525 raft_consensus.cc:385] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.916592  1526 raft_consensus.cc:359] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.917189  1525 raft_consensus.cc:740] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.917622  1524 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:18.918171  1525 consensus_queue.cc:260] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.920537  1525 ts_tablet_manager.cc:1434] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:13:18.920902  1523 tablet_bootstrap.cc:654] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.917351  1526 raft_consensus.cc:385] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.921356  1526 raft_consensus.cc:740] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.922051  1526 consensus_queue.cc:260] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.924010  1526 ts_tablet_manager.cc:1434] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:18.928680  1524 tablet_bootstrap.cc:654] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.929610  1526 tablet_bootstrap.cc:492] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:18.933893  1525 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:18.937062  1583 consensus_queue.cc:1048] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.938563  1526 tablet_bootstrap.cc:654] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.945096  1525 tablet_bootstrap.cc:654] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.951759  1538 raft_consensus.cc:493] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.952462  1538 raft_consensus.cc:515] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.953579  1524 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:18.954280  1524 ts_tablet_manager.cc:1403] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.005s
I20260709 13:13:18.955173  1538 leader_election.cc:290] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:18.957234  1525 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:18.957732  1525 ts_tablet_manager.cc:1403] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 13:13:18.957563  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d695ee04326f476498937637eb685d7b" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:18.958236  1404 raft_consensus.cc:2468] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:18.957537  1524 raft_consensus.cc:359] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.958748  1524 raft_consensus.cc:385] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.959182  1524 raft_consensus.cc:740] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.959515  1295 leader_election.cc:304] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:18.960124  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d695ee04326f476498937637eb685d7b" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:18.960515  1650 raft_consensus.cc:2804] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:18.961001  1650 raft_consensus.cc:493] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.961509  1650 raft_consensus.cc:3060] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.961050  1524 consensus_queue.cc:260] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:18.965875  1293 leader_election.cc:343] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:18.965845  1524 ts_tablet_manager.cc:1434] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:18.973897  1524 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:18.975533  1525 raft_consensus.cc:359] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.976320  1525 raft_consensus.cc:385] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:18.976672  1525 raft_consensus.cc:740] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:18.977779  1650 raft_consensus.cc:515] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:18.985332  1525 consensus_queue.cc:260] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:18.986615  1564 consensus_queue.cc:1048] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:18.987790  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d695ee04326f476498937637eb685d7b" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:18.988569  1404 raft_consensus.cc:3060] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:18.988986  1562 raft_consensus.cc:493] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.989816  1524 tablet_bootstrap.cc:654] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:18.989660  1562 raft_consensus.cc:515] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:18.996160  1562 leader_election.cc:290] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:18.997259  1564 raft_consensus.cc:493] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.997879  1564 raft_consensus.cc:515] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.000644  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d59b30b44054b238642951881f89b66" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:19.001456  1254 raft_consensus.cc:2468] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:19.009136  1525 ts_tablet_manager.cc:1434] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 13:13:19.013136  1525 tablet_bootstrap.cc:492] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:19.018517  1581 raft_consensus.cc:493] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.006079  1628 raft_consensus.cc:493] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.019203  1581 raft_consensus.cc:515] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.007148  1530 raft_consensus.cc:493] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.020750  1530 raft_consensus.cc:515] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.013705  1536 raft_consensus.cc:493] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.022097  1536 raft_consensus.cc:515] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.022181  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.022811  1530 leader_election.cc:290] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.023103  1328 raft_consensus.cc:2468] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.019325  1628 raft_consensus.cc:515] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.025671  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e568e879af50468085dbcfedb5005859" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.026700  1628 leader_election.cc:290] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.027222  1221 leader_election.cc:304] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.027568  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e568e879af50468085dbcfedb5005859" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:19.027529  1581 leader_election.cc:290] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.029362  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:19.029686  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf601481d5614428aa1948ce5e0df02f" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.030237  1477 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.030727  1329 raft_consensus.cc:2393] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 1: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:19.036466  1404 raft_consensus.cc:2468] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:19.024133  1536 leader_election.cc:290] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.045146  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.068610  1329 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.026474  1328 raft_consensus.cc:2468] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:19.045012  1564 leader_election.cc:290] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:19.045750  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d59b30b44054b238642951881f89b66" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:19.037698  1442 leader_election.cc:343] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.038542  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:19.039330  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:19.072062  1221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 44923.5us
I20260709 13:13:19.080940  1524 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:19.078533  1650 leader_election.cc:290] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:19.073840  1583 raft_consensus.cc:2804] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.083487  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d695ee04326f476498937637eb685d7b" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:19.086330  1583 raft_consensus.cc:493] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.086748  1583 raft_consensus.cc:3060] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.039855  1400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf601481d5614428aa1948ce5e0df02f" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:19.089359  1220 leader_election.cc:343] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.090939  1444 leader_election.cc:304] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:19.091758  1536 raft_consensus.cc:2804] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.092123  1536 raft_consensus.cc:493] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.041482  1218 leader_election.cc:304] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.085655  1524 ts_tablet_manager.cc:1403] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.112s	user 0.024s	sys 0.019s
I20260709 13:13:19.037678  1368 leader_election.cc:304] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.092456  1536 raft_consensus.cc:3060] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.038031  1643 consensus_queue.cc:1048] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:13:19.093822  1402 raft_consensus.cc:2468] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.084619  1478 raft_consensus.cc:2468] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:19.094650  1582 raft_consensus.cc:2804] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.109318  1582 raft_consensus.cc:493] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.109761  1582 raft_consensus.cc:3060] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.109998  1220 leader_election.cc:304] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.110919  1530 raft_consensus.cc:2804] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.111294  1530 raft_consensus.cc:493] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.111626  1530 raft_consensus.cc:3060] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.113111  1536 raft_consensus.cc:515] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.116611  1536 leader_election.cc:290] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.117756  1582 raft_consensus.cc:515] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:19.095023  1368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 57466.7us
I20260709 13:13:19.096320  1524 raft_consensus.cc:359] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
W20260709 13:13:19.097352  1218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 55976.3us
I20260709 13:13:19.120487  1524 raft_consensus.cc:385] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.120793  1524 raft_consensus.cc:740] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.097518  1564 raft_consensus.cc:2804] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:19.098640  1293 leader_election.cc:343] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.122162  1564 raft_consensus.cc:493] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.122545  1564 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.097352  1443 leader_election.cc:304] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:19.122851  1530 raft_consensus.cc:515] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:19.100289  1200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:13:19.085264  1442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 47609.3us
I20260709 13:13:19.124089  1295 leader_election.cc:304] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:19.125413  1538 raft_consensus.cc:2804] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.125638  1400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:19.125984  1650 raft_consensus.cc:493] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.126219  1628 raft_consensus.cc:3060] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.126474  1650 raft_consensus.cc:515] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.127100  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e568e879af50468085dbcfedb5005859" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:19.127723  1328 raft_consensus.cc:3060] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.128741  1650 leader_election.cc:290] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:19.130225  1476 raft_consensus.cc:3060] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.131048  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:19.107512  1523 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:19.131739  1475 raft_consensus.cc:2468] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.131982  1523 ts_tablet_manager.cc:1403] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.217s	user 0.044s	sys 0.066s
I20260709 13:13:19.126220  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d59b30b44054b238642951881f89b66" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:19.134979  1478 raft_consensus.cc:3060] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.135017  1650 consensus_queue.cc:1048] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:19.138161  1523 raft_consensus.cc:359] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.126281  1400 raft_consensus.cc:3060] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.145133  1583 raft_consensus.cc:515] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.148072  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:19.148662  1329 raft_consensus.cc:3060] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.133678  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6561d58a0d984196a8f1edde7c628758" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:19.149549  1473 raft_consensus.cc:2468] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:19.150043  1530 leader_election.cc:290] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:19.139081  1538 raft_consensus.cc:697] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:19.153481  1293 leader_election.cc:304] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:19.154384  1643 raft_consensus.cc:2804] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.154094  1538 consensus_queue.cc:237] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.154778  1643 raft_consensus.cc:493] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.155339  1643 raft_consensus.cc:3060] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.121479  1524 consensus_queue.cc:260] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.157095  1400 raft_consensus.cc:2468] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:19.107853  1526 tablet_bootstrap.cc:492] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:19.143123  1582 leader_election.cc:290] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:19.144503  1564 raft_consensus.cc:515] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.160717  1526 ts_tablet_manager.cc:1403] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.231s	user 0.048s	sys 0.025s
I20260709 13:13:19.161280  1220 leader_election.cc:304] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.105005  1525 tablet_bootstrap.cc:654] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.157245  1650 consensus_queue.cc:1048] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.162482  1564 leader_election.cc:290] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.162755  1648 consensus_queue.cc:1048] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.163367  1564 raft_consensus.cc:2804] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.163904  1564 raft_consensus.cc:697] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:19.157804  1524 ts_tablet_manager.cc:1434] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.000s
I20260709 13:13:19.165062  1524 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:19.164947  1564 consensus_queue.cc:237] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.134279  1628 raft_consensus.cc:2749] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.158362  1328 raft_consensus.cc:2468] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:19.168340  1444 leader_election.cc:304] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:19.169483  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:19.157691  1523 raft_consensus.cc:385] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.170104  1328 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.170308  1523 raft_consensus.cc:740] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.144964  1478 raft_consensus.cc:2468] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:19.171659  1523 consensus_queue.cc:260] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.172363  1367 leader_election.cc:304] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:19.173339  1582 raft_consensus.cc:2804] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.173816  1582 raft_consensus.cc:697] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:19.174660  1582 consensus_queue.cc:237] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.178720  1601 consensus_queue.cc:1048] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.179975  1536 raft_consensus.cc:2804] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.180636  1536 raft_consensus.cc:697] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:19.181500  1536 consensus_queue.cc:237] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.183027  1524 tablet_bootstrap.cc:654] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.163640  1526 raft_consensus.cc:359] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.184687  1526 raft_consensus.cc:385] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.184990  1526 raft_consensus.cc:740] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.185860  1328 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:19.185693  1526 consensus_queue.cc:260] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.204509  1525 tablet_bootstrap.cc:492] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:19.205368  1525 ts_tablet_manager.cc:1403] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.195s	user 0.013s	sys 0.002s
I20260709 13:13:19.216442  1526 ts_tablet_manager.cc:1434] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:13:19.217934  1526 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:19.220203  1153 catalog_manager.cc:5697] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.227154  1523 ts_tablet_manager.cc:1434] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.001s
I20260709 13:13:19.209151  1525 raft_consensus.cc:359] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.228273  1523 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:19.228292  1525 raft_consensus.cc:385] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.229159  1525 raft_consensus.cc:740] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.232651  1628 raft_consensus.cc:493] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:19.233384  1628 raft_consensus.cc:515] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.238296  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.242142  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:19.225905  1601 raft_consensus.cc:493] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.244062  1443 leader_election.cc:304] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:19.245389  1701 raft_consensus.cc:2749] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:19.246273  1628 leader_election.cc:290] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.243589  1601 raft_consensus.cc:515] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.248751  1562 consensus_queue.cc:1048] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:19.250290  1601 leader_election.cc:290] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.251583  1221 leader_election.cc:304] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.254765  1583 leader_election.cc:290] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.267071  1525 consensus_queue.cc:260] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.267059  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c469e4ff0f4df4aa908546ef6482f2" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
W20260709 13:13:19.273303  1370 leader_election.cc:343] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:19.258497  1218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 136860us
I20260709 13:13:19.289434  1524 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:19.290005  1524 ts_tablet_manager.cc:1403] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.000s
I20260709 13:13:19.295989  1643 raft_consensus.cc:515] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.297508  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:19.298223  1697 raft_consensus.cc:2804] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:19.302642  1705 log.cc:927] Time spent T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:13:19.333810  1643 leader_election.cc:290] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:19.304165  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:19.305559  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:19.336321  1477 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.310978  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d59b30b44054b238642951881f89b66" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:19.312075  1601 consensus_queue.cc:1048] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.337363  1254 raft_consensus.cc:3060] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.337899  1329 raft_consensus.cc:2468] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
W20260709 13:13:19.338312  1220 leader_election.cc:343] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.314246  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c469e4ff0f4df4aa908546ef6482f2" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:19.340862  1252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6561d58a0d984196a8f1edde7c628758" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:19.315480  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6561d58a0d984196a8f1edde7c628758" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:19.292622  1524 raft_consensus.cc:359] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.341538  1252 raft_consensus.cc:3060] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.324260  1562 consensus_queue.cc:1048] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.331607  1697 raft_consensus.cc:697] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:19.284935  1583 raft_consensus.cc:493] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.342414  1583 raft_consensus.cc:515] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.342757  1697 consensus_queue.cc:237] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.317425  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e568e879af50468085dbcfedb5005859" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:19.340555  1153 catalog_manager.cc:5697] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.341593  1524 raft_consensus.cc:385] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.347502  1524 raft_consensus.cc:740] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.348059  1525 ts_tablet_manager.cc:1434] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.142s	user 0.008s	sys 0.000s
I20260709 13:13:19.348371  1524 consensus_queue.cc:260] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.349498  1525 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:19.356118  1526 tablet_bootstrap.cc:654] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.344571  1478 raft_consensus.cc:3060] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.362416  1524 ts_tablet_manager.cc:1434] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:13:19.363618  1524 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:19.347110  1253 raft_consensus.cc:2468] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:19.377918  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6561d58a0d984196a8f1edde7c628758" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
W20260709 13:13:19.377481  1442 leader_election.cc:343] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.385551  1252 raft_consensus.cc:2468] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:19.391388  1294 leader_election.cc:304] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.392189  1643 raft_consensus.cc:2804] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.392700  1643 raft_consensus.cc:697] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:19.386497  1473 raft_consensus.cc:3060] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.399572  1643 consensus_queue.cc:237] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.403236  1326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c469e4ff0f4df4aa908546ef6482f2" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.405983  1221 leader_election.cc:304] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:19.399575  1648 raft_consensus.cc:493] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.406752  1648 raft_consensus.cc:515] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.408804  1648 leader_election.cc:290] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:19.409638  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb5ff6e1bd14308a0d214d7fcc8fecf" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:19.410734  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb5ff6e1bd14308a0d214d7fcc8fecf" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:19.411128  1295 leader_election.cc:343] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:19.412317  1293 leader_election.cc:343] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.412750  1293 leader_election.cc:304] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:19.413885  1650 raft_consensus.cc:2749] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.413792  1151 catalog_manager.cc:5697] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.416204  1581 raft_consensus.cc:2804] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.416730  1524 tablet_bootstrap.cc:654] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.438445  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c469e4ff0f4df4aa908546ef6482f2" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:19.439119  1402 raft_consensus.cc:2468] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.432631  1477 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:19.440438  1220 leader_election.cc:304] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.441462  1712 raft_consensus.cc:2804] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.441923  1712 raft_consensus.cc:493] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.442233  1712 raft_consensus.cc:3060] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.428047  1478 raft_consensus.cc:2468] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:19.451681  1526 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:19.452294  1526 ts_tablet_manager.cc:1403] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.235s	user 0.013s	sys 0.001s
I20260709 13:13:19.431485  1523 tablet_bootstrap.cc:654] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.454496  1525 tablet_bootstrap.cc:654] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.416786  1581 raft_consensus.cc:697] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:19.458192  1473 raft_consensus.cc:2468] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:19.427246  1149 catalog_manager.cc:5697] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.453176  1583 leader_election.cc:290] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.412554  1254 raft_consensus.cc:2468] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:19.425664  1368 leader_election.cc:304] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:19.478185  1581 consensus_queue.cc:237] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
W20260709 13:13:19.457674  1221 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 51837.3us
I20260709 13:13:19.484990  1582 raft_consensus.cc:2804] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.492081  1582 raft_consensus.cc:493] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.494505  1582 raft_consensus.cc:3060] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:19.488587  1368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 63024.6us
W20260709 13:13:19.493296  1221 leader_election.cc:343] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.511749  1524 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:19.512220  1524 ts_tablet_manager.cc:1403] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.008s
I20260709 13:13:19.515210  1524 raft_consensus.cc:359] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.515846  1524 raft_consensus.cc:385] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.516094  1524 raft_consensus.cc:740] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.516711  1524 consensus_queue.cc:260] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.518889  1524 ts_tablet_manager.cc:1434] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:19.519765  1524 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:19.520676  1526 raft_consensus.cc:359] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.521399  1526 raft_consensus.cc:385] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.521656  1526 raft_consensus.cc:740] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.517063  1582 raft_consensus.cc:515] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.523990  1712 raft_consensus.cc:515] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.528299  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c469e4ff0f4df4aa908546ef6482f2" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:19.530067  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c469e4ff0f4df4aa908546ef6482f2" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:19.530792  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c469e4ff0f4df4aa908546ef6482f2" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:19.532158  1526 consensus_queue.cc:260] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.533249  1327 raft_consensus.cc:3060] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.531581  1582 leader_election.cc:290] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.539848  1254 raft_consensus.cc:2393] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate e89740c5a5de48fd875c8b628616334c in this term.
I20260709 13:13:19.543952  1524 tablet_bootstrap.cc:654] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.540722  1712 leader_election.cc:290] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.541277  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68c469e4ff0f4df4aa908546ef6482f2" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:19.541785  1327 raft_consensus.cc:2468] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:19.545193  1402 raft_consensus.cc:2393] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89740c5a5de48fd875c8b628616334c in current term 1: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:19.541771  1523 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:19.546515  1220 leader_election.cc:304] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:19.547396  1523 ts_tablet_manager.cc:1403] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.319s	user 0.014s	sys 0.005s
I20260709 13:13:19.548095  1370 leader_election.cc:304] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:19.549247  1582 raft_consensus.cc:2804] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.549782  1582 raft_consensus.cc:697] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:19.550036  1712 raft_consensus.cc:2749] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.550674  1582 consensus_queue.cc:237] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.538442  1149 catalog_manager.cc:5697] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.556978  1525 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:19.554803  1526 ts_tablet_manager.cc:1434] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 13:13:19.557672  1525 ts_tablet_manager.cc:1403] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.209s	user 0.017s	sys 0.000s
I20260709 13:13:19.556253  1149 catalog_manager.cc:5697] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.558686  1526 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:19.559887  1648 consensus_queue.cc:1048] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.560343  1525 raft_consensus.cc:359] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.561046  1525 raft_consensus.cc:385] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.561318  1525 raft_consensus.cc:740] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.562042  1524 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:19.562666  1524 ts_tablet_manager.cc:1403] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.011s
I20260709 13:13:19.562057  1525 consensus_queue.cc:260] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.564906  1526 tablet_bootstrap.cc:654] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.565294  1524 raft_consensus.cc:359] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.566088  1524 raft_consensus.cc:385] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.566349  1524 raft_consensus.cc:740] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.567238  1524 consensus_queue.cc:260] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.569568  1524 ts_tablet_manager.cc:1434] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:19.570443  1524 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:19.571316  1525 ts_tablet_manager.cc:1434] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:19.575258  1523 raft_consensus.cc:359] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.576594  1523 raft_consensus.cc:385] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.576781  1524 tablet_bootstrap.cc:654] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.576931  1523 raft_consensus.cc:740] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.577957  1523 consensus_queue.cc:260] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.580879  1523 ts_tablet_manager.cc:1434] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:13:19.583582  1523 tablet_bootstrap.cc:492] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:19.583580  1151 catalog_manager.cc:5697] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.605922  1525 tablet_bootstrap.cc:492] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:19.612269  1525 tablet_bootstrap.cc:654] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.612360  1526 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:19.612836  1526 ts_tablet_manager.cc:1403] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.023s
I20260709 13:13:19.613566  1537 raft_consensus.cc:493] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.614063  1537 raft_consensus.cc:515] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.615988  1537 leader_election.cc:290] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:19.616967  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfaf2eb5ac94004b49869c3fb44246b" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:19.617687  1476 raft_consensus.cc:2468] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:19.619040  1367 leader_election.cc:304] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:19.619449  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfaf2eb5ac94004b49869c3fb44246b" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:19.620100  1254 raft_consensus.cc:2468] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:19.621563  1562 raft_consensus.cc:2804] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.621994  1562 raft_consensus.cc:493] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.622313  1562 raft_consensus.cc:3060] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.628825  1525 tablet_bootstrap.cc:492] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:19.629397  1525 ts_tablet_manager.cc:1403] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:13:19.632238  1526 raft_consensus.cc:359] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.633049  1526 raft_consensus.cc:385] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.633188  1525 raft_consensus.cc:359] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.633738  1526 raft_consensus.cc:740] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.634088  1525 raft_consensus.cc:385] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.634443  1525 raft_consensus.cc:740] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.632961  1473 raft_consensus.cc:3060] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.634608  1526 consensus_queue.cc:260] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.635130  1525 consensus_queue.cc:260] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.637285  1525 ts_tablet_manager.cc:1434] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:19.637300  1526 ts_tablet_manager.cc:1434] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:13:19.638334  1525 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:19.638640  1526 tablet_bootstrap.cc:492] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:19.640133  1523 tablet_bootstrap.cc:654] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.637502  1562 raft_consensus.cc:515] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.643637  1562 leader_election.cc:290] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:19.644621  1525 tablet_bootstrap.cc:654] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.644476  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfaf2eb5ac94004b49869c3fb44246b" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:19.645123  1254 raft_consensus.cc:3060] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.645521  1526 tablet_bootstrap.cc:654] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.647289  1524 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:19.647756  1524 ts_tablet_manager.cc:1403] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.078s	user 0.034s	sys 0.019s
I20260709 13:13:19.654263  1524 raft_consensus.cc:359] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.654984  1524 raft_consensus.cc:385] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.655267  1524 raft_consensus.cc:740] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.655943  1524 consensus_queue.cc:260] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.657585  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bfaf2eb5ac94004b49869c3fb44246b" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:19.657893  1524 ts_tablet_manager.cc:1434] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:19.657935  1526 tablet_bootstrap.cc:492] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:19.658200  1478 raft_consensus.cc:3060] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.658586  1526 ts_tablet_manager.cc:1403] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:13:19.658981  1524 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:19.661131  1526 raft_consensus.cc:359] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.661768  1526 raft_consensus.cc:385] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.662009  1526 raft_consensus.cc:740] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.662695  1526 consensus_queue.cc:260] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.663215  1254 raft_consensus.cc:2468] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:19.664402  1368 leader_election.cc:304] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.665122  1526 ts_tablet_manager.cc:1434] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:19.667398  1525 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:19.665670  1537 raft_consensus.cc:2804] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.674155  1152 catalog_manager.cc:5697] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.675211  1537 raft_consensus.cc:697] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:19.675275  1538 consensus_queue.cc:1048] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.676143  1537 consensus_queue.cc:237] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.678776  1581 consensus_queue.cc:1048] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.669692  1526 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:19.670084  1523 tablet_bootstrap.cc:492] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:19.680876  1523 ts_tablet_manager.cc:1403] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.003s
I20260709 13:13:19.682035  1581 consensus_queue.cc:1048] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.683645  1523 raft_consensus.cc:359] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.684304  1523 raft_consensus.cc:385] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.684576  1523 raft_consensus.cc:740] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.685829  1523 consensus_queue.cc:260] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.688057  1523 ts_tablet_manager.cc:1434] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:19.665000  1478 raft_consensus.cc:2468] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:19.672284  1524 tablet_bootstrap.cc:654] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.689106  1523 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:19.705140  1701 raft_consensus.cc:493] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.705716  1701 raft_consensus.cc:515] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.707768  1701 leader_election.cc:290] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.708473  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb5ff6e1bd14308a0d214d7fcc8fecf" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.709151  1327 raft_consensus.cc:2468] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:19.710512  1444 leader_election.cc:304] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:19.710611  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb5ff6e1bd14308a0d214d7fcc8fecf" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:19.711253  1401 raft_consensus.cc:2468] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:19.711403  1701 raft_consensus.cc:2804] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.711786  1701 raft_consensus.cc:493] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.712100  1701 raft_consensus.cc:3060] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.713205  1601 consensus_queue.cc:1048] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.714159  1530 raft_consensus.cc:493] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.714654  1530 raft_consensus.cc:515] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.716631  1530 leader_election.cc:290] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.719015  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec88e02ca274791a250e577eb123cdb" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.720047  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec88e02ca274791a250e577eb123cdb" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:19.721199  1701 raft_consensus.cc:515] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
W20260709 13:13:19.721561  1221 leader_election.cc:343] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:19.722558  1218 leader_election.cc:343] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.721812  1524 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:19.723132  1218 leader_election.cc:304] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:19.725023  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb5ff6e1bd14308a0d214d7fcc8fecf" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:19.725554  1251 raft_consensus.cc:3060] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.725700  1327 raft_consensus.cc:3060] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.732750  1327 raft_consensus.cc:2468] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:19.733247  1712 raft_consensus.cc:2749] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.737425  1701 leader_election.cc:290] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.737147  1444 leader_election.cc:304] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:19.735487  1523 tablet_bootstrap.cc:654] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.735357  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb5ff6e1bd14308a0d214d7fcc8fecf" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:19.740063  1402 raft_consensus.cc:3060] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.740808  1628 raft_consensus.cc:2804] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.742522  1536 consensus_queue.cc:1048] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.743847  1536 consensus_queue.cc:1048] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.733716  1526 tablet_bootstrap.cc:654] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.748159  1402 raft_consensus.cc:2468] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:19.752555  1582 consensus_queue.cc:1048] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.753158  1628 raft_consensus.cc:697] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:19.754884  1628 consensus_queue.cc:237] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.723417  1524 ts_tablet_manager.cc:1403] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 13:13:19.764907  1525 ts_tablet_manager.cc:1403] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.005s
I20260709 13:13:19.769789  1524 raft_consensus.cc:359] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.770686  1524 raft_consensus.cc:385] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.771021  1524 raft_consensus.cc:740] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.775602  1524 consensus_queue.cc:260] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.775477  1150 catalog_manager.cc:5697] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.784284  1525 raft_consensus.cc:359] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.785147  1525 raft_consensus.cc:385] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.785497  1525 raft_consensus.cc:740] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.793517  1526 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:19.794044  1526 ts_tablet_manager.cc:1403] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.000s
I20260709 13:13:19.794486  1712 consensus_queue.cc:1048] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.797335  1525 consensus_queue.cc:260] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.798956  1526 raft_consensus.cc:359] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.799707  1526 raft_consensus.cc:385] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.800024  1526 raft_consensus.cc:740] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.800967  1523 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:19.800894  1526 consensus_queue.cc:260] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.801661  1523 ts_tablet_manager.cc:1403] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.003s
I20260709 13:13:19.803186  1526 ts_tablet_manager.cc:1434] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:19.806926  1526 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:19.809751  1524 ts_tablet_manager.cc:1434] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:13:19.812259  1523 raft_consensus.cc:359] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.817677  1523 raft_consensus.cc:385] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.818019  1523 raft_consensus.cc:740] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.818704  1523 consensus_queue.cc:260] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.822621  1650 consensus_queue.cc:1048] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.816682  1526 tablet_bootstrap.cc:654] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.812812  1524 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:19.825519  1525 ts_tablet_manager.cc:1434] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:13:19.826511  1525 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:19.828967  1696 raft_consensus.cc:493] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.829617  1696 raft_consensus.cc:515] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.830682  1523 ts_tablet_manager.cc:1434] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260709 13:13:19.831665  1523 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:19.832518  1524 tablet_bootstrap.cc:654] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.832644  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.832828  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:19.835743  1327 raft_consensus.cc:2468] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.836024  1402 raft_consensus.cc:2468] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.837102  1221 leader_election.cc:304] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.833365  1696 leader_election.cc:290] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.838166  1712 raft_consensus.cc:2804] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.838645  1712 raft_consensus.cc:493] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.839068  1712 raft_consensus.cc:3060] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.842144  1538 raft_consensus.cc:493] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.842752  1538 raft_consensus.cc:515] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:19.846975  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:19.848400  1295 leader_election.cc:343] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.848883  1590 consensus_queue.cc:1048] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.849556  1564 raft_consensus.cc:493] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.850119  1564 raft_consensus.cc:515] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.850479  1538 leader_election.cc:290] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:19.850698  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:19.851972  1293 leader_election.cc:343] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.852195  1564 leader_election.cc:290] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:19.852458  1293 leader_election.cc:304] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:19.854288  1538 raft_consensus.cc:2749] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.854801  1530 consensus_queue.cc:1048] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.854945  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:19.857928  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:19.859336  1220 leader_election.cc:343] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:19.861013  1218 leader_election.cc:343] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.861490  1218 leader_election.cc:304] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:19.862423  1530 raft_consensus.cc:2749] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.865799  1525 tablet_bootstrap.cc:654] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.870090  1523 tablet_bootstrap.cc:654] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.875996  1151 catalog_manager.cc:5697] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.856477  1524 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:19.882429  1524 ts_tablet_manager.cc:1403] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.007s
I20260709 13:13:19.883102  1562 raft_consensus.cc:493] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.885104  1562 raft_consensus.cc:515] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.887658  1562 leader_election.cc:290] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.888368  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:19.890751  1524 raft_consensus.cc:359] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.891429  1524 raft_consensus.cc:385] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.891686  1525 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:19.892680  1525 ts_tablet_manager.cc:1403] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.000s
I20260709 13:13:19.892773  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.893653  1327 raft_consensus.cc:2393] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate e89740c5a5de48fd875c8b628616334c in this term.
I20260709 13:13:19.892117  1523 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:19.894331  1523 ts_tablet_manager.cc:1403] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.008s
I20260709 13:13:19.883553  1712 raft_consensus.cc:515] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.894892  1370 leader_election.cc:304] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:19.896080  1562 raft_consensus.cc:3060] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.897127  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:19.897841  1329 raft_consensus.cc:3060] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.899073  1525 raft_consensus.cc:359] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.899758  1525 raft_consensus.cc:385] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.900022  1525 raft_consensus.cc:740] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.900682  1525 consensus_queue.cc:260] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.901278  1526 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:19.897007  1523 raft_consensus.cc:359] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.901654  1523 raft_consensus.cc:385] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.901732  1526 ts_tablet_manager.cc:1403] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.000s
I20260709 13:13:19.901947  1523 raft_consensus.cc:740] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.902652  1523 consensus_queue.cc:260] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.904637  1523 ts_tablet_manager.cc:1434] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.001s
I20260709 13:13:19.904345  1526 raft_consensus.cc:359] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.905047  1526 raft_consensus.cc:385] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:19.905380  1526 raft_consensus.cc:740] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.905648  1562 raft_consensus.cc:2749] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.906575  1525 ts_tablet_manager.cc:1434] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:13:19.906040  1526 consensus_queue.cc:260] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.907553  1525 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:19.908327  1526 ts_tablet_manager.cc:1434] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:19.909855  1526 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:19.915128  1525 tablet_bootstrap.cc:654] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.908442  1523 tablet_bootstrap.cc:492] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:19.924258  1562 raft_consensus.cc:493] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.924535  1523 tablet_bootstrap.cc:654] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.891688  1524 raft_consensus.cc:740] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:19.924813  1562 raft_consensus.cc:515] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:19.925585  1524 consensus_queue.cc:260] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.927631  1524 ts_tablet_manager.cc:1434] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:13:19.928519  1524 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:19.933741  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:19.934604  1524 tablet_bootstrap.cc:654] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:19.935103  1367 leader_election.cc:343] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.937819  1562 leader_election.cc:290] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:19.938166  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:19.938835  1253 raft_consensus.cc:2468] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:19.939996  1368 leader_election.cc:304] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:19.915483  1526 tablet_bootstrap.cc:654] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:19.946558  1628 raft_consensus.cc:493] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.947098  1628 raft_consensus.cc:515] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:19.947803  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:19.948453  1402 raft_consensus.cc:3060] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.950507  1712 leader_election.cc:290] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.956956  1329 raft_consensus.cc:2468] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:19.957463  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:19.958822  1442 leader_election.cc:343] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.960400  1221 leader_election.cc:304] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:19.960577  1696 raft_consensus.cc:493] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.949231  1628 leader_election.cc:290] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:19.961134  1696 raft_consensus.cc:515] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.961539  1530 raft_consensus.cc:2804] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:19.962085  1530 raft_consensus.cc:697] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:19.962877  1530 consensus_queue.cc:237] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:19.966169  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:19.949368  1562 raft_consensus.cc:2804] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:19.967957  1220 leader_election.cc:343] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.971004  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.971863  1327 raft_consensus.cc:2468] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:19.969714  1696 leader_election.cc:290] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:19.973519  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:19.970521  1562 raft_consensus.cc:493] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.982134  1562 raft_consensus.cc:3060] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:19.983269  1444 leader_election.cc:343] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:19.983956  1444 leader_election.cc:304] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:19.985865  1628 raft_consensus.cc:2749] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:19.987993  1525 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:19.988510  1525 ts_tablet_manager.cc:1403] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.004s
I20260709 13:13:19.992061  1696 consensus_queue.cc:1048] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:19.993986  1221 leader_election.cc:304] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:19.995061  1712 raft_consensus.cc:2804] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:19.995419  1712 raft_consensus.cc:493] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.992434  1402 raft_consensus.cc:2468] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:19.995775  1712 raft_consensus.cc:3060] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:19.995857  1526 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:19.996630  1526 ts_tablet_manager.cc:1403] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.009s
I20260709 13:13:20.000020  1526 raft_consensus.cc:359] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.000726  1526 raft_consensus.cc:385] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.002521  1523 tablet_bootstrap.cc:492] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:20.003038  1523 ts_tablet_manager.cc:1403] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.014s
I20260709 13:13:20.004731  1712 raft_consensus.cc:515] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.005946  1523 raft_consensus.cc:359] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.006950  1523 raft_consensus.cc:385] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.007287  1523 raft_consensus.cc:740] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.000977  1526 raft_consensus.cc:740] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.007840  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:20.006505  1524 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:20.008787  1524 ts_tablet_manager.cc:1403] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.011s
I20260709 13:13:20.008606  1327 raft_consensus.cc:3060] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.008448  1153 catalog_manager.cc:5697] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.009138  1523 consensus_queue.cc:260] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.011184  1525 raft_consensus.cc:359] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.011929  1525 raft_consensus.cc:385] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.008671  1526 consensus_queue.cc:260] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.012274  1525 raft_consensus.cc:740] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.014184  1562 raft_consensus.cc:515] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.014636  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:20.017215  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
W20260709 13:13:20.016278  1220 leader_election.cc:343] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.019742  1525 consensus_queue.cc:260] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.020956  1562 leader_election.cc:290] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:20.021143  1473 raft_consensus.cc:3060] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.022331  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:20.022919  1253 raft_consensus.cc:3060] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.028277  1628 raft_consensus.cc:493] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.028821  1628 raft_consensus.cc:515] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.029263  1473 raft_consensus.cc:2468] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:20.029891  1526 ts_tablet_manager.cc:1434] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:13:20.030655  1253 raft_consensus.cc:2468] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:20.031008  1628 leader_election.cc:290] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:20.031641  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec88e02ca274791a250e577eb123cdb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:20.033250  1251 raft_consensus.cc:2468] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:20.034355  1442 leader_election.cc:304] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:20.032423  1368 leader_election.cc:304] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:20.035925  1526 tablet_bootstrap.cc:492] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:20.036572  1628 raft_consensus.cc:2804] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.011601  1523 ts_tablet_manager.cc:1434] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:20.037041  1628 raft_consensus.cc:493] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.037446  1628 raft_consensus.cc:3060] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.040374  1523 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:20.042563  1524 raft_consensus.cc:359] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.044925  1524 raft_consensus.cc:385] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.048508  1524 raft_consensus.cc:740] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.049259  1524 consensus_queue.cc:260] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.050238  1697 consensus_queue.cc:1048] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.052652  1524 ts_tablet_manager.cc:1434] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:13:20.053730  1524 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:20.055310  1523 tablet_bootstrap.cc:654] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.056576  1582 raft_consensus.cc:2804] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.057217  1582 raft_consensus.cc:697] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:20.058113  1582 consensus_queue.cc:237] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.059638  1524 tablet_bootstrap.cc:654] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.048005  1327 raft_consensus.cc:2468] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:20.048121  1526 tablet_bootstrap.cc:654] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.062939  1221 leader_election.cc:304] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:20.064103  1581 raft_consensus.cc:2804] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.064679  1581 raft_consensus.cc:697] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:20.065790  1581 consensus_queue.cc:237] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.072165  1537 consensus_queue.cc:1048] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:20.076488  1525 ts_tablet_manager.cc:1434] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.004s
I20260709 13:13:20.092015  1525 tablet_bootstrap.cc:492] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:20.080884  1601 consensus_queue.cc:1048] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:20.088893  1583 raft_consensus.cc:493] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.110880  1583 raft_consensus.cc:515] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.113839  1583 leader_election.cc:290] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:20.077157  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec88e02ca274791a250e577eb123cdb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:20.146711  1329 raft_consensus.cc:2468] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:20.020529  1712 leader_election.cc:290] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:20.190438  1151 catalog_manager.cc:5697] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.203099  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:20.210824  1329 raft_consensus.cc:2468] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:20.212103  1221 leader_election.cc:304] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:20.215051  1628 raft_consensus.cc:515] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.216022  1581 raft_consensus.cc:2804] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.216598  1581 raft_consensus.cc:493] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.217041  1581 raft_consensus.cc:3060] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.219800  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec88e02ca274791a250e577eb123cdb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:20.220402  1251 raft_consensus.cc:3060] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.222805  1628 leader_election.cc:290] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:20.220937  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:20.226799  1473 raft_consensus.cc:2468] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:20.230587  1562 consensus_queue.cc:1048] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.237536  1525 tablet_bootstrap.cc:654] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.246351  1251 raft_consensus.cc:2468] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:20.248802  1526 tablet_bootstrap.cc:492] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:20.249372  1526 ts_tablet_manager.cc:1403] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.214s	user 0.045s	sys 0.053s
I20260709 13:13:20.254386  1524 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:20.254864  1524 ts_tablet_manager.cc:1403] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.201s	user 0.010s	sys 0.012s
I20260709 13:13:20.255369  1523 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:20.255983  1523 ts_tablet_manager.cc:1403] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.216s	user 0.051s	sys 0.040s
I20260709 13:13:20.257488  1524 raft_consensus.cc:359] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.258163  1524 raft_consensus.cc:385] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.258428  1524 raft_consensus.cc:740] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.259253  1523 raft_consensus.cc:359] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.259258  1524 consensus_queue.cc:260] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.260296  1523 raft_consensus.cc:385] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.260749  1523 raft_consensus.cc:740] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.261379  1536 consensus_queue.cc:1048] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.262423  1524 ts_tablet_manager.cc:1434] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:20.263396  1524 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:20.264315  1442 leader_election.cc:304] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:20.270835  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec88e02ca274791a250e577eb123cdb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:20.271020  1562 consensus_queue.cc:1048] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.271485  1329 raft_consensus.cc:3060] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.271216  1526 raft_consensus.cc:359] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.271993  1526 raft_consensus.cc:385] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.272254  1526 raft_consensus.cc:740] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.272902  1524 tablet_bootstrap.cc:654] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.273130  1536 raft_consensus.cc:2804] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.273654  1536 raft_consensus.cc:697] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:20.274518  1536 consensus_queue.cc:237] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.274688  1523 consensus_queue.cc:260] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.278337  1526 consensus_queue.cc:260] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.282953  1526 ts_tablet_manager.cc:1434] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:13:20.283488  1697 raft_consensus.cc:493] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.283998  1697 raft_consensus.cc:515] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.286007  1697 leader_election.cc:290] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:20.286607  1526 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:20.289659  1581 raft_consensus.cc:515] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.291738  1581 leader_election.cc:290] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:20.292649  1400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d272b7f7ba4b9aa358c6ab6b9c902c" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:20.294603  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:20.295414  1330 raft_consensus.cc:3060] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.296622  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:20.297219  1475 raft_consensus.cc:3060] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.299273  1523 ts_tablet_manager.cc:1434] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 13:13:20.300257  1523 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:20.301620  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d272b7f7ba4b9aa358c6ab6b9c902c" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:20.310406  1329 raft_consensus.cc:2468] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
W20260709 13:13:20.313531  1220 leader_election.cc:343] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:20.314431  1218 leader_election.cc:343] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.315006  1218 leader_election.cc:304] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:20.316258  1523 tablet_bootstrap.cc:654] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.316594  1564 raft_consensus.cc:2749] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:20.331516  1524 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:20.333381  1524 ts_tablet_manager.cc:1403] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.018s
I20260709 13:13:20.338603  1524 raft_consensus.cc:359] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.339448  1628 consensus_queue.cc:1048] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:20.342200  1524 raft_consensus.cc:385] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.342849  1524 raft_consensus.cc:740] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.344062  1524 consensus_queue.cc:260] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.346875  1524 ts_tablet_manager.cc:1434] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:13:20.348891  1524 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:20.352962  1581 consensus_queue.cc:1048] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.358448  1524 tablet_bootstrap.cc:654] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.364694  1330 raft_consensus.cc:2468] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:20.343039  1475 raft_consensus.cc:2468] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:20.373709  1697 consensus_queue.cc:1048] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:20.409205  1523 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
W20260709 13:13:20.411468  1200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:20.420694  1525 tablet_bootstrap.cc:492] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:20.422891  1523 ts_tablet_manager.cc:1403] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.123s	user 0.011s	sys 0.000s
I20260709 13:13:20.423034  1525 ts_tablet_manager.cc:1403] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.331s	user 0.019s	sys 0.003s
I20260709 13:13:20.425680  1525 raft_consensus.cc:359] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.426260  1523 raft_consensus.cc:359] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.427187  1523 raft_consensus.cc:385] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.427522  1523 raft_consensus.cc:740] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.431195  1523 consensus_queue.cc:260] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.431466  1218 leader_election.cc:304] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:20.432402  1524 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:20.432801  1712 raft_consensus.cc:2804] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.433380  1712 raft_consensus.cc:697] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:20.434231  1712 consensus_queue.cc:237] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.432843  1524 ts_tablet_manager.cc:1403] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.017s
I20260709 13:13:20.438009  1582 raft_consensus.cc:493] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.438522  1582 raft_consensus.cc:515] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.439834  1524 raft_consensus.cc:359] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.440543  1582 leader_election.cc:290] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:20.440688  1524 raft_consensus.cc:385] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.441010  1524 raft_consensus.cc:740] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.426601  1525 raft_consensus.cc:385] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.441730  1525 raft_consensus.cc:740] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.444044  1526 tablet_bootstrap.cc:654] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.443812  1524 consensus_queue.cc:260] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.439832  1149 catalog_manager.cc:5697] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.446087  1524 ts_tablet_manager.cc:1434] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:20.447048  1524 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:20.447587  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:20.433374  1523 ts_tablet_manager.cc:1434] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:20.450238  1523 tablet_bootstrap.cc:492] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:20.446650  1525 consensus_queue.cc:260] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.455551  1475 raft_consensus.cc:2468] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:20.456063  1536 raft_consensus.cc:493] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.456254  1526 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:20.456513  1536 raft_consensus.cc:515] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.456717  1526 ts_tablet_manager.cc:1403] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.170s	user 0.007s	sys 0.003s
I20260709 13:13:20.459815  1526 raft_consensus.cc:359] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.460536  1526 raft_consensus.cc:385] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.460847  1526 raft_consensus.cc:740] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.461669  1526 consensus_queue.cc:260] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.463133  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:20.463802  1327 raft_consensus.cc:2468] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:20.464099  1526 ts_tablet_manager.cc:1434] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:20.465176  1526 tablet_bootstrap.cc:492] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:20.465029  1444 leader_election.cc:304] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:20.465943  1628 raft_consensus.cc:2804] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.466312  1628 raft_consensus.cc:493] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.466655  1628 raft_consensus.cc:3060] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.471508  1523 tablet_bootstrap.cc:654] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.472122  1526 tablet_bootstrap.cc:654] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.473767  1712 consensus_queue.cc:1048] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.478760  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:20.479452  1523 tablet_bootstrap.cc:492] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:20.479569  1526 tablet_bootstrap.cc:492] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:20.480015  1523 ts_tablet_manager.cc:1403] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:13:20.453711  1524 tablet_bootstrap.cc:654] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.480198  1526 ts_tablet_manager.cc:1403] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.006s
I20260709 13:13:20.456718  1525 ts_tablet_manager.cc:1434] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:13:20.479384  1402 raft_consensus.cc:2468] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:20.483707  1525 tablet_bootstrap.cc:492] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:20.483443  1526 raft_consensus.cc:359] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.479921  1536 leader_election.cc:290] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:20.484130  1526 raft_consensus.cc:385] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.484445  1526 raft_consensus.cc:740] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.485117  1526 consensus_queue.cc:260] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.484867  1628 raft_consensus.cc:515] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.487550  1526 ts_tablet_manager.cc:1434] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:20.488152  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:20.488714  1526 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:20.488786  1328 raft_consensus.cc:3060] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.490454  1525 tablet_bootstrap.cc:654] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.494916  1367 leader_election.cc:304] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:20.495796  1765 raft_consensus.cc:2804] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.495594  1523 raft_consensus.cc:359] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.496162  1765 raft_consensus.cc:493] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.496637  1765 raft_consensus.cc:3060] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.497541  1526 tablet_bootstrap.cc:654] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.498081  1538 raft_consensus.cc:493] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.498574  1538 raft_consensus.cc:515] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.500660  1538 leader_election.cc:290] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:20.501518  1562 raft_consensus.cc:493] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.502144  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e6253c017e4c2aae09a2b069b190b7" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:20.502022  1562 raft_consensus.cc:515] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.503810  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e6253c017e4c2aae09a2b069b190b7" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:20.496282  1523 raft_consensus.cc:385] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.504810  1523 raft_consensus.cc:740] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.506079  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d272b7f7ba4b9aa358c6ab6b9c902c" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:20.506870  1523 consensus_queue.cc:260] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
W20260709 13:13:20.507838  1367 leader_election.cc:343] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.508497  1523 ts_tablet_manager.cc:1434] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:13:20.509460  1523 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
W20260709 13:13:20.511188  1295 leader_election.cc:343] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.511216  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d272b7f7ba4b9aa358c6ab6b9c902c" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:20.512646  1251 raft_consensus.cc:2468] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:20.504703  1254 raft_consensus.cc:2468] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:20.513010  1765 raft_consensus.cc:515] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.522171  1294 leader_election.cc:304] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:20.523357  1538 raft_consensus.cc:2804] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.504724  1562 leader_election.cc:290] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:20.523823  1538 raft_consensus.cc:493] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.524281  1538 raft_consensus.cc:3060] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.514048  1368 leader_election.cc:304] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:20.525969  1562 raft_consensus.cc:2804] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.526065  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:20.526703  1562 raft_consensus.cc:493] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.527201  1475 raft_consensus.cc:2393] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate 18c0de76f1804e98b0826423261536c9 in this term.
I20260709 13:13:20.527223  1562 raft_consensus.cc:3060] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.524307  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:20.450829  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:20.532932  1370 leader_election.cc:304] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:20.533870  1582 raft_consensus.cc:2749] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:20.537417  1538 raft_consensus.cc:515] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.426326  1153 catalog_manager.cc:5697] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.541993  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b7143fae804b6db2eb33c3cc276f23" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:20.546084  1402 raft_consensus.cc:2393] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 1: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:20.546348  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e6253c017e4c2aae09a2b069b190b7" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:20.547073  1254 raft_consensus.cc:3060] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.549809  1538 leader_election.cc:290] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:20.546372  1628 leader_election.cc:290] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:20.549968  1765 leader_election.cc:290] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:20.561247  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e6253c017e4c2aae09a2b069b190b7" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
W20260709 13:13:20.562739  1295 leader_election.cc:343] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.568819  1524 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:20.569047  1526 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:20.569490  1524 ts_tablet_manager.cc:1403] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.007s
I20260709 13:13:20.569607  1526 ts_tablet_manager.cc:1403] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.081s	user 0.034s	sys 0.012s
I20260709 13:13:20.570744  1328 raft_consensus.cc:2468] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:20.570583  1562 raft_consensus.cc:515] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.573745  1444 leader_election.cc:304] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:20.574954  1523 tablet_bootstrap.cc:654] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.575448  1524 raft_consensus.cc:359] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.576115  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d272b7f7ba4b9aa358c6ab6b9c902c" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:20.576418  1524 raft_consensus.cc:385] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.576753  1524 raft_consensus.cc:740] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
W20260709 13:13:20.577576  1367 leader_election.cc:343] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.578703  1525 tablet_bootstrap.cc:492] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:20.579303  1525 ts_tablet_manager.cc:1403] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.011s
I20260709 13:13:20.579531  1562 leader_election.cc:290] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:20.579435  1526 raft_consensus.cc:359] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.579825  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d272b7f7ba4b9aa358c6ab6b9c902c" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:20.580410  1251 raft_consensus.cc:3060] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.580458  1526 raft_consensus.cc:385] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.580889  1526 raft_consensus.cc:740] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.581950  1526 consensus_queue.cc:260] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.582234  1525 raft_consensus.cc:359] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.582849  1525 raft_consensus.cc:385] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.583127  1525 raft_consensus.cc:740] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.584141  1526 ts_tablet_manager.cc:1434] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:20.585108  1526 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:20.577677  1524 consensus_queue.cc:260] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.590021  1402 raft_consensus.cc:3060] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.591835  1524 ts_tablet_manager.cc:1434] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:20.593091  1524 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:20.599090  1582 raft_consensus.cc:493] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.599674  1582 raft_consensus.cc:515] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.600311  1526 tablet_bootstrap.cc:654] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.601140  1251 raft_consensus.cc:2468] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:20.601688  1583 consensus_queue.cc:1048] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.603874  1254 raft_consensus.cc:2468] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:20.604876  1524 tablet_bootstrap.cc:654] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.605000  1294 leader_election.cc:304] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:20.606266  1538 raft_consensus.cc:2804] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.606686  1538 raft_consensus.cc:697] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:20.607384  1538 consensus_queue.cc:237] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.607692  1368 leader_election.cc:304] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:20.583762  1525 consensus_queue.cc:260] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.608928  1536 raft_consensus.cc:2804] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.609598  1536 raft_consensus.cc:697] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:20.610666  1536 consensus_queue.cc:237] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.609231  1601 raft_consensus.cc:2804] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.612830  1601 raft_consensus.cc:697] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:20.613669  1601 consensus_queue.cc:237] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.616356  1525 ts_tablet_manager.cc:1434] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:13:20.617672  1525 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:20.622445  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:20.626953  1525 tablet_bootstrap.cc:654] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.630589  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:20.633664  1766 raft_consensus.cc:493] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.634166  1766 raft_consensus.cc:515] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.637260  1590 raft_consensus.cc:493] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.637944  1590 raft_consensus.cc:515] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.640070  1524 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:20.640502  1524 ts_tablet_manager.cc:1403] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 13:13:20.641947  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:20.642608  1254 raft_consensus.cc:2468] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:20.642728  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:20.643730  1294 leader_election.cc:304] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:20.644709  1650 raft_consensus.cc:2804] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:20.644811  1293 leader_election.cc:343] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.645148  1650 raft_consensus.cc:493] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.643159  1524 raft_consensus.cc:359] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.645898  1650 raft_consensus.cc:3060] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.646296  1524 raft_consensus.cc:385] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.646741  1524 raft_consensus.cc:740] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.647430  1524 consensus_queue.cc:260] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.648869  1524 ts_tablet_manager.cc:1434] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.003s
I20260709 13:13:20.649693  1524 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:20.650611  1525 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:20.651111  1525 ts_tablet_manager.cc:1403] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:13:20.651273  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dbc9ed002b4e458021f97d435e9fff" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:20.652196  1327 raft_consensus.cc:2468] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:20.654335  1525 raft_consensus.cc:359] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.655030  1525 raft_consensus.cc:385] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.655407  1524 tablet_bootstrap.cc:654] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.655350  1525 raft_consensus.cc:740] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.656407  1525 consensus_queue.cc:260] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.658699  1525 ts_tablet_manager.cc:1434] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:20.659665  1525 tablet_bootstrap.cc:492] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:20.659910  1368 leader_election.cc:304] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:20.660983  1583 raft_consensus.cc:493] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.661653  1583 raft_consensus.cc:515] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.666527  1525 tablet_bootstrap.cc:654] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.670578  1370 leader_election.cc:304] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:20.672230  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141e6a07df1a4244a64d1eb2bb0c66c9" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
W20260709 13:13:20.674538  1221 leader_election.cc:343] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.674778  1526 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:20.675262  1526 ts_tablet_manager.cc:1403] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.004s
I20260709 13:13:20.675335  1523 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:20.675812  1523 ts_tablet_manager.cc:1403] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.025s
I20260709 13:13:20.677984  1526 raft_consensus.cc:359] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.679857  1526 raft_consensus.cc:385] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.680164  1526 raft_consensus.cc:740] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.683597  1526 consensus_queue.cc:260] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.685905  1524 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:20.686540  1524 ts_tablet_manager.cc:1403] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.008s
I20260709 13:13:20.682022  1766 leader_election.cc:290] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:20.690637  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dbc9ed002b4e458021f97d435e9fff" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:20.691465  1475 raft_consensus.cc:2468] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:20.698050  1765 consensus_queue.cc:1048] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:20.699822  1766 raft_consensus.cc:2804] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.700486  1766 raft_consensus.cc:493] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.701017  1766 raft_consensus.cc:3060] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.640785  1590 leader_election.cc:290] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:20.708571  1582 leader_election.cc:290] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:20.709525  1582 consensus_queue.cc:1048] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.710915  1526 ts_tablet_manager.cc:1434] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:13:20.685808  1583 leader_election.cc:290] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:20.712047  1526 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:20.722596  1536 consensus_queue.cc:1048] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:20.728847  1293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 44091.7us
I20260709 13:13:20.737830  1536 consensus_queue.cc:1048] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:20.739231  1150 catalog_manager.cc:5697] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.741034  1650 raft_consensus.cc:515] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.758637  1523 raft_consensus.cc:359] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.760695  1523 raft_consensus.cc:385] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.760936  1523 raft_consensus.cc:740] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.761562  1523 consensus_queue.cc:260] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.763314  1524 raft_consensus.cc:359] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.763861  1524 raft_consensus.cc:385] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.764075  1524 raft_consensus.cc:740] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.771879  1538 raft_consensus.cc:493] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.772441  1538 raft_consensus.cc:515] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.775236  1523 ts_tablet_manager.cc:1434] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 13:13:20.775089  1524 consensus_queue.cc:260] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:20.776211  1523 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:20.786058  1650 leader_election.cc:290] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:20.780625  1537 raft_consensus.cc:2749] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:20.787695  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:20.788316  1254 raft_consensus.cc:3060] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.788717  1538 leader_election.cc:290] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:20.799091  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:20.799830  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0697a4a227684a69982f353a21f6f91c" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:20.782510  1370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 112036us
I20260709 13:13:20.808224  1254 raft_consensus.cc:2468] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:20.815724  1294 leader_election.cc:304] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:20.823251  1794 raft_consensus.cc:2804] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.823746  1794 raft_consensus.cc:697] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:20.824522  1794 consensus_queue.cc:237] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
W20260709 13:13:20.825852  1293 leader_election.cc:343] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:20.826799  1293 leader_election.cc:343] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.835132  1524 ts_tablet_manager.cc:1434] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.148s	user 0.003s	sys 0.005s
I20260709 13:13:20.833125  1153 catalog_manager.cc:5697] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.841996  1524 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:20.842844  1523 tablet_bootstrap.cc:654] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.843991  1149 catalog_manager.cc:5697] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:20.860333  1526 tablet_bootstrap.cc:654] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.866128  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141e6a07df1a4244a64d1eb2bb0c66c9" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:20.875392  1525 tablet_bootstrap.cc:492] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:20.875921  1525 ts_tablet_manager.cc:1403] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.216s	user 0.027s	sys 0.001s
I20260709 13:13:20.876619  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0697a4a227684a69982f353a21f6f91c" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:20.880597  1220 leader_election.cc:343] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.881050  1220 leader_election.cc:304] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:20.882561  1697 raft_consensus.cc:2749] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:20.884354  1295 leader_election.cc:343] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.884795  1295 leader_election.cc:304] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:20.895151  1525 raft_consensus.cc:359] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.895651  1525 raft_consensus.cc:385] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.895898  1525 raft_consensus.cc:740] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.898104  1766 raft_consensus.cc:515] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.902961  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dbc9ed002b4e458021f97d435e9fff" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:20.903551  1478 raft_consensus.cc:3060] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.903611  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dbc9ed002b4e458021f97d435e9fff" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:20.904404  1330 raft_consensus.cc:3060] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.906883  1712 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.907393  1712 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:20.909416  1712 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:20.910491  1525 consensus_queue.cc:260] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.911155  1766 leader_election.cc:290] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:20.912112  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:20.912952  1525 ts_tablet_manager.cc:1434] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:13:20.926556  1525 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:20.925251  1151 catalog_manager.cc:5697] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.899405  1794 raft_consensus.cc:2749] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:20.913606  1218 leader_election.cc:343] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:20.928902  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:20.937849  1330 raft_consensus.cc:2468] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:20.946158  1526 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:20.946727  1526 ts_tablet_manager.cc:1403] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.235s	user 0.012s	sys 0.000s
I20260709 13:13:20.948830  1478 raft_consensus.cc:2468] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:20.950440  1526 raft_consensus.cc:359] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.956091  1526 raft_consensus.cc:385] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.951592  1525 tablet_bootstrap.cc:654] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.953859  1370 leader_election.cc:304] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:20.943403  1327 raft_consensus.cc:2468] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:20.956516  1526 raft_consensus.cc:740] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:20.956949  1766 raft_consensus.cc:2804] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:20.958920  1766 raft_consensus.cc:697] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:20.959183  1221 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:20.960071  1564 raft_consensus.cc:2804] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:20.959860  1766 consensus_queue.cc:237] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:20.960500  1564 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.960925  1564 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:20.961470  1526 consensus_queue.cc:260] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:20.966176  1524 tablet_bootstrap.cc:654] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.968461  1526 ts_tablet_manager.cc:1434] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:13:20.973500  1526 tablet_bootstrap.cc:492] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:20.983208  1526 tablet_bootstrap.cc:654] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:20.987210  1524 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:20.988018  1524 ts_tablet_manager.cc:1403] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.005s
I20260709 13:13:20.992636  1712 consensus_queue.cc:1048] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:20.981751  1149 catalog_manager.cc:5697] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:20.998956  1523 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:20.999698  1523 ts_tablet_manager.cc:1403] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.224s	user 0.022s	sys 0.028s
I20260709 13:13:21.002532  1524 raft_consensus.cc:359] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.010489  1524 raft_consensus.cc:385] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:20.992156  1564 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.018776  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:21.019219  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:21.019804  1327 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:21.020251  1218 leader_election.cc:343] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.011777  1524 raft_consensus.cc:740] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.021450  1524 consensus_queue.cc:260] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.027249  1564 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:21.003631  1523 raft_consensus.cc:359] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.005149  1712 consensus_queue.cc:1048] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.028520  1523 raft_consensus.cc:385] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.028903  1523 raft_consensus.cc:740] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.029673  1523 consensus_queue.cc:260] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.034554  1327 raft_consensus.cc:2468] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:21.034853  1523 ts_tablet_manager.cc:1434] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.003s
I20260709 13:13:21.035981  1523 tablet_bootstrap.cc:492] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:21.036852  1525 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:21.037351  1525 ts_tablet_manager.cc:1403] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.028s
I20260709 13:13:21.037976  1536 raft_consensus.cc:493] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.038435  1536 raft_consensus.cc:515] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.039655  1221 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:21.040020  1525 raft_consensus.cc:359] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.040428  1536 leader_election.cc:290] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:21.040699  1525 raft_consensus.cc:385] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.040995  1712 raft_consensus.cc:2804] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.041599  1712 raft_consensus.cc:697] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:21.042315  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d272b7f7ba4b9aa358c6ab6b9c902c" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:21.043082  1251 raft_consensus.cc:2393] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 1: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:21.042543  1712 consensus_queue.cc:237] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.041023  1525 raft_consensus.cc:740] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.044016  1523 tablet_bootstrap.cc:654] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.044186  1525 consensus_queue.cc:260] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.045789  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d272b7f7ba4b9aa358c6ab6b9c902c" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:21.047300  1525 ts_tablet_manager.cc:1434] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:21.047420  1443 leader_election.cc:304] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:21.048244  1525 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:21.049019  1536 raft_consensus.cc:3060] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.058210  1525 tablet_bootstrap.cc:654] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.060247  1536 raft_consensus.cc:2749] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.035778  1524 ts_tablet_manager.cc:1434] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:13:21.064431  1523 tablet_bootstrap.cc:492] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:21.064972  1523 ts_tablet_manager.cc:1403] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.008s
I20260709 13:13:21.062594  1526 tablet_bootstrap.cc:492] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:21.066053  1526 ts_tablet_manager.cc:1403] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.001s
I20260709 13:13:21.067581  1524 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:21.068461  1523 raft_consensus.cc:359] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.069514  1523 raft_consensus.cc:385] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.069818  1523 raft_consensus.cc:740] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.070839  1523 consensus_queue.cc:260] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.079440  1523 ts_tablet_manager.cc:1434] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:13:21.080466  1523 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:21.088502  1523 tablet_bootstrap.cc:654] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.088505  1526 raft_consensus.cc:359] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.089540  1526 raft_consensus.cc:385] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.089852  1526 raft_consensus.cc:740] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.094216  1526 consensus_queue.cc:260] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.098750  1526 ts_tablet_manager.cc:1434] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:13:21.101573  1536 consensus_queue.cc:1048] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.101816  1524 tablet_bootstrap.cc:654] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.105446  1525 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:21.105913  1525 ts_tablet_manager.cc:1403] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.024s
I20260709 13:13:21.109169  1525 raft_consensus.cc:359] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.110014  1525 raft_consensus.cc:385] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.110270  1525 raft_consensus.cc:740] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.111263  1526 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:21.111017  1525 consensus_queue.cc:260] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.113683  1525 ts_tablet_manager.cc:1434] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:21.114852  1525 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:21.120862  1525 tablet_bootstrap.cc:654] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.124825  1537 raft_consensus.cc:493] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.125515  1537 raft_consensus.cc:515] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.130741  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecd149ab31945ab9517f3ab5061847d" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:21.131335  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecd149ab31945ab9517f3ab5061847d" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:21.131716  1251 raft_consensus.cc:2468] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:21.132040  1473 raft_consensus.cc:2468] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:21.131680  1525 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:21.132917  1525 ts_tablet_manager.cc:1403] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:13:21.133824  1368 leader_election.cc:304] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:21.135694  1525 raft_consensus.cc:359] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.136379  1525 raft_consensus.cc:385] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.136627  1525 raft_consensus.cc:740] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.136739  1801 raft_consensus.cc:2804] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.137136  1801 raft_consensus.cc:493] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.137478  1801 raft_consensus.cc:3060] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.137532  1525 consensus_queue.cc:260] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.138616  1536 raft_consensus.cc:493] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.138362  1153 catalog_manager.cc:5697] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.139109  1536 raft_consensus.cc:515] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.142457  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:21.143179  1251 raft_consensus.cc:2393] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 1: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:21.146592  1523 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:21.146899  1536 leader_election.cc:290] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:21.147114  1523 ts_tablet_manager.cc:1403] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.067s	user 0.029s	sys 0.020s
I20260709 13:13:21.149705  1537 leader_election.cc:290] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:21.150460  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:21.152828  1401 raft_consensus.cc:3060] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.154078  1444 leader_election.cc:304] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:21.155205  1536 raft_consensus.cc:3060] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.154927  1801 raft_consensus.cc:515] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.157398  1801 leader_election.cc:290] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:21.157617  1150 catalog_manager.cc:5697] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.157612  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecd149ab31945ab9517f3ab5061847d" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:21.161298  1478 raft_consensus.cc:3060] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.120862  1526 tablet_bootstrap.cc:654] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.161675  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecd149ab31945ab9517f3ab5061847d" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:21.162319  1251 raft_consensus.cc:3060] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.165908  1701 consensus_queue.cc:1048] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.167248  1524 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:21.167725  1524 ts_tablet_manager.cc:1403] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.000s
I20260709 13:13:21.171092  1524 raft_consensus.cc:359] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.171738  1524 raft_consensus.cc:385] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.172008  1524 raft_consensus.cc:740] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.174727  1524 consensus_queue.cc:260] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.181581  1524 ts_tablet_manager.cc:1434] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:13:21.182549  1524 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:21.182447  1251 raft_consensus.cc:2468] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:21.184799  1368 leader_election.cc:304] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:21.185844  1766 raft_consensus.cc:2804] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.186388  1766 raft_consensus.cc:697] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:21.184973  1701 raft_consensus.cc:493] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.189934  1701 raft_consensus.cc:515] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.193478  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0697a4a227684a69982f353a21f6f91c" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:21.194245  1402 raft_consensus.cc:2468] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:21.179886  1523 raft_consensus.cc:359] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.194801  1523 raft_consensus.cc:385] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.195123  1523 raft_consensus.cc:740] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.195725  1443 leader_election.cc:304] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:21.195899  1523 consensus_queue.cc:260] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.196827  1628 raft_consensus.cc:2804] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.197283  1628 raft_consensus.cc:493] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.197634  1628 raft_consensus.cc:3060] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.199050  1523 ts_tablet_manager.cc:1434] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.001s
I20260709 13:13:21.200069  1523 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:21.187323  1766 consensus_queue.cc:237] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.205801  1701 leader_election.cc:290] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.206810  1526 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:21.211021  1526 ts_tablet_manager.cc:1403] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.001s
I20260709 13:13:21.207077  1794 consensus_queue.cc:1048] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:13:21.207758  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0697a4a227684a69982f353a21f6f91c" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:21.214838  1327 raft_consensus.cc:2468] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:21.217386  1526 raft_consensus.cc:359] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.224493  1525 ts_tablet_manager.cc:1434] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 13:13:21.220866  1801 consensus_queue.cc:1048] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:21.223389  1794 consensus_queue.cc:1048] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:21.223884  1526 raft_consensus.cc:385] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.229882  1526 raft_consensus.cc:740] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.231021  1526 consensus_queue.cc:260] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.233019  1628 raft_consensus.cc:515] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.233773  1524 tablet_bootstrap.cc:654] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.237129  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0697a4a227684a69982f353a21f6f91c" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:21.237811  1327 raft_consensus.cc:3060] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.239120  1478 raft_consensus.cc:2468] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:21.240535  1526 ts_tablet_manager.cc:1434] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:13:21.241878  1526 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:21.242592  1536 raft_consensus.cc:2749] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.245981  1525 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:21.250900  1801 consensus_queue.cc:1048] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.252110  1628 leader_election.cc:290] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.247741  1327 raft_consensus.cc:2468] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:21.252704  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0697a4a227684a69982f353a21f6f91c" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:21.253867  1402 raft_consensus.cc:3060] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.254309  1444 leader_election.cc:304] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:21.262133  1536 raft_consensus.cc:2804] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.277129  1525 tablet_bootstrap.cc:654] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.284305  1523 tablet_bootstrap.cc:654] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.284551  1536 raft_consensus.cc:697] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:21.294713  1536 consensus_queue.cc:237] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.293908  1526 tablet_bootstrap.cc:654] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.292304  1712 raft_consensus.cc:493] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.303561  1524 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:21.301975  1564 raft_consensus.cc:493] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.308048  1564 raft_consensus.cc:515] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.308611  1524 ts_tablet_manager.cc:1403] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.009s
I20260709 13:13:21.310119  1564 leader_election.cc:290] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.312897  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:21.300002  1712 raft_consensus.cc:515] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.313476  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:21.314190  1330 raft_consensus.cc:2468] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
W20260709 13:13:21.314570  1220 leader_election.cc:343] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.315225  1712 leader_election.cc:290] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:21.314991  1151 catalog_manager.cc:5697] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.315953  1221 leader_election.cc:304] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:21.286562  1402 raft_consensus.cc:2468] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:21.317487  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:21.318516  1712 raft_consensus.cc:2804] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.319434  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:21.320649  1524 raft_consensus.cc:359] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.327224  1524 raft_consensus.cc:385] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.327672  1524 raft_consensus.cc:740] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.327747  1712 raft_consensus.cc:493] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.331300  1712 raft_consensus.cc:3060] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:21.332340  1221 leader_election.cc:343] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:21.338752  1218 leader_election.cc:343] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.339227  1218 leader_election.cc:304] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:21.340948  1583 raft_consensus.cc:2749] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.330104  1524 consensus_queue.cc:260] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.357890  1701 raft_consensus.cc:493] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.358428  1701 raft_consensus.cc:515] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.360481  1701 leader_election.cc:290] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:21.367381  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9058031903ea43fb9f534aa81f81ed7d" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:21.368081  1404 raft_consensus.cc:2468] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:21.369344  1443 leader_election.cc:304] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:21.372571  1794 raft_consensus.cc:493] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.373239  1794 raft_consensus.cc:515] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.373716  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9058031903ea43fb9f534aa81f81ed7d" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:21.374362  1254 raft_consensus.cc:2468] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:21.375553  1794 leader_election.cc:290] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.379307  1794 consensus_queue.cc:1048] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.379582  1628 raft_consensus.cc:2804] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.379707  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141e6a07df1a4244a64d1eb2bb0c66c9" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:21.380220  1628 raft_consensus.cc:493] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.380618  1628 raft_consensus.cc:3060] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.382597  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141e6a07df1a4244a64d1eb2bb0c66c9" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:21.383468  1254 raft_consensus.cc:2468] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
W20260709 13:13:21.385378  1295 leader_election.cc:343] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.393229  1524 ts_tablet_manager.cc:1434] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:13:21.397125  1525 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
W20260709 13:13:21.391431  1825 log.cc:927] Time spent T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:13:21.397594  1524 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:21.397660  1525 ts_tablet_manager.cc:1403] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.152s	user 0.018s	sys 0.016s
I20260709 13:13:21.405041  1526 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:21.406684  1526 ts_tablet_manager.cc:1403] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.165s	user 0.029s	sys 0.002s
I20260709 13:13:21.391615  1712 raft_consensus.cc:515] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.409209  1294 leader_election.cc:304] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:21.436550  1796 raft_consensus.cc:2804] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.443812  1796 raft_consensus.cc:493] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.444233  1796 raft_consensus.cc:3060] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.444351  1526 raft_consensus.cc:359] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.445199  1526 raft_consensus.cc:385] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.445502  1526 raft_consensus.cc:740] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.449199  1794 raft_consensus.cc:493] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.449683  1794 raft_consensus.cc:515] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.451699  1794 leader_election.cc:290] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:21.446187  1526 consensus_queue.cc:260] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.460103  1151 catalog_manager.cc:5697] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:21.466037  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e8d0036e5647809908799723c1a147" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:21.467382  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e8d0036e5647809908799723c1a147" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:21.471065  1525 raft_consensus.cc:359] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.471743  1525 raft_consensus.cc:385] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.472005  1525 raft_consensus.cc:740] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.472805  1525 consensus_queue.cc:260] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
W20260709 13:13:21.476874  1295 leader_election.cc:343] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.477535  1628 raft_consensus.cc:515] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.478714  1526 ts_tablet_manager.cc:1434] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:13:21.480929  1697 consensus_queue.cc:1048] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.484697  1650 consensus_queue.cc:1048] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.488734  1526 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:21.486095  1523 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
W20260709 13:13:21.468607  1831 log.cc:927] Time spent T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:21.490141  1523 ts_tablet_manager.cc:1403] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.290s	user 0.022s	sys 0.008s
I20260709 13:13:21.490525  1525 ts_tablet_manager.cc:1434] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.000s
I20260709 13:13:21.493942  1525 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:21.494956  1712 leader_election.cc:290] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.498659  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
W20260709 13:13:21.500612  1220 leader_election.cc:343] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:21.506783  1218 consensus_peers.cc:597] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c -> Peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Couldn't send request to peer 18c0de76f1804e98b0826423261536c9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.507344  1796 raft_consensus.cc:515] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.510634  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141e6a07df1a4244a64d1eb2bb0c66c9" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:21.512027  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141e6a07df1a4244a64d1eb2bb0c66c9" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:21.512655  1255 raft_consensus.cc:3060] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.513856  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:21.514441  1330 raft_consensus.cc:3060] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.515689  1525 tablet_bootstrap.cc:654] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:21.524945  1293 leader_election.cc:343] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.528424  1293 leader_election.cc:304] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:21.529134  1796 leader_election.cc:290] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.520121  1255 raft_consensus.cc:2468] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:21.530792  1526 tablet_bootstrap.cc:654] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.541292  1524 tablet_bootstrap.cc:654] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.538968  1794 raft_consensus.cc:2749] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.530911  1801 consensus_queue.cc:1048] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:13:21.545707  1294 leader_election.cc:304] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:21.547683  1794 raft_consensus.cc:2804] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.548154  1794 raft_consensus.cc:697] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:21.539698  1523 raft_consensus.cc:359] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.554718  1523 raft_consensus.cc:385] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.555109  1523 raft_consensus.cc:740] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.553428  1794 consensus_queue.cc:237] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.579386  1330 raft_consensus.cc:2468] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:21.582983  1523 consensus_queue.cc:260] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.586759  1402 raft_consensus.cc:3060] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.587934  1525 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:21.588516  1525 ts_tablet_manager.cc:1403] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.043s
I20260709 13:13:21.591466  1525 raft_consensus.cc:359] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.592190  1525 raft_consensus.cc:385] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.592525  1525 raft_consensus.cc:740] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.593446  1525 consensus_queue.cc:260] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.607012  1523 ts_tablet_manager.cc:1434] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.001s
I20260709 13:13:21.607865  1523 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:21.611159  1525 ts_tablet_manager.cc:1434] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:21.614434  1525 tablet_bootstrap.cc:492] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:21.600121  1221 leader_election.cc:304] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:21.622628  1712 raft_consensus.cc:2804] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.622880  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9058031903ea43fb9f534aa81f81ed7d" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:21.623116  1712 raft_consensus.cc:697] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:21.623517  1401 raft_consensus.cc:3060] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.624116  1712 consensus_queue.cc:237] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.625368  1526 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:21.625887  1526 ts_tablet_manager.cc:1403] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.006s
I20260709 13:13:21.629072  1628 leader_election.cc:290] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:21.634158  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9058031903ea43fb9f534aa81f81ed7d" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:21.634879  1251 raft_consensus.cc:3060] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.640803  1526 raft_consensus.cc:359] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.641579  1526 raft_consensus.cc:385] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.641849  1526 raft_consensus.cc:740] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
W20260709 13:13:21.617710  1294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 49911.1us
I20260709 13:13:21.653589  1537 consensus_queue.cc:1048] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.659200  1526 consensus_queue.cc:260] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.656728  1251 raft_consensus.cc:2468] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:21.679569  1526 ts_tablet_manager.cc:1434] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 13:13:21.680824  1526 tablet_bootstrap.cc:492] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:21.683709  1401 raft_consensus.cc:2468] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:21.685109  1537 consensus_queue.cc:1048] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.696821  1442 leader_election.cc:304] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:21.698565  1628 raft_consensus.cc:2804] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.699072  1402 raft_consensus.cc:2468] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:21.699088  1628 raft_consensus.cc:697] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:21.700645  1628 consensus_queue.cc:237] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:21.700742  1525 tablet_bootstrap.cc:654] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.703691  1523 tablet_bootstrap.cc:654] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:21.729066  1200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:21.737445  1524 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:21.737983  1524 ts_tablet_manager.cc:1403] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.344s	user 0.016s	sys 0.020s
I20260709 13:13:21.740028  1524 raft_consensus.cc:359] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.740545  1524 raft_consensus.cc:385] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.740779  1524 raft_consensus.cc:740] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.734572  1526 tablet_bootstrap.cc:654] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.741878  1841 raft_consensus.cc:493] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.742477  1841 raft_consensus.cc:515] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.746531  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc36900defe4c799e8a1639efcffd13" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:21.744886  1841 leader_election.cc:290] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.752200  1524 consensus_queue.cc:260] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.753125  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc36900defe4c799e8a1639efcffd13" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:21.754202  1841 raft_consensus.cc:493] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.753160  1255 raft_consensus.cc:2468] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
W20260709 13:13:21.756330  1295 leader_election.cc:343] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.759450  1294 leader_election.cc:304] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:21.760545  1838 raft_consensus.cc:2804] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.760901  1838 raft_consensus.cc:493] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.761226  1838 raft_consensus.cc:3060] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.761708  1524 ts_tablet_manager.cc:1434] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:13:21.762626  1524 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:21.756958  1841 raft_consensus.cc:515] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.774780  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:21.775455  1255 raft_consensus.cc:2468] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:21.776988  1294 leader_election.cc:304] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:21.777869  1794 raft_consensus.cc:2804] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:21.778232  1794 raft_consensus.cc:493] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.778699  1794 raft_consensus.cc:3060] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.778110  1150 catalog_manager.cc:5697] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.785782  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:21.786492  1476 raft_consensus.cc:2468] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:21.781507  1841 leader_election.cc:290] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:21.793514  1838 raft_consensus.cc:515] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.795666  1838 leader_election.cc:290] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.807453  1794 raft_consensus.cc:515] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.800549  1254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc36900defe4c799e8a1639efcffd13" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:21.829098  1801 consensus_queue.cc:1048] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.819336  1254 raft_consensus.cc:3060] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.840706  1701 consensus_queue.cc:1048] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:21.841879  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc36900defe4c799e8a1639efcffd13" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
W20260709 13:13:21.844635  1295 leader_election.cc:343] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.848461  1701 consensus_queue.cc:1048] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:21.872365  1794 leader_election.cc:290] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:21.873885  1523 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:21.874557  1523 ts_tablet_manager.cc:1403] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.267s	user 0.006s	sys 0.016s
I20260709 13:13:21.882721  1151 catalog_manager.cc:5697] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.886963  1525 tablet_bootstrap.cc:492] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:21.887487  1525 ts_tablet_manager.cc:1403] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.273s	user 0.042s	sys 0.047s
I20260709 13:13:21.887804  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:21.888504  1473 raft_consensus.cc:3060] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.890337  1536 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.890910  1536 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.894060  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:21.894485  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:21.894738  1255 raft_consensus.cc:3060] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:21.899019  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:21.890195  1525 raft_consensus.cc:359] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.903085  1444 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:21.903461  1525 raft_consensus.cc:385] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.904083  1525 raft_consensus.cc:740] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.904296  1628 raft_consensus.cc:2749] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:21.909070  1525 consensus_queue.cc:260] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.910051  1536 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:21.918514  1526 tablet_bootstrap.cc:492] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:21.919443  1526 ts_tablet_manager.cc:1403] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.239s	user 0.036s	sys 0.016s
I20260709 13:13:21.921422  1153 catalog_manager.cc:5697] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.920667  1523 raft_consensus.cc:359] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.924079  1523 raft_consensus.cc:385] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.924456  1523 raft_consensus.cc:740] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.928536  1525 ts_tablet_manager.cc:1434] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:13:21.930759  1525 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:21.931874  1524 tablet_bootstrap.cc:654] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.925312  1523 consensus_queue.cc:260] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.940925  1526 raft_consensus.cc:359] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.941656  1526 raft_consensus.cc:385] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:21.941922  1526 raft_consensus.cc:740] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:21.942739  1526 consensus_queue.cc:260] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.945168  1526 ts_tablet_manager.cc:1434] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:13:21.946094  1526 tablet_bootstrap.cc:492] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:21.946619  1473 raft_consensus.cc:2468] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:21.934618  1254 raft_consensus.cc:2468] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:21.954171  1536 raft_consensus.cc:493] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.954756  1536 raft_consensus.cc:515] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:21.955626  1523 ts_tablet_manager.cc:1434] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.002s
I20260709 13:13:21.954128  1293 leader_election.cc:304] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:21.951999  1526 tablet_bootstrap.cc:654] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.957129  1523 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:21.960011  1794 raft_consensus.cc:2804] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.969834  1294 leader_election.cc:304] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:21.970027  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e8d0036e5647809908799723c1a147" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:21.970641  1329 raft_consensus.cc:2468] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:21.971364  1841 raft_consensus.cc:2804] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:21.973801  1841 raft_consensus.cc:697] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:21.976334  1536 leader_election.cc:290] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:21.974714  1841 consensus_queue.cc:237] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:21.974995  1794 raft_consensus.cc:697] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:21.977919  1794 consensus_queue.cc:237] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:21.980235  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e8d0036e5647809908799723c1a147" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:21.983330  1443 leader_election.cc:343] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:21.965977  1255 raft_consensus.cc:2468] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:21.986874  1523 tablet_bootstrap.cc:654] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:21.999718  1525 tablet_bootstrap.cc:654] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.003152  1444 leader_election.cc:304] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:22.006209  1628 raft_consensus.cc:2804] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.006616  1628 raft_consensus.cc:493] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.006954  1628 raft_consensus.cc:3060] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.018313  1628 raft_consensus.cc:515] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.022210  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e8d0036e5647809908799723c1a147" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:22.022820  1327 raft_consensus.cc:3060] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.030155  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e8d0036e5647809908799723c1a147" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
W20260709 13:13:22.031471  1443 leader_election.cc:343] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.032204  1628 leader_election.cc:290] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:22.044191  1537 raft_consensus.cc:493] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.044741  1537 raft_consensus.cc:515] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.046831  1537 leader_election.cc:290] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:22.047495  1526 tablet_bootstrap.cc:492] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:22.047655  1473 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.047995  1526 ts_tablet_manager.cc:1403] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.010s
I20260709 13:13:22.048651  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc36900defe4c799e8a1639efcffd13" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:22.055764  1525 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:22.056289  1525 ts_tablet_manager.cc:1403] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.006s
I20260709 13:13:22.058930  1525 raft_consensus.cc:359] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.059589  1525 raft_consensus.cc:385] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.059839  1525 raft_consensus.cc:740] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.060082  1523 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:22.060559  1523 ts_tablet_manager.cc:1403] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.009s
I20260709 13:13:22.060475  1525 consensus_queue.cc:260] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.061422  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bc36900defe4c799e8a1639efcffd13" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:22.062199  1525 ts_tablet_manager.cc:1434] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:22.069824  1255 raft_consensus.cc:2393] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:22.070075  1525 tablet_bootstrap.cc:492] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:22.071427  1368 leader_election.cc:304] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:22.069983  1327 raft_consensus.cc:2468] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:22.073544  1537 raft_consensus.cc:3060] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.063089  1523 raft_consensus.cc:359] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.058781  1526 raft_consensus.cc:359] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.068105  1524 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:22.075656  1526 raft_consensus.cc:385] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.075912  1524 ts_tablet_manager.cc:1403] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.313s	user 0.010s	sys 0.011s
I20260709 13:13:22.076054  1523 raft_consensus.cc:385] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.076409  1523 raft_consensus.cc:740] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.077149  1523 consensus_queue.cc:260] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.078688  1523 ts_tablet_manager.cc:1434] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:13:22.079660  1523 tablet_bootstrap.cc:492] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:22.075973  1526 raft_consensus.cc:740] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.080675  1444 leader_election.cc:304] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:22.083354  1525 tablet_bootstrap.cc:654] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.084367  1526 consensus_queue.cc:260] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.086320  1526 ts_tablet_manager.cc:1434] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:13:22.088091  1523 tablet_bootstrap.cc:654] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.094120  1526 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:22.098446  1523 tablet_bootstrap.cc:492] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:22.099505  1153 catalog_manager.cc:5697] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.098975  1523 ts_tablet_manager.cc:1403] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:13:22.102329  1153 catalog_manager.cc:5697] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.104736  1523 raft_consensus.cc:359] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.105485  1523 raft_consensus.cc:385] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.106802  1523 raft_consensus.cc:740] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.107553  1523 consensus_queue.cc:260] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.078778  1524 raft_consensus.cc:359] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.108523  1525 tablet_bootstrap.cc:492] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:22.109019  1525 ts_tablet_manager.cc:1403] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.004s
I20260709 13:13:22.110034  1523 ts_tablet_manager.cc:1434] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:22.108556  1524 raft_consensus.cc:385] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.110934  1524 raft_consensus.cc:740] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.111282  1523 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:22.111577  1524 consensus_queue.cc:260] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.116954  1524 ts_tablet_manager.cc:1434] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:13:22.117861  1524 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:22.123991  1523 tablet_bootstrap.cc:654] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.112345  1537 raft_consensus.cc:2749] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:22.112499  1628 raft_consensus.cc:2804] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.129055  1628 raft_consensus.cc:697] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:22.129788  1525 raft_consensus.cc:359] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.133512  1525 raft_consensus.cc:385] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.133795  1525 raft_consensus.cc:740] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.129897  1628 consensus_queue.cc:237] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.133198  1526 tablet_bootstrap.cc:654] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.136523  1858 consensus_queue.cc:1048] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.141953  1402 raft_consensus.cc:3060] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.142757  1524 tablet_bootstrap.cc:654] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.150156  1583 consensus_queue.cc:1048] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.157303  1525 consensus_queue.cc:260] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.159708  1537 raft_consensus.cc:493] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.160216  1537 raft_consensus.cc:515] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.170651  1525 ts_tablet_manager.cc:1434] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:13:22.172003  1525 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:22.174207  1841 consensus_queue.cc:1048] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.175127  1153 catalog_manager.cc:5697] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.176230  1526 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:22.176875  1526 ts_tablet_manager.cc:1403] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.083s	user 0.006s	sys 0.005s
I20260709 13:13:22.183374  1526 raft_consensus.cc:359] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.184309  1526 raft_consensus.cc:385] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.184638  1526 raft_consensus.cc:740] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.185247  1841 consensus_queue.cc:1048] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.192258  1523 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:22.192867  1523 ts_tablet_manager.cc:1403] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.082s	user 0.032s	sys 0.017s
I20260709 13:13:22.194643  1526 consensus_queue.cc:260] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.197014  1526 ts_tablet_manager.cc:1434] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:13:22.197847  1525 tablet_bootstrap.cc:654] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.200862  1524 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:22.201488  1524 ts_tablet_manager.cc:1403] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.001s
I20260709 13:13:22.205608  1524 raft_consensus.cc:359] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.206614  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e8d0036e5647809908799723c1a147" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:22.207100  1524 raft_consensus.cc:385] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.207489  1327 raft_consensus.cc:2393] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate 18c0de76f1804e98b0826423261536c9 in this term.
I20260709 13:13:22.207566  1524 raft_consensus.cc:740] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.214874  1526 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:22.215165  1628 consensus_queue.cc:1048] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.217103  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e8d0036e5647809908799723c1a147" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:22.221782  1367 leader_election.cc:304] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:22.223153  1766 raft_consensus.cc:3060] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.217213  1524 consensus_queue.cc:260] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.218281  1523 raft_consensus.cc:359] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.229476  1523 raft_consensus.cc:385] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.229352  1628 raft_consensus.cc:493] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.230000  1523 raft_consensus.cc:740] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.230191  1628 raft_consensus.cc:515] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.233449  1628 leader_election.cc:290] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:22.234117  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9c856f42e4d8aabac8f485922bac4" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:22.234870  1327 raft_consensus.cc:2468] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:22.220044  1537 leader_election.cc:290] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:22.234400  1524 ts_tablet_manager.cc:1434] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:13:22.235608  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9c856f42e4d8aabac8f485922bac4" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:22.234983  1523 consensus_queue.cc:260] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
W20260709 13:13:22.237885  1443 leader_election.cc:343] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.238656  1524 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:22.238595  1444 leader_election.cc:304] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:22.238934  1766 raft_consensus.cc:2749] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:22.239190  1523 ts_tablet_manager.cc:1434] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:13:22.240600  1523 tablet_bootstrap.cc:492] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:22.241317  1628 raft_consensus.cc:2804] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.241847  1628 raft_consensus.cc:493] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.242296  1628 raft_consensus.cc:3060] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.246481  1524 tablet_bootstrap.cc:654] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.235045  1525 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:22.252631  1525 ts_tablet_manager.cc:1403] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.016s
I20260709 13:13:22.271266  1526 tablet_bootstrap.cc:654] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.268956  1628 raft_consensus.cc:515] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.276551  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9c856f42e4d8aabac8f485922bac4" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:22.298094  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b9c856f42e4d8aabac8f485922bac4" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
W20260709 13:13:22.299810  1443 leader_election.cc:343] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.295650  1327 raft_consensus.cc:3060] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.296186  1701 consensus_queue.cc:1048] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:13:22.304411  1523 tablet_bootstrap.cc:654] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.316352  1327 raft_consensus.cc:2468] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:22.319471  1444 leader_election.cc:304] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:22.284412  1628 leader_election.cc:290] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:22.323079  1878 raft_consensus.cc:2804] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.330334  1878 raft_consensus.cc:697] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:22.331277  1878 consensus_queue.cc:237] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.362074  1524 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:22.362617  1524 ts_tablet_manager.cc:1403] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.014s
I20260709 13:13:22.363119  1794 raft_consensus.cc:493] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.363895  1794 raft_consensus.cc:515] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.366783  1794 leader_election.cc:290] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:22.369798  1583 raft_consensus.cc:493] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.370452  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701a3f41583a49c69e65971c4f0fc271" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:22.370344  1583 raft_consensus.cc:515] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.372761  1524 raft_consensus.cc:359] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.375146  1524 raft_consensus.cc:385] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.375552  1524 raft_consensus.cc:740] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.372186  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701a3f41583a49c69e65971c4f0fc271" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:22.377058  1583 leader_election.cc:290] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:22.379523  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:22.346035  1766 raft_consensus.cc:493] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.380330  1766 raft_consensus.cc:515] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.383487  1525 raft_consensus.cc:359] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.384373  1525 raft_consensus.cc:385] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.384783  1525 raft_consensus.cc:740] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.384196  1524 consensus_queue.cc:260] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.387048  1524 ts_tablet_manager.cc:1434] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:13:22.386269  1525 consensus_queue.cc:260] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.390885  1525 ts_tablet_manager.cc:1434] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.000s
I20260709 13:13:22.391815  1525 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:22.398010  1524 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:22.389119  1403 raft_consensus.cc:2468] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:22.406435  1525 tablet_bootstrap.cc:654] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.407002  1523 tablet_bootstrap.cc:492] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
W20260709 13:13:22.382611  1293 leader_election.cc:343] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:22.408514  1295 leader_election.cc:343] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.407596  1523 ts_tablet_manager.cc:1403] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.167s	user 0.010s	sys 0.005s
I20260709 13:13:22.412002  1295 leader_election.cc:304] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:22.415127  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:22.418565  1220 leader_election.cc:304] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:22.423614  1583 raft_consensus.cc:2804] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.423974  1583 raft_consensus.cc:493] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.424297  1583 raft_consensus.cc:3060] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.416558  1845 raft_consensus.cc:2749] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:22.425213  1221 leader_election.cc:343] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.426697  1523 raft_consensus.cc:359] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.427707  1523 raft_consensus.cc:385] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.428074  1523 raft_consensus.cc:740] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.428186  1526 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:22.428784  1523 consensus_queue.cc:260] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.430985  1526 ts_tablet_manager.cc:1403] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.216s	user 0.041s	sys 0.023s
I20260709 13:13:22.434764  1766 leader_election.cc:290] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:22.418596  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:22.437018  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:22.437532  1526 raft_consensus.cc:359] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.442108  1526 raft_consensus.cc:385] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.442509  1526 raft_consensus.cc:740] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.446589  1524 tablet_bootstrap.cc:654] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.443140  1526 consensus_queue.cc:260] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.447808  1327 raft_consensus.cc:2468] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:22.449402  1370 leader_election.cc:304] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:22.456974  1523 ts_tablet_manager.cc:1434] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:13:22.458436  1523 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:22.466061  1583 raft_consensus.cc:515] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.467311  1255 raft_consensus.cc:2393] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate e89740c5a5de48fd875c8b628616334c in this term.
I20260709 13:13:22.469475  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:22.469806  1628 raft_consensus.cc:493] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.470063  1327 raft_consensus.cc:3060] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.470327  1628 raft_consensus.cc:515] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.470511  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:22.472366  1628 leader_election.cc:290] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:22.461344  1804 raft_consensus.cc:2804] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.474877  1804 raft_consensus.cc:493] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.475207  1804 raft_consensus.cc:3060] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.478500  1153 catalog_manager.cc:5697] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:22.481818  1526 ts_tablet_manager.cc:1434] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.004s
I20260709 13:13:22.482604  1526 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:22.482952  1327 raft_consensus.cc:2468] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:22.483320  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:22.484362  1221 leader_election.cc:304] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:22.485343  1858 raft_consensus.cc:2804] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.485888  1858 raft_consensus.cc:697] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:22.493754  1858 consensus_queue.cc:237] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.495493  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:22.496160  1255 raft_consensus.cc:2468] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:22.497126  1442 leader_election.cc:304] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:22.499365  1880 raft_consensus.cc:2804] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.499827  1880 raft_consensus.cc:493] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.500190  1794 consensus_queue.cc:1048] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.500205  1880 raft_consensus.cc:3060] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.507993  1804 raft_consensus.cc:515] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:22.515971  1524 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
W20260709 13:13:22.517571  1443 leader_election.cc:343] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.517776  1403 raft_consensus.cc:2393] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89740c5a5de48fd875c8b628616334c in current term 1: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:22.519297  1523 tablet_bootstrap.cc:654] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.521625  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:22.524911  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:22.468221  1583 leader_election.cc:290] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:22.525707  1327 raft_consensus.cc:2393] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate e89740c5a5de48fd875c8b628616334c in this term.
I20260709 13:13:22.527642  1524 ts_tablet_manager.cc:1403] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.140s	user 0.009s	sys 0.010s
I20260709 13:13:22.528244  1796 consensus_queue.cc:1048] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.531116  1370 leader_election.cc:304] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:22.526401  1804 leader_election.cc:290] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:22.543200  1525 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:22.543687  1525 ts_tablet_manager.cc:1403] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.152s	user 0.024s	sys 0.011s
I20260709 13:13:22.534725  1883 raft_consensus.cc:2749] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:22.552367  1524 raft_consensus.cc:359] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.555004  1524 raft_consensus.cc:385] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.555284  1524 raft_consensus.cc:740] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.555964  1524 consensus_queue.cc:260] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.558115  1524 ts_tablet_manager.cc:1434] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:13:22.558954  1524 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:22.564451  1523 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:22.564996  1523 ts_tablet_manager.cc:1403] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.005s
I20260709 13:13:22.582147  1524 tablet_bootstrap.cc:654] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.582320  1794 consensus_queue.cc:1048] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.588078  1880 raft_consensus.cc:515] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.595228  1796 consensus_queue.cc:1048] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.600253  1525 raft_consensus.cc:359] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.600879  1583 raft_consensus.cc:493] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.602312  1883 raft_consensus.cc:493] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.613961  1526 tablet_bootstrap.cc:654] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.615096  1525 raft_consensus.cc:385] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.616853  1525 raft_consensus.cc:740] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.617624  1525 consensus_queue.cc:260] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.617532  1883 raft_consensus.cc:515] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.631548  1525 ts_tablet_manager.cc:1434] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.001s
I20260709 13:13:22.632782  1883 leader_election.cc:290] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:22.632782  1525 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:22.634377  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701a3f41583a49c69e65971c4f0fc271" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:22.635025  1327 raft_consensus.cc:2468] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:22.643042  1841 raft_consensus.cc:493] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.643533  1841 raft_consensus.cc:515] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.644186  1525 tablet_bootstrap.cc:654] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.647270  1370 leader_election.cc:304] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:22.636034  1150 catalog_manager.cc:5697] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:22.655300  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701a3f41583a49c69e65971c4f0fc271" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:22.657819  1524 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:22.657879  1537 raft_consensus.cc:2804] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.658335  1537 raft_consensus.cc:493] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.658447  1524 ts_tablet_manager.cc:1403] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.019s
I20260709 13:13:22.658664  1537 raft_consensus.cc:3060] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.665298  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8ca76daab4ec193441ebe56431bfb" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:22.665096  1524 raft_consensus.cc:359] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.665918  1524 raft_consensus.cc:385] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.666209  1524 raft_consensus.cc:740] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.617058  1583 raft_consensus.cc:515] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.666890  1524 consensus_queue.cc:260] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.676931  1524 ts_tablet_manager.cc:1434] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:13:22.678086  1524 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
W20260709 13:13:22.678918  1293 leader_election.cc:343] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.681998  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:22.687290  1583 leader_election.cc:290] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:22.688000  1878 consensus_queue.cc:1048] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.688313  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:22.689011  1478 raft_consensus.cc:2468] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:22.690514  1218 leader_election.cc:304] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:22.696707  1537 raft_consensus.cc:515] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.698386  1841 leader_election.cc:290] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
W20260709 13:13:22.698773  1367 leader_election.cc:343] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.699126  1712 raft_consensus.cc:2804] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.699669  1712 raft_consensus.cc:493] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.700114  1712 raft_consensus.cc:3060] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.698423  1537 leader_election.cc:290] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:22.706245  1524 tablet_bootstrap.cc:654] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.723948  1523 raft_consensus.cc:359] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.724567  1523 raft_consensus.cc:385] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.724788  1523 raft_consensus.cc:740] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
W20260709 13:13:22.723891  1220 leader_election.cc:343] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.728528  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701a3f41583a49c69e65971c4f0fc271" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:22.729204  1329 raft_consensus.cc:3060] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.734167  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701a3f41583a49c69e65971c4f0fc271" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:22.736807  1525 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:22.738266  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8ca76daab4ec193441ebe56431bfb" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:22.738617  1251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:22.738926  1255 raft_consensus.cc:2468] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:22.739216  1251 raft_consensus.cc:3060] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.741209  1294 leader_election.cc:304] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:22.742558  1794 raft_consensus.cc:2804] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.742987  1794 raft_consensus.cc:493] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.743353  1794 raft_consensus.cc:3060] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.737334  1525 ts_tablet_manager.cc:1403] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.021s
I20260709 13:13:22.743520  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:22.725322  1880 leader_election.cc:290] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
W20260709 13:13:22.748441  1367 leader_election.cc:343] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:22.748898  1443 leader_election.cc:343] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.752254  1628 consensus_queue.cc:1048] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:22.756421  1525 raft_consensus.cc:359] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.756827  1329 raft_consensus.cc:2468] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:22.757229  1525 raft_consensus.cc:385] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:22.757596  1525 raft_consensus.cc:740] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:22.758071  1523 consensus_queue.cc:260] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.758657  1370 leader_election.cc:304] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:22.761340  1525 consensus_queue.cc:260] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.769109  1583 raft_consensus.cc:493] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.769595  1583 raft_consensus.cc:515] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.776621  1583 leader_election.cc:290] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:22.756364  1794 raft_consensus.cc:515] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.778645  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:22.779150  1794 leader_election.cc:290] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:22.782522  1251 raft_consensus.cc:2468] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:22.767397  1883 raft_consensus.cc:2804] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.782701  1523 ts_tablet_manager.cc:1434] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.217s	user 0.006s	sys 0.000s
I20260709 13:13:22.784762  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8ca76daab4ec193441ebe56431bfb" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:22.785944  1473 raft_consensus.cc:3060] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.783735  1883 raft_consensus.cc:697] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:22.786716  1523 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:22.787058  1883 consensus_queue.cc:237] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:22.783701  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8ca76daab4ec193441ebe56431bfb" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:22.789789  1253 raft_consensus.cc:3060] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.791061  1525 ts_tablet_manager.cc:1434] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:13:22.792114  1525 tablet_bootstrap.cc:492] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:22.783267  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:22.795789  1476 raft_consensus.cc:2468] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
W20260709 13:13:22.784338  1221 leader_election.cc:343] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.784428  1442 leader_election.cc:304] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:22.798022  1525 tablet_bootstrap.cc:654] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.797864  1218 leader_election.cc:304] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:22.799005  1701 raft_consensus.cc:2804] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.802320  1701 raft_consensus.cc:697] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:22.802405  1583 raft_consensus.cc:2804] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:22.802798  1583 raft_consensus.cc:493] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:22.803119  1583 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.803207  1701 consensus_queue.cc:237] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.793601  1523 tablet_bootstrap.cc:654] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:22.813663  1583 raft_consensus.cc:515] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.816883  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:22.817446  1478 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.817821  1583 leader_election.cc:290] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:22.817981  1253 raft_consensus.cc:2468] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:22.789227  1712 raft_consensus.cc:515] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.822475  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
W20260709 13:13:22.824021  1221 leader_election.cc:343] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:22.825472  1294 leader_election.cc:304] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:22.909375  1478 raft_consensus.cc:2468] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:22.910383  1218 leader_election.cc:304] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:22.915019  1794 raft_consensus.cc:2804] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.902024  1473 raft_consensus.cc:2468] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:22.916436  1858 raft_consensus.cc:2804] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:22.951325  1712 leader_election.cc:290] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:22.936582  1858 raft_consensus.cc:697] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:22.952801  1858 consensus_queue.cc:237] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:22.955446  1526 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:22.956137  1526 ts_tablet_manager.cc:1403] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.474s	user 0.010s	sys 0.011s
I20260709 13:13:22.960981  1537 raft_consensus.cc:493] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.961513  1537 raft_consensus.cc:515] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:22.970530  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:22.971160  1477 raft_consensus.cc:3060] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:22.975539  1524 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:22.976040  1524 ts_tablet_manager.cc:1403] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.298s	user 0.012s	sys 0.023s
I20260709 13:13:22.988034  1537 leader_election.cc:290] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:23.006536  1524 raft_consensus.cc:359] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.007535  1524 raft_consensus.cc:385] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.007862  1524 raft_consensus.cc:740] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.008682  1524 consensus_queue.cc:260] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.011178  1525 tablet_bootstrap.cc:492] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:23.011680  1525 ts_tablet_manager.cc:1403] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.220s	user 0.036s	sys 0.043s
I20260709 13:13:23.022501  1526 raft_consensus.cc:359] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.023286  1526 raft_consensus.cc:385] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.023558  1526 raft_consensus.cc:740] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.024917  1526 consensus_queue.cc:260] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.026119  1523 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:23.026633  1523 ts_tablet_manager.cc:1403] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.003s
I20260709 13:13:23.027189  1526 ts_tablet_manager.cc:1434] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:13:23.028141  1526 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:22.999846  1794 raft_consensus.cc:697] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:23.031626  1524 ts_tablet_manager.cc:1434] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:13:23.032496  1523 raft_consensus.cc:359] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.034595  1523 raft_consensus.cc:385] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.035156  1524 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:23.034921  1523 raft_consensus.cc:740] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.034855  1794 consensus_queue.cc:237] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.036065  1523 consensus_queue.cc:260] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:23.038025  1443 consensus_peers.cc:597] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.038312  1523 ts_tablet_manager.cc:1434] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:23.039523  1523 tablet_bootstrap.cc:492] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
W20260709 13:13:23.049973  1218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 69535.2us
I20260709 13:13:23.051896  1524 tablet_bootstrap.cc:654] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.053715  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:23.059110  1907 consensus_queue.cc:1048] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:23.065972  1200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:23.067575  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:23.076092  1402 raft_consensus.cc:3060] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.085938  1525 raft_consensus.cc:359] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.089221  1525 raft_consensus.cc:385] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.099274  1525 raft_consensus.cc:740] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.097767  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:23.100276  1253 raft_consensus.cc:2393] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 1: Already voted for candidate e89740c5a5de48fd875c8b628616334c in this term.
I20260709 13:13:23.100168  1525 consensus_queue.cc:260] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.092018  1477 raft_consensus.cc:2468] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:23.103525  1525 ts_tablet_manager.cc:1434] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.092s	user 0.004s	sys 0.002s
I20260709 13:13:23.106606  1525 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:23.126111  1153 catalog_manager.cc:5697] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.129390  1523 tablet_bootstrap.cc:654] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.139385  1712 consensus_queue.cc:1048] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:23.143036  1218 leader_election.cc:304] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:23.153105  1368 leader_election.cc:304] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
W20260709 13:13:23.154896  1293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 78360.4us
I20260709 13:13:23.153982  1905 raft_consensus.cc:2804] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:23.170751  1905 raft_consensus.cc:697] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:23.170876  1583 consensus_queue.cc:1048] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:23.171665  1905 consensus_queue.cc:237] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.175196  1152 catalog_manager.cc:5697] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.178280  1526 tablet_bootstrap.cc:654] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.189311  1628 raft_consensus.cc:493] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.189842  1628 raft_consensus.cc:515] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.192163  1628 leader_election.cc:290] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:23.195361  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701a3f41583a49c69e65971c4f0fc271" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:23.196323  1149 catalog_manager.cc:5697] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.199385  1402 raft_consensus.cc:2468] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:23.207492  1523 tablet_bootstrap.cc:492] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:23.208034  1523 ts_tablet_manager.cc:1403] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.169s	user 0.006s	sys 0.008s
I20260709 13:13:23.209527  1326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701a3f41583a49c69e65971c4f0fc271" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:23.210369  1326 raft_consensus.cc:2393] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 1: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:23.202497  1884 raft_consensus.cc:2749] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:23.213140  1444 leader_election.cc:304] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:23.217098  1525 tablet_bootstrap.cc:654] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.222864  1628 raft_consensus.cc:3060] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.210868  1523 raft_consensus.cc:359] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.223742  1523 raft_consensus.cc:385] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.224190  1523 raft_consensus.cc:740] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.225204  1523 consensus_queue.cc:260] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.232486  1523 ts_tablet_manager.cc:1434] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:13:23.234472  1628 raft_consensus.cc:2749] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:23.239497  1526 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:23.240227  1526 ts_tablet_manager.cc:1403] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.212s	user 0.011s	sys 0.003s
I20260709 13:13:23.248435  1523 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:23.251466  1524 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:23.252029  1524 ts_tablet_manager.cc:1403] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.217s	user 0.014s	sys 0.002s
I20260709 13:13:23.252317  1583 raft_consensus.cc:493] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.252835  1583 raft_consensus.cc:515] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.254940  1583 leader_election.cc:290] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:23.255465  1524 raft_consensus.cc:359] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.256493  1524 raft_consensus.cc:385] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.256816  1524 raft_consensus.cc:740] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.243240  1526 raft_consensus.cc:359] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:23.257622  1526 raft_consensus.cc:385] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.257957  1526 raft_consensus.cc:740] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.258730  1526 consensus_queue.cc:260] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:23.260334  1153 catalog_manager.cc:5697] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.251696  1907 consensus_queue.cc:1048] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:23.259603  1524 consensus_queue.cc:260] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.267390  1151 catalog_manager.cc:5697] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.268567  1526 ts_tablet_manager.cc:1434] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:13:23.297988  1526 tablet_bootstrap.cc:492] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:23.267481  1524 ts_tablet_manager.cc:1434] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:13:23.302168  1524 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:23.307761  1524 tablet_bootstrap.cc:654] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.269392  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed66ef7a02f46b699f94f562b334afd" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:23.280723  1525 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:23.286721  1884 consensus_queue.cc:1048] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:23.292712  1402 raft_consensus.cc:3060] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.268847  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed66ef7a02f46b699f94f562b334afd" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:23.323514  1218 leader_election.cc:343] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:23.326372  1526 tablet_bootstrap.cc:654] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.335932  1907 consensus_queue.cc:1048] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:23.337728  1220 leader_election.cc:343] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:23.338213  1220 leader_election.cc:304] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:23.340837  1697 raft_consensus.cc:2749] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:23.365877  1858 consensus_queue.cc:1048] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:23.371933  1525 ts_tablet_manager.cc:1403] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.266s	user 0.016s	sys 0.006s
I20260709 13:13:23.372958  1583 raft_consensus.cc:493] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.373010  1326 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.373543  1583 raft_consensus.cc:515] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.383354  1523 tablet_bootstrap.cc:654] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.399415  1524 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:23.400136  1524 ts_tablet_manager.cc:1403] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.036s
I20260709 13:13:23.403352  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541fd181a6934377a1d38c9dc9db98a1" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:23.404629  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541fd181a6934377a1d38c9dc9db98a1" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:23.405264  1218 leader_election.cc:343] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:23.407016  1220 leader_election.cc:343] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:23.407601  1220 leader_election.cc:304] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:23.410884  1858 raft_consensus.cc:2749] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:23.395402  1583 leader_election.cc:290] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:23.415875  1583 consensus_queue.cc:1048] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:23.418164  1524 raft_consensus.cc:359] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:23.419128  1524 raft_consensus.cc:385] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.419447  1524 raft_consensus.cc:740] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.422107  1524 consensus_queue.cc:260] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:23.419843  1884 consensus_queue.cc:1048] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:23.438367  1524 ts_tablet_manager.cc:1434] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:13:23.443456  1524 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:23.457836  1525 raft_consensus.cc:359] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.466435  1525 raft_consensus.cc:385] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.467634  1526 tablet_bootstrap.cc:492] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:23.468494  1526 ts_tablet_manager.cc:1403] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.171s	user 0.010s	sys 0.037s
I20260709 13:13:23.467020  1525 raft_consensus.cc:740] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.477864  1525 consensus_queue.cc:260] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.473805  1526 raft_consensus.cc:359] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.491917  1525 ts_tablet_manager.cc:1434] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.001s
I20260709 13:13:23.497377  1526 raft_consensus.cc:385] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.497721  1526 raft_consensus.cc:740] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.498440  1526 consensus_queue.cc:260] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.490655  1524 tablet_bootstrap.cc:654] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.498054  1525 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:23.501755  1918 raft_consensus.cc:493] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.502218  1918 raft_consensus.cc:515] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.511241  1526 ts_tablet_manager.cc:1434] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:13:23.512269  1526 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f: Bootstrap starting.
I20260709 13:13:23.512130  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6958d3ba5e114d41a6b80c1c57ac0026" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:23.513192  1404 raft_consensus.cc:3060] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:23.513396  1295 leader_election.cc:343] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:23.515529  1918 leader_election.cc:290] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:23.517781  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6958d3ba5e114d41a6b80c1c57ac0026" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:23.521319  1525 tablet_bootstrap.cc:654] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.521677  1526 tablet_bootstrap.cc:654] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:23.521346  1293 leader_election.cc:343] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:23.522737  1293 leader_election.cc:304] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:23.524283  1908 raft_consensus.cc:2749] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:23.536059  1523 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:23.536572  1523 ts_tablet_manager.cc:1403] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.288s	user 0.013s	sys 0.004s
I20260709 13:13:23.537410  1526 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f: No bootstrap required, opened a new log
I20260709 13:13:23.537869  1526 ts_tablet_manager.cc:1403] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.010s
I20260709 13:13:23.540419  1526 raft_consensus.cc:359] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.541055  1526 raft_consensus.cc:385] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.541435  1526 raft_consensus.cc:740] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.542197  1526 consensus_queue.cc:260] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.545162  1526 ts_tablet_manager.cc:1434] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:13:23.546541  1524 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: No bootstrap required, opened a new log
I20260709 13:13:23.546996  1524 ts_tablet_manager.cc:1403] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.001s
I20260709 13:13:23.542374  1523 raft_consensus.cc:359] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.553277  1523 raft_consensus.cc:385] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.553674  1523 raft_consensus.cc:740] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.560891  1523 consensus_queue.cc:260] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.560937  1918 consensus_queue.cc:1048] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:23.577971  1905 consensus_queue.cc:1048] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:23.549445  1524 raft_consensus.cc:359] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.580945  1524 raft_consensus.cc:385] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.581274  1524 raft_consensus.cc:740] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.582212  1523 ts_tablet_manager.cc:1434] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.005s
I20260709 13:13:23.583186  1523 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:23.585487  1525 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:23.585328  1524 consensus_queue.cc:260] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.585947  1525 ts_tablet_manager.cc:1403] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.022s
W20260709 13:13:23.641471  1444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 53562.5us
I20260709 13:13:23.643258  1525 raft_consensus.cc:359] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.654346  1525 raft_consensus.cc:385] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.655194  1525 raft_consensus.cc:740] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.659186  1919 raft_consensus.cc:493] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.659713  1919 raft_consensus.cc:515] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:23.661808  1919 leader_election.cc:290] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:23.662544  1523 tablet_bootstrap.cc:654] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.665271  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbe7a061fdd480e9dbf9bd9ec64cdd9" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:23.665957  1253 raft_consensus.cc:2468] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 0.
I20260709 13:13:23.667299  1294 leader_election.cc:304] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:23.668919  1841 raft_consensus.cc:2804] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:23.669386  1841 raft_consensus.cc:493] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.669798  1841 raft_consensus.cc:3060] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.672109  1524 ts_tablet_manager.cc:1434] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.000s
I20260709 13:13:23.672942  1525 consensus_queue.cc:260] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.674582  1909 consensus_queue.cc:1048] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:23.675209  1525 ts_tablet_manager.cc:1434] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.084s	user 0.012s	sys 0.004s
I20260709 13:13:23.676172  1525 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:23.688915  1913 raft_consensus.cc:493] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.689477  1913 raft_consensus.cc:515] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.691563  1913 leader_election.cc:290] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:23.686290  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbe7a061fdd480e9dbf9bd9ec64cdd9" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:23.692063  1841 raft_consensus.cc:515] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
W20260709 13:13:23.699915  1295 leader_election.cc:343] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:23.702525  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:23.703369  1330 raft_consensus.cc:2468] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 0.
I20260709 13:13:23.697000  1913 consensus_queue.cc:1048] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:13:23.711374  1525 tablet_bootstrap.cc:654] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.721688  1841 leader_election.cc:290] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:23.726611  1523 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:23.727141  1523 ts_tablet_manager.cc:1403] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.144s	user 0.011s	sys 0.001s
I20260709 13:13:23.727327  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:23.728030  1221 leader_election.cc:304] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:23.730403  1523 raft_consensus.cc:359] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:23.731067  1523 raft_consensus.cc:385] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.731323  1523 raft_consensus.cc:740] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.733453  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbe7a061fdd480e9dbf9bd9ec64cdd9" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:23.734771  1905 raft_consensus.cc:2804] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:23.735209  1905 raft_consensus.cc:493] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.735612  1905 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.731935  1523 consensus_queue.cc:260] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:23.736258  1402 raft_consensus.cc:3060] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.746048  1905 raft_consensus.cc:515] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.752630  1402 raft_consensus.cc:2468] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:23.753970  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:23.754743  1330 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.759752  1905 leader_election.cc:290] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:23.760545  1295 leader_election.cc:304] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:23.761951  1908 raft_consensus.cc:2804] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:23.762569  1908 raft_consensus.cc:697] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
W20260709 13:13:23.746078  1218 leader_election.cc:343] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:23.763469  1908 consensus_queue.cc:237] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:23.765996  1523 ts_tablet_manager.cc:1434] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.002s
I20260709 13:13:23.769398  1525 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:23.777982  1523 tablet_bootstrap.cc:492] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:23.778661  1525 ts_tablet_manager.cc:1403] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.005s
I20260709 13:13:23.787837  1525 raft_consensus.cc:359] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.788590  1525 raft_consensus.cc:385] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.788921  1525 raft_consensus.cc:740] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.789640  1525 consensus_queue.cc:260] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.773378  1330 raft_consensus.cc:2468] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:23.793612  1525 ts_tablet_manager.cc:1434] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:13:23.790552  1218 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 44508.7us
I20260709 13:13:23.795792  1628 raft_consensus.cc:493] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.796422  1152 catalog_manager.cc:5697] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 0 to 1, leader changed from <none> to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 1 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.797039  1221 leader_election.cc:304] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:23.797426  1628 raft_consensus.cc:515] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.798683  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbe7a061fdd480e9dbf9bd9ec64cdd9" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:23.799266  1253 raft_consensus.cc:3060] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.803817  1858 raft_consensus.cc:2804] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:23.804327  1858 raft_consensus.cc:697] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:23.806236  1628 leader_election.cc:290] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:23.807487  1858 consensus_queue.cc:237] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:23.810002  1253 raft_consensus.cc:2468] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:23.811467  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:23.815174  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:23.815673  1330 raft_consensus.cc:2393] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 1: Already voted for candidate e89740c5a5de48fd875c8b628616334c in this term.
I20260709 13:13:23.816215  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:23.814534  1525 tablet_bootstrap.cc:492] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9: Bootstrap starting.
I20260709 13:13:23.819411  1477 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.826400  1477 raft_consensus.cc:2468] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 1.
I20260709 13:13:23.827239  1523 tablet_bootstrap.cc:654] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.820834  1444 leader_election.cc:304] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:23.829955  1907 raft_consensus.cc:2749] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:23.826601  1525 tablet_bootstrap.cc:654] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.831843  1153 catalog_manager.cc:5697] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 0 to 1, leader changed from <none> to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 1 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.839421  1523 tablet_bootstrap.cc:492] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:23.839880  1523 ts_tablet_manager.cc:1403] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.001s
I20260709 13:13:23.842698  1628 raft_consensus.cc:493] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.843170  1628 raft_consensus.cc:515] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.843299  1523 raft_consensus.cc:359] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.844216  1523 raft_consensus.cc:385] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.844558  1523 raft_consensus.cc:740] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.847918  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed66ef7a02f46b699f94f562b334afd" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:23.848001  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed66ef7a02f46b699f94f562b334afd" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:23.848660  1255 raft_consensus.cc:2468] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:23.848757  1404 raft_consensus.cc:2468] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:23.845067  1628 leader_election.cc:290] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:23.850143  1525 tablet_bootstrap.cc:492] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9: No bootstrap required, opened a new log
I20260709 13:13:23.850116  1442 leader_election.cc:304] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:23.850744  1525 ts_tablet_manager.cc:1403] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:13:23.851523  1907 raft_consensus.cc:2804] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:23.845232  1523 consensus_queue.cc:260] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.851930  1907 raft_consensus.cc:493] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.852387  1907 raft_consensus.cc:3060] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.853504  1525 raft_consensus.cc:359] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.854159  1525 raft_consensus.cc:385] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.854451  1525 raft_consensus.cc:740] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.855105  1525 consensus_queue.cc:260] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:23.857604  1525 ts_tablet_manager.cc:1434] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:23.859752  1907 raft_consensus.cc:515] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.860285  1523 ts_tablet_manager.cc:1434] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:23.861261  1523 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3: Bootstrap starting.
I20260709 13:13:23.862239  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed66ef7a02f46b699f94f562b334afd" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:23.862533  1907 leader_election.cc:290] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:23.862743  1404 raft_consensus.cc:3060] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.862754  1255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed66ef7a02f46b699f94f562b334afd" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:23.863444  1255 raft_consensus.cc:3060] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.869902  1255 raft_consensus.cc:2468] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:23.870424  1404 raft_consensus.cc:2468] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:23.871083  1442 leader_election.cc:304] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:23.872082  1907 raft_consensus.cc:2804] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:23.872524  1907 raft_consensus.cc:697] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:23.873428  1907 consensus_queue.cc:237] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.879045  1523 tablet_bootstrap.cc:654] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.884770  1523 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3: No bootstrap required, opened a new log
I20260709 13:13:23.885216  1523 ts_tablet_manager.cc:1403] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:13:23.885504  1151 catalog_manager.cc:5697] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:23.887727  1523 raft_consensus.cc:359] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.888409  1523 raft_consensus.cc:385] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.888657  1523 raft_consensus.cc:740] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.889281  1523 consensus_queue.cc:260] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:23.894148  1523 ts_tablet_manager.cc:1434] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:24.055045  1801 raft_consensus.cc:493] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.056581  1801 raft_consensus.cc:515] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:24.063248  1801 leader_election.cc:290] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:24.064373  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6958d3ba5e114d41a6b80c1c57ac0026" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:24.065660  1330 raft_consensus.cc:2468] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:24.069006  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6958d3ba5e114d41a6b80c1c57ac0026" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:24.070008  1477 raft_consensus.cc:2468] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 0.
I20260709 13:13:24.071616  1367 leader_election.cc:304] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:24.072541  1801 raft_consensus.cc:2804] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:24.072970  1801 raft_consensus.cc:493] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.074141  1801 raft_consensus.cc:3060] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.085278  1955 raft_consensus.cc:493] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.086156  1955 raft_consensus.cc:515] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:24.089715  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541fd181a6934377a1d38c9dc9db98a1" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:24.089558  1801 raft_consensus.cc:515] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:24.090591  1404 raft_consensus.cc:2468] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:24.091975  1443 leader_election.cc:304] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:24.093390  1907 raft_consensus.cc:2804] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:24.093782  1907 raft_consensus.cc:493] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.094105  1907 raft_consensus.cc:3060] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.094055  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6958d3ba5e114d41a6b80c1c57ac0026" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:24.094121  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541fd181a6934377a1d38c9dc9db98a1" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:24.098166  1330 raft_consensus.cc:3060] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.098444  1253 raft_consensus.cc:2468] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 0.
I20260709 13:13:24.092366  1955 leader_election.cc:290] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:24.104876  1801 leader_election.cc:290] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:24.107165  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6958d3ba5e114d41a6b80c1c57ac0026" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:24.107969  1473 raft_consensus.cc:3060] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.114136  1330 raft_consensus.cc:2468] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:24.115953  1370 leader_election.cc:304] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:24.120154  1801 raft_consensus.cc:2804] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:24.122031  1801 raft_consensus.cc:697] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:24.123641  1473 raft_consensus.cc:2468] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:24.124006  1801 consensus_queue.cc:237] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:24.142052  1907 raft_consensus.cc:515] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:24.143121  1153 catalog_manager.cc:5697] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.148402  1253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541fd181a6934377a1d38c9dc9db98a1" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:24.148438  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541fd181a6934377a1d38c9dc9db98a1" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:24.149272  1253 raft_consensus.cc:3060] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.149372  1404 raft_consensus.cc:3060] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.160096  1404 raft_consensus.cc:2468] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:24.164779  1794 consensus_queue.cc:1048] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:24.165140  1443 leader_election.cc:304] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:24.166143  1955 raft_consensus.cc:2804] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:24.166673  1955 raft_consensus.cc:697] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:24.167780  1955 consensus_queue.cc:237] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:24.173233  1907 leader_election.cc:290] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 1 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:24.183781  1253 raft_consensus.cc:2468] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:24.227550  1794 consensus_queue.cc:1048] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:24.224764  1153 catalog_manager.cc:5697] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 1 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.275218  1955 consensus_queue.cc:1048] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:24.290299  1628 consensus_queue.cc:1048] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:24.332921  1905 consensus_queue.cc:1048] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:24.345212  1697 consensus_queue.cc:1048] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:24.538842  1801 consensus_queue.cc:1048] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:24.552232  1801 consensus_queue.cc:1048] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:24.648036  1628 consensus_queue.cc:1048] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:24.658327  1968 consensus_queue.cc:1048] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:25.757750 23430 tablet_server.cc:179] TabletServer@127.22.225.129:0 shutting down...
W20260709 13:13:25.791198  1294 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:25.794710  1294 consensus_peers.cc:597] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.795411  1294 consensus_peers.cc:597] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.806527  1294 consensus_peers.cc:597] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.825035  1442 consensus_peers.cc:597] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.832758 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:25.833608 23430 tablet_replica.cc:333] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.834352 23430 raft_consensus.cc:2243] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.834838 23430 raft_consensus.cc:2272] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.837150 23430 tablet_replica.cc:333] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.837694 23430 raft_consensus.cc:2243] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.838096 23430 raft_consensus.cc:2272] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.840024 23430 tablet_replica.cc:333] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.840642 23430 raft_consensus.cc:2243] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.841657 23430 raft_consensus.cc:2272] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.844484 23430 tablet_replica.cc:333] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.845338 23430 raft_consensus.cc:2243] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.846143 23430 raft_consensus.cc:2272] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.850512 23430 tablet_replica.cc:333] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.851291 23430 raft_consensus.cc:2243] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.851919 23430 raft_consensus.cc:2272] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.854660 23430 tablet_replica.cc:333] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.855432 23430 raft_consensus.cc:2243] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.856478 23430 raft_consensus.cc:2272] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.859650 23430 tablet_replica.cc:333] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.860641 23430 raft_consensus.cc:2243] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.861894 23430 raft_consensus.cc:2272] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:25.863554  1368 consensus_peers.cc:597] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.865429  1442 consensus_peers.cc:597] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.865834 23430 tablet_replica.cc:333] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.866693 23430 raft_consensus.cc:2243] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.867291 23430 raft_consensus.cc:2272] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.870443 23430 tablet_replica.cc:333] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.871081 23430 raft_consensus.cc:2243] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.871584 23430 raft_consensus.cc:2272] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.874066 23430 tablet_replica.cc:333] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.874825 23430 raft_consensus.cc:2243] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.875953 23430 raft_consensus.cc:2272] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.879603 23430 tablet_replica.cc:333] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
W20260709 13:13:25.880645  1442 consensus_peers.cc:597] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.880649 23430 raft_consensus.cc:2243] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:25.881385  1442 consensus_peers.cc:597] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.881966 23430 raft_consensus.cc:2272] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.884238 23430 tablet_replica.cc:333] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.884845 23430 raft_consensus.cc:2243] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.885771 23430 raft_consensus.cc:2272] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.888046 23430 tablet_replica.cc:333] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.888720 23430 raft_consensus.cc:2243] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.889257 23430 raft_consensus.cc:2272] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.891422 23430 tablet_replica.cc:333] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.892093 23430 raft_consensus.cc:2243] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.893303 23430 raft_consensus.cc:2272] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.896634 23430 tablet_replica.cc:333] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.897421 23430 raft_consensus.cc:2243] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.897966 23430 raft_consensus.cc:2272] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.900286 23430 tablet_replica.cc:333] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.900858 23430 raft_consensus.cc:2243] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.901729 23430 raft_consensus.cc:2272] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.904728 23430 tablet_replica.cc:333] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.905530 23430 raft_consensus.cc:2243] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.906616 23430 raft_consensus.cc:2272] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.909581 23430 tablet_replica.cc:333] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.910164 23430 raft_consensus.cc:2243] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.910980 23430 raft_consensus.cc:2272] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.914031 23430 tablet_replica.cc:333] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
W20260709 13:13:25.914789  1368 consensus_peers.cc:597] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.914845 23430 raft_consensus.cc:2243] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.915817 23430 raft_consensus.cc:2272] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.918534 23430 tablet_replica.cc:333] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.919227 23430 raft_consensus.cc:2243] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.919703 23430 raft_consensus.cc:2272] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.922740 23430 tablet_replica.cc:333] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.923467 23430 raft_consensus.cc:2243] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.924036 23430 raft_consensus.cc:2272] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.926961 23430 tablet_replica.cc:333] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.927724 23430 raft_consensus.cc:2243] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.928344 23430 raft_consensus.cc:2272] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.932085 23430 tablet_replica.cc:333] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.932632 23430 raft_consensus.cc:2243] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.933600 23430 raft_consensus.cc:2272] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.935830 23430 tablet_replica.cc:333] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.936498 23430 raft_consensus.cc:2243] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.936980 23430 raft_consensus.cc:2272] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.939580 23430 tablet_replica.cc:333] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.940158 23430 raft_consensus.cc:2243] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.940599 23430 raft_consensus.cc:2272] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.943183 23430 tablet_replica.cc:333] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
W20260709 13:13:25.943608  1294 consensus_peers.cc:597] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.943984 23430 raft_consensus.cc:2243] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.944705 23430 raft_consensus.cc:2272] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.947667 23430 tablet_replica.cc:333] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.948396 23430 raft_consensus.cc:2243] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.949445 23430 raft_consensus.cc:2272] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.952430 23430 tablet_replica.cc:333] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.953215 23430 raft_consensus.cc:2243] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.953748 23430 raft_consensus.cc:2272] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.956274 23430 tablet_replica.cc:333] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.956907 23430 raft_consensus.cc:2243] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.957335 23430 raft_consensus.cc:2272] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.960023 23430 tablet_replica.cc:333] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.960799 23430 raft_consensus.cc:2243] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:25.960822  1294 consensus_peers.cc:597] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.961735 23430 raft_consensus.cc:2272] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.963696 23430 tablet_replica.cc:333] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.964217 23430 raft_consensus.cc:2243] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.964952 23430 raft_consensus.cc:2272] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.966969 23430 tablet_replica.cc:333] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.967614 23430 raft_consensus.cc:2243] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.968001 23430 raft_consensus.cc:2272] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.969905 23430 tablet_replica.cc:333] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.970400 23430 raft_consensus.cc:2243] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.970805 23430 raft_consensus.cc:2272] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.972707 23430 tablet_replica.cc:333] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.973373 23430 raft_consensus.cc:2243] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.974257 23430 raft_consensus.cc:2272] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.976649 23430 tablet_replica.cc:333] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.977187 23430 raft_consensus.cc:2243] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.977923 23430 raft_consensus.cc:2272] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.980001 23430 tablet_replica.cc:333] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.980499 23430 raft_consensus.cc:2243] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.980967 23430 raft_consensus.cc:2272] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.983059 23430 tablet_replica.cc:333] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.983703 23430 raft_consensus.cc:2243] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.984185 23430 raft_consensus.cc:2272] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.986789 23430 tablet_replica.cc:333] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.987382 23430 raft_consensus.cc:2243] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.988189 23430 raft_consensus.cc:2272] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.990183 23430 tablet_replica.cc:333] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.990746 23430 raft_consensus.cc:2243] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.991129 23430 raft_consensus.cc:2272] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.993014 23430 tablet_replica.cc:333] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.993588 23430 raft_consensus.cc:2243] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.994079 23430 raft_consensus.cc:2272] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.996856 23430 tablet_replica.cc:333] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:25.997432 23430 raft_consensus.cc:2243] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:25.997479  1368 consensus_peers.cc:597] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.998304 23430 raft_consensus.cc:2272] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.000581 23430 tablet_replica.cc:333] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:26.001279 23430 raft_consensus.cc:2243] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.001772 23430 raft_consensus.cc:2272] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.002739  1442 consensus_peers.cc:597] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.004103 23430 tablet_replica.cc:333] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:26.004733 23430 raft_consensus.cc:2243] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.005455 23430 raft_consensus.cc:2272] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.007257 23430 tablet_replica.cc:333] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:26.007660 23430 raft_consensus.cc:2243] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:26.008033 23430 raft_consensus.cc:2272] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:26.009871 23430 tablet_replica.cc:333] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: stopping tablet replica
I20260709 13:13:26.010272 23430 raft_consensus.cc:2243] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:26.010958 23430 raft_consensus.cc:2272] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:26.020892  1368 consensus_peers.cc:597] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.048159  1294 consensus_peers.cc:597] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.049223  1368 consensus_peers.cc:597] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.053536  1368 consensus_peers.cc:597] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.068806  1442 consensus_peers.cc:597] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.089987 23430 tablet_server.cc:196] TabletServer@127.22.225.129:0 shutdown complete.
W20260709 13:13:26.140882  1368 consensus_peers.cc:597] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.145099  1368 consensus_peers.cc:597] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.175913  1294 consensus_peers.cc:597] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.182816  1294 consensus_peers.cc:597] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.183815 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:26.188241  1368 consensus_peers.cc:597] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.199434  1294 consensus_peers.cc:597] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:26.207705  1980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:26.208081  1982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.211365 23430 server_base.cc:1061] running on GCE node
W20260709 13:13:26.211918  1984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:26.215334 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:26.215631 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:26.215880 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602806215860 us; error 0 us; skew 500 ppm
I20260709 13:13:26.216655 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:26.227139 23430 webserver.cc:533] Webserver started at http://127.22.225.129:38085/ using document root <none> and password file <none>
I20260709 13:13:26.227885 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:26.228168 23430 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:13:26.229638  1294 consensus_peers.cc:597] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.232563 23430 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:13:26.240515  1991 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:26.241405 23430 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:13:26.241796 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "e89740c5a5de48fd875c8b628616334c"
format_stamp: "Formatted at 2026-07-09 13:13:14 on dist-test-slave-fx0m"
I20260709 13:13:26.242317 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:13:26.256884  1368 consensus_peers.cc:597] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.267791 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:26.269593 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:26.271123 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:26.278671  1998 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:13:26.525874 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:13:26.526173 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.251s	user 0.004s	sys 0.008s
I20260709 13:13:26.526461 23430 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:13:26.530686  1998 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.543247  1998 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.544015  1998 tablet_bootstrap.cc:492] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.544603  1998 ts_tablet_manager.cc:1403] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:13:26.546500  1998 raft_consensus.cc:359] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.547019  1998 raft_consensus.cc:740] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.547552  1998 consensus_queue.cc:260] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.549599  1998 ts_tablet_manager.cc:1434] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:26.550209  1998 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.564953  1998 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.565910  1998 tablet_bootstrap.cc:492] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.566901  1998 ts_tablet_manager.cc:1403] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:13:26.569319  1998 raft_consensus.cc:359] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.570008  1998 raft_consensus.cc:740] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.570798  1998 consensus_queue.cc:260] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.572649  1998 ts_tablet_manager.cc:1434] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:26.573477  1998 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.586846  1998 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.587785  1998 tablet_bootstrap.cc:492] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.588501  1998 ts_tablet_manager.cc:1403] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:13:26.591197  1998 raft_consensus.cc:359] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.591928  1998 raft_consensus.cc:740] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.592600  1998 consensus_queue.cc:260] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.594704  1998 ts_tablet_manager.cc:1434] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:26.595638  1998 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.632913  1998 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.633728  1998 tablet_bootstrap.cc:492] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.634238  1998 ts_tablet_manager.cc:1403] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.016s
I20260709 13:13:26.636680  1998 raft_consensus.cc:359] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:26.637398  1998 raft_consensus.cc:740] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.638232  1998 consensus_queue.cc:260] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:26.640184  1998 ts_tablet_manager.cc:1434] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:26.640910  1998 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.671145  1998 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.672117  1998 tablet_bootstrap.cc:492] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.672756  1998 ts_tablet_manager.cc:1403] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.008s
I20260709 13:13:26.675228  1998 raft_consensus.cc:359] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:26.675918  1998 raft_consensus.cc:740] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.676574  1998 consensus_queue.cc:260] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:26.678534  1998 ts_tablet_manager.cc:1434] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:26.679308  1998 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.695322  1998 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.696224  1998 tablet_bootstrap.cc:492] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.696887  1998 ts_tablet_manager.cc:1403] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:13:26.698958  1998 raft_consensus.cc:359] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.699446  1998 raft_consensus.cc:740] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.700053  1998 consensus_queue.cc:260] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.701648  1998 ts_tablet_manager.cc:1434] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:26.702260  1998 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.715065  1998 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.715993  1998 tablet_bootstrap.cc:492] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.716634  1998 ts_tablet_manager.cc:1403] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:13:26.718815  1998 raft_consensus.cc:359] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.719448  1998 raft_consensus.cc:740] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.720032  1998 consensus_queue.cc:260] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.721535  1998 ts_tablet_manager.cc:1434] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:26.722101  1998 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.734054  1998 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.734931  1998 tablet_bootstrap.cc:492] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.735513  1998 ts_tablet_manager.cc:1403] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:13:26.737818  1998 raft_consensus.cc:359] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.738476  1998 raft_consensus.cc:740] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.739146  1998 consensus_queue.cc:260] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.740887  1998 ts_tablet_manager.cc:1434] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:26.741642  1998 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.753945  1998 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.754819  1998 tablet_bootstrap.cc:492] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.755331  1998 ts_tablet_manager.cc:1403] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:13:26.757718  1998 raft_consensus.cc:359] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.758363  1998 raft_consensus.cc:740] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.758998  1998 consensus_queue.cc:260] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.760591  1998 ts_tablet_manager.cc:1434] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:13:26.761245  1998 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.774586  1998 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.775465  1998 tablet_bootstrap.cc:492] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.776084  1998 ts_tablet_manager.cc:1403] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:13:26.778393  1998 raft_consensus.cc:359] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:26.779068  1998 raft_consensus.cc:740] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.779106 23430 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:13:26.779659 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.253s	user 0.196s	sys 0.013s
I20260709 13:13:26.779788  1998 consensus_queue.cc:260] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:26.781823  1998 ts_tablet_manager.cc:1434] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:26.782599  1998 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.795414  1998 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.796461  1998 tablet_bootstrap.cc:492] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.797150  1998 ts_tablet_manager.cc:1403] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:13:26.799806  1998 raft_consensus.cc:359] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.800565  1998 raft_consensus.cc:740] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.801478  1998 consensus_queue.cc:260] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.803771  1998 ts_tablet_manager.cc:1434] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:26.804628  1998 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.820186  1998 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.821128  1998 tablet_bootstrap.cc:492] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.821672  1998 ts_tablet_manager.cc:1403] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:13:26.823421  1998 raft_consensus.cc:359] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:26.823941  1998 raft_consensus.cc:740] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.824539  1998 consensus_queue.cc:260] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:26.826341  1998 ts_tablet_manager.cc:1434] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:26.827133  1998 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.843291  1998 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.844339  1998 tablet_bootstrap.cc:492] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.845113  1998 ts_tablet_manager.cc:1403] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:13:26.847499  1998 raft_consensus.cc:359] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.848229  1998 raft_consensus.cc:740] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.848785  1907 raft_consensus.cc:493] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:26.849368  1907 raft_consensus.cc:515] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.851356  1907 leader_election.cc:290] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:26.852969  1998 consensus_queue.cc:260] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.854913  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:26.855195  1998 ts_tablet_manager.cc:1434] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:13:26.856010  1998 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
W20260709 13:13:26.859501  1442 leader_election.cc:336] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:26.860037  1442 leader_election.cc:304] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:26.861637  1968 raft_consensus.cc:2749] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.870287  1998 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.871922  1998 tablet_bootstrap.cc:492] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.872617  1998 ts_tablet_manager.cc:1403] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:13:26.874958  1998 raft_consensus.cc:359] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.875460  1998 raft_consensus.cc:740] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.876123  1998 consensus_queue.cc:260] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.877915  1998 ts_tablet_manager.cc:1434] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:13:26.878563  1998 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.891780  1998 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.892781  1998 tablet_bootstrap.cc:492] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.893525  1998 ts_tablet_manager.cc:1403] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:13:26.895442 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:44541
I20260709 13:13:26.895793  2071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:44541 every 8 connection(s)
I20260709 13:13:26.895488  1998 raft_consensus.cc:359] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.896497  1998 raft_consensus.cc:740] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.897183  1998 consensus_queue.cc:260] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.898718  1998 ts_tablet_manager.cc:1434] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:26.899361  1998 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.918665  1998 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:26.919699  1998 tablet_bootstrap.cc:492] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:26.920413  1998 ts_tablet_manager.cc:1403] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.012s
I20260709 13:13:26.922225  1972 raft_consensus.cc:493] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:26.922812  1972 raft_consensus.cc:515] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.923313  1998 raft_consensus.cc:359] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.924065  1998 raft_consensus.cc:740] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:26.924862  1998 consensus_queue.cc:260] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.927426  1998 ts_tablet_manager.cc:1434] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:26.928442  1998 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:26.931871  2072 heartbeater.cc:344] Connected to a master server at 127.22.225.190:33845
I20260709 13:13:26.932344  2072 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:26.927060  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:26.933395  2072 heartbeater.cc:507] Master 127.22.225.190:33845 requested a full tablet report, sending...
I20260709 13:13:26.935560  1794 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:26.936055  1794 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.936811  1968 raft_consensus.cc:493] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:26.937366  1968 raft_consensus.cc:515] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.940266  1968 leader_election.cc:290] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:26.940878  1907 raft_consensus.cc:493] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:26.941360  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:26.941450  1907 raft_consensus.cc:515] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.943758  1907 leader_election.cc:290] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:26.944502  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:26.947598  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:26.948393  1403 raft_consensus.cc:2468] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:26.950516  1443 leader_election.cc:304] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:26.951736  1794 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:26.952430  1907 raft_consensus.cc:2804] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.954089  1907 raft_consensus.cc:493] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:26.955828  1907 raft_consensus.cc:3060] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.925276  1972 leader_election.cc:290] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:26.969338  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:26.970372  2044 raft_consensus.cc:2468] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:26.972021  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:26.975492  1968 raft_consensus.cc:493] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:26.976150  1442 leader_election.cc:304] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:26.976265  1968 raft_consensus.cc:515] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:26.978920  1986 raft_consensus.cc:2804] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.979452  1986 raft_consensus.cc:493] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:26.979925  1986 raft_consensus.cc:3060] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.981386  1968 leader_election.cc:290] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:26.982653  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:26.989678  1907 raft_consensus.cc:515] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:26.997843  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:26.998638  1403 raft_consensus.cc:3060] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.001727  1845 raft_consensus.cc:493] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.002555  1845 raft_consensus.cc:515] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.006494  1845 leader_election.cc:290] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.007789  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.011065  1403 raft_consensus.cc:2468] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:27.012823  1443 leader_election.cc:304] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:27.016410  1968 raft_consensus.cc:2804] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.023593  1907 leader_election.cc:290] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.028406  1972 raft_consensus.cc:493] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.029214  1972 raft_consensus.cc:515] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.032737  2081 raft_consensus.cc:493] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.033398  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:27.035943  1972 leader_election.cc:290] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
W20260709 13:13:27.033907  1442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 57891.6us
I20260709 13:13:27.039479  1794 raft_consensus.cc:493] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.070873  1794 raft_consensus.cc:515] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.043488  1845 raft_consensus.cc:493] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.077764  1845 raft_consensus.cc:515] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.079164  1794 leader_election.cc:290] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
W20260709 13:13:27.080529  1442 leader_election.cc:343] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.085811  1986 raft_consensus.cc:515] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.087481  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.088809  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.088060  1907 raft_consensus.cc:493] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.090152  1845 leader_election.cc:290] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.089766  1907 raft_consensus.cc:515] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.093634  2083 raft_consensus.cc:493] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.094209  2083 raft_consensus.cc:515] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.094556  1986 leader_election.cc:290] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.096287  2083 leader_election.cc:290] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.097170  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.099464  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.100242  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.102645  1326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:27.111444  1907 leader_election.cc:290] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.115160  1326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.115847  1326 raft_consensus.cc:2468] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:27.118396  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.119130  2045 raft_consensus.cc:2468] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.119937  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.120290  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.120682  2041 raft_consensus.cc:2468] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.120988  2044 raft_consensus.cc:2468] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.122146  1444 leader_election.cc:304] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:27.122768  1845 raft_consensus.cc:493] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.123288  1986 raft_consensus.cc:2804] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.123534  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.073588  2081 raft_consensus.cc:515] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.118549  1998 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.127657  1294 leader_election.cc:304] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:27.130867  1794 raft_consensus.cc:2804] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.131232  1794 raft_consensus.cc:493] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.131664  1794 raft_consensus.cc:3060] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.131253  1294 leader_election.cc:304] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:27.132658  1294 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
I20260709 13:13:27.137559  1981 raft_consensus.cc:2804] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.127468  1968 raft_consensus.cc:697] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:27.128990  1986 raft_consensus.cc:493] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.137936  1981 raft_consensus.cc:493] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.148615  1998 tablet_bootstrap.cc:492] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:27.151081  1998 ts_tablet_manager.cc:1403] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.223s	user 0.069s	sys 0.081s
I20260709 13:13:27.129670  1845 raft_consensus.cc:515] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.145257  1972 raft_consensus.cc:493] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.145545  1986 raft_consensus.cc:3060] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.154513  1294 leader_election.cc:343] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:27.156788  1442 leader_election.cc:343] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.157312  1442 leader_election.cc:304] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.157495  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.157835  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.158411  2041 raft_consensus.cc:3060] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.159869  1943 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.160363  1943 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.151734  1981 raft_consensus.cc:3060] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.161543  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:27.158438  1442 leader_election.cc:343] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.164144  1998 raft_consensus.cc:359] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.164839  1998 raft_consensus.cc:740] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.165544  1999 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.166018  1972 raft_consensus.cc:515] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.168931  1998 consensus_queue.cc:260] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.172271  1998 ts_tablet_manager.cc:1434] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 13:13:27.173174  1998 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:27.174513  1845 leader_election.cc:290] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.175065  1845 raft_consensus.cc:2804] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.175400  1845 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.175766  1845 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.172088  1442 leader_election.cc:343] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.177147  1999 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.177335  1442 leader_election.cc:304] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.178269  2083 raft_consensus.cc:2749] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:27.179522  1442 leader_election.cc:343] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.181687  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:27.183090  1442 leader_election.cc:343] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.155781  1294 leader_election.cc:304] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.167888  1794 raft_consensus.cc:515] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.171132  1907 raft_consensus.cc:2749] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.192581  1794 leader_election.cc:290] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.196748  1794 raft_consensus.cc:2749] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:27.198447  1295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:34201, user_credentials={real_user=slave}} blocked reactor thread for 64610.2us
W20260709 13:13:27.205147  1294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 50683.4us
I20260709 13:13:27.192430  1981 raft_consensus.cc:515] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.214038  1794 raft_consensus.cc:493] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.215894  1152 ts_manager.cc:194] Re-registered known tserver with Master: e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.217495  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.218853  1999 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.219617  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.220227  2044 raft_consensus.cc:3060] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.220691  1981 leader_election.cc:290] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.224577  1794 raft_consensus.cc:515] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.228526  2090 raft_consensus.cc:493] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.229287  2090 raft_consensus.cc:515] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.231395  2090 leader_election.cc:290] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.214211  2041 raft_consensus.cc:2468] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
W20260709 13:13:27.245428  1294 leader_election.cc:343] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.243485  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.245467  1794 leader_election.cc:290] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.249307  1981 raft_consensus.cc:493] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.249491  2082 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.249926  1981 raft_consensus.cc:515] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.251377  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.252120  1981 leader_election.cc:290] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.255023  1972 leader_election.cc:290] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.255029  1444 leader_election.cc:304] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.255570  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:27.256206  1907 raft_consensus.cc:2749] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.256245  1473 raft_consensus.cc:2468] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:27.249995  2082 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
W20260709 13:13:27.257694  1294 leader_election.cc:343] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.259052  2082 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.259090  1367 leader_election.cc:304] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:27.260726  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.261564  2045 raft_consensus.cc:2468] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:27.262270  1943 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.262607  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.204756  1968 consensus_queue.cc:237] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.263885  1442 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:27.262857  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.265434  2040 raft_consensus.cc:2393] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbe86acd78454edfa45d9c095875cb2f in current term 2: Already voted for candidate 18c0de76f1804e98b0826423261536c9 in this term.
I20260709 13:13:27.260803  2089 raft_consensus.cc:2804] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.266417  2089 raft_consensus.cc:493] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.266805  2089 raft_consensus.cc:3060] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.268085  2082 raft_consensus.cc:2804] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.268464  2082 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.268797  2082 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.275036  1943 raft_consensus.cc:493] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.275594  1943 raft_consensus.cc:515] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.277460  2081 leader_election.cc:290] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.255194  2039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.278790  2039 raft_consensus.cc:3060] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.296597  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:27.304665  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88e6c0060fd34173a140bae79fbc0ed6" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:27.306239  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:27.307132  1794 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.308179  1477 raft_consensus.cc:2393] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbe86acd78454edfa45d9c095875cb2f in current term 2: Already voted for candidate 18c0de76f1804e98b0826423261536c9 in this term.
I20260709 13:13:27.307608  1794 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.311398  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:27.313802  2087 raft_consensus.cc:493] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.314329  2087 raft_consensus.cc:515] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.316330  2087 leader_election.cc:290] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.317040  1326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.317914  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.318265  1326 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
W20260709 13:13:27.320071  1294 leader_election.cc:343] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.309499  2083 raft_consensus.cc:493] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.321297  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.321599  2083 raft_consensus.cc:515] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.321887  1403 raft_consensus.cc:2468] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.323606  2083 leader_election.cc:290] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.324204  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.324775  1403 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:27.326211  1443 leader_election.cc:304] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:27.327034  2083 raft_consensus.cc:2804] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.327384  2083 raft_consensus.cc:493] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.327739  2083 raft_consensus.cc:3060] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.303452  2088 raft_consensus.cc:493] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.329830  2088 raft_consensus.cc:515] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.331933  2088 leader_election.cc:290] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.300385  2081 raft_consensus.cc:493] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.332715  2081 raft_consensus.cc:515] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.334666  2081 leader_election.cc:290] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.317018  1943 leader_election.cc:290] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.311707  1442 leader_election.cc:304] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:27.338798  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.339475  2040 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:27.340461  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.341176  1326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.341810  1326 raft_consensus.cc:2468] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:27.342640  2091 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.343066  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.343200  2044 raft_consensus.cc:2468] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:27.338798  2093 raft_consensus.cc:493] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.345175  2093 raft_consensus.cc:515] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.347273  2093 leader_election.cc:290] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.340473  1794 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.351022  1794 raft_consensus.cc:493] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.351430  1794 raft_consensus.cc:515] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
W20260709 13:13:27.353008  1294 leader_election.cc:343] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.353114  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.336310  2083 raft_consensus.cc:515] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.357975  1295 leader_election.cc:304] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.358023  1294 leader_election.cc:304] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:27.359524  1907 raft_consensus.cc:2804] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.364936  2093 raft_consensus.cc:2804] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.368750  1968 raft_consensus.cc:493] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.375120  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.375681  1968 raft_consensus.cc:515] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.378139  1968 leader_election.cc:290] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.379957  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.365059  2087 raft_consensus.cc:2804] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.393671  2087 raft_consensus.cc:697] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:27.394690  2087 consensus_queue.cc:237] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.343217  2091 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.395740  1403 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.382447  1370 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:27.402544  1370 leader_election.cc:304] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:27.373965  1943 raft_consensus.cc:493] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.381875  2093 raft_consensus.cc:493] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.408962  1295 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
W20260709 13:13:27.394408  1442 leader_election.cc:343] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:27.410789  1294 leader_election.cc:343] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.400131  2096 raft_consensus.cc:493] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.418427  1330 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:27.419577  1325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.420096  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.420226  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.378674  1986 raft_consensus.cc:515] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.399983  2088 raft_consensus.cc:493] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.407603  1999 raft_consensus.cc:2804] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.421720  1794 leader_election.cc:290] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.406351  2086 raft_consensus.cc:2804] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.412554  2093 raft_consensus.cc:3060] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.424844  1327 raft_consensus.cc:2468] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:27.411741  1943 raft_consensus.cc:515] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.434134  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.434782  2042 raft_consensus.cc:2468] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:27.435038  1943 leader_election.cc:290] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.412694  1907 raft_consensus.cc:697] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:27.413962  2085 raft_consensus.cc:2804] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.436836  1442 leader_election.cc:304] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:27.437216  2085 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.437655  2085 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.437742  1444 leader_election.cc:304] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.438648  1986 leader_election.cc:290] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.439428  1473 raft_consensus.cc:2393] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbe86acd78454edfa45d9c095875cb2f in current term 2: Already voted for candidate 18c0de76f1804e98b0826423261536c9 in this term.
I20260709 13:13:27.439294  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.441039  2038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.441771  2036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.423595  2096 raft_consensus.cc:515] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.444358  1907 consensus_queue.cc:237] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.450866  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.457957  1403 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.422034  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96429c9f69a43a898faaab20a0cc9d8" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.445847  1152 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60122
I20260709 13:13:27.473456  1295 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:27.431895  1999 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.431057  2086 raft_consensus.cc:493] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.450528  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.448560  2092 raft_consensus.cc:493] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.429768  2039 raft_consensus.cc:2468] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:27.446458  2096 leader_election.cc:290] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.484949  1294 leader_election.cc:304] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:27.450982  2083 leader_election.cc:290] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.449738  2091 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.471320  1986 raft_consensus.cc:493] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.470449  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.431627  2088 raft_consensus.cc:515] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.447875  2085 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.479314  2081 raft_consensus.cc:2804] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.432088  2089 raft_consensus.cc:515] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.480334  1999 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.480033  2086 raft_consensus.cc:3060] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.492563  1444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 54901us
I20260709 13:13:27.493847  2087 raft_consensus.cc:2804] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.495249  1293 leader_election.cc:304] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.486428  2092 raft_consensus.cc:515] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.491983  2099 raft_consensus.cc:2804] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.502727  2099 raft_consensus.cc:493] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.503098  2099 raft_consensus.cc:3060] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.501485  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.497697  2045 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:27.504940  2088 leader_election.cc:290] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.505318  1325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:27.505928  1325 raft_consensus.cc:3060] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.506809  2085 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.508061  2072 heartbeater.cc:499] Master 127.22.225.190:33845 was elected leader, sending a full tablet report...
I20260709 13:13:27.508324  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c04006aa6c64fbd86fb7ff6b1f2b7ae" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.494544  2081 raft_consensus.cc:493] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.509577  2081 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.510422  2039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.511569  2039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.512311  2039 raft_consensus.cc:2393] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 2: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:27.517428  2038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.516882  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:27.517884  1845 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.519070  1328 raft_consensus.cc:2393] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 2: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:27.519541  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.519932  2035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.520182  2044 raft_consensus.cc:3060] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.520561  2035 raft_consensus.cc:2468] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.520728  2045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.522956  2092 leader_election.cc:290] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.493609  1986 raft_consensus.cc:515] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.525264  1986 leader_election.cc:290] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.525516  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
W20260709 13:13:27.525624  1368 leader_election.cc:343] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.526922  2089 leader_election.cc:290] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.527269  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.527844  1404 raft_consensus.cc:2468] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
W20260709 13:13:27.531800  1442 leader_election.cc:343] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.532464  2039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.533262  2039 raft_consensus.cc:2468] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:27.536440  2044 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:27.525707  1153 catalog_manager.cc:5697] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.537894  1442 leader_election.cc:304] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:27.538784  1986 raft_consensus.cc:2804] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.539233  1986 raft_consensus.cc:697] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:27.540251  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:27.540042  1986 consensus_queue.cc:237] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.540804  1473 raft_consensus.cc:3060] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.541445  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
W20260709 13:13:27.542716  1293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 142207us
I20260709 13:13:27.545022  1400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb1be411e3cd45fab10d3ca9265e1696" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:27.545241  1981 raft_consensus.cc:3060] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.545676  1400 raft_consensus.cc:3060] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.518275  2038 raft_consensus.cc:2393] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 2: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
W20260709 13:13:27.526944  1368 leader_election.cc:343] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:27.550592  1368 leader_election.cc:343] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.569342  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:27.570257  1404 raft_consensus.cc:2468] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:27.572824  2098 raft_consensus.cc:2804] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.573295  2098 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.573670  2098 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.576840  1293 leader_election.cc:304] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.561695  1295 leader_election.cc:304] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
W20260709 13:13:27.578359  1368 leader_election.cc:343] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.578744  1368 leader_election.cc:304] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.497051  2087 raft_consensus.cc:697] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
W20260709 13:13:27.589658  1368 leader_election.cc:343] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.590332  1368 leader_election.cc:304] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 18c0de76f1804e98b0826423261536c9
W20260709 13:13:27.591282  1368 leader_election.cc:343] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.591642  1368 leader_election.cc:304] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.591571  1473 raft_consensus.cc:2468] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 2.
I20260709 13:13:27.594621  1325 raft_consensus.cc:2468] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:27.595995  1367 leader_election.cc:304] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:27.597157  2089 raft_consensus.cc:2749] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.599135  2095 raft_consensus.cc:2749] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.600785  2103 raft_consensus.cc:2804] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.601255  2103 raft_consensus.cc:697] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:27.602075  2103 consensus_queue.cc:237] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:27.610571  1368 leader_election.cc:343] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.612847  1368 leader_election.cc:304] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:27.615572  2096 raft_consensus.cc:2804] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.616460  2096 raft_consensus.cc:493] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.617380  2096 raft_consensus.cc:3060] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.628156  1999 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.580106  2091 raft_consensus.cc:493] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.628381  2093 raft_consensus.cc:515] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
W20260709 13:13:27.629559  1442 leader_election.cc:343] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.648765  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:27.656086  1403 raft_consensus.cc:2393] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bbe86acd78454edfa45d9c095875cb2f in current term 2: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:27.655722  1478 raft_consensus.cc:2468] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.660859  1794 raft_consensus.cc:2749] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.635946  2036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6d1cb4d3ccd49f9ac929224a0ad18b4" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.641268  1845 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.673604  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:27.674942  1294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 190105us
I20260709 13:13:27.676632  1370 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
W20260709 13:13:27.662343  1442 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 69131.6us
I20260709 13:13:27.651818  2091 raft_consensus.cc:515] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.674484  1475 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
W20260709 13:13:27.697499  1295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:34201, user_credentials={real_user=slave}} blocked reactor thread for 135917us
W20260709 13:13:27.699247  1368 leader_election.cc:343] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.694319  1329 raft_consensus.cc:2393] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 2: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:27.686805  2085 raft_consensus.cc:2804] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.692979  2082 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.711580  2081 raft_consensus.cc:515] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.712296  1998 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:27.690997  1972 raft_consensus.cc:2804] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.714709  1998 tablet_bootstrap.cc:492] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:27.715442  1998 ts_tablet_manager.cc:1403] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.542s	user 0.020s	sys 0.022s
I20260709 13:13:27.713254  1972 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.730163  2035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.731204  1972 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.714524  1475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:27.736310  1475 raft_consensus.cc:2468] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:27.721053  1981 raft_consensus.cc:2749] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.725767  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:27.713526  2085 raft_consensus.cc:493] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.737890  2085 raft_consensus.cc:3060] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.726280  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.738448  2044 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.727412  2091 leader_election.cc:290] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.740892  2093 leader_election.cc:290] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.728996  2086 raft_consensus.cc:515] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.743058  2086 leader_election.cc:290] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.743839  1293 leader_election.cc:304] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.744899  2093 raft_consensus.cc:2804] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.745203  2085 raft_consensus.cc:515] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.745263  2093 raft_consensus.cc:493] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.745493  1293 leader_election.cc:304] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.719995  2038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.729250  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.734476  1400 raft_consensus.cc:2468] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:27.747762  1999 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.748021  2085 leader_election.cc:290] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.746908  2093 raft_consensus.cc:3060] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.747639  2094 raft_consensus.cc:2804] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.678771  2087 consensus_queue.cc:237] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.724890  1444 leader_election.cc:304] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.713270  2082 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.738099  1476 raft_consensus.cc:2393] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bbe86acd78454edfa45d9c095875cb2f in current term 2: Already voted for candidate 18c0de76f1804e98b0826423261536c9 in this term.
I20260709 13:13:27.754925  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6b66c1551c438084e2d9766814c7d3" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.748353  2089 raft_consensus.cc:2764] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:13:27.759039  1293 leader_election.cc:304] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:27.759886  2096 raft_consensus.cc:515] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.760385  2108 raft_consensus.cc:2804] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.760818  2108 raft_consensus.cc:493] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.761183  2108 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.753330  2094 raft_consensus.cc:493] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.761375  2083 raft_consensus.cc:2804] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.761680  2094 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.761929  2083 raft_consensus.cc:697] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:27.762722  2044 raft_consensus.cc:2468] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:27.762858  2083 consensus_queue.cc:237] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.764045  1328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.766201  1442 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:27.767990  1330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f4c48f5f44fb7a7c683868e97d498" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:27.771966  1986 raft_consensus.cc:2804] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.772495  1986 raft_consensus.cc:697] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:27.772737  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:27.773581  1329 raft_consensus.cc:2393] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 2: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:27.773402  1986 consensus_queue.cc:237] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.775774  1998 raft_consensus.cc:359] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.776619  1998 raft_consensus.cc:740] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:27.779922  1400 raft_consensus.cc:1275] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.782784  1998 consensus_queue.cc:260] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.829314  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:27.830484  1478 raft_consensus.cc:2468] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
W20260709 13:13:27.831943  1444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 48997.8us
I20260709 13:13:27.842598  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
W20260709 13:13:27.846257  1294 leader_election.cc:343] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.847301  1972 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.848488  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:27.849050  1327 raft_consensus.cc:3060] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.851522  1998 ts_tablet_manager.cc:1434] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.005s
W20260709 13:13:27.857573  1442 leader_election.cc:343] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.852667  1998 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
W20260709 13:13:27.850898  1295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:34201, user_credentials={real_user=slave}} blocked reactor thread for 116751us
W20260709 13:13:27.862298  1294 leader_election.cc:343] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:27.874385  1294 leader_election.cc:343] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.874927  1294 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.879074  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:27.879588  1794 raft_consensus.cc:2749] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.879659  1403 raft_consensus.cc:3060] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.881573  1294 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.883096  1370 leader_election.cc:304] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.854851  2098 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.888623  2098 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:27.851423  2099 raft_consensus.cc:515] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.890769  2099 leader_election.cc:290] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.891497  1477 raft_consensus.cc:2393] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 2: Already voted for candidate 18c0de76f1804e98b0826423261536c9 in this term.
I20260709 13:13:27.895049  1399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:27.895274  2081 leader_election.cc:290] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.895720  1399 raft_consensus.cc:3060] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.844986  2108 raft_consensus.cc:515] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.853719  1325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:27.899776  2108 leader_election.cc:290] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.900270  1325 raft_consensus.cc:2393] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 2: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:27.855261  2096 leader_election.cc:290] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.901388  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
W20260709 13:13:27.903139  1368 leader_election.cc:343] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.904960  2036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.905750  2036 raft_consensus.cc:3060] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.884953  2092 raft_consensus.cc:2749] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:13:27.872040  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.131:34201, user_credentials={real_user=slave}} blocked reactor thread for 90893.9us
I20260709 13:13:27.909139  1972 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:27.910135  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:27.910981  1401 raft_consensus.cc:2393] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 2: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:27.912045  2093 raft_consensus.cc:515] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:27.912624  2106 consensus_queue.cc:1048] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:27.913288  1328 raft_consensus.cc:2393] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18c0de76f1804e98b0826423261536c9 in current term 2: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:27.914040  2039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.915236  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
W20260709 13:13:27.915318  1368 leader_election.cc:343] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.856240  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b311b738bf44b1abdf2cc9faeb4a19" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
W20260709 13:13:27.915395  1442 consensus_peers.cc:597] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.920884  2093 leader_election.cc:290] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.908919  1327 raft_consensus.cc:2468] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 2.
I20260709 13:13:27.925743  1370 leader_election.cc:304] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.884112  2094 raft_consensus.cc:515] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:27.929955  2094 leader_election.cc:290] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:27.933039  1404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:27.935910  1404 raft_consensus.cc:2393] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bbe86acd78454edfa45d9c095875cb2f in current term 2: Already voted for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in this term.
I20260709 13:13:27.932567  1370 leader_election.cc:304] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.935854  2103 raft_consensus.cc:3060] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:27.939792  1444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 98060.6us
W20260709 13:13:27.940932  1368 leader_election.cc:343] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:27.941865  1444 leader_election.cc:304] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.942463  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:27.943519  1327 raft_consensus.cc:2393] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 2: Already voted for candidate bbe86acd78454edfa45d9c095875cb2f in this term.
I20260709 13:13:27.946309  1293 leader_election.cc:304] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:27.952242  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:27.952952  1403 raft_consensus.cc:2468] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:27.951663  1370 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.954842  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:27.955425  1327 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.956463  1999 raft_consensus.cc:2749] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.957259  2038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.957831  1370 leader_election.cc:304] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.958600  1999 raft_consensus.cc:2804] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.959074  1999 raft_consensus.cc:697] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:27.959964  1999 consensus_queue.cc:237] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.960536  2118 raft_consensus.cc:2749] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.939419  2089 raft_consensus.cc:3060] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.962208  1370 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.963400  2087 raft_consensus.cc:2804] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:27.973016  2087 raft_consensus.cc:493] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:27.973459  2087 raft_consensus.cc:3060] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.974488  2035 raft_consensus.cc:1275] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.975687  1474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:27.976363  1474 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.963809  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.964162  1295 leader_election.cc:304] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:27.977154  2101 consensus_queue.cc:1048] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:27.978192  2107 raft_consensus.cc:2804] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.978681  2107 raft_consensus.cc:697] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:27.979523  2107 consensus_queue.cc:237] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.964440  1399 raft_consensus.cc:2468] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:27.964993  1327 raft_consensus.cc:2468] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:27.966578  2038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.956764  2041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189f636ed54445ea91f7f9411e1b7593" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:27.983160  1295 leader_election.cc:304] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:27.985461  1473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:27.986454  1473 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.987232  1477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58147dc2306b445bbc1134344d2d129d" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:27.989452  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d77a5b6b9c4251a7ca4a132c0cddcb" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:27.990217  1478 raft_consensus.cc:2393] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fc95e1790d2492e93bddd6efb72a2c3 in current term 2: Already voted for candidate 18c0de76f1804e98b0826423261536c9 in this term.
I20260709 13:13:27.954447  1986 raft_consensus.cc:3060] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.991652  1367 leader_election.cc:304] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:27.992413  2085 raft_consensus.cc:2804] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:27.993347  2085 raft_consensus.cc:697] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:27.977239  2090 raft_consensus.cc:2749] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.994228  2085 consensus_queue.cc:237] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:27.997186  2038 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:27.981936  2040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c6d73d03124b02976ae2b9126c2d7e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:28.003157  1473 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:28.008780  1152 catalog_manager.cc:5697] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:28.011791  2118 raft_consensus.cc:2749] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:28.003958  1474 raft_consensus.cc:2468] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:27.977396  2089 raft_consensus.cc:2749] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:27.996074  1151 catalog_manager.cc:5697] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 2 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:27.954871  2036 raft_consensus.cc:2468] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:28.021425  2103 raft_consensus.cc:2749] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:28.027956  1986 raft_consensus.cc:2749] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:28.031018  1327 raft_consensus.cc:1275] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:28.035431  1294 leader_election.cc:343] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:28.036772  1294 leader_election.cc:343] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.037830  1294 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:28.038295  1293 leader_election.cc:304] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:28.039426  2119 raft_consensus.cc:2749] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:28.039458  2093 raft_consensus.cc:2804] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.040274  2093 raft_consensus.cc:697] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:28.041383  2093 consensus_queue.cc:237] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:28.045158  2042 raft_consensus.cc:1275] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.045815  1399 raft_consensus.cc:1275] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.046422  2035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:28.047112  2035 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.050362  2094 consensus_queue.cc:1048] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:28.051720  1442 leader_election.cc:304] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 2fc95e1790d2492e93bddd6efb72a2c3
I20260709 13:13:28.053171  2081 raft_consensus.cc:2804] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.053658  2081 raft_consensus.cc:697] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:28.059633  1477 raft_consensus.cc:2468] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:28.055452  1444 leader_election.cc:304] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
W20260709 13:13:28.062144  1294 leader_election.cc:343] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.070827  1293 leader_election.cc:304] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
W20260709 13:13:28.071218  1294 leader_election.cc:343] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.074105  1293 leader_election.cc:304] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: 
W20260709 13:13:28.077234  1294 leader_election.cc:343] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.079070  2102 consensus_queue.cc:1048] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:13:28.069245  2101 raft_consensus.cc:2804] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.054487  2081 consensus_queue.cc:237] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:28.081389  2098 raft_consensus.cc:2804] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.076304  2091 raft_consensus.cc:2804] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.088923  2098 raft_consensus.cc:697] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:28.089423  2101 raft_consensus.cc:697] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:28.094033  2091 raft_consensus.cc:697] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:28.109668  1794 consensus_queue.cc:1048] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:28.095706  2038 raft_consensus.cc:2468] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
W20260709 13:13:28.135253  1368 consensus_peers.cc:597] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.141832  1473 raft_consensus.cc:1275] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer 2fc95e1790d2492e93bddd6efb72a2c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.101504  2087 raft_consensus.cc:515] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:28.146034  1943 consensus_queue.cc:1048] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:13:28.158643  1401 raft_consensus.cc:1275] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.158852  2087 leader_election.cc:290] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:28.146167  2098 consensus_queue.cc:237] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
W20260709 13:13:28.144508  2129 log.cc:927] Time spent T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:13:28.174525  2100 consensus_queue.cc:1048] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:13:28.177788  1474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:28.178473  1474 raft_consensus.cc:3060] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.179198  2036 raft_consensus.cc:1275] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.180768  1907 consensus_queue.cc:1048] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.183193  2091 consensus_queue.cc:237] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:28.196328  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "becaecefa770428abc9030aa88b4825e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
W20260709 13:13:28.201339  1294 leader_election.cc:343] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:28.235195  1998 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:28.166989  2101 consensus_queue.cc:237] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:28.249881  1998 tablet_bootstrap.cc:492] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:28.253720  1998 ts_tablet_manager.cc:1403] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.402s	user 0.040s	sys 0.007s
W20260709 13:13:28.272118  1294 consensus_peers.cc:597] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:28.260902  2035 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:28.263168  2041 raft_consensus.cc:1275] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.294696  1328 raft_consensus.cc:1275] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.296546  1404 raft_consensus.cc:1275] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.293216  1474 raft_consensus.cc:2468] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:28.321172  1998 raft_consensus.cc:359] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:28.326792  1998 raft_consensus.cc:740] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.327517  2113 consensus_queue.cc:1048] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:13:28.328050  1998 consensus_queue.cc:260] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:28.448889  1370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:33279, user_credentials={real_user=slave}} blocked reactor thread for 89818.1us
I20260709 13:13:28.363420  1152 catalog_manager.cc:5697] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:28.478744  1998 ts_tablet_manager.cc:1434] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.225s	user 0.019s	sys 0.003s
W20260709 13:13:28.476429  1367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 108047us
I20260709 13:13:28.496845  2098 consensus_queue.cc:1048] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:13:28.531978  1294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 62881.7us
I20260709 13:13:28.540437  1328 raft_consensus.cc:1275] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer 2fc95e1790d2492e93bddd6efb72a2c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.536355  2041 raft_consensus.cc:1275] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:28.548563  1294 consensus_peers.cc:597] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:28.553817  2090 consensus_queue.cc:1048] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:28.573335  1442 consensus_peers.cc:597] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.594976  1442 consensus_peers.cc:597] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:28.595923  2106 consensus_queue.cc:1048] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.599716  1404 raft_consensus.cc:1275] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.612219  1399 raft_consensus.cc:1275] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.618884  1293 leader_election.cc:304] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:28.628033  1478 raft_consensus.cc:1275] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:28.630950  1368 consensus_peers.cc:597] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.631647  2154 consensus_queue.cc:1048] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.633147  2107 consensus_queue.cc:1048] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:28.633595  1368 consensus_peers.cc:597] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.634241  1368 consensus_peers.cc:597] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:28.625708  2102 consensus_queue.cc:1048] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:13:28.640846  1998 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:28.641749  2113 raft_consensus.cc:2804] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:28.642278  2113 raft_consensus.cc:697] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:28.643168  2113 consensus_queue.cc:237] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
W20260709 13:13:28.640444  1442 consensus_peers.cc:597] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.659664  2041 raft_consensus.cc:1275] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.669032  1794 consensus_queue.cc:1048] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:28.669471  1368 consensus_peers.cc:597] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:28.671212  1327 raft_consensus.cc:1275] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.698132  1998 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:28.699510  1998 tablet_bootstrap.cc:492] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:28.700433  1998 ts_tablet_manager.cc:1403] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.009s
I20260709 13:13:28.735100  1474 raft_consensus.cc:1275] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.735261  2040 raft_consensus.cc:1275] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.736954  2119 consensus_queue.cc:1048] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:28.739126  1294 consensus_peers.cc:597] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:28.740229  1294 consensus_peers.cc:597] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:28.711887  1968 consensus_queue.cc:1048] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:13:28.753870  2044 raft_consensus.cc:3060] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:28.753939  2042 raft_consensus.cc:1275] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:28.759117  1368 consensus_peers.cc:597] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.753068  1294 consensus_peers.cc:597] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.760615  1151 catalog_manager.cc:5697] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 2 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } }
I20260709 13:13:28.762214  1151 catalog_manager.cc:5697] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } }
I20260709 13:13:28.764418  2106 consensus_queue.cc:1048] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.765012  2087 consensus_queue.cc:1048] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.771107  1328 raft_consensus.cc:1275] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.780028  1907 consensus_queue.cc:1048] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:28.782323  1368 consensus_peers.cc:597] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.783558  1442 consensus_peers.cc:597] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:28.783735  1294 consensus_peers.cc:597] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.791425  1478 raft_consensus.cc:1275] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.791651  2119 consensus_queue.cc:1048] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:28.834308  1442 consensus_peers.cc:597] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:28.838805  1998 raft_consensus.cc:359] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:28.839619  1998 raft_consensus.cc:740] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
W20260709 13:13:28.840580  1293 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 49338.8us
I20260709 13:13:28.843791  2092 consensus_queue.cc:1048] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:28.840458  1998 consensus_queue.cc:260] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:28.873449  1998 ts_tablet_manager.cc:1434] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.173s	user 0.005s	sys 0.005s
I20260709 13:13:28.874436  1998 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:28.882061  1401 raft_consensus.cc:1275] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:28.906548  2125 consensus_queue.cc:1048] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:28.916801  1294 consensus_peers.cc:597] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.919476  1368 consensus_peers.cc:597] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.984120  1294 consensus_peers.cc:597] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:28.987219  1998 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:28.988020  1998 tablet_bootstrap.cc:492] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:28.989236  1998 ts_tablet_manager.cc:1403] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.008s
I20260709 13:13:28.991042  1998 raft_consensus.cc:359] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:28.991575  1998 raft_consensus.cc:740] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:28.992473  1998 consensus_queue.cc:260] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:28.994901  1998 ts_tablet_manager.cc:1434] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:28.995684  1998 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:28.999601  1152 catalog_manager.cc:5697] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 2 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.001624  1152 catalog_manager.cc:5697] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 2 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.003309  1152 catalog_manager.cc:5697] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 2 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.005134  1152 catalog_manager.cc:5697] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 2 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.013267  1152 catalog_manager.cc:5697] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } }
I20260709 13:13:29.015273  1152 catalog_manager.cc:5697] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 2 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.018069  1998 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.019232  1998 tablet_bootstrap.cc:492] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.019838  1998 ts_tablet_manager.cc:1403] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.011s
I20260709 13:13:29.023792  1998 raft_consensus.cc:359] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.024466  1998 raft_consensus.cc:740] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.025254  1998 consensus_queue.cc:260] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.027396  1998 ts_tablet_manager.cc:1434] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:29.028183  1998 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.034452  1153 catalog_manager.cc:5697] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.035995  1153 catalog_manager.cc:5697] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.037384  1153 catalog_manager.cc:5697] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.038968  1153 catalog_manager.cc:5697] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:29.043190  1294 consensus_peers.cc:597] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:29.053762  1998 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.054750  1998 tablet_bootstrap.cc:492] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.055382  1998 ts_tablet_manager.cc:1403] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:13:29.057888  1998 raft_consensus.cc:359] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.058550  1998 raft_consensus.cc:740] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.059180  1998 consensus_queue.cc:260] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.060989  1998 ts_tablet_manager.cc:1434] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:29.061830  1998 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.134011  2044 raft_consensus.cc:3060] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.137652  1998 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.138597  1998 tablet_bootstrap.cc:492] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.139207  1998 ts_tablet_manager.cc:1403] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.013s
I20260709 13:13:29.148578  1152 catalog_manager.cc:5697] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 2, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 2 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.154428  1998 raft_consensus.cc:359] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.155155  1998 raft_consensus.cc:740] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.159757  1998 consensus_queue.cc:260] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.167775  1998 ts_tablet_manager.cc:1434] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:13:29.168547  1998 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.193295  1998 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.194366  1998 tablet_bootstrap.cc:492] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.195096  1998 ts_tablet_manager.cc:1403] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.007s
I20260709 13:13:29.197701  1998 raft_consensus.cc:359] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.198448  1998 raft_consensus.cc:740] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.198769  2040 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.199213  1998 consensus_queue.cc:260] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.201331  1998 ts_tablet_manager.cc:1434] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:29.202265  1998 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.254846  1998 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.263463  1998 tablet_bootstrap.cc:492] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.264176  1998 ts_tablet_manager.cc:1403] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.016s
I20260709 13:13:29.266671  1998 raft_consensus.cc:359] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.267372  1998 raft_consensus.cc:740] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.268065  1998 consensus_queue.cc:260] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.269387  1477 raft_consensus.cc:1275] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:29.270175  1998 ts_tablet_manager.cc:1434] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:29.270979  1998 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.271029  2085 consensus_queue.cc:1048] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:29.304467  1998 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.306782  1998 tablet_bootstrap.cc:492] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.307397  1998 ts_tablet_manager.cc:1403] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.017s
I20260709 13:13:29.310129  1998 raft_consensus.cc:359] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.310643  1998 raft_consensus.cc:740] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.311241  1998 consensus_queue.cc:260] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.313130  1998 ts_tablet_manager.cc:1434] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:13:29.314764  1998 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.326373  1998 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.327061  1998 tablet_bootstrap.cc:492] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.327562  1998 ts_tablet_manager.cc:1403] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:13:29.329282  1998 raft_consensus.cc:359] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.329764  1998 raft_consensus.cc:740] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.330250  1998 consensus_queue.cc:260] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.331699  1998 ts_tablet_manager.cc:1434] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:29.332612  1998 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.344240  1998 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.345080  1998 tablet_bootstrap.cc:492] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.345660  1998 ts_tablet_manager.cc:1403] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:13:29.347672  1998 raft_consensus.cc:359] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.348342  1998 raft_consensus.cc:740] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.348918  1998 consensus_queue.cc:260] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.350929  1998 ts_tablet_manager.cc:1434] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:29.352092  1998 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.366115  1998 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.367019  1998 tablet_bootstrap.cc:492] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.367720  1998 ts_tablet_manager.cc:1403] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:13:29.370148  1998 raft_consensus.cc:359] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.370781  1998 raft_consensus.cc:740] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.371476  1998 consensus_queue.cc:260] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.373023  1998 ts_tablet_manager.cc:1434] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:29.374125  1998 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.389317  1998 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.390017  1998 tablet_bootstrap.cc:492] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.390540  1998 ts_tablet_manager.cc:1403] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 13:13:29.392203  1998 raft_consensus.cc:359] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.392706  1998 raft_consensus.cc:740] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.393268  1998 consensus_queue.cc:260] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.395190  1998 ts_tablet_manager.cc:1434] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:29.396139  1998 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.409653  1998 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.410353  1998 tablet_bootstrap.cc:492] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.410876  1998 ts_tablet_manager.cc:1403] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:13:29.412542  1998 raft_consensus.cc:359] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.413053  1998 raft_consensus.cc:740] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.413708  1998 consensus_queue.cc:260] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.415241  1998 ts_tablet_manager.cc:1434] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:29.416608  1998 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.431377  1998 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.432058  1998 tablet_bootstrap.cc:492] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.432559  1998 ts_tablet_manager.cc:1403] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:13:29.434460  1998 raft_consensus.cc:359] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.434942  1998 raft_consensus.cc:740] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.435527  1998 consensus_queue.cc:260] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.437286  1998 ts_tablet_manager.cc:1434] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 13:13:29.438061  1998 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.454434  1998 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.455152  1998 tablet_bootstrap.cc:492] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.455669  1998 ts_tablet_manager.cc:1403] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:13:29.457402  1998 raft_consensus.cc:359] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.457902  1998 raft_consensus.cc:740] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.458477  1998 consensus_queue.cc:260] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.460335  1998 ts_tablet_manager.cc:1434] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:29.461199  1998 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.473685  1998 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.474406  1998 tablet_bootstrap.cc:492] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.474913  1998 ts_tablet_manager.cc:1403] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:13:29.476840  1998 raft_consensus.cc:359] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.477429  1998 raft_consensus.cc:740] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.477967  1998 consensus_queue.cc:260] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.479894  1998 ts_tablet_manager.cc:1434] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:29.480769  1998 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.486699  2044 raft_consensus.cc:3060] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.497385  1998 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.498296  1998 tablet_bootstrap.cc:492] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.498917  1998 ts_tablet_manager.cc:1403] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:13:29.501128  1998 raft_consensus.cc:359] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.501784  1998 raft_consensus.cc:740] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.502405  1998 consensus_queue.cc:260] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.504170  1998 ts_tablet_manager.cc:1434] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:29.504875  1998 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.520159  1998 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.520936  1998 tablet_bootstrap.cc:492] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.521621  1998 ts_tablet_manager.cc:1403] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 13:13:29.524029  1998 raft_consensus.cc:359] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.524680  1998 raft_consensus.cc:740] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.525465  1998 consensus_queue.cc:260] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.526947  1998 ts_tablet_manager.cc:1434] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:13:29.528905  1998 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.545763  1998 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.546500  1998 tablet_bootstrap.cc:492] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.547034  1998 ts_tablet_manager.cc:1403] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 13:13:29.549057  1998 raft_consensus.cc:359] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.549638  1998 raft_consensus.cc:740] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.550266  1998 consensus_queue.cc:260] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.552510  1998 ts_tablet_manager.cc:1434] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:13:29.553264  1998 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.565120  1998 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.566076  1998 tablet_bootstrap.cc:492] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.566754  1998 ts_tablet_manager.cc:1403] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 13:13:29.572222  1998 raft_consensus.cc:359] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.572926  1998 raft_consensus.cc:740] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.573606  1998 consensus_queue.cc:260] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.575484  1998 ts_tablet_manager.cc:1434] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:13:29.576472  1998 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.588464  2044 raft_consensus.cc:3060] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.617614  1998 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.618681  1998 tablet_bootstrap.cc:492] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.619370  1998 ts_tablet_manager.cc:1403] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.023s
I20260709 13:13:29.621778  1998 raft_consensus.cc:359] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.622402  1998 raft_consensus.cc:740] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.623001  1998 consensus_queue.cc:260] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.625159  1998 ts_tablet_manager.cc:1434] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:29.626170  1998 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.641778  1998 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.642673  1998 tablet_bootstrap.cc:492] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.643334  1998 ts_tablet_manager.cc:1403] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:13:29.645651  2044 raft_consensus.cc:3060] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.645720  1998 raft_consensus.cc:359] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.646696  1998 raft_consensus.cc:740] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.651798  1998 consensus_queue.cc:260] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.654148  1998 ts_tablet_manager.cc:1434] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 13:13:29.654906  1998 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.675168  1998 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.676105  1998 tablet_bootstrap.cc:492] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.676786  1998 ts_tablet_manager.cc:1403] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:13:29.679147  1998 raft_consensus.cc:359] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.679778  1998 raft_consensus.cc:740] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.680366  1998 consensus_queue.cc:260] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.682662  1998 ts_tablet_manager.cc:1434] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:13:29.683414  1998 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.716488  1998 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.717439  1998 tablet_bootstrap.cc:492] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.718092  1998 ts_tablet_manager.cc:1403] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.035s	user 0.025s	sys 0.008s
I20260709 13:13:29.720572  1998 raft_consensus.cc:359] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.721263  1998 raft_consensus.cc:740] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.721916  1998 consensus_queue.cc:260] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.723878  1998 ts_tablet_manager.cc:1434] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:29.725255  1998 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.729737  2115 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.730294  2115 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.732273  2115 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:29.733443  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:29.734113  2044 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:29.735426  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f" is_pre_election: true
I20260709 13:13:29.735936  1327 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 2.
I20260709 13:13:29.737125  1370 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:29.738616  2095 raft_consensus.cc:2804] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:29.738974  2095 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.739274  2095 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.745294  1998 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.746783  1998 tablet_bootstrap.cc:492] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.747412  1998 ts_tablet_manager.cc:1403] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 13:13:29.749753  2095 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.749871  1998 raft_consensus.cc:359] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.750720  1998 raft_consensus.cc:740] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.751439  1998 consensus_queue.cc:260] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:29.752138  2095 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:29.752977  2044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:29.753458  1998 ts_tablet_manager.cc:1434] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:29.753579  2044 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.754405  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:29.754703  1998 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Bootstrap starting.
I20260709 13:13:29.754956  1327 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:29.761287  1327 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 3.
I20260709 13:13:29.762221  1370 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:29.762992  2095 raft_consensus.cc:2804] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:29.764068  2095 raft_consensus.cc:697] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:29.764488  2044 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 3.
I20260709 13:13:29.765034  2095 consensus_queue.cc:237] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:29.769526  2044 raft_consensus.cc:3060] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:29.773702  1998 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:29.774694  1998 tablet_bootstrap.cc:492] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Bootstrap complete.
I20260709 13:13:29.775326  1998 ts_tablet_manager.cc:1403] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:13:29.777818  1998 raft_consensus.cc:359] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.778460  1998 raft_consensus.cc:740] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.779211  1998 consensus_queue.cc:260] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:29.800483  1151 catalog_manager.cc:5697] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 1 to 3, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.816509  1998 ts_tablet_manager.cc:1434] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.002s
I20260709 13:13:30.038950  2113 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.039880  2113 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:30.042021  2113 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:30.042841  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c" is_pre_election: true
I20260709 13:13:30.042909  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:30.043764  2042 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 1.
I20260709 13:13:30.044271  1401 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 2.
I20260709 13:13:30.044855  1294 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:30.045562  2113 raft_consensus.cc:2804] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:30.045948  2113 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.046231  2113 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.052107  2113 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:30.053905  2113 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 3 election: Requested vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:30.054502  2042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e89740c5a5de48fd875c8b628616334c"
I20260709 13:13:30.054809  1401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "bbe86acd78454edfa45d9c095875cb2f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:30.055138  2042 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.055387  1401 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:30.062678  1401 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 3.
I20260709 13:13:30.062772  2042 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbe86acd78454edfa45d9c095875cb2f in term 3.
I20260709 13:13:30.063869  1295 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f; no voters: 
I20260709 13:13:30.064896  2113 raft_consensus.cc:2804] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:30.065425  2113 raft_consensus.cc:697] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 3 LEADER]: Becoming Leader. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:30.066470  2113 consensus_queue.cc:237] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:30.075913  1151 catalog_manager.cc:5697] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f reported cstate change: term changed from 1 to 3, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to bbe86acd78454edfa45d9c095875cb2f (127.22.225.130). New cstate: current_term: 3 leader_uuid: "bbe86acd78454edfa45d9c095875cb2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.173316  1327 raft_consensus.cc:1275] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Refusing update from remote peer 2fc95e1790d2492e93bddd6efb72a2c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:30.174752  2212 consensus_queue.cc:1048] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.185370  2044 raft_consensus.cc:1275] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Refusing update from remote peer 2fc95e1790d2492e93bddd6efb72a2c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:30.186883  2212 consensus_queue.cc:1048] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.205518  2044 raft_consensus.cc:3060] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.227380  2040 raft_consensus.cc:3060] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.503752  1400 raft_consensus.cc:1275] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:30.505347  2113 consensus_queue.cc:1048] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.519776  2044 raft_consensus.cc:1275] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Refusing update from remote peer bbe86acd78454edfa45d9c095875cb2f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:30.521926  2085 consensus_queue.cc:1048] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:36.381942  1367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 164933us
W20260709 13:13:36.429364  1368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 80176.2us
W20260709 13:13:36.528589  1368 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:44541, user_credentials={real_user=slave}} blocked reactor thread for 61439.5us
I20260709 13:13:37.255137 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:37.309176  1329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4"
dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:60880
I20260709 13:13:37.310145  1329 raft_consensus.cc:606] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:37.323007  1476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75"
dest_uuid: "18c0de76f1804e98b0826423261536c9"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:54666
I20260709 13:13:37.323518  1476 raft_consensus.cc:606] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:37.326020  1476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99"
dest_uuid: "18c0de76f1804e98b0826423261536c9"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:54666
I20260709 13:13:37.326501  1476 raft_consensus.cc:606] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:37.338423  1403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59ed770654a140988fd6e180dad119cc"
dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:42214
I20260709 13:13:37.338903  1403 raft_consensus.cc:606] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:37.341197  1403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c9d052234b64c6c9657372e21b121af"
dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:42214
I20260709 13:13:37.341579  1403 raft_consensus.cc:606] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:37.343736  1476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04"
dest_uuid: "18c0de76f1804e98b0826423261536c9"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:54666
I20260709 13:13:37.344386  1476 raft_consensus.cc:606] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:37.345546 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:37.346900 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:37.362733  2236 raft_consensus.cc:993] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.363415  2240 raft_consensus.cc:1081] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.365020  2035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53270
I20260709 13:13:37.365584  2035 raft_consensus.cc:493] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.365931  2035 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.372538  2035 raft_consensus.cc:515] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.374891  2035 leader_election.cc:290] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 3 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:37.386569  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:37.387323  1478 raft_consensus.cc:3055] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:37.387624  1478 raft_consensus.cc:740] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:37.388444  1478 consensus_queue.cc:260] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.389743  1478 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.391034  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c175554ac140ef8db4ae40ed5afc75" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:37.391669  1329 raft_consensus.cc:3060] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.394999  2240 raft_consensus.cc:993] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.395486  2240 raft_consensus.cc:1081] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.397375  1478 raft_consensus.cc:2468] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 3.
I20260709 13:13:37.397480  2035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53270
I20260709 13:13:37.398190  2035 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.398593  2035 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.401508  1992 leader_election.cc:304] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:37.401937  1329 raft_consensus.cc:2468] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 3.
I20260709 13:13:37.403522  2259 raft_consensus.cc:2804] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:37.405745  2035 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.405773  2259 raft_consensus.cc:697] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 3 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:37.407327  2259 consensus_queue.cc:237] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.407927  2035 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 3 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:37.408483  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:37.409129  1476 raft_consensus.cc:3055] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:37.409305  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b6cfeddad84835825e5e204da91e99" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:37.409449  1476 raft_consensus.cc:740] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:37.409909  1329 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.410393  1476 consensus_queue.cc:260] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.411525  1476 raft_consensus.cc:3060] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:37.416792  1329 raft_consensus.cc:2468] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 3.
I20260709 13:13:37.418231  1995 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:37.419034  2259 raft_consensus.cc:2804] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:37.419492  2259 raft_consensus.cc:697] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 3 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:37.419513  1476 raft_consensus.cc:2468] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 3.
I20260709 13:13:37.420527  2259 consensus_queue.cc:237] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.429491  1150 catalog_manager.cc:5697] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 2 to 3, leader changed from 18c0de76f1804e98b0826423261536c9 (127.22.225.132) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 3 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.453409  1150 catalog_manager.cc:5697] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 2 to 3, leader changed from 18c0de76f1804e98b0826423261536c9 (127.22.225.132) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 3 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:37.492807  1351 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2320 after lost signal to thread 23433
W20260709 13:13:37.494124  1351 debug-util.cc:398] Leaking SignalData structure 0x7b0800154660 after lost signal to thread 1187
W20260709 13:13:37.500608  1351 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd540 after lost signal to thread 2071
I20260709 13:13:37.532496  2246 raft_consensus.cc:993] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.533202  2242 raft_consensus.cc:1081] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.534756  2035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c9d052234b64c6c9657372e21b121af"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53272
I20260709 13:13:37.535391  2035 raft_consensus.cc:493] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.535781  2035 raft_consensus.cc:3060] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.544425  2035 raft_consensus.cc:515] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:37.547509  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9d052234b64c6c9657372e21b121af" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:37.547778  2035 leader_election.cc:290] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:37.548058  1329 raft_consensus.cc:3060] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.553542  1329 raft_consensus.cc:2468] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:37.558586  1995 leader_election.cc:304] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:37.559340  2259 raft_consensus.cc:2804] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.559803  2259 raft_consensus.cc:697] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:37.560528  2259 consensus_queue.cc:237] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:37.566520  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9d052234b64c6c9657372e21b121af" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:37.567274  1403 raft_consensus.cc:3055] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:37.567677  1403 raft_consensus.cc:740] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:37.568584  1403 consensus_queue.cc:260] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:37.570050  1403 raft_consensus.cc:3060] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.581822  1403 raft_consensus.cc:2468] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:37.599946  1150 catalog_manager.cc:5697] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 1 to 2, leader changed from 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 2 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.709926  2250 raft_consensus.cc:993] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.710543  2252 raft_consensus.cc:1081] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.712419  2039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:13:37.712881  2039 raft_consensus.cc:493] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.713325  2039 raft_consensus.cc:3060] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.721005  2039 raft_consensus.cc:515] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.722949  2039 leader_election.cc:290] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:37.723963  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:37.724107  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ced950a049249b1a6e0621dbb3de9d4" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:37.724596  1476 raft_consensus.cc:3060] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.724771  1327 raft_consensus.cc:3055] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:37.725229  1327 raft_consensus.cc:740] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:37.726056  1327 consensus_queue.cc:260] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.727420  1327 raft_consensus.cc:3060] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.729339  1476 raft_consensus.cc:2468] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:37.730454  1992 leader_election.cc:304] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:37.731101  2259 raft_consensus.cc:2804] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.731554  2259 raft_consensus.cc:697] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:37.732443  2259 consensus_queue.cc:237] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:37.737174  1327 raft_consensus.cc:2468] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:37.745898  1150 catalog_manager.cc:5697] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 2 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.753608  2246 raft_consensus.cc:993] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.754043  2242 raft_consensus.cc:1081] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.755753  2039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59ed770654a140988fd6e180dad119cc"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53272
I20260709 13:13:37.756206  2039 raft_consensus.cc:493] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.756497  2039 raft_consensus.cc:3060] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.764712  2039 raft_consensus.cc:515] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:37.770803  2039 leader_election.cc:290] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:37.771548  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:37.772223  1403 raft_consensus.cc:3055] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:37.772082  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:37.772775  1403 raft_consensus.cc:740] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:37.772948  1476 raft_consensus.cc:3060] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.773595  1403 consensus_queue.cc:260] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:37.774843  1403 raft_consensus.cc:3060] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.785161  1403 raft_consensus.cc:2468] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:37.789788  1994 leader_election.cc:304] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:37.791824  2259 raft_consensus.cc:2804] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.792295  2259 raft_consensus.cc:697] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:37.793434  1476 raft_consensus.cc:2468] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:37.797096  2259 consensus_queue.cc:237] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:37.812826  1150 catalog_manager.cc:5697] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 1 to 2, leader changed from 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 2 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.847445  1327 raft_consensus.cc:1275] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.848615  2259 consensus_queue.cc:1048] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.868448  1476 raft_consensus.cc:1275] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.874980  2274 consensus_queue.cc:1048] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:37.885313  1327 raft_consensus.cc:1275] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.887060  2259 consensus_queue.cc:1048] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.900102  2240 raft_consensus.cc:993] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.900576  2240 raft_consensus.cc:1081] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:37.902707  2039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53270
I20260709 13:13:37.903213  2039 raft_consensus.cc:493] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.903549  2039 raft_consensus.cc:3060] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.905297  1476 raft_consensus.cc:1275] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:37.907383  2259 consensus_queue.cc:1048] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:37.912014  2039 raft_consensus.cc:515] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:37.914657  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:37.915191  1403 raft_consensus.cc:3060] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.928563  1403 raft_consensus.cc:2468] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:37.929997  1994 leader_election.cc:304] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:37.932024  2260 raft_consensus.cc:2804] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.932528  2260 raft_consensus.cc:697] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:37.933416  2260 consensus_queue.cc:237] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:37.942317  2039 leader_election.cc:290] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:37.942667  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:37.943316  1476 raft_consensus.cc:3055] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:37.943634  1476 raft_consensus.cc:740] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:37.944401  1476 consensus_queue.cc:260] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:37.945652  1476 raft_consensus.cc:3060] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.951526  1150 catalog_manager.cc:5697] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 1 to 2, leader changed from 18c0de76f1804e98b0826423261536c9 (127.22.225.132) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 2 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.954704  1476 raft_consensus.cc:2468] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:38.075788  1327 raft_consensus.cc:1275] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.077240  2260 consensus_queue.cc:1048] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.095307  1402 raft_consensus.cc:1275] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.101277  2260 consensus_queue.cc:1048] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.119288  1327 raft_consensus.cc:1275] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.120790  2260 consensus_queue.cc:1048] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.132974  1474 raft_consensus.cc:1275] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.135514  2274 consensus_queue.cc:1048] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.184885  1402 raft_consensus.cc:1275] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.186123  2284 consensus_queue.cc:1048] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.200239  1474 raft_consensus.cc:1275] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.201946  2284 consensus_queue.cc:1048] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.334949  1402 raft_consensus.cc:1275] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.336424  2284 consensus_queue.cc:1048] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.347852 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:38.349568  1474 raft_consensus.cc:1275] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.351022  2260 consensus_queue.cc:1048] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.409329 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:38.457970  1327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae"
dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:60880
I20260709 13:13:38.458487  1327 raft_consensus.cc:606] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:38.461158  1327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1"
dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:60880
I20260709 13:13:38.461608  1327 raft_consensus.cc:606] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:38.463863  1327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ef816cc2381433d87915406a71a365d"
dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:60880
I20260709 13:13:38.464315  1327 raft_consensus.cc:606] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:38.466511  1402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798"
dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:42214
I20260709 13:13:38.467001  1402 raft_consensus.cc:606] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:38.473116  1327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acbe7a061fdd480e9dbf9bd9ec64cdd9"
dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:60880
I20260709 13:13:38.473603  1327 raft_consensus.cc:606] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:38.476622 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:38.478252 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:38.567224  2252 raft_consensus.cc:993] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.567801  2268 raft_consensus.cc:1081] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.569486  2039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:13:38.570207  2039 raft_consensus.cc:493] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.570549  2039 raft_consensus.cc:3060] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.577550  2039 raft_consensus.cc:515] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.580381  1474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:38.580924  1474 raft_consensus.cc:3060] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.589156  2039 leader_election.cc:290] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:38.590314  1474 raft_consensus.cc:2468] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:38.591596  1992 leader_election.cc:304] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:38.591693  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d16cd36a26e44ed8084e41f237f1ad1" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:38.592432  2260 raft_consensus.cc:2804] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.592914  2260 raft_consensus.cc:697] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:38.593847  2260 consensus_queue.cc:237] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.592345  1327 raft_consensus.cc:3055] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.596570  1327 raft_consensus.cc:740] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:38.617650  1327 consensus_queue.cc:260] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.619289  1327 raft_consensus.cc:3060] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.641798  1327 raft_consensus.cc:2468] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:38.652380  1151 catalog_manager.cc:5697] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 2 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.716634  2252 raft_consensus.cc:993] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.717221  2268 raft_consensus.cc:1081] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.718924  2039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:13:38.719530  2039 raft_consensus.cc:493] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.719877  2039 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:38.727473  2039 raft_consensus.cc:515] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.730232  1474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:38.730580  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146867b47b5b455fa5eab18fa30e09ae" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:38.730786  1474 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:38.731225  1327 raft_consensus.cc:3055] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:38.731585  1327 raft_consensus.cc:740] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:38.732352  1327 consensus_queue.cc:260] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.733500  1327 raft_consensus.cc:3060] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:38.744839  2039 leader_election.cc:290] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 3 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:38.746093  1327 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 3.
I20260709 13:13:38.747292  1995 leader_election.cc:304] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:38.748208  2260 raft_consensus.cc:2804] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:38.748709  2260 raft_consensus.cc:697] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 3 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:38.749379  1474 raft_consensus.cc:2468] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 3.
I20260709 13:13:38.749660  2260 consensus_queue.cc:237] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.769765  1151 catalog_manager.cc:5697] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 2 to 3, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 3 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.852330  2252 raft_consensus.cc:993] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.853856  2252 raft_consensus.cc:1081] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.856422  2044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ef816cc2381433d87915406a71a365d"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:13:38.857092  2044 raft_consensus.cc:493] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.857486  2044 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:38.863544  2044 raft_consensus.cc:515] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.865558  2044 leader_election.cc:290] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 3 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:38.866609  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:38.867324  1476 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:38.867141  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ef816cc2381433d87915406a71a365d" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:38.870267  1327 raft_consensus.cc:3055] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:38.870651  1327 raft_consensus.cc:740] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:38.871308  1327 consensus_queue.cc:260] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.872380  1327 raft_consensus.cc:3060] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:38.874656  1476 raft_consensus.cc:2468] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 3.
I20260709 13:13:38.878943  1327 raft_consensus.cc:2468] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 3.
I20260709 13:13:38.880940  1995 leader_election.cc:304] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:38.882120  2260 raft_consensus.cc:2804] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:38.882562  2260 raft_consensus.cc:697] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 3 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:38.883419  2260 consensus_queue.cc:237] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:38.904119  1151 catalog_manager.cc:5697] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 2 to 3, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 3 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.931190  2252 raft_consensus.cc:993] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.931787  2239 raft_consensus.cc:1081] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.933203  2044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acbe7a061fdd480e9dbf9bd9ec64cdd9"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:13:38.934662  2044 raft_consensus.cc:493] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.935034  2044 raft_consensus.cc:3060] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.937039  2295 raft_consensus.cc:993] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.937539  2295 raft_consensus.cc:1081] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:38.939077  2039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53272
I20260709 13:13:38.939579  2039 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.939925  2039 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.942801  2044 raft_consensus.cc:515] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:38.946283  2044 leader_election.cc:290] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:38.946585  1327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbe7a061fdd480e9dbf9bd9ec64cdd9" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:38.947147  1327 raft_consensus.cc:3055] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.947427  1327 raft_consensus.cc:740] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:38.948158  1327 consensus_queue.cc:260] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:38.949172  2039 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:38.949543  1327 raft_consensus.cc:3060] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.950641  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbe7a061fdd480e9dbf9bd9ec64cdd9" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:38.951246  1402 raft_consensus.cc:3060] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.951661  2039 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 4 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:38.954445  1325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:38.955032  1325 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.957753  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a11fac66d73d43d2ac8f1a4c97c78798" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:38.958314  1403 raft_consensus.cc:3055] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:38.958593  1403 raft_consensus.cc:740] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:38.959323  1403 consensus_queue.cc:260] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:38.960312  1327 raft_consensus.cc:2468] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:38.960501  1403 raft_consensus.cc:3060] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:38.961598  1995 leader_election.cc:304] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:38.962486  2260 raft_consensus.cc:2804] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.963095  2260 raft_consensus.cc:697] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:38.963964  2260 consensus_queue.cc:237] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:38.970847  1403 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 4.
I20260709 13:13:38.975591  1994 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:38.976398  2259 raft_consensus.cc:2804] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:38.976850  2259 raft_consensus.cc:697] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 4 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:38.977684  2259 consensus_queue.cc:237] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:38.987046  1325 raft_consensus.cc:2468] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 4.
I20260709 13:13:38.990121  1402 raft_consensus.cc:2468] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:39.005847  1151 catalog_manager.cc:5697] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 2 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.009130  1151 catalog_manager.cc:5697] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 3 to 4, leader changed from 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 4 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.010720  1476 raft_consensus.cc:1275] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.015605  2260 consensus_queue.cc:1048] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.049690  1325 raft_consensus.cc:1275] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.051239  2260 consensus_queue.cc:1048] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.234375  1325 raft_consensus.cc:1275] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:39.235989  2259 consensus_queue.cc:1048] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.252203  1478 raft_consensus.cc:1275] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:39.254065  2284 consensus_queue.cc:1048] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.308063  1329 raft_consensus.cc:1275] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:39.309193  2284 consensus_queue.cc:1048] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.330560  1476 raft_consensus.cc:1275] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:39.331966  2284 consensus_queue.cc:1048] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.437928  1403 raft_consensus.cc:1275] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:39.439018  2260 consensus_queue.cc:1048] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.451642  1325 raft_consensus.cc:1275] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 4 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:39.453701  2308 consensus_queue.cc:1048] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:39.479498 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:39.546551 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:39.589368  1403 raft_consensus.cc:1275] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.592980  2308 consensus_queue.cc:1048] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.599143  1325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e"
dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:60880
I20260709 13:13:39.599814  1325 raft_consensus.cc:606] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 3 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:39.595709  1329 raft_consensus.cc:1275] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.601953  2308 consensus_queue.cc:1048] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.610002  1329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73b8ca76daab4ec193441ebe56431bfb"
dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:60880
I20260709 13:13:39.610669  1329 raft_consensus.cc:606] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:39.613415  1327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad"
dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
mode: GRACEFUL
new_leader_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:60880
I20260709 13:13:39.613992  1327 raft_consensus.cc:606] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Received request to transfer leadership to TS e89740c5a5de48fd875c8b628616334c
I20260709 13:13:39.615317 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:39.617024 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:39.908257  2268 raft_consensus.cc:993] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:39.908746  2252 raft_consensus.cc:1081] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 3 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:39.910145  2044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:13:39.910686  2044 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:39.911031  2044 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.919833  2044 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:39.923262  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:39.923786  1329 raft_consensus.cc:3055] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:39.923961  2044 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 4 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:39.924060  1329 raft_consensus.cc:740] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:39.924979  1329 consensus_queue.cc:260] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:39.926158  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aac3ebb386142cdaf24fffaf202c86e" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:39.926748  1402 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.932926  1402 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 4.
I20260709 13:13:39.926357  1329 raft_consensus.cc:3060] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:39.934078  1994 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:39.934937  2260 raft_consensus.cc:2804] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:39.935396  2260 raft_consensus.cc:697] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 4 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:39.936260  2260 consensus_queue.cc:237] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:39.956378  1329 raft_consensus.cc:2468] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 4.
I20260709 13:13:39.968199  1151 catalog_manager.cc:5697] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 3 to 4, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 4 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:39.987421  2252 raft_consensus.cc:993] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:39.988101  2268 raft_consensus.cc:1081] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:39.990355  2044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73b8ca76daab4ec193441ebe56431bfb"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:13:39.991065  2044 raft_consensus.cc:493] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:39.991544  2044 raft_consensus.cc:3060] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.999450  2044 raft_consensus.cc:515] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:40.001544  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8ca76daab4ec193441ebe56431bfb" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:40.001782  2044 leader_election.cc:290] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:40.002070  1478 raft_consensus.cc:3060] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.001965  1329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b8ca76daab4ec193441ebe56431bfb" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:40.003585  1329 raft_consensus.cc:3055] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.003906  1329 raft_consensus.cc:740] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:40.004582  1329 consensus_queue.cc:260] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:40.005827  1329 raft_consensus.cc:3060] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.010951  1478 raft_consensus.cc:2468] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:40.012729  1992 leader_election.cc:304] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:40.014006  2309 raft_consensus.cc:2804] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.014477  2309 raft_consensus.cc:697] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:40.015353  2309 consensus_queue.cc:237] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:40.026084  1329 raft_consensus.cc:2468] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:40.038072  1151 catalog_manager.cc:5697] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 2 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.059324  2268 raft_consensus.cc:993] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f: : Instructing follower e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:40.059819  2318 raft_consensus.cc:1081] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Signalling peer e89740c5a5de48fd875c8b628616334c to start an election
I20260709 13:13:40.061599  2044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad"
dest_uuid: "e89740c5a5de48fd875c8b628616334c"
 from {username='slave'} at 127.0.0.1:53274
I20260709 13:13:40.062143  2044 raft_consensus.cc:493] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:40.062495  2044 raft_consensus.cc:3060] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.068039  2044 raft_consensus.cc:515] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:40.070683  2044 leader_election.cc:290] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:40.070578  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:40.071755  1325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e231c21d5eac41b2822621361cb74cad" candidate_uuid: "e89740c5a5de48fd875c8b628616334c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbe86acd78454edfa45d9c095875cb2f"
I20260709 13:13:40.072417  1325 raft_consensus.cc:3055] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:40.072748  1325 raft_consensus.cc:740] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbe86acd78454edfa45d9c095875cb2f, State: Running, Role: LEADER
I20260709 13:13:40.073421  1478 raft_consensus.cc:3060] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.073570  1325 consensus_queue.cc:260] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:40.075031  1325 raft_consensus.cc:3060] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:40.089192  1478 raft_consensus.cc:2468] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:40.091984  1992 leader_election.cc:304] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c; no voters: 
I20260709 13:13:40.092940  2309 raft_consensus.cc:2804] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:40.093407  1325 raft_consensus.cc:2468] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89740c5a5de48fd875c8b628616334c in term 2.
I20260709 13:13:40.093513  2309 raft_consensus.cc:697] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Becoming Leader. State: Replica: e89740c5a5de48fd875c8b628616334c, State: Running, Role: LEADER
I20260709 13:13:40.096144  2309 consensus_queue.cc:237] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:40.114828  1151 catalog_manager.cc:5697] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to e89740c5a5de48fd875c8b628616334c (127.22.225.129). New cstate: current_term: 2 leader_uuid: "e89740c5a5de48fd875c8b628616334c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.406627  1325 raft_consensus.cc:1275] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 4 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:40.408047  2260 consensus_queue.cc:1048] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:40.427327  1402 raft_consensus.cc:1275] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:40.429009  2309 consensus_queue.cc:1048] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:40.544417  1476 raft_consensus.cc:1275] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.545168  1325 raft_consensus.cc:1275] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.546612  2284 consensus_queue.cc:1048] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.547936  2309 consensus_queue.cc:1048] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.560945  1325 raft_consensus.cc:1275] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.566571  2309 consensus_queue.cc:1048] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.607033  1476 raft_consensus.cc:1275] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer e89740c5a5de48fd875c8b628616334c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:40.611581  2334 consensus_queue.cc:1048] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:40.618149 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:40.713267 23430 tablet_server.cc:179] TabletServer@127.22.225.129:44541 shutting down...
W20260709 13:13:40.756865  1294 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 61 similar messages]
W20260709 13:13:40.796573  1294 consensus_peers.cc:597] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:40.803583  1367 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.132:33083, user_credentials={real_user=slave}} blocked reactor thread for 47101.8us
W20260709 13:13:40.809093  1368 consensus_peers.cc:597] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:40.811179  1294 consensus_peers.cc:597] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.818799 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:40.821938 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.823076 23430 raft_consensus.cc:2243] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:40.825348  1442 consensus_peers.cc:597] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.825915 23430 raft_consensus.cc:2272] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.829445 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.830438 23430 raft_consensus.cc:2243] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.831013 23430 raft_consensus.cc:2272] T becaecefa770428abc9030aa88b4825e P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:40.831445  1294 consensus_peers.cc:597] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.833928 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.834879 23430 raft_consensus.cc:2243] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.835348 23430 raft_consensus.cc:2272] T fbcbf94f9eb44b7f85be2c961b4d641e P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.838464 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.839447 23430 raft_consensus.cc:2243] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.840025 23430 raft_consensus.cc:2272] T 58147dc2306b445bbc1134344d2d129d P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.843123 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.844331 23430 raft_consensus.cc:2243] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.845355 23430 raft_consensus.cc:2272] T 59ed770654a140988fd6e180dad119cc P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.848268 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.849177 23430 raft_consensus.cc:2243] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.849745 23430 raft_consensus.cc:2272] T cf505580e1d94688a182fbba553caf49 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.852845 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.853670 23430 raft_consensus.cc:2243] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.854331 23430 raft_consensus.cc:2272] T 6d59b30b44054b238642951881f89b66 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.857244 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.858094 23430 raft_consensus.cc:2243] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.858644 23430 raft_consensus.cc:2272] T 96e6253c017e4c2aae09a2b069b190b7 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.861491 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.864084 23430 raft_consensus.cc:2243] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.865057 23430 raft_consensus.cc:2272] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.868683 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.869652 23430 raft_consensus.cc:2243] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.870275 23430 raft_consensus.cc:2272] T f96429c9f69a43a898faaab20a0cc9d8 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.873593 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.874424 23430 raft_consensus.cc:2243] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.875350 23430 raft_consensus.cc:2272] T a11fac66d73d43d2ac8f1a4c97c78798 P e89740c5a5de48fd875c8b628616334c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.878089 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.880142 23430 raft_consensus.cc:2243] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.881146 23430 raft_consensus.cc:2272] T 1d16cd36a26e44ed8084e41f237f1ad1 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.883919 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.884822 23430 raft_consensus.cc:2243] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.885360 23430 raft_consensus.cc:2272] T 141e6a07df1a4244a64d1eb2bb0c66c9 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:40.890013  1368 consensus_peers.cc:597] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.890563 23430 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:40.891028  1442 consensus_peers.cc:597] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.891523 23430 raft_consensus.cc:2243] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:40.892524  1442 consensus_peers.cc:597] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.892697 23430 raft_consensus.cc:2272] T b19cd97df43d45fea5f71645e8ee8a04 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.895624 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.896463 23430 raft_consensus.cc:2243] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.896912 23430 raft_consensus.cc:2272] T e568e879af50468085dbcfedb5005859 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.900175 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.901217 23430 raft_consensus.cc:2243] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.902575 23430 raft_consensus.cc:2272] T 73b8ca76daab4ec193441ebe56431bfb P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:40.906514  1294 consensus_peers.cc:597] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.909406 23430 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:40.910017  1442 consensus_peers.cc:597] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.910442 23430 raft_consensus.cc:2243] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.911101 23430 raft_consensus.cc:2272] T cb1be411e3cd45fab10d3ca9265e1696 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.914266 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.915159 23430 raft_consensus.cc:2243] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.916152 23430 raft_consensus.cc:2272] T 44c175554ac140ef8db4ae40ed5afc75 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.918880 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.919766 23430 raft_consensus.cc:2243] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.920804 23430 raft_consensus.cc:2272] T 3aac3ebb386142cdaf24fffaf202c86e P e89740c5a5de48fd875c8b628616334c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.923918 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.924775 23430 raft_consensus.cc:2243] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.925295 23430 raft_consensus.cc:2272] T 8bc36900defe4c799e8a1639efcffd13 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.928372 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.929253 23430 raft_consensus.cc:2243] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:40.929560  1442 consensus_peers.cc:597] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.929776 23430 raft_consensus.cc:2272] T b7724e8025f442c084e2988c3de7cc75 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.932874 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.933771 23430 raft_consensus.cc:2243] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.934258 23430 raft_consensus.cc:2272] T 1ecd149ab31945ab9517f3ab5061847d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.937285 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.938102 23430 raft_consensus.cc:2243] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.939638 23430 raft_consensus.cc:2272] T e6c6d73d03124b02976ae2b9126c2d7e P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.942612 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.943473 23430 raft_consensus.cc:2243] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.944010 23430 raft_consensus.cc:2272] T 1a7de12179bb42a98b37bf18c8eb8591 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.946928 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.947715 23430 raft_consensus.cc:2243] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.948696 23430 raft_consensus.cc:2272] T 146867b47b5b455fa5eab18fa30e09ae P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.951488 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.952219 23430 raft_consensus.cc:2243] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.952783 23430 raft_consensus.cc:2272] T 6bfaf2eb5ac94004b49869c3fb44246b P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.955602 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.956396 23430 raft_consensus.cc:2243] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.956877 23430 raft_consensus.cc:2272] T 6561d58a0d984196a8f1edde7c628758 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.959604 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.960414 23430 raft_consensus.cc:2243] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.960911 23430 raft_consensus.cc:2272] T 80d272b7f7ba4b9aa358c6ab6b9c902c P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.963889 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.964687 23430 raft_consensus.cc:2243] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.965670 23430 raft_consensus.cc:2272] T 5c9d052234b64c6c9657372e21b121af P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.968712 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.969507 23430 raft_consensus.cc:2243] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:40.970489 23430 raft_consensus.cc:2272] T 57b6cfeddad84835825e5e204da91e99 P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.973472 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.974298 23430 raft_consensus.cc:2243] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.974823 23430 raft_consensus.cc:2272] T 38b311b738bf44b1abdf2cc9faeb4a19 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:40.976325  1442 consensus_peers.cc:597] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.977792 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.978708 23430 raft_consensus.cc:2243] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.979277 23430 raft_consensus.cc:2272] T 189f636ed54445ea91f7f9411e1b7593 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.982307 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.983084 23430 raft_consensus.cc:2243] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.983626 23430 raft_consensus.cc:2272] T b66f4c48f5f44fb7a7c683868e97d498 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.986676 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.987445 23430 raft_consensus.cc:2243] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.988021 23430 raft_consensus.cc:2272] T 38d77a5b6b9c4251a7ca4a132c0cddcb P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:40.988561  1368 consensus_peers.cc:597] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:40.991012 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.991940 23430 raft_consensus.cc:2243] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.992424 23430 raft_consensus.cc:2272] T fed66ef7a02f46b699f94f562b334afd P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.995503 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:40.996251 23430 raft_consensus.cc:2243] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:40.996857 23430 raft_consensus.cc:2272] T 541fd181a6934377a1d38c9dc9db98a1 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:40.999704 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:41.000450 23430 raft_consensus.cc:2243] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.001044 23430 raft_consensus.cc:2272] T 68c469e4ff0f4df4aa908546ef6482f2 P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.004168 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:41.004967 23430 raft_consensus.cc:2243] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.005512 23430 raft_consensus.cc:2272] T 8ec88e02ca274791a250e577eb123cdb P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:41.005851  1294 consensus_peers.cc:597] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.008289 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:41.009228 23430 raft_consensus.cc:2243] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.009794 23430 raft_consensus.cc:2272] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.012573 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:41.013363 23430 raft_consensus.cc:2243] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.014374 23430 raft_consensus.cc:2272] T e231c21d5eac41b2822621361cb74cad P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.017400 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:41.018169 23430 raft_consensus.cc:2243] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.018796 23430 raft_consensus.cc:2272] T 88e6c0060fd34173a140bae79fbc0ed6 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.022130 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:41.022904 23430 raft_consensus.cc:2243] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.023494 23430 raft_consensus.cc:2272] T dd6b66c1551c438084e2d9766814c7d3 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.026355 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:41.027112 23430 raft_consensus.cc:2243] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.028007 23430 raft_consensus.cc:2272] T 9058031903ea43fb9f534aa81f81ed7d P e89740c5a5de48fd875c8b628616334c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.031124 23430 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:41.031745  1442 consensus_peers.cc:597] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.031898 23430 raft_consensus.cc:2243] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.033113 23430 raft_consensus.cc:2272] T 7ef816cc2381433d87915406a71a365d P e89740c5a5de48fd875c8b628616334c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:41.034983  1368 consensus_peers.cc:597] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.036290 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:41.037071 23430 raft_consensus.cc:2243] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.038053 23430 raft_consensus.cc:2272] T 1ced950a049249b1a6e0621dbb3de9d4 P e89740c5a5de48fd875c8b628616334c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:41.059725  1294 consensus_peers.cc:597] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.060530  1442 consensus_peers.cc:597] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.067690  1442 consensus_peers.cc:597] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.072587  1368 consensus_peers.cc:597] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.073339  1368 consensus_peers.cc:597] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.095485  1294 consensus_peers.cc:597] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.097713  1368 consensus_peers.cc:597] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.100180  1294 consensus_peers.cc:597] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.123930 23430 tablet_server.cc:196] TabletServer@127.22.225.129:44541 shutdown complete.
W20260709 13:13:41.136101  1368 consensus_peers.cc:597] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.139581  1368 consensus_peers.cc:597] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.174510  1294 consensus_peers.cc:597] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.192830  1294 consensus_peers.cc:597] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.198670  1294 consensus_peers.cc:597] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.202095  1368 consensus_peers.cc:597] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.221170 23430 tablet_server.cc:179] TabletServer@127.22.225.130:0 shutting down...
W20260709 13:13:41.224218  1442 consensus_peers.cc:597] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.239138  1444 consensus_peers.cc:597] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.263396 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:41.264312 23430 tablet_replica.cc:333] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.265210 23430 raft_consensus.cc:2243] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.265659 23430 raft_consensus.cc:2272] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.268069 23430 tablet_replica.cc:333] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.268792 23430 raft_consensus.cc:2243] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.269294 23430 raft_consensus.cc:2272] T 7ef816cc2381433d87915406a71a365d P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.271766 23430 tablet_replica.cc:333] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.272572 23430 raft_consensus.cc:2243] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.273178 23430 raft_consensus.cc:2272] T 44c175554ac140ef8db4ae40ed5afc75 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:41.275250  1370 consensus_peers.cc:597] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.275622 23430 tablet_replica.cc:333] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.276563 23430 raft_consensus.cc:2243] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.277102 23430 raft_consensus.cc:2272] T 73b8ca76daab4ec193441ebe56431bfb P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.280447 23430 tablet_replica.cc:333] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
W20260709 13:13:41.280273  1444 consensus_peers.cc:597] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.281267 23430 raft_consensus.cc:2243] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.281795 23430 raft_consensus.cc:2272] T 1ced950a049249b1a6e0621dbb3de9d4 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.284576 23430 tablet_replica.cc:333] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.285369 23430 raft_consensus.cc:2243] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.286389 23430 raft_consensus.cc:2272] T dd6b66c1551c438084e2d9766814c7d3 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.289018 23430 tablet_replica.cc:333] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.289882 23430 raft_consensus.cc:2243] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.290433 23430 raft_consensus.cc:2272] T 15e8d0036e5647809908799723c1a147 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.292518 23430 tablet_replica.cc:333] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.293135 23430 raft_consensus.cc:2243] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.293915 23430 raft_consensus.cc:2272] T 141e6a07df1a4244a64d1eb2bb0c66c9 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.296188 23430 tablet_replica.cc:333] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.296908 23430 raft_consensus.cc:2243] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.297925 23430 raft_consensus.cc:2272] T 96e6253c017e4c2aae09a2b069b190b7 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.300573 23430 tablet_replica.cc:333] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.301388 23430 raft_consensus.cc:2243] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.301904 23430 raft_consensus.cc:2272] T 88e6c0060fd34173a140bae79fbc0ed6 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.304570 23430 tablet_replica.cc:333] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.305410 23430 raft_consensus.cc:2243] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.305888 23430 raft_consensus.cc:2272] T 57b6cfeddad84835825e5e204da91e99 P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.308499 23430 tablet_replica.cc:333] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.309233 23430 raft_consensus.cc:2243] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.309726 23430 raft_consensus.cc:2272] T 38b311b738bf44b1abdf2cc9faeb4a19 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:41.310559  1444 consensus_peers.cc:597] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.311997 23430 tablet_replica.cc:333] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.312662 23430 raft_consensus.cc:2243] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.313107 23430 raft_consensus.cc:2272] T 21b9c856f42e4d8aabac8f485922bac4 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.315362 23430 tablet_replica.cc:333] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.315923 23430 raft_consensus.cc:2243] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.316325 23430 raft_consensus.cc:2272] T 701a3f41583a49c69e65971c4f0fc271 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.318655 23430 tablet_replica.cc:333] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.319196 23430 raft_consensus.cc:2243] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.319615 23430 raft_consensus.cc:2272] T 0697a4a227684a69982f353a21f6f91c P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.322052 23430 tablet_replica.cc:333] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.322871 23430 raft_consensus.cc:2243] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.323365 23430 raft_consensus.cc:2272] T 68c469e4ff0f4df4aa908546ef6482f2 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:41.323951  1444 consensus_peers.cc:597] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.325917 23430 tablet_replica.cc:333] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.326565 23430 raft_consensus.cc:2243] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.326987 23430 raft_consensus.cc:2272] T f1b7143fae804b6db2eb33c3cc276f23 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.329115 23430 tablet_replica.cc:333] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.329694 23430 raft_consensus.cc:2243] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.330096 23430 raft_consensus.cc:2272] T e568e879af50468085dbcfedb5005859 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.332096 23430 tablet_replica.cc:333] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.332864 23430 raft_consensus.cc:2243] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.333340 23430 raft_consensus.cc:2272] T 39dbc9ed002b4e458021f97d435e9fff P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.335742 23430 tablet_replica.cc:333] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.336598 23430 raft_consensus.cc:2243] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.337673 23430 raft_consensus.cc:2272] T 6561d58a0d984196a8f1edde7c628758 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.340319 23430 tablet_replica.cc:333] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
W20260709 13:13:41.340366  1370 consensus_peers.cc:597] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.341210 23430 raft_consensus.cc:2243] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.341764 23430 raft_consensus.cc:2272] T 6958d3ba5e114d41a6b80c1c57ac0026 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.344481 23430 tablet_replica.cc:333] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
W20260709 13:13:41.344506  1444 consensus_peers.cc:597] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.345304 23430 raft_consensus.cc:2243] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.345753 23430 raft_consensus.cc:2272] T 5c9d052234b64c6c9657372e21b121af P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.347657 23430 tablet_replica.cc:333] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.348253 23430 raft_consensus.cc:2243] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.348701 23430 raft_consensus.cc:2272] T 8ec88e02ca274791a250e577eb123cdb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.350675 23430 tablet_replica.cc:333] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.351329 23430 raft_consensus.cc:2243] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.351805 23430 raft_consensus.cc:2272] T 2bb045a1ea9c4a7d81082cfb9317cacc P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.354487 23430 tablet_replica.cc:333] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.355216 23430 raft_consensus.cc:2243] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.355701 23430 raft_consensus.cc:2272] T edb5ff6e1bd14308a0d214d7fcc8fecf P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.358163 23430 tablet_replica.cc:333] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.358892 23430 raft_consensus.cc:2243] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.359431 23430 raft_consensus.cc:2272] T 1a7de12179bb42a98b37bf18c8eb8591 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.362020 23430 tablet_replica.cc:333] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.362733 23430 raft_consensus.cc:2243] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.363220 23430 raft_consensus.cc:2272] T 146867b47b5b455fa5eab18fa30e09ae P bbe86acd78454edfa45d9c095875cb2f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.365723 23430 tablet_replica.cc:333] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.366463 23430 raft_consensus.cc:2243] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.367426 23430 raft_consensus.cc:2272] T e6c6d73d03124b02976ae2b9126c2d7e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.370121 23430 tablet_replica.cc:333] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.370790 23430 raft_consensus.cc:2243] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.371274 23430 raft_consensus.cc:2272] T e231c21d5eac41b2822621361cb74cad P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.374274 23430 tablet_replica.cc:333] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.374961 23430 raft_consensus.cc:2243] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.375882 23430 raft_consensus.cc:2272] T 8a76b504d1f94cd18b99eddae689c4bb P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.378350 23430 tablet_replica.cc:333] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.379014 23430 raft_consensus.cc:2243] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.380004 23430 raft_consensus.cc:2272] T 189f636ed54445ea91f7f9411e1b7593 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.382741 23430 tablet_replica.cc:333] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.383458 23430 raft_consensus.cc:2243] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.384442 23430 raft_consensus.cc:2272] T b66f4c48f5f44fb7a7c683868e97d498 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.389569 23430 tablet_replica.cc:333] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.390071 23430 raft_consensus.cc:2243] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.390761 23430 raft_consensus.cc:2272] T fdfb8ffcbef24e338137b942224f9ed8 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.392578 23430 tablet_replica.cc:333] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.393136 23430 raft_consensus.cc:2243] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.393573 23430 raft_consensus.cc:2272] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.395678 23430 tablet_replica.cc:333] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.396303 23430 raft_consensus.cc:2243] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.396821 23430 raft_consensus.cc:2272] T a11fac66d73d43d2ac8f1a4c97c78798 P bbe86acd78454edfa45d9c095875cb2f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.399137 23430 tablet_replica.cc:333] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
W20260709 13:13:41.398975  1444 consensus_peers.cc:597] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.399861 23430 raft_consensus.cc:2243] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.400621 23430 raft_consensus.cc:2272] T 8bc36900defe4c799e8a1639efcffd13 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.402905 23430 tablet_replica.cc:333] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.403599 23430 raft_consensus.cc:2243] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.403988 23430 raft_consensus.cc:2272] T 3aac3ebb386142cdaf24fffaf202c86e P bbe86acd78454edfa45d9c095875cb2f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.406430 23430 tablet_replica.cc:333] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.406951 23430 raft_consensus.cc:2243] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.407693 23430 raft_consensus.cc:2272] T b7724e8025f442c084e2988c3de7cc75 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.409597 23430 tablet_replica.cc:333] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.410070 23430 raft_consensus.cc:2243] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.410439 23430 raft_consensus.cc:2272] T bf601481d5614428aa1948ce5e0df02f P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.412431 23430 tablet_replica.cc:333] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.412922 23430 raft_consensus.cc:2243] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.413782 23430 raft_consensus.cc:2272] T d695ee04326f476498937637eb685d7b P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.416316 23430 tablet_replica.cc:333] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.416960 23430 raft_consensus.cc:2243] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:41.417491 23430 raft_consensus.cc:2272] T 1d16cd36a26e44ed8084e41f237f1ad1 P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.419884 23430 tablet_replica.cc:333] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.420502 23430 raft_consensus.cc:2243] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.421459 23430 raft_consensus.cc:2272] T 58147dc2306b445bbc1134344d2d129d P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.424010 23430 tablet_replica.cc:333] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.424683 23430 raft_consensus.cc:2243] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.425680 23430 raft_consensus.cc:2272] T becaecefa770428abc9030aa88b4825e P bbe86acd78454edfa45d9c095875cb2f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:41.428339 23430 tablet_replica.cc:333] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f: stopping tablet replica
I20260709 13:13:41.428869 23430 raft_consensus.cc:2243] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:41.429873 23430 raft_consensus.cc:2272] T d7b91b4efbf841fbb8d25e87fef4b296 P bbe86acd78454edfa45d9c095875cb2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:41.430265  1444 consensus_peers.cc:597] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.513831  1370 consensus_peers.cc:597] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.515153  1444 consensus_peers.cc:597] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.593780  1444 consensus_peers.cc:597] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.599229  1370 consensus_peers.cc:597] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.602880  1370 consensus_peers.cc:597] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.608846  1370 consensus_peers.cc:597] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.672134  1370 consensus_peers.cc:597] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:41.692159  1370 consensus_peers.cc:597] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:41.938342  2291 raft_consensus.cc:493] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:41.938876  2291 raft_consensus.cc:515] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:41.940124  2339 raft_consensus.cc:493] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:41.940639  2339 raft_consensus.cc:515] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:41.940979  2291 leader_election.cc:290] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:41.944787  2291 raft_consensus.cc:493] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:41.945302  2291 raft_consensus.cc:515] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:41.947453  2291 leader_election.cc:290] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:41.953379  1368 leader_election.cc:336] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:41.954428  1442 leader_election.cc:336] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:41.957842  1442 leader_election.cc:336] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:41.959625  2339 leader_election.cc:290] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:41.964744  1370 leader_election.cc:336] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:41.965199  1370 leader_election.cc:304] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:41.966277  2339 raft_consensus.cc:2749] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:41.960186  1444 leader_election.cc:336] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:41.968400  1444 leader_election.cc:304] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:41.969107  2291 raft_consensus.cc:2749] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:41.970075  1444 leader_election.cc:336] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:41.970505  1444 leader_election.cc:304] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:41.971784  2291 raft_consensus.cc:2749] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.041810  2291 raft_consensus.cc:493] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.042398  2291 raft_consensus.cc:515] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:42.044847  2291 leader_election.cc:290] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.048246  1442 leader_election.cc:336] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.048607  2339 raft_consensus.cc:493] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.049149  2339 raft_consensus.cc:515] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.050894  2339 leader_election.cc:290] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.054440  1444 leader_election.cc:336] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.054975  1444 leader_election.cc:304] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.056227  2291 raft_consensus.cc:2749] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:42.056993  1368 leader_election.cc:336] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.059419  1370 leader_election.cc:336] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.059908  1370 leader_election.cc:304] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.060730  2295 raft_consensus.cc:2749] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.101686  2295 raft_consensus.cc:493] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.102196  2295 raft_consensus.cc:515] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:42.105650  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:42.105835  2295 leader_election.cc:290] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:42.109200  2236 raft_consensus.cc:493] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.109690  2236 raft_consensus.cc:515] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:42.111565  2236 leader_election.cc:290] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.112442  1368 leader_election.cc:336] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.114274  1368 leader_election.cc:304] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.115479  2295 raft_consensus.cc:2749] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:42.116935  1442 leader_election.cc:336] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.117470  1444 leader_election.cc:336] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.117888  1444 leader_election.cc:304] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.118605  2236 raft_consensus.cc:2749] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.121111  2236 raft_consensus.cc:493] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.121623  2236 raft_consensus.cc:515] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:42.123811  2236 leader_election.cc:290] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.127440  1442 leader_election.cc:336] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.128123  1444 leader_election.cc:336] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.128684  1444 leader_election.cc:304] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.129558  2236 raft_consensus.cc:2749] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.149474  2236 raft_consensus.cc:493] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.150167  2236 raft_consensus.cc:515] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:42.152724  2236 leader_election.cc:290] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:42.153414  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:42.157612  1442 leader_election.cc:336] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.158071  1442 leader_election.cc:304] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.158805  2236 raft_consensus.cc:2749] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.238648  2236 raft_consensus.cc:493] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.239063  2236 raft_consensus.cc:515] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:42.240628  2236 leader_election.cc:290] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:42.240783  2291 raft_consensus.cc:493] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.241309  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:42.241434  2291 raft_consensus.cc:515] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:42.242069  1403 raft_consensus.cc:2468] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:42.243566  2291 leader_election.cc:290] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:42.244433  1443 leader_election.cc:304] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:42.245254  2291 raft_consensus.cc:2804] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:42.245643  2291 raft_consensus.cc:493] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.246033  2291 raft_consensus.cc:3060] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:42.246037  1442 leader_election.cc:336] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.249235  1444 leader_election.cc:336] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
W20260709 13:13:42.249818  1442 leader_election.cc:336] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.250240  1442 leader_election.cc:304] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.250926  2236 raft_consensus.cc:2749] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.253376  2291 raft_consensus.cc:515] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:42.255046  2291 leader_election.cc:290] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 election: Requested vote from peers 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:42.255604  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19cd97df43d45fea5f71645e8ee8a04" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:42.256204  1403 raft_consensus.cc:3060] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:42.265390  1442 leader_election.cc:336] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.265808  1403 raft_consensus.cc:2468] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 3.
I20260709 13:13:42.267269  1443 leader_election.cc:304] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.268018  2291 raft_consensus.cc:2804] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:42.269718  2291 raft_consensus.cc:697] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 3 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:42.270361  2339 raft_consensus.cc:493] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.270519  2291 consensus_queue.cc:237] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:42.270893  2339 raft_consensus.cc:515] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:42.272842  2339 leader_election.cc:290] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:42.275203  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:42.276001  1478 raft_consensus.cc:2468] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 2.
I20260709 13:13:42.277915  1367 leader_election.cc:304] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:42.281273  2339 raft_consensus.cc:2804] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:42.281387  1368 leader_election.cc:336] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.281770  2339 raft_consensus.cc:493] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.282202  2339 raft_consensus.cc:3060] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:42.288565  1150 catalog_manager.cc:5697] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 2 to 3, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 3 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.290159  2339 raft_consensus.cc:515] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
I20260709 13:13:42.292513  2339 leader_election.cc:290] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 election: Requested vote from peers 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:42.292979  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ed770654a140988fd6e180dad119cc" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:42.293560  1478 raft_consensus.cc:3060] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:42.296695  1368 leader_election.cc:336] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.298738  2339 raft_consensus.cc:493] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.299293  2339 raft_consensus.cc:515] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.300158  1478 raft_consensus.cc:2468] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 3.
I20260709 13:13:42.301265  1367 leader_election.cc:304] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.301810  2339 leader_election.cc:290] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:42.304989  2316 raft_consensus.cc:2804] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:42.305583  2316 raft_consensus.cc:697] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:42.306630  2316 consensus_queue.cc:237] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:42.316247  1370 leader_election.cc:336] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
W20260709 13:13:42.317409  1368 leader_election.cc:336] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.318387  2339 raft_consensus.cc:493] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.318902  2339 raft_consensus.cc:515] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.320811  2339 leader_election.cc:290] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:42.325908  2295 raft_consensus.cc:493] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.327055  2295 raft_consensus.cc:515] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
W20260709 13:13:42.326380  1370 leader_election.cc:336] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.329622  2295 leader_election.cc:290] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:42.332111  1368 leader_election.cc:304] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.333055  2295 raft_consensus.cc:2749] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:13:42.336630  1370 leader_election.cc:336] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
W20260709 13:13:42.340613  1368 leader_election.cc:336] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.341041  1368 leader_election.cc:304] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
W20260709 13:13:42.341874  1368 leader_election.cc:336] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.342232  1368 leader_election.cc:304] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.343318  2339 raft_consensus.cc:2749] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.343987  2339 raft_consensus.cc:2749] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.347426  1150 catalog_manager.cc:5697] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 2 to 3, leader changed from e89740c5a5de48fd875c8b628616334c (127.22.225.129) to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.355759  2236 raft_consensus.cc:493] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.356246  2236 raft_consensus.cc:515] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:42.357646  2236 leader_election.cc:290] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.365780  1444 leader_election.cc:336] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
W20260709 13:13:42.366683  1442 leader_election.cc:336] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.367091  1442 leader_election.cc:304] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.367748  2236 raft_consensus.cc:2749] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.381319  2291 raft_consensus.cc:493] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:42.382103  2291 raft_consensus.cc:515] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:42.384459  2291 leader_election.cc:290] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.392912  1444 leader_election.cc:336] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
W20260709 13:13:42.393713  1442 leader_election.cc:336] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.394107  1442 leader_election.cc:304] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.394711  2291 raft_consensus.cc:2749] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:42.440241  2295 raft_consensus.cc:493] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.440814  2295 raft_consensus.cc:515] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.450747  2295 leader_election.cc:290] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.454028  1368 leader_election.cc:336] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.455176  1370 leader_election.cc:336] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.455626  1370 leader_election.cc:304] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.456670  2339 raft_consensus.cc:2749] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:42.470323  2339 raft_consensus.cc:493] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.470834  2339 raft_consensus.cc:515] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.472590  2339 leader_election.cc:290] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.476449  1370 leader_election.cc:336] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
W20260709 13:13:42.477913  1368 leader_election.cc:336] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.478281  1368 leader_election.cc:304] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.478821  2339 raft_consensus.cc:2749] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.496917  2339 raft_consensus.cc:493] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.497490  2339 raft_consensus.cc:515] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.499667  2339 leader_election.cc:290] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.504061  1368 leader_election.cc:336] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.504534  1370 leader_election.cc:336] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.505021  1370 leader_election.cc:304] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.505754  2339 raft_consensus.cc:2749] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:42.509753 23430 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1351)
I20260709 13:13:42.527217  2339 raft_consensus.cc:493] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.527762  2339 raft_consensus.cc:515] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.529601  2339 leader_election.cc:290] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:42.530586  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:42.534422  1370 leader_election.cc:336] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.534824  1370 leader_election.cc:304] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:42.535421  2339 raft_consensus.cc:2749] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:42.597150  2295 raft_consensus.cc:493] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.597685  2295 raft_consensus.cc:515] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.599731  2295 leader_election.cc:290] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.605171  1368 leader_election.cc:336] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.605926  1370 leader_election.cc:336] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.606385  1370 leader_election.cc:304] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.607388  2295 raft_consensus.cc:2749] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:42.632582  2291 raft_consensus.cc:493] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.633060  2291 raft_consensus.cc:515] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.635993  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:42.636801  2291 leader_election.cc:290] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
W20260709 13:13:42.639134  1444 leader_election.cc:336] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.639605  1444 leader_election.cc:304] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:42.639773  2291 raft_consensus.cc:493] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.640278  2236 raft_consensus.cc:2749] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:42.640301  2291 raft_consensus.cc:515] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:42.643424  2291 leader_election.cc:290] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.646056  1442 leader_election.cc:336] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.647615  1444 leader_election.cc:336] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.647979  1444 leader_election.cc:304] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.648821  2291 raft_consensus.cc:2749] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.657975  2339 raft_consensus.cc:493] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.658478  2339 raft_consensus.cc:515] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.659970  2339 leader_election.cc:290] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:42.660944  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b91b4efbf841fbb8d25e87fef4b296" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:42.664885  1370 leader_election.cc:336] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.665298  1370 leader_election.cc:304] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 18c0de76f1804e98b0826423261536c9, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:42.665860  2339 raft_consensus.cc:2749] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:42.734259  2339 raft_consensus.cc:493] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.734897  2291 raft_consensus.cc:493] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.734942  2339 raft_consensus.cc:515] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.735373  2291 raft_consensus.cc:515] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:42.737775  2339 leader_election.cc:290] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:42.738322  2291 leader_election.cc:290] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:42.740427  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
W20260709 13:13:42.741022  1442 leader_election.cc:336] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.741058  1478 raft_consensus.cc:2468] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:42.742895  1367 leader_election.cc:304] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
W20260709 13:13:42.743122  1444 leader_election.cc:336] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.743712  2339 raft_consensus.cc:2804] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:42.743673  1444 leader_election.cc:304] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.744153  2339 raft_consensus.cc:493] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
W20260709 13:13:42.744450  1370 leader_election.cc:336] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.744626  2339 raft_consensus.cc:3060] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.745483  2291 raft_consensus.cc:2749] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:42.750394  2339 raft_consensus.cc:515] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.750841  1478 raft_consensus.cc:1275] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Refusing update from remote peer 2fc95e1790d2492e93bddd6efb72a2c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:42.752365  2339 leader_election.cc:290] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:42.752336  2316 consensus_queue.cc:1048] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:42.753958  1478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a76b504d1f94cd18b99eddae689c4bb" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
I20260709 13:13:42.754484  1478 raft_consensus.cc:3060] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:42.759822  1370 leader_election.cc:336] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.762481  1478 raft_consensus.cc:2468] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 2.
I20260709 13:13:42.763738  1367 leader_election.cc:304] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:42.764721  2316 raft_consensus.cc:2804] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:42.765223  2316 raft_consensus.cc:697] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:42.765692  2339 raft_consensus.cc:493] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.766048  2316 consensus_queue.cc:237] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.766260  2339 raft_consensus.cc:515] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.768972  2339 leader_election.cc:290] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:42.776381  2291 raft_consensus.cc:493] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.776926  2291 raft_consensus.cc:515] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.785218  2236 raft_consensus.cc:493] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.785836  2236 raft_consensus.cc:515] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } }
W20260709 13:13:42.787652  1368 leader_election.cc:336] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.789443  1370 leader_election.cc:336] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.793367  2291 leader_election.cc:290] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:42.798352  2291 raft_consensus.cc:493] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.798782  2291 raft_consensus.cc:515] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.800653  2291 leader_election.cc:290] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:42.794342  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d695ee04326f476498937637eb685d7b" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
W20260709 13:13:42.800789  1442 leader_election.cc:336] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.794482  2236 leader_election.cc:290] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541)
I20260709 13:13:42.801714  1370 leader_election.cc:304] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.802407  2339 raft_consensus.cc:2749] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.803541  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b91b4efbf841fbb8d25e87fef4b296" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:42.804131  1402 raft_consensus.cc:2468] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:42.805177  1443 leader_election.cc:304] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
I20260709 13:13:42.805902  2291 raft_consensus.cc:2804] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:42.806231  2291 raft_consensus.cc:493] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.806536  2291 raft_consensus.cc:3060] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:42.809823  1444 leader_election.cc:336] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.810335  1444 leader_election.cc:304] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: 2fc95e1790d2492e93bddd6efb72a2c3, bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:42.811013  2236 raft_consensus.cc:2749] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:13:42.811983  1444 leader_election.cc:336] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.812426  1444 leader_election.cc:304] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.813104  2236 raft_consensus.cc:2749] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:42.813949  1444 leader_election.cc:336] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.814324  1150 catalog_manager.cc:5697] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:42.822647  1368 consensus_peers.cc:597] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.826558  2291 raft_consensus.cc:515] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.828583  2291 leader_election.cc:290] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:42.829608  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b91b4efbf841fbb8d25e87fef4b296" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:42.830202  1402 raft_consensus.cc:3060] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:42.836724  1444 leader_election.cc:336] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.837101  1402 raft_consensus.cc:2468] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:42.837687  2295 raft_consensus.cc:493] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.838142  2295 raft_consensus.cc:515] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.838267  1443 leader_election.cc:304] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:42.839095  2291 raft_consensus.cc:2804] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:42.839532  2291 raft_consensus.cc:697] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:42.840240  2291 consensus_queue.cc:237] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.841207  2295 leader_election.cc:290] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.845963  1370 leader_election.cc:336] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
W20260709 13:13:42.846604  1368 leader_election.cc:336] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:42.847057  1368 leader_election.cc:304] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.847787  2295 raft_consensus.cc:2749] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:42.853912  1150 catalog_manager.cc:5697] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:42.861977  2295 raft_consensus.cc:493] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.862514  2295 raft_consensus.cc:515] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } }
I20260709 13:13:42.865991  2295 leader_election.cc:290] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
W20260709 13:13:42.868949  1368 leader_election.cc:336] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
W20260709 13:13:42.869894  1370 leader_election.cc:336] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.870224  1370 leader_election.cc:304] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:42.870729  2295 raft_consensus.cc:2749] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:42.872823  2316 raft_consensus.cc:493] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.873234  2316 raft_consensus.cc:515] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.875357  2316 leader_election.cc:290] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:42.876281  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d695ee04326f476498937637eb685d7b" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9" is_pre_election: true
I20260709 13:13:42.876850  1476 raft_consensus.cc:2468] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 1.
I20260709 13:13:42.877592  2236 raft_consensus.cc:493] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.878214  1367 leader_election.cc:304] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
W20260709 13:13:42.879395  1370 leader_election.cc:336] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.879585  2339 raft_consensus.cc:2804] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:42.880023  2339 raft_consensus.cc:493] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.880400  2339 raft_consensus.cc:3060] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.878085  2236 raft_consensus.cc:515] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.886327  2236 leader_election.cc:290] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:42.888105  1402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" is_pre_election: true
I20260709 13:13:42.888778  1402 raft_consensus.cc:2468] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 1.
I20260709 13:13:42.890290  1443 leader_election.cc:304] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: 
W20260709 13:13:42.890998  1444 leader_election.cc:336] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.891414  2236 raft_consensus.cc:2804] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:42.891773  2236 raft_consensus.cc:493] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bbe86acd78454edfa45d9c095875cb2f)
I20260709 13:13:42.892102  2236 raft_consensus.cc:3060] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.896319  2236 raft_consensus.cc:515] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.901476  2339 raft_consensus.cc:515] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.902311  1402 raft_consensus.cc:1275] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Refusing update from remote peer 18c0de76f1804e98b0826423261536c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:42.906790  2339 leader_election.cc:290] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 18c0de76f1804e98b0826423261536c9 (127.22.225.132:33083)
I20260709 13:13:42.907246  2291 consensus_queue.cc:1048] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:42.908988  1476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d695ee04326f476498937637eb685d7b" candidate_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18c0de76f1804e98b0826423261536c9"
W20260709 13:13:42.902872  1442 consensus_peers.cc:597] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:42.909576  1476 raft_consensus.cc:3060] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:42.911248  1370 leader_election.cc:336] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
W20260709 13:13:42.914331  1444 leader_election.cc:336] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:42.918892  1403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdfb8ffcbef24e338137b942224f9ed8" candidate_uuid: "18c0de76f1804e98b0826423261536c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fc95e1790d2492e93bddd6efb72a2c3"
I20260709 13:13:42.919471  1403 raft_consensus.cc:3060] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.919909  1476 raft_consensus.cc:2468] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fc95e1790d2492e93bddd6efb72a2c3 in term 2.
I20260709 13:13:42.921684  2236 leader_election.cc:290] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Requested vote from peers bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279), 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201)
I20260709 13:13:42.922919  1367 leader_election.cc:304] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:42.926502  1403 raft_consensus.cc:2468] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18c0de76f1804e98b0826423261536c9 in term 2.
I20260709 13:13:42.928845  2295 raft_consensus.cc:2804] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:42.930524  1443 leader_election.cc:304] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18c0de76f1804e98b0826423261536c9, 2fc95e1790d2492e93bddd6efb72a2c3; no voters: bbe86acd78454edfa45d9c095875cb2f
I20260709 13:13:42.935792  2346 raft_consensus.cc:2804] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:42.936329  2346 raft_consensus.cc:697] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Becoming Leader. State: Replica: 18c0de76f1804e98b0826423261536c9, State: Running, Role: LEADER
I20260709 13:13:42.929399  2295 raft_consensus.cc:697] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: Becoming Leader. State: Replica: 2fc95e1790d2492e93bddd6efb72a2c3, State: Running, Role: LEADER
I20260709 13:13:42.937371  2346 consensus_queue.cc:237] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.937367  2295 consensus_queue.cc:237] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } }
I20260709 13:13:42.968719  1150 catalog_manager.cc:5697] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.989444  1150 catalog_manager.cc:5697] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 reported cstate change: term changed from 1 to 2, leader changed from bbe86acd78454edfa45d9c095875cb2f (127.22.225.130) to 18c0de76f1804e98b0826423261536c9 (127.22.225.132). New cstate: current_term: 2 leader_uuid: "18c0de76f1804e98b0826423261536c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fc95e1790d2492e93bddd6efb72a2c3" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 34201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:43.104707  1368 consensus_peers.cc:597] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.213891 23430 tablet_server.cc:196] TabletServer@127.22.225.130:0 shutdown complete.
W20260709 13:13:43.255065  1368 consensus_peers.cc:597] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:43.277149  1368 consensus_peers.cc:597] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.288121 23430 tablet_server.cc:179] TabletServer@127.22.225.131:0 shutting down...
I20260709 13:13:43.313477  1476 raft_consensus.cc:1275] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Refusing update from remote peer 2fc95e1790d2492e93bddd6efb72a2c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:13:43.313508  1443 consensus_peers.cc:597] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.314862  2339 consensus_queue.cc:1048] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:43.329768  1443 consensus_peers.cc:597] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.331045 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:43.332103 23430 tablet_replica.cc:333] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.333036 23430 raft_consensus.cc:2243] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.333652 23430 raft_consensus.cc:2272] T acbe7a061fdd480e9dbf9bd9ec64cdd9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.338219 23430 tablet_replica.cc:333] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.339167 23430 raft_consensus.cc:2243] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.339735 23430 raft_consensus.cc:2272] T b19cd97df43d45fea5f71645e8ee8a04 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.343389 23430 tablet_replica.cc:333] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
W20260709 13:13:43.343518  1370 consensus_peers.cc:597] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.343972  1442 consensus_peers.cc:597] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.344247 23430 raft_consensus.cc:2243] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.344898 23430 raft_consensus.cc:2272] T 15e8d0036e5647809908799723c1a147 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.347882 23430 tablet_replica.cc:333] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.348724 23430 raft_consensus.cc:2243] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.349602 23430 raft_consensus.cc:2272] T dd6b66c1551c438084e2d9766814c7d3 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.352883  1443 consensus_peers.cc:597] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.353372 23430 tablet_replica.cc:333] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.354243 23430 raft_consensus.cc:2243] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.354801 23430 raft_consensus.cc:2272] T 141e6a07df1a4244a64d1eb2bb0c66c9 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.357388 23430 tablet_replica.cc:333] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.358150 23430 raft_consensus.cc:2243] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.358677 23430 raft_consensus.cc:2272] T 9058031903ea43fb9f534aa81f81ed7d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.360375  1443 consensus_peers.cc:597] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.361449 23430 tablet_replica.cc:333] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
W20260709 13:13:43.361311  1442 consensus_peers.cc:597] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.362236 23430 raft_consensus.cc:2243] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.362824 23430 raft_consensus.cc:2272] T 96e6253c017e4c2aae09a2b069b190b7 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.365419 23430 tablet_replica.cc:333] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.366261 23430 raft_consensus.cc:2243] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.367202 23430 raft_consensus.cc:2272] T 39dbc9ed002b4e458021f97d435e9fff P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.369732 23430 tablet_replica.cc:333] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.370275 23430 raft_consensus.cc:2243] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.370968 23430 raft_consensus.cc:2272] T 38b311b738bf44b1abdf2cc9faeb4a19 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.372961 23430 tablet_replica.cc:333] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.373601 23430 raft_consensus.cc:2243] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.374071 23430 raft_consensus.cc:2272] T f96429c9f69a43a898faaab20a0cc9d8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.376447 23430 tablet_replica.cc:333] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.376998 23430 raft_consensus.cc:2243] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.377789 23430 raft_consensus.cc:2272] T cf505580e1d94688a182fbba553caf49 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.379837 23430 tablet_replica.cc:333] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.380585 23430 raft_consensus.cc:2243] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.381495 23430 raft_consensus.cc:2272] T 6d59b30b44054b238642951881f89b66 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.381457  1443 consensus_peers.cc:597] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.384116 23430 tablet_replica.cc:333] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.384703 23430 raft_consensus.cc:2243] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:43.385430  1444 consensus_peers.cc:597] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.385614 23430 raft_consensus.cc:2272] T 6958d3ba5e114d41a6b80c1c57ac0026 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.387902 23430 tablet_replica.cc:333] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
W20260709 13:13:43.388499  1443 consensus_peers.cc:597] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.388578 23430 raft_consensus.cc:2243] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.389777 23430 raft_consensus.cc:2272] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.391541  1442 consensus_peers.cc:597] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.392443 23430 tablet_replica.cc:333] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.393175 23430 raft_consensus.cc:2243] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.393625 23430 raft_consensus.cc:2272] T 5c9d052234b64c6c9657372e21b121af P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.395382 23430 tablet_replica.cc:333] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.395893 23430 raft_consensus.cc:2243] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.396610 23430 raft_consensus.cc:2272] T 8a76b504d1f94cd18b99eddae689c4bb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.399261 23430 tablet_replica.cc:333] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.399847 23430 raft_consensus.cc:2243] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.400264 23430 raft_consensus.cc:2272] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.402323 23430 tablet_replica.cc:333] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.402891 23430 raft_consensus.cc:2243] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.403307 23430 raft_consensus.cc:2272] T 189f636ed54445ea91f7f9411e1b7593 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.405028 23430 tablet_replica.cc:333] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.405578 23430 raft_consensus.cc:2243] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.405997 23430 raft_consensus.cc:2272] T b66f4c48f5f44fb7a7c683868e97d498 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.407737 23430 tablet_replica.cc:333] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.408253 23430 raft_consensus.cc:2243] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.408631 23430 raft_consensus.cc:2272] T fdfb8ffcbef24e338137b942224f9ed8 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.410511 23430 tablet_replica.cc:333] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.411048 23430 raft_consensus.cc:2243] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.411871 23430 raft_consensus.cc:2272] T 6bfaf2eb5ac94004b49869c3fb44246b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.413928 23430 tablet_replica.cc:333] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.414448 23430 raft_consensus.cc:2243] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.415222 23430 raft_consensus.cc:2272] T 1ecd149ab31945ab9517f3ab5061847d P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.417230 23430 tablet_replica.cc:333] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.417861 23430 raft_consensus.cc:2243] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.418344 23430 raft_consensus.cc:2272] T e6c6d73d03124b02976ae2b9126c2d7e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.420805 23430 tablet_replica.cc:333] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
W20260709 13:13:43.421222  1442 consensus_peers.cc:597] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.421433 23430 raft_consensus.cc:2243] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.422281 23430 raft_consensus.cc:2272] T 1a7de12179bb42a98b37bf18c8eb8591 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.424086 23430 tablet_replica.cc:333] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.424651 23430 raft_consensus.cc:2243] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.425067 23430 raft_consensus.cc:2272] T b7724e8025f442c084e2988c3de7cc75 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.426901 23430 tablet_replica.cc:333] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.427414 23430 raft_consensus.cc:2243] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.428153 23430 raft_consensus.cc:2272] T bf601481d5614428aa1948ce5e0df02f P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.430091 23430 tablet_replica.cc:333] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.430586 23430 raft_consensus.cc:2243] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.430994 23430 raft_consensus.cc:2272] T fed66ef7a02f46b699f94f562b334afd P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.432780 23430 tablet_replica.cc:333] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.433357 23430 raft_consensus.cc:2243] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.433841 23430 raft_consensus.cc:2272] T d7b91b4efbf841fbb8d25e87fef4b296 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.435576 23430 tablet_replica.cc:333] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.436129 23430 raft_consensus.cc:2243] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.436987 23430 raft_consensus.cc:2272] T 2bb045a1ea9c4a7d81082cfb9317cacc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.438850 23430 tablet_replica.cc:333] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.439368 23430 raft_consensus.cc:2243] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.440061 23430 raft_consensus.cc:2272] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.441924 23430 tablet_replica.cc:333] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.442426 23430 raft_consensus.cc:2243] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.442850 23430 raft_consensus.cc:2272] T edb5ff6e1bd14308a0d214d7fcc8fecf P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.445206 23430 tablet_replica.cc:333] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.445845 23430 raft_consensus.cc:2243] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.446326 23430 raft_consensus.cc:2272] T a11fac66d73d43d2ac8f1a4c97c78798 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.447630  1444 consensus_peers.cc:597] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.448415 23430 tablet_replica.cc:333] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.449008 23430 raft_consensus.cc:2243] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.449800 23430 raft_consensus.cc:2272] T 59ed770654a140988fd6e180dad119cc P 2fc95e1790d2492e93bddd6efb72a2c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.451941 23430 tablet_replica.cc:333] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.452478 23430 raft_consensus.cc:2243] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.452955 23430 raft_consensus.cc:2272] T cb1be411e3cd45fab10d3ca9265e1696 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.455432 23430 tablet_replica.cc:333] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.456275 23430 raft_consensus.cc:2243] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.456962 23430 pending_rounds.cc:70] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3: Trying to abort 1 pending ops.
W20260709 13:13:43.457095  1442 consensus_peers.cc:597] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.457252 23430 pending_rounds.cc:77] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637162784391168 op_type: NO_OP noop_request { }
I20260709 13:13:43.457749 23430 raft_consensus.cc:2889] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:43.457976 23430 raft_consensus.cc:2272] T d695ee04326f476498937637eb685d7b P 2fc95e1790d2492e93bddd6efb72a2c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.460332 23430 tablet_replica.cc:333] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.460851 23430 raft_consensus.cc:2243] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.461261 23430 raft_consensus.cc:2272] T 541fd181a6934377a1d38c9dc9db98a1 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.463065 23430 tablet_replica.cc:333] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.463546 23430 raft_consensus.cc:2243] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.464030 23430 raft_consensus.cc:2272] T 21b9c856f42e4d8aabac8f485922bac4 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.466257 23430 tablet_replica.cc:333] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.466732 23430 raft_consensus.cc:2243] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.467590 23430 raft_consensus.cc:2272] T 701a3f41583a49c69e65971c4f0fc271 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.467790  1442 consensus_peers.cc:597] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.470165 23430 tablet_replica.cc:333] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.470773 23430 raft_consensus.cc:2243] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:43.470817  1443 consensus_peers.cc:597] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.471267 23430 raft_consensus.cc:2272] T 0697a4a227684a69982f353a21f6f91c P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.473992 23430 tablet_replica.cc:333] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.474509 23430 raft_consensus.cc:2243] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.475056 23430 raft_consensus.cc:2272] T f1b7143fae804b6db2eb33c3cc276f23 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.477242 23430 tablet_replica.cc:333] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.477797 23430 raft_consensus.cc:2243] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.478492 23430 raft_consensus.cc:2272] T 68c469e4ff0f4df4aa908546ef6482f2 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.480258 23430 tablet_replica.cc:333] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.480754 23430 raft_consensus.cc:2243] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.481535 23430 raft_consensus.cc:2272] T fbcbf94f9eb44b7f85be2c961b4d641e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.483235 23430 tablet_replica.cc:333] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.483680 23430 raft_consensus.cc:2243] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.484077 23430 raft_consensus.cc:2272] T 8bc36900defe4c799e8a1639efcffd13 P 2fc95e1790d2492e93bddd6efb72a2c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.486042 23430 tablet_replica.cc:333] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3: stopping tablet replica
I20260709 13:13:43.486457 23430 raft_consensus.cc:2243] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.486826 23430 raft_consensus.cc:2272] T 3aac3ebb386142cdaf24fffaf202c86e P 2fc95e1790d2492e93bddd6efb72a2c3 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.546087  1443 consensus_peers.cc:597] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:34201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.548414  1443 consensus_peers.cc:597] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:34201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.554476  1444 consensus_peers.cc:597] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.560118 23430 tablet_server.cc:196] TabletServer@127.22.225.131:0 shutdown complete.
W20260709 13:13:43.561187  1443 consensus_peers.cc:597] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:34201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.564419  1444 consensus_peers.cc:597] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 -> Peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Couldn't send request to peer bbe86acd78454edfa45d9c095875cb2f. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:43.583276  1442 consensus_peers.cc:597] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.622841 23430 tablet_server.cc:179] TabletServer@127.22.225.132:0 shutting down...
W20260709 13:13:43.634856  1442 consensus_peers.cc:597] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.659477 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:43.660251 23430 tablet_replica.cc:333] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.660984 23430 raft_consensus.cc:2243] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.661531 23430 raft_consensus.cc:2272] T 7ef816cc2381433d87915406a71a365d P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.663599 23430 tablet_replica.cc:333] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.664387 23430 raft_consensus.cc:2243] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.665333 23430 raft_consensus.cc:2272] T 15e8d0036e5647809908799723c1a147 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.667090 23430 tablet_replica.cc:333] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.667629 23430 raft_consensus.cc:2243] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.668139 23430 raft_consensus.cc:2272] T 57b6cfeddad84835825e5e204da91e99 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.670384 23430 tablet_replica.cc:333] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.670948 23430 raft_consensus.cc:2243] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.671404 23430 raft_consensus.cc:2272] T 1ced950a049249b1a6e0621dbb3de9d4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.672390  1442 consensus_peers.cc:597] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 -> Peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Couldn't send request to peer e89740c5a5de48fd875c8b628616334c. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:43.673484 23430 tablet_replica.cc:333] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.674057 23430 raft_consensus.cc:2243] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.674734 23430 raft_consensus.cc:2272] T 9058031903ea43fb9f534aa81f81ed7d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.676647 23430 tablet_replica.cc:333] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.677186 23430 raft_consensus.cc:2243] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.677546 23430 raft_consensus.cc:2272] T 6958d3ba5e114d41a6b80c1c57ac0026 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.679436 23430 tablet_replica.cc:333] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.680186 23430 raft_consensus.cc:2243] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.680647 23430 raft_consensus.cc:2272] T 80d272b7f7ba4b9aa358c6ab6b9c902c P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.683029 23430 tablet_replica.cc:333] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.683573 23430 raft_consensus.cc:2243] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.684305 23430 raft_consensus.cc:2272] T 541fd181a6934377a1d38c9dc9db98a1 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.686192 23430 tablet_replica.cc:333] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.686692 23430 raft_consensus.cc:2243] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.687089 23430 raft_consensus.cc:2272] T 701a3f41583a49c69e65971c4f0fc271 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.688862 23430 tablet_replica.cc:333] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.689440 23430 raft_consensus.cc:2243] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.690133 23430 raft_consensus.cc:2272] T 21b9c856f42e4d8aabac8f485922bac4 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.691834 23430 tablet_replica.cc:333] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.692399 23430 raft_consensus.cc:2243] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.693202 23430 raft_consensus.cc:2272] T 0697a4a227684a69982f353a21f6f91c P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.695449 23430 tablet_replica.cc:333] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.696009 23430 raft_consensus.cc:2243] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.696696 23430 raft_consensus.cc:2272] T f1b7143fae804b6db2eb33c3cc276f23 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.698479 23430 tablet_replica.cc:333] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.698997 23430 raft_consensus.cc:2243] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.699398 23430 raft_consensus.cc:2272] T 59ed770654a140988fd6e180dad119cc P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.702044 23430 tablet_replica.cc:333] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.702577 23430 raft_consensus.cc:2243] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.702982 23430 raft_consensus.cc:2272] T d6d1cb4d3ccd49f9ac929224a0ad18b4 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.704739 23430 tablet_replica.cc:333] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.705335 23430 raft_consensus.cc:2243] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.705683 23430 raft_consensus.cc:2272] T 2bb045a1ea9c4a7d81082cfb9317cacc P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.707408 23430 tablet_replica.cc:333] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.707871 23430 raft_consensus.cc:2243] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.708541 23430 raft_consensus.cc:2272] T edb5ff6e1bd14308a0d214d7fcc8fecf P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.710278 23430 tablet_replica.cc:333] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.710729 23430 raft_consensus.cc:2243] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.711401 23430 raft_consensus.cc:2272] T 8ec88e02ca274791a250e577eb123cdb P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.713125 23430 tablet_replica.cc:333] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.713621 23430 raft_consensus.cc:2243] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.714337 23430 raft_consensus.cc:2272] T b19cd97df43d45fea5f71645e8ee8a04 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.716964 23430 tablet_replica.cc:333] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.717527 23430 raft_consensus.cc:2243] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.718241 23430 raft_consensus.cc:2272] T e568e879af50468085dbcfedb5005859 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.719916 23430 tablet_replica.cc:333] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.720489 23430 raft_consensus.cc:2243] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.720878 23430 raft_consensus.cc:2272] T cf505580e1d94688a182fbba553caf49 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.722611 23430 tablet_replica.cc:333] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.723097 23430 raft_consensus.cc:2243] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.723429 23430 raft_consensus.cc:2272] T 6d59b30b44054b238642951881f89b66 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.725345 23430 tablet_replica.cc:333] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.725829 23430 raft_consensus.cc:2243] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.726559 23430 raft_consensus.cc:2272] T 88e6c0060fd34173a140bae79fbc0ed6 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.728875 23430 tablet_replica.cc:333] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.729446 23430 raft_consensus.cc:2243] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.730291 23430 raft_consensus.cc:2272] T f96429c9f69a43a898faaab20a0cc9d8 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.731837  1443 consensus_peers.cc:597] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 -> Peer 2fc95e1790d2492e93bddd6efb72a2c3 (127.22.225.131:34201): Couldn't send request to peer 2fc95e1790d2492e93bddd6efb72a2c3. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.131:34201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.732497 23430 tablet_replica.cc:333] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.733058 23430 raft_consensus.cc:2243] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.733454 23430 raft_consensus.cc:2272] T e231c21d5eac41b2822621361cb74cad P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.733693  2364 raft_consensus.cc:493] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e89740c5a5de48fd875c8b628616334c)
I20260709 13:13:43.734146  2364 raft_consensus.cc:515] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18c0de76f1804e98b0826423261536c9" member_type: VOTER last_known_addr { host: "127.22.225.132" port: 33083 } } peers { permanent_uuid: "e89740c5a5de48fd875c8b628616334c" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 44541 } } peers { permanent_uuid: "bbe86acd78454edfa45d9c095875cb2f" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33279 } }
I20260709 13:13:43.735302 23430 tablet_replica.cc:333] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.735821  2364 leader_election.cc:290] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541), bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279)
I20260709 13:13:43.736071 23430 raft_consensus.cc:2243] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.736675 23430 raft_consensus.cc:2272] T 8a76b504d1f94cd18b99eddae689c4bb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.739236 23430 tablet_replica.cc:333] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.739979 23430 raft_consensus.cc:2243] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:43.740288  1442 leader_election.cc:336] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e89740c5a5de48fd875c8b628616334c (127.22.225.129:44541): Network error: Client connection negotiation failed: client connection to 127.22.225.129:44541: connect: Connection refused (error 111)
I20260709 13:13:43.740445 23430 raft_consensus.cc:2272] T 39dbc9ed002b4e458021f97d435e9fff P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.740840  1444 leader_election.cc:336] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bbe86acd78454edfa45d9c095875cb2f (127.22.225.130:33279): Network error: Client connection negotiation failed: client connection to 127.22.225.130:33279: connect: Connection refused (error 111)
I20260709 13:13:43.741245  1444 leader_election.cc:304] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18c0de76f1804e98b0826423261536c9; no voters: bbe86acd78454edfa45d9c095875cb2f, e89740c5a5de48fd875c8b628616334c
I20260709 13:13:43.741802  2364 raft_consensus.cc:2749] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:43.742583 23430 tablet_replica.cc:333] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.743170 23430 raft_consensus.cc:2243] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.743562 23430 raft_consensus.cc:2272] T 6561d58a0d984196a8f1edde7c628758 P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.745505 23430 tablet_replica.cc:333] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.745996 23430 raft_consensus.cc:2243] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.746408 23430 raft_consensus.cc:2272] T bf601481d5614428aa1948ce5e0df02f P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.748139 23430 tablet_replica.cc:333] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.748656 23430 raft_consensus.cc:2243] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.749440 23430 raft_consensus.cc:2272] T 38d77a5b6b9c4251a7ca4a132c0cddcb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.751101 23430 tablet_replica.cc:333] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.751605 23430 raft_consensus.cc:2243] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.752257 23430 pending_rounds.cc:70] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9: Trying to abort 1 pending ops.
I20260709 13:13:43.752449 23430 pending_rounds.cc:77] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637162815909888 op_type: NO_OP noop_request { }
I20260709 13:13:43.752714 23430 raft_consensus.cc:2889] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:43.752974 23430 raft_consensus.cc:2272] T fdfb8ffcbef24e338137b942224f9ed8 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.755012 23430 tablet_replica.cc:333] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.755533 23430 raft_consensus.cc:2243] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.756255 23430 raft_consensus.cc:2272] T 9c04006aa6c64fbd86fb7ff6b1f2b7ae P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.758046 23430 tablet_replica.cc:333] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.758541 23430 raft_consensus.cc:2243] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.758929 23430 raft_consensus.cc:2272] T becaecefa770428abc9030aa88b4825e P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.760591 23430 tablet_replica.cc:333] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.761066 23430 raft_consensus.cc:2243] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.761536 23430 raft_consensus.cc:2272] T 58147dc2306b445bbc1134344d2d129d P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.763190 23430 tablet_replica.cc:333] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.763679 23430 raft_consensus.cc:2243] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.764071 23430 raft_consensus.cc:2272] T fbcbf94f9eb44b7f85be2c961b4d641e P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.765870 23430 tablet_replica.cc:333] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.766371 23430 raft_consensus.cc:2243] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.766817 23430 raft_consensus.cc:2272] T d695ee04326f476498937637eb685d7b P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.768729 23430 tablet_replica.cc:333] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.769268 23430 raft_consensus.cc:2243] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.769655 23430 raft_consensus.cc:2272] T 1d16cd36a26e44ed8084e41f237f1ad1 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.771363 23430 tablet_replica.cc:333] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.771852 23430 raft_consensus.cc:2243] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.772245 23430 raft_consensus.cc:2272] T 44c175554ac140ef8db4ae40ed5afc75 P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.774087 23430 tablet_replica.cc:333] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.774646 23430 raft_consensus.cc:2243] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.775061 23430 raft_consensus.cc:2272] T 73b8ca76daab4ec193441ebe56431bfb P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.777385 23430 tablet_replica.cc:333] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.777890 23430 raft_consensus.cc:2243] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.778565 23430 raft_consensus.cc:2272] T cb1be411e3cd45fab10d3ca9265e1696 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.780555 23430 tablet_replica.cc:333] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.781149 23430 raft_consensus.cc:2243] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.781541 23430 raft_consensus.cc:2272] T 6bfaf2eb5ac94004b49869c3fb44246b P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.783342 23430 tablet_replica.cc:333] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.783849 23430 raft_consensus.cc:2243] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.784273 23430 raft_consensus.cc:2272] T 1ecd149ab31945ab9517f3ab5061847d P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.786248 23430 tablet_replica.cc:333] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.786744 23430 raft_consensus.cc:2243] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.787130 23430 raft_consensus.cc:2272] T 146867b47b5b455fa5eab18fa30e09ae P 18c0de76f1804e98b0826423261536c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.788942 23430 tablet_replica.cc:333] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.789449 23430 raft_consensus.cc:2243] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.790196 23430 raft_consensus.cc:2272] T fed66ef7a02f46b699f94f562b334afd P 18c0de76f1804e98b0826423261536c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.792126 23430 tablet_replica.cc:333] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9: stopping tablet replica
I20260709 13:13:43.792585 23430 raft_consensus.cc:2243] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.793326 23430 pending_rounds.cc:70] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9: Trying to abort 1 pending ops.
I20260709 13:13:43.793531 23430 pending_rounds.cc:77] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637162360807424 op_type: NO_OP noop_request { }
I20260709 13:13:43.793795 23430 raft_consensus.cc:2889] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:43.794056 23430 raft_consensus.cc:2272] T d7b91b4efbf841fbb8d25e87fef4b296 P 18c0de76f1804e98b0826423261536c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.855177 23430 tablet_server.cc:196] TabletServer@127.22.225.132:0 shutdown complete.
I20260709 13:13:43.914135 23430 master.cc:562] Master@127.22.225.190:33845 shutting down...
I20260709 13:13:43.937134 23430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.937695 23430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.938035 23430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6ba8f4341cdd4818befb2cf3d81b43fb: stopping tablet replica
I20260709 13:13:43.960433 23430 master.cc:584] Master@127.22.225.190:33845 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (29363 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:13:44.050089 23430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.225.190:45711
I20260709 13:13:44.051316 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:44.057575  2370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.057734  2369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.058255  2372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.060321 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:44.061275 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:44.061450 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:44.061563 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602824061552 us; error 0 us; skew 500 ppm
I20260709 13:13:44.062029 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:44.064522 23430 webserver.cc:533] Webserver started at http://127.22.225.190:33579/ using document root <none> and password file <none>
I20260709 13:13:44.065044 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:44.065279 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:44.089596 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:44.091161 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/master-0-root/instance:
uuid: "ef9f00ca7d704150a75b4dc15d29bcfb"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:44.096045 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.006s
I20260709 13:13:44.099651  2378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.100375 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:13:44.100611 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/master-0-root
uuid: "ef9f00ca7d704150a75b4dc15d29bcfb"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:44.100832 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:44.118974 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:44.120154 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:44.159394 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.190:45711
I20260709 13:13:44.159488  2429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.190:45711 every 8 connection(s)
I20260709 13:13:44.163882  2430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.175716  2430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb: Bootstrap starting.
I20260709 13:13:44.180778  2430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.185005  2430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb: No bootstrap required, opened a new log
I20260709 13:13:44.187318  2430 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9f00ca7d704150a75b4dc15d29bcfb" member_type: VOTER }
I20260709 13:13:44.187808  2430 raft_consensus.cc:385] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.187994  2430 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef9f00ca7d704150a75b4dc15d29bcfb, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.188511  2430 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9f00ca7d704150a75b4dc15d29bcfb" member_type: VOTER }
I20260709 13:13:44.188934  2430 raft_consensus.cc:399] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:44.189144  2430 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:44.189425  2430 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.193962  2430 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9f00ca7d704150a75b4dc15d29bcfb" member_type: VOTER }
I20260709 13:13:44.194398  2430 leader_election.cc:304] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef9f00ca7d704150a75b4dc15d29bcfb; no voters: 
I20260709 13:13:44.195423  2430 leader_election.cc:290] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:44.195883  2433 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.197294  2433 raft_consensus.cc:697] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 1 LEADER]: Becoming Leader. State: Replica: ef9f00ca7d704150a75b4dc15d29bcfb, State: Running, Role: LEADER
I20260709 13:13:44.198024  2433 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9f00ca7d704150a75b4dc15d29bcfb" member_type: VOTER }
I20260709 13:13:44.198421  2430 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:44.209406  2435 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef9f00ca7d704150a75b4dc15d29bcfb. Latest consensus state: current_term: 1 leader_uuid: "ef9f00ca7d704150a75b4dc15d29bcfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9f00ca7d704150a75b4dc15d29bcfb" member_type: VOTER } }
I20260709 13:13:44.209371  2434 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef9f00ca7d704150a75b4dc15d29bcfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef9f00ca7d704150a75b4dc15d29bcfb" member_type: VOTER } }
I20260709 13:13:44.210249  2435 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:44.210348  2434 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:44.212675  2442 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:44.219363  2442 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:44.220537 23430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:44.228215  2442 catalog_manager.cc:1383] Generated new cluster ID: 88f799abd76d4299a4533fd1e7b6d9ba
I20260709 13:13:44.228559  2442 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:44.244297  2442 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:44.245810  2442 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:44.261489  2442 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb: Generated new TSK 0
I20260709 13:13:44.262079  2442 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:44.287539 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:44.294533  2451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.295603  2452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.299269  2454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.300030 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:44.302274 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:44.302484 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:44.302667 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602824302632 us; error 0 us; skew 500 ppm
I20260709 13:13:44.303349 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:44.305828 23430 webserver.cc:533] Webserver started at http://127.22.225.129:44037/ using document root <none> and password file <none>
I20260709 13:13:44.306322 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:44.306521 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:44.306802 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:44.308077 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root/instance:
uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:44.312376 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:13:44.315610  2459 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.316341 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:44.316622 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:44.316882 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:44.341392 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:44.342630 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:44.344110 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:44.346549 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:44.346781 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.347049 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:44.347250 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.390769 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:38759
I20260709 13:13:44.390875  2521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:38759 every 8 connection(s)
I20260709 13:13:44.396171 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:44.405334  2526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.407511  2527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.410543  2529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.411145 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:44.412184 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:44.412371 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:44.412496 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602824412485 us; error 0 us; skew 500 ppm
I20260709 13:13:44.413007 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:44.415488 23430 webserver.cc:533] Webserver started at http://127.22.225.130:43069/ using document root <none> and password file <none>
I20260709 13:13:44.415921 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:44.416077 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:44.416285 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:44.417549 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-1-root/instance:
uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:44.422046 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:13:44.425343  2534 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.426074 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:44.426375 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-1-root
uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:44.426656 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:44.441807  2522 heartbeater.cc:344] Connected to a master server at 127.22.225.190:45711
I20260709 13:13:44.442312  2522 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:44.443228  2522 heartbeater.cc:507] Master 127.22.225.190:45711 requested a full tablet report, sending...
I20260709 13:13:44.445518  2395 ts_manager.cc:194] Registered new tserver with Master: 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759)
I20260709 13:13:44.447607  2395 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51168
I20260709 13:13:44.451195 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:44.452453 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:44.453958 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:44.456133 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:44.456357 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.456598 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:44.456765 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.498402 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.130:33999
I20260709 13:13:44.498571  2596 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.130:33999 every 8 connection(s)
I20260709 13:13:44.503631 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:44.511358  2600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.512163  2601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.515856  2604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.516474  2597 heartbeater.cc:344] Connected to a master server at 127.22.225.190:45711
I20260709 13:13:44.516501 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:44.517053  2597 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:44.517794 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:44.518115 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:44.518103  2597 heartbeater.cc:507] Master 127.22.225.190:45711 requested a full tablet report, sending...
I20260709 13:13:44.518620 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602824518590 us; error 0 us; skew 500 ppm
I20260709 13:13:44.519434 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:44.520642  2395 ts_manager.cc:194] Registered new tserver with Master: 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:44.522697  2395 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51182
I20260709 13:13:44.522852 23430 webserver.cc:533] Webserver started at http://127.22.225.131:36749/ using document root <none> and password file <none>
I20260709 13:13:44.523402 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:44.523660 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:44.523998 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:44.525768 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-2-root/instance:
uuid: "2c5e680501ae47ae847288a540abd53a"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:44.530579 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:44.533897  2608 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.534819 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:44.535167 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-2-root
uuid: "2c5e680501ae47ae847288a540abd53a"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:44.535497 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:44.549247 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:44.550376 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:44.551761 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:44.554023 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:44.554222 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.554488 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:44.554647 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.594687 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.131:39341
I20260709 13:13:44.594805  2670 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.131:39341 every 8 connection(s)
I20260709 13:13:44.608487  2671 heartbeater.cc:344] Connected to a master server at 127.22.225.190:45711
I20260709 13:13:44.608898  2671 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:44.609663  2671 heartbeater.cc:507] Master 127.22.225.190:45711 requested a full tablet report, sending...
I20260709 13:13:44.611537  2395 ts_manager.cc:194] Registered new tserver with Master: 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:44.612535 23430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014494138s
I20260709 13:13:44.613021  2395 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51196
I20260709 13:13:44.638006  2395 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51204:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:44.640926  2395 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:44.721828  2487 tablet_service.cc:1511] Processing CreateTablet for tablet 30572622c8284959a800a2408c05fff2 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:44.722196  2635 tablet_service.cc:1511] Processing CreateTablet for tablet e9ef1b7294e142f3bfb5aae008e33dab (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:44.723353  2633 tablet_service.cc:1511] Processing CreateTablet for tablet 97f0fcbbffdc48c3804706804010a00b (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:44.722196  2634 tablet_service.cc:1511] Processing CreateTablet for tablet d213bc4be6764d12bf6c72c676e62241 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:44.720808  2636 tablet_service.cc:1511] Processing CreateTablet for tablet 30572622c8284959a800a2408c05fff2 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:44.725752  2485 tablet_service.cc:1511] Processing CreateTablet for tablet d213bc4be6764d12bf6c72c676e62241 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:44.728364  2632 tablet_service.cc:1511] Processing CreateTablet for tablet 737b76e658c3442c8f07632aae9162f5 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:44.729871  2484 tablet_service.cc:1511] Processing CreateTablet for tablet 97f0fcbbffdc48c3804706804010a00b (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:44.724517  2486 tablet_service.cc:1511] Processing CreateTablet for tablet e9ef1b7294e142f3bfb5aae008e33dab (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:44.731638  2631 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3c7e9c80824e3fa4a3caf9a683ed0c (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:44.723802  2635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ef1b7294e142f3bfb5aae008e33dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.735235  2483 tablet_service.cc:1511] Processing CreateTablet for tablet 737b76e658c3442c8f07632aae9162f5 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:44.737525  2633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f0fcbbffdc48c3804706804010a00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.739846  2481 tablet_service.cc:1511] Processing CreateTablet for tablet 1465d3dc2b894846bf7e96e3298302db (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:44.737588  2482 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3c7e9c80824e3fa4a3caf9a683ed0c (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:44.742794  2630 tablet_service.cc:1511] Processing CreateTablet for tablet 1465d3dc2b894846bf7e96e3298302db (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:44.744270  2630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1465d3dc2b894846bf7e96e3298302db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.723389  2487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30572622c8284959a800a2408c05fff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.746662  2629 tablet_service.cc:1511] Processing CreateTablet for tablet 35941c3996044df79fea5de812ea4acf (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:44.747965  2629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35941c3996044df79fea5de812ea4acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.749809  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1465d3dc2b894846bf7e96e3298302db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.750469  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ef1b7294e142f3bfb5aae008e33dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.750739  2628 tablet_service.cc:1511] Processing CreateTablet for tablet af7421f978344e0590908c6cb4d0f786 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:44.752058  2628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7421f978344e0590908c6cb4d0f786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.753417  2485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d213bc4be6764d12bf6c72c676e62241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.753468  2636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30572622c8284959a800a2408c05fff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.754715  2627 tablet_service.cc:1511] Processing CreateTablet for tablet cae39ef4ad4248cb86d26247aac0260e (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:44.755800  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3c7e9c80824e3fa4a3caf9a683ed0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.756141  2627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae39ef4ad4248cb86d26247aac0260e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.757407  2632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737b76e658c3442c8f07632aae9162f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.761390  2631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3c7e9c80824e3fa4a3caf9a683ed0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.761960  2483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737b76e658c3442c8f07632aae9162f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.763919  2634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d213bc4be6764d12bf6c72c676e62241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.774618  2480 tablet_service.cc:1511] Processing CreateTablet for tablet 35941c3996044df79fea5de812ea4acf (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:44.777577  2479 tablet_service.cc:1511] Processing CreateTablet for tablet af7421f978344e0590908c6cb4d0f786 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:44.780287  2478 tablet_service.cc:1511] Processing CreateTablet for tablet cae39ef4ad4248cb86d26247aac0260e (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:44.765760  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f0fcbbffdc48c3804706804010a00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.783394  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae39ef4ad4248cb86d26247aac0260e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.789358  2480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35941c3996044df79fea5de812ea4acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.791574  2479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7421f978344e0590908c6cb4d0f786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.826717  2562 tablet_service.cc:1511] Processing CreateTablet for tablet 30572622c8284959a800a2408c05fff2 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:44.828214  2562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30572622c8284959a800a2408c05fff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.830773  2561 tablet_service.cc:1511] Processing CreateTablet for tablet e9ef1b7294e142f3bfb5aae008e33dab (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:44.832367  2561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ef1b7294e142f3bfb5aae008e33dab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.834796  2560 tablet_service.cc:1511] Processing CreateTablet for tablet d213bc4be6764d12bf6c72c676e62241 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:44.836244  2560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d213bc4be6764d12bf6c72c676e62241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.849885  2686 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:44.854249  2556 tablet_service.cc:1511] Processing CreateTablet for tablet 1465d3dc2b894846bf7e96e3298302db (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:44.855636  2556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1465d3dc2b894846bf7e96e3298302db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.862277  2555 tablet_service.cc:1511] Processing CreateTablet for tablet 35941c3996044df79fea5de812ea4acf (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:44.863718  2555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35941c3996044df79fea5de812ea4acf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.866178  2558 tablet_service.cc:1511] Processing CreateTablet for tablet 737b76e658c3442c8f07632aae9162f5 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:44.867590  2558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737b76e658c3442c8f07632aae9162f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.870239  2559 tablet_service.cc:1511] Processing CreateTablet for tablet 97f0fcbbffdc48c3804706804010a00b (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:44.871631  2559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f0fcbbffdc48c3804706804010a00b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.874253  2557 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3c7e9c80824e3fa4a3caf9a683ed0c (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:44.875588  2557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3c7e9c80824e3fa4a3caf9a683ed0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.882709  2554 tablet_service.cc:1511] Processing CreateTablet for tablet af7421f978344e0590908c6cb4d0f786 (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:44.884099  2554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7421f978344e0590908c6cb4d0f786. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.890657  2553 tablet_service.cc:1511] Processing CreateTablet for tablet cae39ef4ad4248cb86d26247aac0260e (DEFAULT_TABLE table=test-workload [id=4ccb772fdc884c6a973143b07419823f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:44.892448  2553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cae39ef4ad4248cb86d26247aac0260e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.916704  2686 tablet_bootstrap.cc:654] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.953776  2688 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:44.959910  2687 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:44.962182  2686 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:44.962752  2686 ts_tablet_manager.cc:1403] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.113s	user 0.009s	sys 0.005s
I20260709 13:13:44.965770  2686 raft_consensus.cc:359] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:44.966471  2686 raft_consensus.cc:385] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.966769  2686 raft_consensus.cc:740] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.967268  2687 tablet_bootstrap.cc:654] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.967681  2686 consensus_queue.cc:260] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:44.968532  2688 tablet_bootstrap.cc:654] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.970098  2671 heartbeater.cc:499] Master 127.22.225.190:45711 was elected leader, sending a full tablet report...
I20260709 13:13:44.973176  2687 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:44.973778  2687 ts_tablet_manager.cc:1403] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:13:44.974527  2686 ts_tablet_manager.cc:1434] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:13:44.975543  2686 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:44.975896  2688 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:44.976475  2688 ts_tablet_manager.cc:1403] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 13:13:44.976806  2687 raft_consensus.cc:359] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:44.977599  2687 raft_consensus.cc:385] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.977895  2687 raft_consensus.cc:740] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.978753  2687 consensus_queue.cc:260] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:44.979903  2688 raft_consensus.cc:359] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:44.980738  2688 raft_consensus.cc:385] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.981127  2688 raft_consensus.cc:740] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.982030  2688 consensus_queue.cc:260] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:44.983529  2686 tablet_bootstrap.cc:654] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.988584  2687 ts_tablet_manager.cc:1434] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:13:44.989596  2522 heartbeater.cc:499] Master 127.22.225.190:45711 was elected leader, sending a full tablet report...
I20260709 13:13:44.997848  2597 heartbeater.cc:499] Master 127.22.225.190:45711 was elected leader, sending a full tablet report...
I20260709 13:13:44.998541  2688 ts_tablet_manager.cc:1434] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 13:13:44.999661  2688 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.007411  2688 tablet_bootstrap.cc:654] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.009661  2696 raft_consensus.cc:493] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.010216  2696 raft_consensus.cc:515] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.015640  2687 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.034147  2696 leader_election.cc:290] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.040223  2686 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.041231  2687 tablet_bootstrap.cc:654] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.054595  2686 ts_tablet_manager.cc:1403] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.079s	user 0.028s	sys 0.035s
I20260709 13:13:45.058874  2686 raft_consensus.cc:359] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.059859  2686 raft_consensus.cc:385] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.060230  2686 raft_consensus.cc:740] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.061276  2686 consensus_queue.cc:260] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.064155  2686 ts_tablet_manager.cc:1434] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:45.065807  2686 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:45.073017  2688 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:45.077824  2687 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.075969  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.078083  2688 ts_tablet_manager.cc:1403] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.079s	user 0.051s	sys 0.012s
I20260709 13:13:45.078523  2687 ts_tablet_manager.cc:1403] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.063s	user 0.023s	sys 0.023s
W20260709 13:13:45.079424  2461 leader_election.cc:343] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.074445  2690 raft_consensus.cc:493] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.080425  2686 tablet_bootstrap.cc:654] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.080165  2690 raft_consensus.cc:515] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.081924  2687 raft_consensus.cc:359] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.082257  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.082816  2687 raft_consensus.cc:385] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.082993  2646 raft_consensus.cc:2468] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.083233  2687 raft_consensus.cc:740] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.084168  2687 consensus_queue.cc:260] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.084865  2463 leader_election.cc:304] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:45.084189  2688 raft_consensus.cc:359] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.085915  2688 raft_consensus.cc:385] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.086290  2688 raft_consensus.cc:740] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.086297  2696 raft_consensus.cc:2804] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.086957  2696 raft_consensus.cc:493] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.087324  2696 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.087404  2688 consensus_queue.cc:260] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.089792  2688 ts_tablet_manager.cc:1434] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:45.090823  2688 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.097230  2688 tablet_bootstrap.cc:654] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.098269  2696 raft_consensus.cc:515] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.100859  2690 leader_election.cc:290] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:45.108536  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" is_pre_election: true
W20260709 13:13:45.110787  2609 leader_election.cc:343] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.114765  2687 ts_tablet_manager.cc:1434] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:13:45.116089  2687 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.118831  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.119427  2696 leader_election.cc:290] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Requested vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
W20260709 13:13:45.120215  2461 leader_election.cc:343] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.121104  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.121701  2646 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.134457  2687 tablet_bootstrap.cc:654] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.146520  2646 raft_consensus.cc:2468] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.148108  2463 leader_election.cc:304] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:45.148430  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.149169  2687 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.149349  2696 raft_consensus.cc:2804] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.149837  2687 ts_tablet_manager.cc:1403] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.004s
I20260709 13:13:45.149859  2696 raft_consensus.cc:697] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Running, Role: LEADER
I20260709 13:13:45.151631  2696 consensus_queue.cc:237] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.153365  2686 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.153299  2687 raft_consensus.cc:359] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.154044  2686 ts_tablet_manager.cc:1403] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.089s	user 0.034s	sys 0.039s
I20260709 13:13:45.154431  2688 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
W20260709 13:13:45.150671  2610 leader_election.cc:343] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.154961  2688 ts_tablet_manager.cc:1403] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.040s
I20260709 13:13:45.155419  2610 leader_election.cc:304] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a; no voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:45.156508  2690 raft_consensus.cc:2749] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.154433  2687 raft_consensus.cc:385] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.157449  2687 raft_consensus.cc:740] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.157274  2686 raft_consensus.cc:359] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.158034  2686 raft_consensus.cc:385] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.158355  2686 raft_consensus.cc:740] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.158406  2687 consensus_queue.cc:260] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.159328  2686 consensus_queue.cc:260] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.159672  2688 raft_consensus.cc:359] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.160756  2687 ts_tablet_manager.cc:1434] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:45.160833  2688 raft_consensus.cc:385] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.161547  2688 raft_consensus.cc:740] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.161844  2687 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.162808  2688 consensus_queue.cc:260] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.164328  2686 ts_tablet_manager.cc:1434] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:13:45.165243  2688 ts_tablet_manager.cc:1434] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:45.165422  2686 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:45.166369  2688 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.169025  2687 tablet_bootstrap.cc:654] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.172690  2686 tablet_bootstrap.cc:654] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.175315  2688 tablet_bootstrap.cc:654] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.192672  2392 catalog_manager.cc:5697] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.211647  2687 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.212073  2686 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.212209  2688 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:45.212988  2686 ts_tablet_manager.cc:1403] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.034s
I20260709 13:13:45.213141  2688 ts_tablet_manager.cc:1403] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.021s
I20260709 13:13:45.212168  2687 ts_tablet_manager.cc:1403] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.026s
W20260709 13:13:45.216058  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:45.216269  2688 raft_consensus.cc:359] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.217056  2688 raft_consensus.cc:385] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.217365  2688 raft_consensus.cc:740] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.217461  2687 raft_consensus.cc:359] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.218230  2688 consensus_queue.cc:260] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.218232  2687 raft_consensus.cc:385] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.219290  2687 raft_consensus.cc:740] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.219516  2686 raft_consensus.cc:359] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.220224  2686 raft_consensus.cc:385] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.220122  2687 consensus_queue.cc:260] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.222298  2688 ts_tablet_manager.cc:1434] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:13:45.222472  2687 ts_tablet_manager.cc:1434] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:45.220606  2686 raft_consensus.cc:740] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.223352  2688 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.223541  2687 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.223800  2686 consensus_queue.cc:260] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.226178  2686 ts_tablet_manager.cc:1434] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:13:45.227226  2686 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:45.230733  2687 tablet_bootstrap.cc:654] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.233842  2686 tablet_bootstrap.cc:654] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.238524  2690 raft_consensus.cc:493] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.239156  2690 raft_consensus.cc:515] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.241448  2690 leader_election.cc:290] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:45.243739  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.238207  2688 tablet_bootstrap.cc:654] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.244397  2687 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.244889  2687 ts_tablet_manager.cc:1403] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:13:45.245025  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" is_pre_election: true
W20260709 13:13:45.246526  2609 leader_election.cc:343] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:45.247668  2610 leader_election.cc:343] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.248111  2610 leader_election.cc:304] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a; no voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:45.248404  2687 raft_consensus.cc:359] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.249306  2690 raft_consensus.cc:2749] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.249505  2687 raft_consensus.cc:385] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.250029  2687 raft_consensus.cc:740] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.250787  2687 consensus_queue.cc:260] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.251806  2686 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.252319  2686 ts_tablet_manager.cc:1403] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:13:45.252360  2688 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:45.252998  2688 ts_tablet_manager.cc:1403] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 13:13:45.253144  2687 ts_tablet_manager.cc:1434] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:45.255477  2686 raft_consensus.cc:359] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.255882  2687 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.256286  2686 raft_consensus.cc:385] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.255967  2688 raft_consensus.cc:359] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.256680  2686 raft_consensus.cc:740] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.256858  2688 raft_consensus.cc:385] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.257236  2688 raft_consensus.cc:740] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.257637  2686 consensus_queue.cc:260] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.258117  2688 consensus_queue.cc:260] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.260262  2686 ts_tablet_manager.cc:1434] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:45.261269  2686 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:45.262940  2688 ts_tablet_manager.cc:1434] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:45.264053  2688 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.264238  2696 raft_consensus.cc:493] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.264706  2696 raft_consensus.cc:515] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.266801  2696 leader_election.cc:290] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.267577  2686 tablet_bootstrap.cc:654] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.268450  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.269345  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.269977  2646 raft_consensus.cc:2468] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
W20260709 13:13:45.269992  2461 leader_election.cc:343] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.263038  2687 tablet_bootstrap.cc:654] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.272965  2686 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.273468  2686 ts_tablet_manager.cc:1403] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 13:13:45.270469  2688 tablet_bootstrap.cc:654] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.275231  2463 leader_election.cc:304] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:45.276170  2687 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.276731  2687 ts_tablet_manager.cc:1403] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 13:13:45.276414  2686 raft_consensus.cc:359] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.277170  2686 raft_consensus.cc:385] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.277876  2686 raft_consensus.cc:740] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.278749  2686 consensus_queue.cc:260] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.280097  2687 raft_consensus.cc:359] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.280833  2687 raft_consensus.cc:385] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.281209  2687 raft_consensus.cc:740] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.282115  2687 consensus_queue.cc:260] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.283026  2686 ts_tablet_manager.cc:1434] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:45.284040  2686 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:45.284785  2687 ts_tablet_manager.cc:1434] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:13:45.285861  2687 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.277168  2696 raft_consensus.cc:2804] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.290671  2686 tablet_bootstrap.cc:654] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.290998  2696 raft_consensus.cc:493] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.291425  2696 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.292511  2687 tablet_bootstrap.cc:654] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.295462  2693 raft_consensus.cc:493] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.302711  2693 raft_consensus.cc:515] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.303169  2686 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.303768  2686 ts_tablet_manager.cc:1403] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:13:45.305785  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.306438  2572 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.306600  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.306691  2686 raft_consensus.cc:359] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.307581  2686 raft_consensus.cc:385] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.299026  2696 raft_consensus.cc:515] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.307809  2688 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:45.307941  2686 raft_consensus.cc:740] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.307873  2461 leader_election.cc:304] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.308573  2688 ts_tablet_manager.cc:1403] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.001s
I20260709 13:13:45.309329  2686 consensus_queue.cc:260] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.311064  2646 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.314913  2686 ts_tablet_manager.cc:1434] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:13:45.315183  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.316056  2645 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.316169  2686 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:45.306051  2693 leader_election.cc:290] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.316982  2696 leader_election.cc:290] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Requested vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.322196  2687 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.322708  2687 ts_tablet_manager.cc:1403] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.010s
I20260709 13:13:45.325840  2687 raft_consensus.cc:359] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.326570  2687 raft_consensus.cc:385] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.326840  2687 raft_consensus.cc:740] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.327036  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.327749  2687 consensus_queue.cc:260] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.328804  2686 tablet_bootstrap.cc:654] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.318682  2688 raft_consensus.cc:359] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.329454  2688 raft_consensus.cc:385] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.329831  2688 raft_consensus.cc:740] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.330637  2688 consensus_queue.cc:260] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.319270  2693 raft_consensus.cc:2804] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.335093  2693 raft_consensus.cc:493] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.334475  2572 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.338850  2693 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.333514  2687 ts_tablet_manager.cc:1434] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:13:45.343753  2686 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.344270  2686 ts_tablet_manager.cc:1403] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.015s
I20260709 13:13:45.346882  2686 raft_consensus.cc:359] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.347215  2694 raft_consensus.cc:493] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.347581  2686 raft_consensus.cc:385] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.347973  2686 raft_consensus.cc:740] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.347767  2694 raft_consensus.cc:515] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.348834  2686 consensus_queue.cc:260] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.349663  2687 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.338435  2645 raft_consensus.cc:2468] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.350680  2686 ts_tablet_manager.cc:1434] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:45.350701  2694 leader_election.cc:290] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.337260  2688 ts_tablet_manager.cc:1434] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:13:45.351660  2686 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:45.352299  2694 raft_consensus.cc:493] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.352800  2694 raft_consensus.cc:515] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.347826  2572 raft_consensus.cc:2468] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.346447  2693 raft_consensus.cc:515] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.354748  2463 leader_election.cc:304] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:45.359198  2720 raft_consensus.cc:2804] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.359561  2687 tablet_bootstrap.cc:654] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.355284  2688 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.361574  2720 raft_consensus.cc:697] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Running, Role: LEADER
I20260709 13:13:45.362545  2720 consensus_queue.cc:237] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.370206  2694 leader_election.cc:290] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.371737  2693 leader_election.cc:290] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Requested vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.372737  2686 tablet_bootstrap.cc:654] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.372718  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.373526  2645 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.373816  2688 tablet_bootstrap.cc:654] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.381701  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.382330  2572 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.385861  2688 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:45.386562  2688 ts_tablet_manager.cc:1403] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.001s
I20260709 13:13:45.390280  2572 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.391386  2688 raft_consensus.cc:359] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.391765  2461 leader_election.cc:304] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.392138  2688 raft_consensus.cc:385] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.392257  2686 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.393373  2686 ts_tablet_manager.cc:1403] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.006s
I20260709 13:13:45.394258  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" is_pre_election: true
I20260709 13:13:45.395620  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ef1b7294e142f3bfb5aae008e33dab" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" is_pre_election: true
I20260709 13:13:45.396358  2686 raft_consensus.cc:359] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.397130  2686 raft_consensus.cc:385] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:45.397375  2535 leader_election.cc:343] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.397485  2686 raft_consensus.cc:740] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
W20260709 13:13:45.398204  2535 leader_election.cc:343] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.392583  2688 raft_consensus.cc:740] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.392781  2693 raft_consensus.cc:2804] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.399026  2693 raft_consensus.cc:697] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Running, Role: LEADER
I20260709 13:13:45.399397  2688 consensus_queue.cc:260] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.399928  2693 consensus_queue.cc:237] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.397315  2645 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.404008  2687 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.404498  2687 ts_tablet_manager.cc:1403] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.004s
I20260709 13:13:45.407274  2687 raft_consensus.cc:359] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.407651  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.407922  2687 raft_consensus.cc:385] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.408241  2687 raft_consensus.cc:740] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.408341  2646 raft_consensus.cc:2468] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 0.
I20260709 13:13:45.398607  2686 consensus_queue.cc:260] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.408967  2687 consensus_queue.cc:260] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.409765  2538 leader_election.cc:304] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:45.409024  2393 catalog_manager.cc:5697] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.410966  2694 raft_consensus.cc:2804] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.411309  2694 raft_consensus.cc:493] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.411645  2694 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.413240  2686 ts_tablet_manager.cc:1434] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:13:45.415678  2686 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a: Bootstrap starting.
I20260709 13:13:45.417975  2688 ts_tablet_manager.cc:1434] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:13:45.422281  2694 raft_consensus.cc:515] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.425487  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.426082  2646 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.411554  2687 ts_tablet_manager.cc:1434] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:45.428010  2687 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.427913  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:45.428741  2686 tablet_bootstrap.cc:654] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:45.429688  2535 leader_election.cc:343] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.430759  2688 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.434440  2690 raft_consensus.cc:493] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.434886  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ef1b7294e142f3bfb5aae008e33dab" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.435318  2687 tablet_bootstrap.cc:654] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.434978  2690 raft_consensus.cc:515] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
W20260709 13:13:45.436309  2538 leader_election.cc:343] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.436761  2538 leader_election.cc:304] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a
I20260709 13:13:45.438447  2688 tablet_bootstrap.cc:654] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.441318  2646 raft_consensus.cc:2468] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 1.
I20260709 13:13:45.442482  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.443156  2572 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 0.
I20260709 13:13:45.437345  2690 leader_election.cc:290] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:45.444132  2694 leader_election.cc:290] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.444410  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" is_pre_election: true
I20260709 13:13:45.444927  2694 raft_consensus.cc:2749] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.445104  2496 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 0.
I20260709 13:13:45.446494  2610 leader_election.cc:304] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.447893  2690 raft_consensus.cc:2804] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.447381  2393 catalog_manager.cc:5697] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.448329  2690 raft_consensus.cc:493] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.451267  2690 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.451875  2688 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:45.452373  2688 ts_tablet_manager.cc:1403] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.002s
I20260709 13:13:45.453120  2687 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.453606  2687 ts_tablet_manager.cc:1403] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 13:13:45.455082  2688 raft_consensus.cc:359] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.455736  2688 raft_consensus.cc:385] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.455994  2688 raft_consensus.cc:740] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.456243  2687 raft_consensus.cc:359] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.456918  2687 raft_consensus.cc:385] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.456609  2688 consensus_queue.cc:260] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.457214  2687 raft_consensus.cc:740] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.457943  2687 consensus_queue.cc:260] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.458842  2688 ts_tablet_manager.cc:1434] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:45.459832  2688 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.459923  2687 ts_tablet_manager.cc:1434] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:45.460886  2687 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:45.461609  2690 raft_consensus.cc:515] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.449798  2538 leader_election.cc:304] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:45.450776  2686 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a: No bootstrap required, opened a new log
I20260709 13:13:45.464805  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.464805  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:45.465492  2686 ts_tablet_manager.cc:1403] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.000s
I20260709 13:13:45.465497  2572 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.465771  2496 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.466879  2687 tablet_bootstrap.cc:654] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.468417  2686 raft_consensus.cc:359] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.469113  2686 raft_consensus.cc:385] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.469410  2686 raft_consensus.cc:740] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.470791  2731 raft_consensus.cc:2804] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.471880  2690 leader_election.cc:290] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:45.472807  2686 consensus_queue.cc:260] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.473053  2496 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 1.
I20260709 13:13:45.475417  2609 leader_election.cc:304] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:45.471535  2731 raft_consensus.cc:697] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:45.476927  2731 consensus_queue.cc:237] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.484340  2688 tablet_bootstrap.cc:654] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.485601  2693 raft_consensus.cc:493] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.485867  2690 raft_consensus.cc:2804] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.475499  2686 ts_tablet_manager.cc:1434] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:45.486636  2690 raft_consensus.cc:697] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 1 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:45.486287  2693 raft_consensus.cc:515] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.489943  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30572622c8284959a800a2408c05fff2" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.490542  2645 raft_consensus.cc:2468] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.484366  2572 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 1.
I20260709 13:13:45.491801  2463 leader_election.cc:304] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:45.492667  2696 raft_consensus.cc:2804] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.493034  2696 raft_consensus.cc:493] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.493409  2696 raft_consensus.cc:3060] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.493794  2693 leader_election.cc:290] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:45.494189  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30572622c8284959a800a2408c05fff2" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.495090  2572 raft_consensus.cc:2468] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.495618  2693 raft_consensus.cc:493] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.496106  2693 raft_consensus.cc:515] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.498764  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.499725  2572 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.499926  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.500873  2645 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.500788  2690 consensus_queue.cc:237] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.502199  2696 raft_consensus.cc:515] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.502934  2463 leader_election.cc:304] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:45.498894  2693 leader_election.cc:290] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.503830  2693 raft_consensus.cc:2804] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.504196  2693 raft_consensus.cc:493] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.504549  2693 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.508519  2720 raft_consensus.cc:493] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.509071  2688 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:45.509025  2720 raft_consensus.cc:515] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.509769  2688 ts_tablet_manager.cc:1403] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.007s
I20260709 13:13:45.511312  2720 leader_election.cc:290] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.511963  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.512938  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
W20260709 13:13:45.513276  2461 leader_election.cc:343] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.513612  2646 raft_consensus.cc:2468] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.505025  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30572622c8284959a800a2408c05fff2" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.515444  2645 raft_consensus.cc:3060] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.515303  2688 raft_consensus.cc:359] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.516316  2688 raft_consensus.cc:385] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.516732  2463 leader_election.cc:304] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:45.516670  2688 raft_consensus.cc:740] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.518028  2720 raft_consensus.cc:2804] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.518615  2720 raft_consensus.cc:493] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.518028  2688 consensus_queue.cc:260] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.518968  2720 raft_consensus.cc:3060] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.520434  2688 ts_tablet_manager.cc:1434] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:13:45.521598  2688 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6: Bootstrap starting.
I20260709 13:13:45.521540  2693 raft_consensus.cc:515] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.524808  2395 catalog_manager.cc:5697] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 1 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.528070  2688 tablet_bootstrap.cc:654] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.528182  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.529208  2572 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.532624  2645 raft_consensus.cc:2468] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.534464  2687 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: No bootstrap required, opened a new log
I20260709 13:13:45.534955  2687 ts_tablet_manager.cc:1403] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.002s
I20260709 13:13:45.537180  2688 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6: No bootstrap required, opened a new log
I20260709 13:13:45.537643  2688 ts_tablet_manager.cc:1403] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:13:45.538270  2696 leader_election.cc:290] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Requested vote from peers 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:45.539515  2571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30572622c8284959a800a2408c05fff2" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.540190  2571 raft_consensus.cc:3060] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.540612  2688 raft_consensus.cc:359] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.541344  2688 raft_consensus.cc:385] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.541633  2688 raft_consensus.cc:740] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.542376  2693 leader_election.cc:290] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Requested vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.542493  2688 consensus_queue.cc:260] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.542995  2693 consensus_queue.cc:1048] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.543552  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.544149  2646 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.544582  2688 ts_tablet_manager.cc:1434] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:45.547359  2572 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.548928  2461 leader_election.cc:304] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.553457  2696 raft_consensus.cc:2804] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.554057  2696 raft_consensus.cc:697] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Running, Role: LEADER
I20260709 13:13:45.555123  2696 consensus_queue.cc:237] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.557830  2720 raft_consensus.cc:515] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.562376  2646 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.564620  2463 leader_election.cc:304] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:45.564668  2687 raft_consensus.cc:359] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.565442  2687 raft_consensus.cc:385] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.565768  2687 raft_consensus.cc:740] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.569523  2693 raft_consensus.cc:493] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.570107  2693 raft_consensus.cc:515] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.573902  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.574524  2572 raft_consensus.cc:3060] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.576612  2393 catalog_manager.cc:5697] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 1 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.573920  2720 leader_election.cc:290] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Requested vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.583063  2720 raft_consensus.cc:2804] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.583617  2720 raft_consensus.cc:697] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Running, Role: LEADER
I20260709 13:13:45.584631  2720 consensus_queue.cc:237] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:45.587059  2570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.587806  2570 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.588786  2693 leader_election.cc:290] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.589172  2461 leader_election.cc:304] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.591110  2572 raft_consensus.cc:2468] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.592373  2693 raft_consensus.cc:2804] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.593765  2693 raft_consensus.cc:493] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.589911  2687 consensus_queue.cc:260] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.594777  2461 leader_election.cc:304] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.590915  2571 raft_consensus.cc:2468] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.596374  2741 raft_consensus.cc:2804] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.596832  2741 raft_consensus.cc:697] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Running, Role: LEADER
I20260709 13:13:45.597340  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.598022  2645 raft_consensus.cc:3060] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.597700  2741 consensus_queue.cc:237] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.599668  2687 ts_tablet_manager.cc:1434] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.008s
I20260709 13:13:45.603354  2646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.604259  2646 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.612326  2645 raft_consensus.cc:2468] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.594799  2693 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.616358  2393 catalog_manager.cc:5697] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.626370  2571 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.632211  2693 raft_consensus.cc:515] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.635075  2720 consensus_queue.cc:1048] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.635370  2571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.636066  2571 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.636663  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.637280  2645 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.641458  2393 catalog_manager.cc:5697] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.644024  2571 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.643339  2393 catalog_manager.cc:5697] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.645290  2461 leader_election.cc:304] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.646236  2693 leader_election.cc:290] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Requested vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.646100  2720 raft_consensus.cc:2804] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.646098  2645 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.647828  2720 raft_consensus.cc:697] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Running, Role: LEADER
I20260709 13:13:45.648765  2720 consensus_queue.cc:237] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.662719  2395 catalog_manager.cc:5697] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.748790  2720 raft_consensus.cc:493] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.749279  2720 raft_consensus.cc:515] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.751348  2720 leader_election.cc:290] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.752067  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ef1b7294e142f3bfb5aae008e33dab" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:45.752344  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ef1b7294e142f3bfb5aae008e33dab" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:45.752693  2572 raft_consensus.cc:2468] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.753008  2645 raft_consensus.cc:2468] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 0.
I20260709 13:13:45.753695  2461 leader_election.cc:304] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.754390  2720 raft_consensus.cc:2804] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.754737  2720 raft_consensus.cc:493] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.754956  2720 raft_consensus.cc:3060] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.760273  2720 raft_consensus.cc:515] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.762269  2720 leader_election.cc:290] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Requested vote from peers 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:45.762864  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ef1b7294e142f3bfb5aae008e33dab" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:45.763283  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ef1b7294e142f3bfb5aae008e33dab" candidate_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:45.763371  2572 raft_consensus.cc:3060] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.763824  2645 raft_consensus.cc:3060] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.768440  2572 raft_consensus.cc:2468] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.768499  2645 raft_consensus.cc:2468] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22ebc50a2932456ab24e9fe4ff5e8533 in term 1.
I20260709 13:13:45.769639  2461 leader_election.cc:304] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:45.770303  2720 raft_consensus.cc:2804] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.770710  2720 raft_consensus.cc:697] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Becoming Leader. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Running, Role: LEADER
I20260709 13:13:45.771319  2720 consensus_queue.cc:237] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:45.778148  2395 catalog_manager.cc:5697] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.823889 23430 ts_manager.cc:295] Set tserver state for 22ebc50a2932456ab24e9fe4ff5e8533 to MAINTENANCE_MODE
I20260709 13:13:45.824590 23430 tablet_server.cc:179] TabletServer@127.22.225.129:0 shutting down...
I20260709 13:13:45.842312 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:45.843230 23430 tablet_replica.cc:333] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.843941 23430 raft_consensus.cc:2243] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.844580 23430 pending_rounds.cc:70] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Trying to abort 1 pending ops.
I20260709 13:13:45.844802 23430 pending_rounds.cc:77] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637173657616384 op_type: NO_OP noop_request { }
I20260709 13:13:45.845140 23430 raft_consensus.cc:2889] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:45.845427 23430 raft_consensus.cc:2272] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.847857 23430 tablet_replica.cc:333] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.848451 23430 raft_consensus.cc:2243] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.848834 23430 raft_consensus.cc:2272] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.850523 23430 tablet_replica.cc:333] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.851068 23430 raft_consensus.cc:2243] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.851639 23430 pending_rounds.cc:70] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Trying to abort 1 pending ops.
I20260709 13:13:45.851850 23430 pending_rounds.cc:77] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637174366175232 op_type: NO_OP noop_request { }
I20260709 13:13:45.852114 23430 raft_consensus.cc:2889] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:45.852380 23430 raft_consensus.cc:2272] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.854519 23430 tablet_replica.cc:333] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.855126 23430 raft_consensus.cc:2243] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.855733 23430 pending_rounds.cc:70] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Trying to abort 1 pending ops.
I20260709 13:13:45.855927 23430 pending_rounds.cc:77] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637173554155520 op_type: NO_OP noop_request { }
I20260709 13:13:45.856182 23430 raft_consensus.cc:2889] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:45.856443 23430 raft_consensus.cc:2272] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.858350 23430 tablet_replica.cc:333] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.858872 23430 raft_consensus.cc:2243] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:45.859225 23430 raft_consensus.cc:2272] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.860980 23430 tablet_replica.cc:333] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.861542 23430 raft_consensus.cc:2243] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.862103 23430 pending_rounds.cc:70] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Trying to abort 1 pending ops.
I20260709 13:13:45.862295 23430 pending_rounds.cc:77] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637173606629376 op_type: NO_OP noop_request { }
I20260709 13:13:45.862550 23430 raft_consensus.cc:2889] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:45.862818 23430 raft_consensus.cc:2272] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.864722 23430 tablet_replica.cc:333] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.865276 23430 raft_consensus.cc:2243] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.865831 23430 pending_rounds.cc:70] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Trying to abort 1 pending ops.
I20260709 13:13:45.866027 23430 pending_rounds.cc:77] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637172722053120 op_type: NO_OP noop_request { }
I20260709 13:13:45.866283 23430 raft_consensus.cc:2889] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:45.866536 23430 raft_consensus.cc:2272] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.868521 23430 tablet_replica.cc:333] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.869040 23430 raft_consensus.cc:2243] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.869647 23430 pending_rounds.cc:70] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Trying to abort 1 pending ops.
I20260709 13:13:45.869854 23430 pending_rounds.cc:77] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637172858101760 op_type: NO_OP noop_request { }
I20260709 13:13:45.870105 23430 raft_consensus.cc:2889] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:45.870365 23430 raft_consensus.cc:2272] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.872309 23430 tablet_replica.cc:333] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.872794 23430 raft_consensus.cc:2243] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.873385 23430 pending_rounds.cc:70] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Trying to abort 1 pending ops.
I20260709 13:13:45.873592 23430 pending_rounds.cc:77] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637173867397120 op_type: NO_OP noop_request { }
I20260709 13:13:45.873840 23430 raft_consensus.cc:2889] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:45.874114 23430 raft_consensus.cc:2272] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.875937 23430 tablet_replica.cc:333] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: stopping tablet replica
I20260709 13:13:45.876402 23430 raft_consensus.cc:2243] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:45.877179 23430 raft_consensus.cc:2272] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:45.888882  2690 consensus_queue.cc:1048] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.900856 23430 tablet_server.cc:196] TabletServer@127.22.225.129:0 shutdown complete.
W20260709 13:13:45.903868  2609 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111) [suppressed 289 similar messages]
W20260709 13:13:45.911338  2609 consensus_peers.cc:597] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:45.934466  2731 consensus_queue.cc:1048] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:45.951792  2535 consensus_peers.cc:597] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:46.217144  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:46.952744  2694 raft_consensus.cc:493] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.953395  2694 raft_consensus.cc:515] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:46.955571  2694 leader_election.cc:290] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:46.957206  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:46.957860  2645 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 1.
I20260709 13:13:46.958937  2538 leader_election.cc:304] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:46.959719  2694 raft_consensus.cc:2804] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:46.959988  2694 raft_consensus.cc:493] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:46.960172  2535 leader_election.cc:336] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:46.960284  2694 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.965273  2694 raft_consensus.cc:515] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:46.966815  2694 leader_election.cc:290] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:46.967813  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:46.968390  2645 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:46.970073  2535 leader_election.cc:336] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:46.972985  2645 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 2.
I20260709 13:13:46.974076  2538 leader_election.cc:304] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:46.974727  2694 raft_consensus.cc:2804] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.975741  2694 raft_consensus.cc:697] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:46.976691  2694 consensus_queue.cc:237] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:46.984759  2395 catalog_manager.cc:5697] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 1 to 2, leader changed from 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.074657  2752 raft_consensus.cc:493] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.075218  2752 raft_consensus.cc:515] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.076917  2752 leader_election.cc:290] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.078200  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:47.078853  2572 raft_consensus.cc:2468] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 1.
I20260709 13:13:47.080050  2610 leader_election.cc:304] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:47.080859  2752 raft_consensus.cc:2804] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:47.080920  2609 leader_election.cc:336] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.081413  2752 raft_consensus.cc:493] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.081842  2752 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.087361  2752 raft_consensus.cc:515] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.088979  2752 leader_election.cc:290] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.090052  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:47.090656  2572 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:47.092334  2609 leader_election.cc:336] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.095870  2572 raft_consensus.cc:2468] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 2.
I20260709 13:13:47.096741  2610 leader_election.cc:304] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:47.097369  2752 raft_consensus.cc:2804] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.098434  2752 raft_consensus.cc:697] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:47.099066  2752 consensus_queue.cc:237] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.101809  2771 raft_consensus.cc:493] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.102308  2771 raft_consensus.cc:515] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:47.104223  2771 leader_election.cc:290] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.105268  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30572622c8284959a800a2408c05fff2" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:47.105897  2572 raft_consensus.cc:2468] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 1.
I20260709 13:13:47.106928  2610 leader_election.cc:304] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:47.106842  2395 catalog_manager.cc:5697] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 1 to 2, leader changed from 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.107712  2771 raft_consensus.cc:2804] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:47.107931  2609 leader_election.cc:336] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.108150  2771 raft_consensus.cc:493] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.108500  2771 raft_consensus.cc:3060] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.113782  2771 raft_consensus.cc:515] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:47.115604  2771 leader_election.cc:290] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.116633  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30572622c8284959a800a2408c05fff2" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:47.117216  2572 raft_consensus.cc:3060] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.118407  2771 raft_consensus.cc:493] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22ebc50a2932456ab24e9fe4ff5e8533)
I20260709 13:13:47.118866  2771 raft_consensus.cc:515] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
W20260709 13:13:47.119091  2609 leader_election.cc:336] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.120745  2771 leader_election.cc:290] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.121768  2571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:47.122977  2572 raft_consensus.cc:2468] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 2.
I20260709 13:13:47.123986  2610 leader_election.cc:304] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:47.124720  2771 raft_consensus.cc:2804] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.125195  2771 raft_consensus.cc:697] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
W20260709 13:13:47.125458  2609 leader_election.cc:336] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.125942  2609 leader_election.cc:304] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a; no voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:47.126027  2771 consensus_queue.cc:237] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:47.126710  2752 raft_consensus.cc:2749] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:47.133630  2395 catalog_manager.cc:5697] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 1 to 2, leader changed from 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.138842  2694 raft_consensus.cc:493] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22ebc50a2932456ab24e9fe4ff5e8533)
I20260709 13:13:47.139312  2694 raft_consensus.cc:515] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.141242  2694 leader_election.cc:290] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:47.142547  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a" is_pre_election: true
I20260709 13:13:47.143088  2645 raft_consensus.cc:2468] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 1.
I20260709 13:13:47.144017  2538 leader_election.cc:304] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:47.144774  2694 raft_consensus.cc:2804] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:47.144775  2535 leader_election.cc:336] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.145277  2694 raft_consensus.cc:493] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22ebc50a2932456ab24e9fe4ff5e8533)
I20260709 13:13:47.145665  2694 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.150295  2694 raft_consensus.cc:515] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.151790  2694 leader_election.cc:290] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:47.152757  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:47.153358  2645 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:47.155315  2535 leader_election.cc:336] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.158529  2645 raft_consensus.cc:2468] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 2.
I20260709 13:13:47.159428  2538 leader_election.cc:304] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:47.160036  2694 raft_consensus.cc:2804] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.160362  2694 raft_consensus.cc:697] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:47.161154  2694 consensus_queue.cc:237] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.167507  2395 catalog_manager.cc:5697] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 1 to 2, leader changed from 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:47.178893  2771 raft_consensus.cc:493] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.179391  2771 raft_consensus.cc:515] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.181170  2771 leader_election.cc:290] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.182278  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:47.183029  2572 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 1.
I20260709 13:13:47.184083  2610 leader_election.cc:304] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
W20260709 13:13:47.184612  2609 leader_election.cc:336] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.184808  2771 raft_consensus.cc:2804] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:47.185277  2771 raft_consensus.cc:493] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.185590  2771 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.190683  2771 raft_consensus.cc:515] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.192376  2771 leader_election.cc:290] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.193459  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:47.194088  2572 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:47.195636  2609 leader_election.cc:336] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.199368  2572 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 2.
I20260709 13:13:47.200496  2610 leader_election.cc:304] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:47.201251  2752 raft_consensus.cc:2804] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.203496  2752 raft_consensus.cc:697] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:47.204335  2752 consensus_queue.cc:237] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.211061  2395 catalog_manager.cc:5697] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 1 to 2, leader changed from 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:47.218245  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:47.383823  2535 consensus_peers.cc:597] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.444947  2645 raft_consensus.cc:1275] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:47.446208  2694 consensus_queue.cc:1048] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:47.518615  2572 raft_consensus.cc:1275] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:47.519820  2752 consensus_queue.cc:1048] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:47.534757  2609 consensus_peers.cc:597] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.593794  2572 raft_consensus.cc:1275] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:13:47.593971  2535 consensus_peers.cc:597] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.595185  2752 consensus_queue.cc:1048] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:47.607024  2609 consensus_peers.cc:597] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.613461  2572 raft_consensus.cc:1275] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:47.614821  2752 consensus_queue.cc:1048] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:47.628314  2609 consensus_peers.cc:597] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:47.641415  2752 raft_consensus.cc:493] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.641824  2752 raft_consensus.cc:515] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.643280  2752 leader_election.cc:290] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.644313  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:47.644963  2572 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 1.
I20260709 13:13:47.645932  2610 leader_election.cc:304] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:47.646555  2752 raft_consensus.cc:2804] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:47.646914  2752 raft_consensus.cc:493] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:47.647111  2609 leader_election.cc:336] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.647261  2752 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.647822  2771 raft_consensus.cc:493] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.648300  2771 raft_consensus.cc:515] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.650269  2771 leader_election.cc:290] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.651263  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:47.651909  2572 raft_consensus.cc:2468] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 1.
I20260709 13:13:47.652872  2610 leader_election.cc:304] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:47.653646  2771 raft_consensus.cc:2804] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:47.653990  2771 raft_consensus.cc:493] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:47.654037  2609 leader_election.cc:336] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.654254  2771 raft_consensus.cc:3060] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.654413  2752 raft_consensus.cc:515] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.656275  2752 leader_election.cc:290] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.657330  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:47.657879  2572 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:47.659866  2609 leader_election.cc:336] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.660437  2771 raft_consensus.cc:515] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.662175  2771 leader_election.cc:290] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.663190  2571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:47.663295  2572 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 2.
I20260709 13:13:47.663738  2571 raft_consensus.cc:3060] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.664307  2610 leader_election.cc:304] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:47.665117  2771 raft_consensus.cc:2804] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.665673  2771 raft_consensus.cc:697] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:47.666358  2771 consensus_queue.cc:237] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
W20260709 13:13:47.666949  2609 leader_election.cc:336] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.669274  2571 raft_consensus.cc:2468] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 2.
I20260709 13:13:47.670455  2610 leader_election.cc:304] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:47.671240  2771 raft_consensus.cc:2804] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.671727  2771 raft_consensus.cc:697] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:47.672402  2771 consensus_queue.cc:237] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.673702  2393 catalog_manager.cc:5697] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 1 to 2, leader changed from 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.685139  2645 raft_consensus.cc:1275] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.685336  2393 catalog_manager.cc:5697] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 1 to 2, leader changed from 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:47.686319  2694 consensus_queue.cc:1048] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.838605  2771 raft_consensus.cc:493] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.839094  2771 raft_consensus.cc:515] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.840763  2771 leader_election.cc:290] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.841876  2571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ef1b7294e142f3bfb5aae008e33dab" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" is_pre_election: true
I20260709 13:13:47.842598  2571 raft_consensus.cc:2468] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 1.
I20260709 13:13:47.843580  2610 leader_election.cc:304] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:47.844220  2771 raft_consensus.cc:2804] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:13:47.844271  2609 leader_election.cc:336] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.844554  2771 raft_consensus.cc:493] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.844895  2771 raft_consensus.cc:3060] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:47.849735  2771 raft_consensus.cc:515] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.851222  2771 leader_election.cc:290] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:47.852198  2571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9ef1b7294e142f3bfb5aae008e33dab" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:47.852702  2571 raft_consensus.cc:3060] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:47.854403  2609 leader_election.cc:336] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111)
I20260709 13:13:47.857277  2571 raft_consensus.cc:2468] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 2.
I20260709 13:13:47.858227  2610 leader_election.cc:304] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 22ebc50a2932456ab24e9fe4ff5e8533
I20260709 13:13:47.858803  2771 raft_consensus.cc:2804] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:47.859200  2771 raft_consensus.cc:697] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:47.859812  2771 consensus_queue.cc:237] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:47.866966  2395 catalog_manager.cc:5697] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 1 to 2, leader changed from 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:48.059670  2609 consensus_peers.cc:597] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.100390  2571 raft_consensus.cc:1275] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:48.101857  2771 consensus_queue.cc:1048] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:48.125941  2571 raft_consensus.cc:1275] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:48.127137  2775 consensus_queue.cc:1048] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:48.145383  2609 consensus_peers.cc:597] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:48.219121  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:48.283154  2609 consensus_peers.cc:597] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:48.284060  2571 raft_consensus.cc:1275] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:48.285296  2771 consensus_queue.cc:1048] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:48.608973  2609 consensus_peers.cc:597] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:48.675681  2535 consensus_peers.cc:597] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.220216  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:49.700297  2535 consensus_peers.cc:597] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.807034  2609 consensus_peers.cc:597] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:49.933550  2535 consensus_peers.cc:597] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:50.075906  2609 consensus_peers.cc:597] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:50.115316  2609 consensus_peers.cc:597] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:50.221148  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:50.483106  2609 consensus_peers.cc:597] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:50.640987  2609 consensus_peers.cc:597] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:50.755535  2609 consensus_peers.cc:597] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:50.907886  2535 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111) [suppressed 91 similar messages]
I20260709 13:13:50.927066 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:50.933043  2794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.933669  2795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:50.934804  2797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:50.936863 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:50.937772 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:50.937992 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:50.938185 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602830938164 us; error 0 us; skew 500 ppm
I20260709 13:13:50.938823 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:50.941817 23430 webserver.cc:533] Webserver started at http://127.22.225.129:44037/ using document root <none> and password file <none>
I20260709 13:13:50.942239 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:50.942382 23430 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:50.945600 23430 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:50.948900  2802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:50.949643 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:13:50.949932 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-fx0m"
I20260709 13:13:50.950206 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:50.963603 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:50.964545 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:50.965939 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:50.969406  2809 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:13:50.977918  2535 consensus_peers.cc:597] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:50.987756  2609 consensus_peers.cc:597] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:51.015776 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:13:51.016113 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.048s	user 0.003s	sys 0.000s
I20260709 13:13:51.016435 23430 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:13:51.020799  2809 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.033931  2809 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:51.034798  2809 tablet_bootstrap.cc:492] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.035441  2809 ts_tablet_manager.cc:1403] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:13:51.037928  2809 raft_consensus.cc:359] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.038601  2809 raft_consensus.cc:740] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.039260  2809 consensus_queue.cc:260] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.041756  2809 ts_tablet_manager.cc:1434] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:13:51.042578  2809 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.056890  2809 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:51.057864  2809 tablet_bootstrap.cc:492] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.058498  2809 ts_tablet_manager.cc:1403] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:13:51.060976  2809 raft_consensus.cc:359] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.061833  2809 raft_consensus.cc:740] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.062503  2809 consensus_queue.cc:260] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.064430  2809 ts_tablet_manager.cc:1434] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:51.065277  2809 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.069308 23430 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:13:51.069679 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.053s	user 0.046s	sys 0.007s
I20260709 13:13:51.081295  2809 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:51.082502  2809 tablet_bootstrap.cc:492] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.083295  2809 ts_tablet_manager.cc:1403] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:13:51.086532  2809 raft_consensus.cc:359] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.087538  2809 raft_consensus.cc:740] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.088500  2809 consensus_queue.cc:260] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.091152  2809 ts_tablet_manager.cc:1434] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:51.092136  2809 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.108335  2809 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:51.109266  2809 tablet_bootstrap.cc:492] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.109854  2809 ts_tablet_manager.cc:1403] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.001s
I20260709 13:13:51.112353  2809 raft_consensus.cc:359] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.113184  2809 raft_consensus.cc:740] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.113790  2809 consensus_queue.cc:260] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.115569  2809 ts_tablet_manager.cc:1434] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:51.116174  2809 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.129562 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:38759
I20260709 13:13:51.129699  2872 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:38759 every 8 connection(s)
I20260709 13:13:51.133313  2809 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:51.134692  2809 tablet_bootstrap.cc:492] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.135632  2809 ts_tablet_manager.cc:1403] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:13:51.139595  2809 raft_consensus.cc:359] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.140533  2809 raft_consensus.cc:740] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.141367  2809 consensus_queue.cc:260] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.143031 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:51.143669  2809 ts_tablet_manager.cc:1434] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:51.144534  2809 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.145778  2845 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.154984  2874 heartbeater.cc:344] Connected to a master server at 127.22.225.190:45711
I20260709 13:13:51.155428  2874 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:51.156472  2874 heartbeater.cc:507] Master 127.22.225.190:45711 requested a full tablet report, sending...
I20260709 13:13:51.160434  2845 pending_rounds.cc:85] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting all ops after (but not including) 0
I20260709 13:13:51.160722  2845 pending_rounds.cc:107] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:51.160964  2845 raft_consensus.cc:2889] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:51.143002  2875 tablet.cc:2406] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:51.176404  2809 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:51.177377  2809 tablet_bootstrap.cc:492] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.178090  2809 ts_tablet_manager.cc:1403] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.020s
I20260709 13:13:51.181777  2395 ts_manager.cc:194] Re-registered known tserver with Master: 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759)
I20260709 13:13:51.180614  2809 raft_consensus.cc:359] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.182745  2809 raft_consensus.cc:740] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.183555  2809 consensus_queue.cc:260] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.185647  2809 ts_tablet_manager.cc:1434] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:51.186491  2809 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.186939  2645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
mode: GRACEFUL
new_leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:13:51.187673  2645 raft_consensus.cc:606] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Received request to transfer leadership to TS 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:51.193101  2645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
mode: GRACEFUL
new_leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:13:51.193217  2395 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51218
I20260709 13:13:51.193681  2645 raft_consensus.cc:606] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 1 LEADER]: Received request to transfer leadership to TS 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:51.197182  2874 heartbeater.cc:499] Master 127.22.225.190:45711 was elected leader, sending a full tablet report...
I20260709 13:13:51.197477  2645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
mode: GRACEFUL
new_leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:13:51.198268  2645 raft_consensus.cc:606] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Received request to transfer leadership to TS 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:51.199590 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:51.200263 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:51.200984 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:51.203112  2809 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:51.204103  2809 tablet_bootstrap.cc:492] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.204738  2809 ts_tablet_manager.cc:1403] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:13:51.207062  2809 raft_consensus.cc:359] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:51.207857  2809 raft_consensus.cc:740] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.208523  2809 consensus_queue.cc:260] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } } peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } }
I20260709 13:13:51.210392  2809 ts_tablet_manager.cc:1434] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.006s
I20260709 13:13:51.211175  2809 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.220115  2809 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:51.220775  2809 tablet_bootstrap.cc:492] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.221355  2809 ts_tablet_manager.cc:1403] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.010s	user 0.010s	sys 0.000s
W20260709 13:13:51.222133  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:51.223297  2809 raft_consensus.cc:359] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.223794  2809 raft_consensus.cc:385] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:51.223960  2809 raft_consensus.cc:740] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.224413  2809 consensus_queue.cc:260] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.226116  2809 ts_tablet_manager.cc:1434] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:51.226871  2809 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.237411  2809 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:51.238125  2809 tablet_bootstrap.cc:492] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.238643  2809 ts_tablet_manager.cc:1403] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:13:51.240291  2809 raft_consensus.cc:359] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.240859  2809 raft_consensus.cc:740] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.241403  2809 consensus_queue.cc:260] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.243121  2809 ts_tablet_manager.cc:1434] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:51.243863  2809 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap starting.
I20260709 13:13:51.254593  2809 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:51.255271  2809 tablet_bootstrap.cc:492] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Bootstrap complete.
I20260709 13:13:51.255785  2809 ts_tablet_manager.cc:1403] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:13:51.257385  2809 raft_consensus.cc:359] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.257978  2809 raft_consensus.cc:740] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22ebc50a2932456ab24e9fe4ff5e8533, State: Initialized, Role: FOLLOWER
I20260709 13:13:51.258492  2809 consensus_queue.cc:260] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.260169  2809 ts_tablet_manager.cc:1434] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:51.295367  2845 raft_consensus.cc:3060] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.300240  2845 pending_rounds.cc:85] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting all ops after (but not including) 0
I20260709 13:13:51.300429  2845 pending_rounds.cc:107] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:51.300604  2845 raft_consensus.cc:2889] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.350410  2845 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.362172  2845 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:51.378371  2845 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.383811  2845 pending_rounds.cc:85] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting all ops after (but not including) 0
I20260709 13:13:51.384032  2845 pending_rounds.cc:107] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:51.384274  2845 raft_consensus.cc:2889] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.398581  2793 raft_consensus.cc:993] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a: : Instructing follower 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:51.398990  2850 raft_consensus.cc:1081] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Signalling peer 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:51.400381  2571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:37856
I20260709 13:13:51.400991  2571 raft_consensus.cc:493] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:51.401320  2571 raft_consensus.cc:3060] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:51.405969  2571 raft_consensus.cc:515] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.407585  2571 leader_election.cc:290] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:51.408393  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:51.408566  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737b76e658c3442c8f07632aae9162f5" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:51.409000  2845 raft_consensus.cc:3060] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:51.409173  2645 raft_consensus.cc:3055] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:51.409631  2645 raft_consensus.cc:740] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:51.410259  2645 consensus_queue.cc:260] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.411209  2645 raft_consensus.cc:3060] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:51.414146  2845 raft_consensus.cc:2468] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:51.415386  2535 leader_election.cc:304] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:51.416199  2694 raft_consensus.cc:2804] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:51.416330  2645 raft_consensus.cc:2468] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:51.416738  2694 raft_consensus.cc:697] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:51.417718  2694 consensus_queue.cc:237] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.425066  2395 catalog_manager.cc:5697] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 2 to 3, leader changed from 2c5e680501ae47ae847288a540abd53a (127.22.225.131) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 3 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.509295  2793 raft_consensus.cc:993] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a: : Instructing follower 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:51.509698  2850 raft_consensus.cc:1081] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Signalling peer 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:51.510960  2571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:37856
I20260709 13:13:51.511446  2571 raft_consensus.cc:493] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:51.511750  2571 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:51.516986  2571 raft_consensus.cc:515] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.518572  2571 leader_election.cc:290] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:51.519249  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:51.519520  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:51.519838  2845 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:51.520133  2645 raft_consensus.cc:3055] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:51.520423  2645 raft_consensus.cc:740] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:51.521212  2645 consensus_queue.cc:260] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.522234  2645 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:51.523028  2844 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.525558  2845 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:51.526594  2535 leader_election.cc:304] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:51.527267  2694 raft_consensus.cc:2804] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:51.527691  2694 raft_consensus.cc:697] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:51.528519  2694 consensus_queue.cc:237] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.529289  2645 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:51.529984  2844 pending_rounds.cc:85] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting all ops after (but not including) 0
I20260709 13:13:51.530328  2844 pending_rounds.cc:107] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:51.530588  2844 raft_consensus.cc:2889] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.536518  2395 catalog_manager.cc:5697] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 2 to 3, leader changed from 2c5e680501ae47ae847288a540abd53a (127.22.225.131) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 3 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.561339  2793 raft_consensus.cc:993] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a: : Instructing follower 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:51.561719  2850 raft_consensus.cc:1081] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 1 LEADER]: Signalling peer 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:51.563117  2571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:37856
I20260709 13:13:51.563561  2571 raft_consensus.cc:493] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:51.563851  2571 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.569244  2571 raft_consensus.cc:515] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.571971  2571 leader_election.cc:290] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:51.571801  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:51.573014  2845 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.573319  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:51.573966  2645 raft_consensus.cc:3055] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:51.574286  2645 raft_consensus.cc:740] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:51.575090  2645 consensus_queue.cc:260] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.576278  2645 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.578823  2845 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 2.
I20260709 13:13:51.579895  2535 leader_election.cc:304] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:51.580690  2694 raft_consensus.cc:2804] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:51.581215  2694 raft_consensus.cc:697] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:51.581133  2645 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 2.
I20260709 13:13:51.582204  2694 consensus_queue.cc:237] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:51.589607  2393 catalog_manager.cc:5697] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 1 to 2, leader changed from 2c5e680501ae47ae847288a540abd53a (127.22.225.131) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.682749  2845 raft_consensus.cc:3060] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.688263  2845 pending_rounds.cc:85] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting all ops after (but not including) 0
I20260709 13:13:51.688464  2845 pending_rounds.cc:107] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:51.688722  2845 raft_consensus.cc:2889] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.804591  2845 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.809420  2845 pending_rounds.cc:85] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting all ops after (but not including) 0
I20260709 13:13:51.809684  2845 pending_rounds.cc:107] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:51.809903  2845 raft_consensus.cc:2889] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.845382  2645 raft_consensus.cc:1275] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:51.846526  2694 consensus_queue.cc:1048] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.856606  2845 raft_consensus.cc:1275] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:51.858052  2694 consensus_queue.cc:1048] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:51.858671  2694 consensus_queue.cc:1243] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Peer 22ebc50a2932456ab24e9fe4ff5e8533 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:13:51.860893  2845 pending_rounds.cc:85] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting all ops after (but not including) 0
I20260709 13:13:51.861176  2845 pending_rounds.cc:107] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:51.861394  2845 raft_consensus.cc:2889] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:51.994025  2645 raft_consensus.cc:1275] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.995193  2909 consensus_queue.cc:1048] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.003646  2845 raft_consensus.cc:1275] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:52.004997  2903 consensus_queue.cc:1048] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.082837  2845 raft_consensus.cc:1275] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:52.084081  2903 consensus_queue.cc:1048] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.091548  2645 raft_consensus.cc:1275] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:52.092998  2694 consensus_queue.cc:1048] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:52.211751 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:13:52.222985  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:52.228128  2571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
mode: GRACEFUL
new_leader_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:37862
I20260709 13:13:52.228662  2571 raft_consensus.cc:606] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Received request to transfer leadership to TS 2c5e680501ae47ae847288a540abd53a
I20260709 13:13:52.230984  2571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
mode: GRACEFUL
new_leader_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:37862
I20260709 13:13:52.231416  2571 raft_consensus.cc:606] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Received request to transfer leadership to TS 2c5e680501ae47ae847288a540abd53a
I20260709 13:13:52.232398 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:52.232841 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:52.233410 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:52.380839  2903 raft_consensus.cc:993] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6: : Instructing follower 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:52.381471  2694 raft_consensus.cc:1081] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Signalling peer 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:52.383302  2645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:33122
I20260709 13:13:52.383733  2645 raft_consensus.cc:493] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:52.384018  2645 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.388798  2645 raft_consensus.cc:515] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:52.390173  2645 leader_election.cc:290] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 3 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:52.390903  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:52.391189  2571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3c7e9c80824e3fa4a3caf9a683ed0c" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:52.391578  2845 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.391767  2571 raft_consensus.cc:3055] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:52.392124  2571 raft_consensus.cc:740] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:52.392691  2571 consensus_queue.cc:260] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:52.393550  2571 raft_consensus.cc:3060] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.396489  2845 raft_consensus.cc:2468] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 3.
I20260709 13:13:52.397450  2609 leader_election.cc:304] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:52.397648  2571 raft_consensus.cc:2468] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 3.
I20260709 13:13:52.398123  2901 raft_consensus.cc:2804] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:52.398597  2901 raft_consensus.cc:697] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:52.399343  2901 consensus_queue.cc:237] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:52.406129  2393 catalog_manager.cc:5697] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 2 to 3, leader changed from 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 3 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.510977  2903 raft_consensus.cc:993] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6: : Instructing follower 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:52.511413  2694 raft_consensus.cc:1081] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Signalling peer 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:52.512727  2645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:33122
I20260709 13:13:52.513200  2645 raft_consensus.cc:493] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:52.513432  2645 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.517993  2645 raft_consensus.cc:515] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:52.519451  2645 leader_election.cc:290] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 3 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:52.520285  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:52.520478  2571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:52.520965  2845 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.520998  2571 raft_consensus.cc:3055] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:52.521457  2571 raft_consensus.cc:740] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:52.522074  2571 consensus_queue.cc:260] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:52.522897  2571 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:52.526430  2845 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 3.
I20260709 13:13:52.527333  2571 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 3.
I20260709 13:13:52.527681  2609 leader_election.cc:304] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:52.528697  2901 raft_consensus.cc:2804] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:52.529238  2901 raft_consensus.cc:697] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:52.529980  2901 consensus_queue.cc:237] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:52.536552  2393 catalog_manager.cc:5697] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 2 to 3, leader changed from 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 3 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:52.936954  2845 raft_consensus.cc:1275] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:52.938329  2901 consensus_queue.cc:1048] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:52.950462  2571 raft_consensus.cc:1275] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:52.951938  2901 consensus_queue.cc:1048] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:53.028015  2845 raft_consensus.cc:1275] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:53.028005  2571 raft_consensus.cc:1275] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:53.029379  2793 consensus_queue.cc:1048] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:53.029943  2901 consensus_queue.cc:1048] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:53.223871  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:53.239552 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:53.248056  2571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
mode: GRACEFUL
new_leader_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:37862
I20260709 13:13:53.248521  2571 raft_consensus.cc:606] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Received request to transfer leadership to TS 2c5e680501ae47ae847288a540abd53a
I20260709 13:13:53.250604  2645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35941c3996044df79fea5de812ea4acf"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
mode: GRACEFUL
new_leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:13:53.251025  2645 raft_consensus.cc:606] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Received request to transfer leadership to TS 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:53.253141  2645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
mode: GRACEFUL
new_leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:13:53.253538  2645 raft_consensus.cc:606] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Received request to transfer leadership to TS 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:53.254388 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:53.254801 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:53.255291 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:53.500232  2926 raft_consensus.cc:993] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a: : Instructing follower 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:53.500788  2793 raft_consensus.cc:1081] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Signalling peer 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:53.502367  2901 raft_consensus.cc:993] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a: : Instructing follower 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:53.502668  2571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35941c3996044df79fea5de812ea4acf"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:37856
I20260709 13:13:53.502974  2793 raft_consensus.cc:1081] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Signalling peer 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:53.503270  2571 raft_consensus.cc:493] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.503679  2571 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.504662  2572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:37856
I20260709 13:13:53.505270  2572 raft_consensus.cc:493] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.505626  2572 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.510879  2571 raft_consensus.cc:515] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.512360  2572 raft_consensus.cc:515] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.513389  2571 leader_election.cc:290] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:53.513715  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:53.513926  2645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:53.514303  2845 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.514439  2645 raft_consensus.cc:3055] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:53.514882  2645 raft_consensus.cc:740] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:53.515772  2572 leader_election.cc:290] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 4 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:53.516497  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:53.515595  2645 consensus_queue.cc:260] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.517113  2644 raft_consensus.cc:3055] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:53.517467  2644 raft_consensus.cc:740] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:53.517560  2645 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.518293  2644 consensus_queue.cc:260] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.519554  2644 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.521239  2845 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:53.515691  2844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7421f978344e0590908c6cb4d0f786" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:53.522444  2844 raft_consensus.cc:3060] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:53.522785  2645 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:53.522765  2535 leader_election.cc:304] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:53.523942  2694 raft_consensus.cc:2804] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:53.525803  2694 raft_consensus.cc:697] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:53.526579  2694 consensus_queue.cc:237] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.526968  2644 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 4.
I20260709 13:13:53.528283  2538 leader_election.cc:304] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5e680501ae47ae847288a540abd53a, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:53.529106  2927 raft_consensus.cc:2804] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:53.529779  2844 raft_consensus.cc:2468] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 4.
I20260709 13:13:53.531941  2927 raft_consensus.cc:697] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:53.532889  2927 consensus_queue.cc:237] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.534904  2929 raft_consensus.cc:993] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6: : Instructing follower 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:53.535432  2694 raft_consensus.cc:1081] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Signalling peer 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:53.534789  2395 catalog_manager.cc:5697] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 2 to 3, leader changed from 2c5e680501ae47ae847288a540abd53a (127.22.225.131) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 3 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.537047  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:33122
I20260709 13:13:53.537617  2644 raft_consensus.cc:493] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:53.538079  2644 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.545432  2644 raft_consensus.cc:515] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.547427  2644 leader_election.cc:290] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 3 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:53.547941  2844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:53.548710  2844 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.548952  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:53.550148  2572 raft_consensus.cc:3055] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:53.550498  2572 raft_consensus.cc:740] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:53.551312  2395 catalog_manager.cc:5697] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 3 to 4, leader changed from 2c5e680501ae47ae847288a540abd53a (127.22.225.131) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 4 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:53.551564  2572 consensus_queue.cc:260] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.553264  2572 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:53.556876  2844 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 3.
I20260709 13:13:53.558293  2609 leader_election.cc:304] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:53.558959  2793 raft_consensus.cc:2804] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:53.559439  2793 raft_consensus.cc:697] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:53.560046  2793 consensus_queue.cc:237] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:53.561805  2572 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 3.
I20260709 13:13:53.567138  2395 catalog_manager.cc:5697] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 2 to 3, leader changed from 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 3 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:53.937629  2844 raft_consensus.cc:1275] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:53.938820  2694 consensus_queue.cc:1048] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:53.947088  2644 raft_consensus.cc:1275] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:53.948748  2694 consensus_queue.cc:1048] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:54.056941  2644 raft_consensus.cc:1275] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:54.058130  2694 consensus_queue.cc:1048] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.063189  2572 raft_consensus.cc:1275] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:54.065869  2938 consensus_queue.cc:1048] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.069710  2844 raft_consensus.cc:1275] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:54.069888  2845 raft_consensus.cc:1275] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:54.072022  2938 consensus_queue.cc:1048] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.072671  2694 consensus_queue.cc:1048] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:13:54.225028  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:54.261633 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:54.271311  2572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35941c3996044df79fea5de812ea4acf"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
mode: GRACEFUL
new_leader_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:37862
I20260709 13:13:54.271992  2572 raft_consensus.cc:606] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Received request to transfer leadership to TS 2c5e680501ae47ae847288a540abd53a
I20260709 13:13:54.274890  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
mode: GRACEFUL
new_leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:13:54.275384  2644 raft_consensus.cc:606] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Received request to transfer leadership to TS 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:54.277963  2572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
mode: GRACEFUL
new_leader_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:37862
I20260709 13:13:54.278396  2572 raft_consensus.cc:606] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 LEADER]: Received request to transfer leadership to TS 2c5e680501ae47ae847288a540abd53a
I20260709 13:13:54.279408 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:54.279887 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:54.280571 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:54.296947  2927 raft_consensus.cc:993] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6: : Instructing follower 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:54.297528  2694 raft_consensus.cc:1081] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 LEADER]: Signalling peer 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:54.298755  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:33122
I20260709 13:13:54.299229  2644 raft_consensus.cc:493] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.299575  2644 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.307240  2644 raft_consensus.cc:515] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.308996  2644 leader_election.cc:290] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:54.310050  2844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:54.310088  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:54.310935  2572 raft_consensus.cc:3055] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:54.310979  2844 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.311323  2572 raft_consensus.cc:740] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:54.312450  2572 consensus_queue.cc:260] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.314468  2572 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.321151  2844 raft_consensus.cc:2468] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 2.
I20260709 13:13:54.322346  2609 leader_election.cc:304] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:54.323182  2944 raft_consensus.cc:2804] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:54.323553  2944 raft_consensus.cc:697] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:54.323683  2572 raft_consensus.cc:2468] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 2.
I20260709 13:13:54.325027  2944 consensus_queue.cc:237] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.338629  2392 catalog_manager.cc:5697] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 1 to 2, leader changed from 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 2 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.503515  2927 raft_consensus.cc:993] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6: : Instructing follower 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:54.503944  2694 raft_consensus.cc:1081] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Signalling peer 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:54.505334  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35941c3996044df79fea5de812ea4acf"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:33122
I20260709 13:13:54.505779  2644 raft_consensus.cc:493] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.506042  2644 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.511788  2644 raft_consensus.cc:515] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.513695  2644 leader_election.cc:290] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 4 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:54.514317  2844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:54.515223  2844 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.514700  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35941c3996044df79fea5de812ea4acf" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:54.515837  2572 raft_consensus.cc:3055] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:54.516093  2572 raft_consensus.cc:740] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:54.516805  2572 consensus_queue.cc:260] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.518299  2572 raft_consensus.cc:3060] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:54.521462  2844 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 4.
I20260709 13:13:54.522639  2609 leader_election.cc:304] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:54.523324  2944 raft_consensus.cc:2804] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:54.523867  2944 raft_consensus.cc:697] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 4 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:54.524247  2572 raft_consensus.cc:2468] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 4.
I20260709 13:13:54.525071  2944 consensus_queue.cc:237] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.531423  2392 catalog_manager.cc:5697] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 3 to 4, leader changed from 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 4 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.748229  2938 raft_consensus.cc:993] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a: : Instructing follower 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:54.748790  2938 raft_consensus.cc:1081] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Signalling peer 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:54.750540  2572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:37856
I20260709 13:13:54.750996  2572 raft_consensus.cc:493] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.751304  2572 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.756548  2572 raft_consensus.cc:515] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.758147  2572 leader_election.cc:290] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:54.758962  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:54.759303  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f0fcbbffdc48c3804706804010a00b" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:54.759636  2845 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.759900  2644 raft_consensus.cc:3055] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:54.760257  2644 raft_consensus.cc:740] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:54.761370  2644 consensus_queue.cc:260] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.762850  2644 raft_consensus.cc:3060] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.768330  2845 raft_consensus.cc:2468] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:54.769809  2535 leader_election.cc:304] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:54.770335  2644 raft_consensus.cc:2468] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:54.770710  2694 raft_consensus.cc:2804] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:54.771194  2694 raft_consensus.cc:697] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:54.772230  2694 consensus_queue.cc:237] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:54.779834  2392 catalog_manager.cc:5697] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 2 to 3, leader changed from 2c5e680501ae47ae847288a540abd53a (127.22.225.131) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 3 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.787537  2572 raft_consensus.cc:1275] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.788812  2938 consensus_queue.cc:1048] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:54.798107  2845 raft_consensus.cc:1275] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:54.800289  2938 consensus_queue.cc:1048] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.048157  2845 raft_consensus.cc:1275] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:55.049302  2938 consensus_queue.cc:1048] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.057230  2572 raft_consensus.cc:1275] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:55.058840  2938 consensus_queue.cc:1048] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.163503  2845 raft_consensus.cc:1275] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:55.164615  2927 consensus_queue.cc:1048] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.174078  2644 raft_consensus.cc:1275] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:55.175596  2958 consensus_queue.cc:1048] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:55.226135  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:55.286962 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:55.295756  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
mode: GRACEFUL
new_leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:13:55.296277  2644 raft_consensus.cc:606] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Received request to transfer leadership to TS 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:55.298655  2572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
mode: GRACEFUL
new_leader_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:37862
I20260709 13:13:55.299115  2572 raft_consensus.cc:606] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Received request to transfer leadership to TS 2c5e680501ae47ae847288a540abd53a
I20260709 13:13:55.301348  2644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
mode: GRACEFUL
new_leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:33134
I20260709 13:13:55.301795  2644 raft_consensus.cc:606] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Received request to transfer leadership to TS 6d95d9a9346b42d4b9605fc179fd58e6
I20260709 13:13:55.302732 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:13:55.303207 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:55.303726 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:55.553278  2694 raft_consensus.cc:993] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6: : Instructing follower 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:55.553704  2958 raft_consensus.cc:1081] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Signalling peer 2c5e680501ae47ae847288a540abd53a to start an election
I20260709 13:13:55.555032  2644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e"
dest_uuid: "2c5e680501ae47ae847288a540abd53a"
 from {username='slave'} at 127.0.0.1:33122
I20260709 13:13:55.555509  2644 raft_consensus.cc:493] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.555812  2644 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.561895  2644 raft_consensus.cc:515] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.563874  2644 leader_election.cc:290] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 4 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999)
I20260709 13:13:55.564558  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:55.564863  2572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cae39ef4ad4248cb86d26247aac0260e" candidate_uuid: "2c5e680501ae47ae847288a540abd53a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
I20260709 13:13:55.565277  2845 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.565426  2572 raft_consensus.cc:3055] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:55.565784  2572 raft_consensus.cc:740] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:55.566421  2572 consensus_queue.cc:260] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.567399  2572 raft_consensus.cc:3060] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.570189  2845 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 4.
I20260709 13:13:55.571242  2609 leader_election.cc:304] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 2c5e680501ae47ae847288a540abd53a; no voters: 
I20260709 13:13:55.573495  2572 raft_consensus.cc:2468] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c5e680501ae47ae847288a540abd53a in term 4.
I20260709 13:13:55.574869  2938 raft_consensus.cc:2804] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:55.575479  2938 raft_consensus.cc:697] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 4 LEADER]: Becoming Leader. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:55.576568  2938 consensus_queue.cc:237] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.584251  2395 catalog_manager.cc:5697] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a reported cstate change: term changed from 3 to 4, leader changed from 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130) to 2c5e680501ae47ae847288a540abd53a (127.22.225.131). New cstate: current_term: 4 leader_uuid: "2c5e680501ae47ae847288a540abd53a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.680003  2943 raft_consensus.cc:993] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a: : Instructing follower 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:55.680478  2938 raft_consensus.cc:1081] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Signalling peer 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:55.681969  2572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:37856
I20260709 13:13:55.682441  2572 raft_consensus.cc:493] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.682725  2572 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:55.687167  2572 raft_consensus.cc:515] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.688686  2572 leader_election.cc:290] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:55.689515  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:55.689719  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d213bc4be6764d12bf6c72c676e62241" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:55.690135  2845 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:55.690343  2644 raft_consensus.cc:3055] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:55.690740  2644 raft_consensus.cc:740] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:55.691519  2644 consensus_queue.cc:260] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.692606  2644 raft_consensus.cc:3060] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:55.695626  2845 raft_consensus.cc:2468] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:55.696609  2535 leader_election.cc:304] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:55.697453  2958 raft_consensus.cc:2804] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:55.697885  2958 raft_consensus.cc:697] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:55.698063  2644 raft_consensus.cc:2468] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 3.
I20260709 13:13:55.698633  2958 consensus_queue.cc:237] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.704686  2395 catalog_manager.cc:5697] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 2 to 3, leader changed from 2c5e680501ae47ae847288a540abd53a (127.22.225.131) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 3 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.873776  2944 raft_consensus.cc:993] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a: : Instructing follower 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:55.874207  2938 raft_consensus.cc:1081] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Signalling peer 6d95d9a9346b42d4b9605fc179fd58e6 to start an election
I20260709 13:13:55.875600  2571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db"
dest_uuid: "6d95d9a9346b42d4b9605fc179fd58e6"
 from {username='slave'} at 127.0.0.1:37856
I20260709 13:13:55.875975  2571 raft_consensus.cc:493] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.876199  2571 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.881368  2571 raft_consensus.cc:515] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.882707  2571 leader_election.cc:290] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 4 election: Requested vote from peers 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759), 2c5e680501ae47ae847288a540abd53a (127.22.225.131:39341)
I20260709 13:13:55.883455  2845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "22ebc50a2932456ab24e9fe4ff5e8533"
I20260709 13:13:55.883700  2644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1465d3dc2b894846bf7e96e3298302db" candidate_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2c5e680501ae47ae847288a540abd53a"
I20260709 13:13:55.884060  2845 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.884238  2644 raft_consensus.cc:3055] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:55.884635  2644 raft_consensus.cc:740] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2c5e680501ae47ae847288a540abd53a, State: Running, Role: LEADER
I20260709 13:13:55.885566  2644 consensus_queue.cc:260] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.886871  2644 raft_consensus.cc:3060] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:55.890642  2845 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 4.
I20260709 13:13:55.891708  2535 leader_election.cc:304] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22ebc50a2932456ab24e9fe4ff5e8533, 6d95d9a9346b42d4b9605fc179fd58e6; no voters: 
I20260709 13:13:55.892432  2958 raft_consensus.cc:2804] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:55.892912  2958 raft_consensus.cc:697] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 LEADER]: Becoming Leader. State: Replica: 6d95d9a9346b42d4b9605fc179fd58e6, State: Running, Role: LEADER
I20260709 13:13:55.893558  2644 raft_consensus.cc:2468] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d95d9a9346b42d4b9605fc179fd58e6 in term 4.
I20260709 13:13:55.893989  2958 consensus_queue.cc:237] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } }
I20260709 13:13:55.900745  2395 catalog_manager.cc:5697] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 reported cstate change: term changed from 3 to 4, leader changed from 2c5e680501ae47ae847288a540abd53a (127.22.225.131) to 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130). New cstate: current_term: 4 leader_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.983764  2571 raft_consensus.cc:1275] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:55.984920  2938 consensus_queue.cc:1048] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d95d9a9346b42d4b9605fc179fd58e6" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:55.994421  2845 raft_consensus.cc:1275] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Refusing update from remote peer 2c5e680501ae47ae847288a540abd53a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:55.996629  2944 consensus_queue.cc:1048] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:56.141796  2845 raft_consensus.cc:1275] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:56.142951  2958 consensus_queue.cc:1048] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:56.151124  2644 raft_consensus.cc:1275] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:56.152631  2694 consensus_queue.cc:1048] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:56.226998  2443 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:56.309620 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:56.311933  2845 raft_consensus.cc:1275] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:56.313208  2694 consensus_queue.cc:1048] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22ebc50a2932456ab24e9fe4ff5e8533" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:56.326653  2644 raft_consensus.cc:1275] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Refusing update from remote peer 6d95d9a9346b42d4b9605fc179fd58e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:13:56.328379  2694 consensus_queue.cc:1048] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5e680501ae47ae847288a540abd53a" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:56.348645 23430 tablet_server.cc:179] TabletServer@127.22.225.129:38759 shutting down...
I20260709 13:13:56.371788 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:56.372514 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.373291 23430 raft_consensus.cc:2243] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.373860 23430 raft_consensus.cc:2272] T 737b76e658c3442c8f07632aae9162f5 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.377477 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.378525 23430 raft_consensus.cc:2243] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.379256 23430 raft_consensus.cc:2272] T 1465d3dc2b894846bf7e96e3298302db P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.388945 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.389889 23430 raft_consensus.cc:2243] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.390403 23430 raft_consensus.cc:2272] T cae39ef4ad4248cb86d26247aac0260e P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.394304 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.395208 23430 raft_consensus.cc:2243] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.395800 23430 raft_consensus.cc:2272] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.399046 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.399884 23430 raft_consensus.cc:2243] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.400492 23430 raft_consensus.cc:2272] T e9ef1b7294e142f3bfb5aae008e33dab P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.403834 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.404592 23430 raft_consensus.cc:2243] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.405272 23430 raft_consensus.cc:2272] T 35941c3996044df79fea5de812ea4acf P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:56.408623  2609 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 13:13:56.408699 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.409536 23430 raft_consensus.cc:2243] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.410051 23430 raft_consensus.cc:2272] T d213bc4be6764d12bf6c72c676e62241 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:56.411617  2609 consensus_peers.cc:597] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:56.413179 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.413727 23430 raft_consensus.cc:2243] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.414139 23430 raft_consensus.cc:2272] T 30572622c8284959a800a2408c05fff2 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.416347 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.416837 23430 raft_consensus.cc:2243] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.417238 23430 raft_consensus.cc:2272] T 97f0fcbbffdc48c3804706804010a00b P 22ebc50a2932456ab24e9fe4ff5e8533 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.419243 23430 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:56.419682 23430 raft_consensus.cc:2243] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.420159 23430 raft_consensus.cc:2272] T af7421f978344e0590908c6cb4d0f786 P 22ebc50a2932456ab24e9fe4ff5e8533 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:56.433946  2609 consensus_peers.cc:597] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:56.454272 23430 tablet_server.cc:196] TabletServer@127.22.225.129:38759 shutdown complete.
I20260709 13:13:56.481024 23430 tablet_server.cc:179] TabletServer@127.22.225.130:0 shutting down...
W20260709 13:13:56.501096  2535 consensus_peers.cc:597] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:56.509137 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:56.509850 23430 tablet_replica.cc:333] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.510545 23430 raft_consensus.cc:2243] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.511361 23430 raft_consensus.cc:2272] T 737b76e658c3442c8f07632aae9162f5 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.513792 23430 tablet_replica.cc:333] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.514364 23430 raft_consensus.cc:2243] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.515136 23430 raft_consensus.cc:2272] T af7421f978344e0590908c6cb4d0f786 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.517369 23430 tablet_replica.cc:333] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.517983 23430 raft_consensus.cc:2243] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.518379 23430 raft_consensus.cc:2272] T e9ef1b7294e142f3bfb5aae008e33dab P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.520416 23430 tablet_replica.cc:333] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.520911 23430 raft_consensus.cc:2243] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.521353 23430 raft_consensus.cc:2272] T 35941c3996044df79fea5de812ea4acf P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.523588 23430 tablet_replica.cc:333] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.524176 23430 raft_consensus.cc:2243] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.524773 23430 raft_consensus.cc:2272] T 30572622c8284959a800a2408c05fff2 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:56.526688  2609 consensus_peers.cc:597] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:56.527329 23430 tablet_replica.cc:333] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.527976 23430 raft_consensus.cc:2243] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.528771 23430 raft_consensus.cc:2272] T 97f0fcbbffdc48c3804706804010a00b P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.531010 23430 tablet_replica.cc:333] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.531540 23430 raft_consensus.cc:2243] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.532308 23430 raft_consensus.cc:2272] T d213bc4be6764d12bf6c72c676e62241 P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.535499 23430 tablet_replica.cc:333] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.536012 23430 raft_consensus.cc:2243] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.536410 23430 raft_consensus.cc:2272] T cae39ef4ad4248cb86d26247aac0260e P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.538972 23430 tablet_replica.cc:333] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.539479 23430 raft_consensus.cc:2243] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.539966 23430 raft_consensus.cc:2272] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 6d95d9a9346b42d4b9605fc179fd58e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.542002 23430 tablet_replica.cc:333] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6: stopping tablet replica
I20260709 13:13:56.542491 23430 raft_consensus.cc:2243] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.543267 23430 raft_consensus.cc:2272] T 1465d3dc2b894846bf7e96e3298302db P 6d95d9a9346b42d4b9605fc179fd58e6 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:56.553457  2609 consensus_peers.cc:597] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a -> Peer 22ebc50a2932456ab24e9fe4ff5e8533 (127.22.225.129:38759): Couldn't send request to peer 22ebc50a2932456ab24e9fe4ff5e8533. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:38759: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:56.568876 23430 tablet_server.cc:196] TabletServer@127.22.225.130:0 shutdown complete.
I20260709 13:13:56.593362 23430 tablet_server.cc:179] TabletServer@127.22.225.131:0 shutting down...
W20260709 13:13:56.598896  2610 consensus_peers.cc:597] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a -> Peer 6d95d9a9346b42d4b9605fc179fd58e6 (127.22.225.130:33999): Couldn't send request to peer 6d95d9a9346b42d4b9605fc179fd58e6. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33999: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:56.623965 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:56.624769 23430 tablet_replica.cc:333] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.625950 23430 raft_consensus.cc:2243] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.626991 23430 raft_consensus.cc:2272] T e9ef1b7294e142f3bfb5aae008e33dab P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.629292 23430 tablet_replica.cc:333] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.629878 23430 raft_consensus.cc:2243] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.630560 23430 raft_consensus.cc:2272] T 35941c3996044df79fea5de812ea4acf P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.632557 23430 tablet_replica.cc:333] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.633117 23430 raft_consensus.cc:2243] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.633529 23430 raft_consensus.cc:2272] T af7421f978344e0590908c6cb4d0f786 P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.635659 23430 tablet_replica.cc:333] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.636130 23430 raft_consensus.cc:2243] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.636533 23430 raft_consensus.cc:2272] T 737b76e658c3442c8f07632aae9162f5 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.638664 23430 tablet_replica.cc:333] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.639151 23430 raft_consensus.cc:2243] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.639559 23430 raft_consensus.cc:2272] T 1465d3dc2b894846bf7e96e3298302db P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.642776 23430 tablet_replica.cc:333] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.643340 23430 raft_consensus.cc:2243] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.644126 23430 raft_consensus.cc:2272] T cae39ef4ad4248cb86d26247aac0260e P 2c5e680501ae47ae847288a540abd53a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.646734 23430 tablet_replica.cc:333] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.647454 23430 raft_consensus.cc:2243] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.648298 23430 raft_consensus.cc:2272] T 9e3c7e9c80824e3fa4a3caf9a683ed0c P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.650336 23430 tablet_replica.cc:333] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.650822 23430 raft_consensus.cc:2243] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.651597 23430 raft_consensus.cc:2272] T 30572622c8284959a800a2408c05fff2 P 2c5e680501ae47ae847288a540abd53a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.653544 23430 tablet_replica.cc:333] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.653995 23430 raft_consensus.cc:2243] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.654366 23430 raft_consensus.cc:2272] T d213bc4be6764d12bf6c72c676e62241 P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.656503 23430 tablet_replica.cc:333] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a: stopping tablet replica
I20260709 13:13:56.656986 23430 raft_consensus.cc:2243] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:56.657428 23430 raft_consensus.cc:2272] T 97f0fcbbffdc48c3804706804010a00b P 2c5e680501ae47ae847288a540abd53a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.679997 23430 tablet_server.cc:196] TabletServer@127.22.225.131:0 shutdown complete.
I20260709 13:13:56.704916 23430 master.cc:562] Master@127.22.225.190:45711 shutting down...
I20260709 13:13:56.727964 23430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:56.728542 23430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:56.728858 23430 tablet_replica.cc:333] T 00000000000000000000000000000000 P ef9f00ca7d704150a75b4dc15d29bcfb: stopping tablet replica
I20260709 13:13:56.748989 23430 master.cc:584] Master@127.22.225.190:45711 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12743 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:13:56.794147 23430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.225.190:36251
I20260709 13:13:56.795311 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:56.802147  2985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:56.802150  2982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:56.802196  2983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:56.803452 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:56.804316 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:56.804489 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:56.804608 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602836804597 us; error 0 us; skew 500 ppm
I20260709 13:13:56.805063 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:56.807375 23430 webserver.cc:533] Webserver started at http://127.22.225.190:36951/ using document root <none> and password file <none>
I20260709 13:13:56.807837 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:56.807986 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:56.808218 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:56.809376 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/master-0-root/instance:
uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8"
format_stamp: "Formatted at 2026-07-09 13:13:56 on dist-test-slave-fx0m"
I20260709 13:13:56.813864 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:56.817183  2990 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:56.817984 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:56.818265 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/master-0-root
uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8"
format_stamp: "Formatted at 2026-07-09 13:13:56 on dist-test-slave-fx0m"
I20260709 13:13:56.818585 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:56.839135 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:56.840341 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:56.877343 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.190:36251
I20260709 13:13:56.877462  3041 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.190:36251 every 8 connection(s)
I20260709 13:13:56.881047  3042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:56.893381  3042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8: Bootstrap starting.
I20260709 13:13:56.898155  3042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:56.902279  3042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8: No bootstrap required, opened a new log
I20260709 13:13:56.904376  3042 raft_consensus.cc:359] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8" member_type: VOTER }
I20260709 13:13:56.904732  3042 raft_consensus.cc:385] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:56.904989  3042 raft_consensus.cc:740] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe3fe9263114be4adfb4b7d0b0a89f8, State: Initialized, Role: FOLLOWER
I20260709 13:13:56.905601  3042 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8" member_type: VOTER }
I20260709 13:13:56.906041  3042 raft_consensus.cc:399] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:56.906262  3042 raft_consensus.cc:493] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:56.906531  3042 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:56.911254  3042 raft_consensus.cc:515] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8" member_type: VOTER }
I20260709 13:13:56.911794  3042 leader_election.cc:304] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffe3fe9263114be4adfb4b7d0b0a89f8; no voters: 
I20260709 13:13:56.912864  3042 leader_election.cc:290] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:56.913198  3045 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:56.914484  3045 raft_consensus.cc:697] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 1 LEADER]: Becoming Leader. State: Replica: ffe3fe9263114be4adfb4b7d0b0a89f8, State: Running, Role: LEADER
I20260709 13:13:56.915155  3045 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8" member_type: VOTER }
I20260709 13:13:56.915799  3042 sys_catalog.cc:565] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:56.918004  3047 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffe3fe9263114be4adfb4b7d0b0a89f8. Latest consensus state: current_term: 1 leader_uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8" member_type: VOTER } }
I20260709 13:13:56.917876  3046 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffe3fe9263114be4adfb4b7d0b0a89f8" member_type: VOTER } }
I20260709 13:13:56.918579  3047 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:56.918676  3046 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:56.922052  3050 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:56.929872  3050 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:56.930800 23430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:56.938155  3050 catalog_manager.cc:1383] Generated new cluster ID: f0c39429432b4ae7b4ff755987a04005
I20260709 13:13:56.938431  3050 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:56.956439  3050 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:56.957741  3050 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:56.968732  3050 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8: Generated new TSK 0
I20260709 13:13:56.969347  3050 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:56.997676 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:57.004995  3063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:57.006366  3064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:57.007664  3066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:57.007925 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:57.008982 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:57.009246 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:57.009439 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602837009420 us; error 0 us; skew 500 ppm
I20260709 13:13:57.009991 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:57.012179 23430 webserver.cc:533] Webserver started at http://127.22.225.129:39205/ using document root <none> and password file <none>
I20260709 13:13:57.012655 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:57.012853 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:57.013162 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:57.014247 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-0-root/instance:
uuid: "c0c3540170da43998024395336dbf982"
format_stamp: "Formatted at 2026-07-09 13:13:57 on dist-test-slave-fx0m"
I20260709 13:13:57.018771 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:57.022168  3071 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.022927 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:57.023263 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "c0c3540170da43998024395336dbf982"
format_stamp: "Formatted at 2026-07-09 13:13:57 on dist-test-slave-fx0m"
I20260709 13:13:57.023635 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:57.066514 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:57.067829 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:57.069464 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:57.071854 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:57.072094 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.072348 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:57.072561 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.113772 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:43373
I20260709 13:13:57.113868  3133 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:43373 every 8 connection(s)
I20260709 13:13:57.119438 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:57.126730  3138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:57.127236  3139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:57.130846  3141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:57.131238 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:57.132081  3134 heartbeater.cc:344] Connected to a master server at 127.22.225.190:36251
I20260709 13:13:57.132565  3134 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:57.132776 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:57.133057 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:57.133288 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602837133264 us; error 0 us; skew 500 ppm
I20260709 13:13:57.133387  3134 heartbeater.cc:507] Master 127.22.225.190:36251 requested a full tablet report, sending...
I20260709 13:13:57.133966 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:57.135879  3007 ts_manager.cc:194] Registered new tserver with Master: c0c3540170da43998024395336dbf982 (127.22.225.129:43373)
I20260709 13:13:57.136793 23430 webserver.cc:533] Webserver started at http://127.22.225.130:42753/ using document root <none> and password file <none>
I20260709 13:13:57.137393 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:57.137612 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:57.137822  3007 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38746
I20260709 13:13:57.137892 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:57.139474 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-1-root/instance:
uuid: "d23280a2dc894ded92998dcd223e9276"
format_stamp: "Formatted at 2026-07-09 13:13:57 on dist-test-slave-fx0m"
I20260709 13:13:57.144119 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:57.147272  3146 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.148075 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:13:57.148355 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-1-root
uuid: "d23280a2dc894ded92998dcd223e9276"
format_stamp: "Formatted at 2026-07-09 13:13:57 on dist-test-slave-fx0m"
I20260709 13:13:57.148646 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:57.159636 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:57.160701 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:57.162078 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:57.164101 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:57.164309 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.164538 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:57.164702 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.203377 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.130:37853
I20260709 13:13:57.203567  3208 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.130:37853 every 8 connection(s)
I20260709 13:13:57.208262 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:57.215619  3212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:57.218031  3213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:57.219941 23430 server_base.cc:1061] running on GCE node
W20260709 13:13:57.220202  3215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:57.221344  3209 heartbeater.cc:344] Connected to a master server at 127.22.225.190:36251
I20260709 13:13:57.221551 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:57.221808  3209 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:57.221845 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:57.222193 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602837222174 us; error 0 us; skew 500 ppm
I20260709 13:13:57.222766  3209 heartbeater.cc:507] Master 127.22.225.190:36251 requested a full tablet report, sending...
I20260709 13:13:57.223019 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:57.225330  3007 ts_manager.cc:194] Registered new tserver with Master: d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853)
I20260709 13:13:57.225764 23430 webserver.cc:533] Webserver started at http://127.22.225.131:45171/ using document root <none> and password file <none>
I20260709 13:13:57.226426 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:57.226668 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:57.226962 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:57.227152  3007 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38750
I20260709 13:13:57.228525 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-2-root/instance:
uuid: "cc9ae2270ad6409fbfb8c0425a4deb91"
format_stamp: "Formatted at 2026-07-09 13:13:57 on dist-test-slave-fx0m"
I20260709 13:13:57.232951 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:57.236224  3220 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.236944 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:57.237250 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-2-root
uuid: "cc9ae2270ad6409fbfb8c0425a4deb91"
format_stamp: "Formatted at 2026-07-09 13:13:57 on dist-test-slave-fx0m"
I20260709 13:13:57.237527 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602441430441-23430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:57.255697 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:57.256806 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:57.258242 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:57.260394 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:57.260617 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.260843 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:57.261018 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:57.298816 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.131:45397
I20260709 13:13:57.298931  3282 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.131:45397 every 8 connection(s)
I20260709 13:13:57.311910  3283 heartbeater.cc:344] Connected to a master server at 127.22.225.190:36251
I20260709 13:13:57.312343  3283 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:57.313056  3283 heartbeater.cc:507] Master 127.22.225.190:36251 requested a full tablet report, sending...
I20260709 13:13:57.314921  3007 ts_manager.cc:194] Registered new tserver with Master: cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397)
I20260709 13:13:57.315256 23430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013275755s
I20260709 13:13:57.316359  3007 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38760
I20260709 13:13:57.339691  3007 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38764:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:57.341851  3007 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:57.385676  3174 tablet_service.cc:1511] Processing CreateTablet for tablet c90beb429ac4415eb14ec37c4acfe319 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8288e3c6ff2442fd804b31d2e863a0fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:57.387253  3174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90beb429ac4415eb14ec37c4acfe319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.387434  3173 tablet_service.cc:1511] Processing CreateTablet for tablet 35663ac3c09b4bd68fdb1930996eccb2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8288e3c6ff2442fd804b31d2e863a0fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:57.388875  3173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35663ac3c09b4bd68fdb1930996eccb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.390774  3247 tablet_service.cc:1511] Processing CreateTablet for tablet 35663ac3c09b4bd68fdb1930996eccb2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8288e3c6ff2442fd804b31d2e863a0fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:57.392122  3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35663ac3c09b4bd68fdb1930996eccb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.393479  3248 tablet_service.cc:1511] Processing CreateTablet for tablet c90beb429ac4415eb14ec37c4acfe319 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8288e3c6ff2442fd804b31d2e863a0fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:57.394765  3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90beb429ac4415eb14ec37c4acfe319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.408114  3298 tablet_bootstrap.cc:492] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276: Bootstrap starting.
I20260709 13:13:57.412797  3099 tablet_service.cc:1511] Processing CreateTablet for tablet c90beb429ac4415eb14ec37c4acfe319 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8288e3c6ff2442fd804b31d2e863a0fb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:57.414763  3099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90beb429ac4415eb14ec37c4acfe319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.415370  3298 tablet_bootstrap.cc:654] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.413095  3098 tablet_service.cc:1511] Processing CreateTablet for tablet 35663ac3c09b4bd68fdb1930996eccb2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8288e3c6ff2442fd804b31d2e863a0fb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:57.417677  3098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35663ac3c09b4bd68fdb1930996eccb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.425858  3298 tablet_bootstrap.cc:492] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276: No bootstrap required, opened a new log
I20260709 13:13:57.426496  3298 ts_tablet_manager.cc:1403] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.010s
I20260709 13:13:57.432567  3298 raft_consensus.cc:359] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.433324  3298 raft_consensus.cc:385] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.433633  3298 raft_consensus.cc:740] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.434368  3298 consensus_queue.cc:260] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.436510  3299 tablet_bootstrap.cc:492] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91: Bootstrap starting.
I20260709 13:13:57.438108  3209 heartbeater.cc:499] Master 127.22.225.190:36251 was elected leader, sending a full tablet report...
I20260709 13:13:57.440569  3298 ts_tablet_manager.cc:1434] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:13:57.441691  3298 tablet_bootstrap.cc:492] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276: Bootstrap starting.
I20260709 13:13:57.441994  3302 tablet_bootstrap.cc:492] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982: Bootstrap starting.
I20260709 13:13:57.447985  3299 tablet_bootstrap.cc:654] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.449491  3302 tablet_bootstrap.cc:654] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.449625  3298 tablet_bootstrap.cc:654] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.456516  3298 tablet_bootstrap.cc:492] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276: No bootstrap required, opened a new log
I20260709 13:13:57.456900  3298 ts_tablet_manager.cc:1403] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.002s
I20260709 13:13:57.457487  3299 tablet_bootstrap.cc:492] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91: No bootstrap required, opened a new log
I20260709 13:13:57.457948  3299 ts_tablet_manager.cc:1403] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:13:57.458420  3302 tablet_bootstrap.cc:492] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982: No bootstrap required, opened a new log
I20260709 13:13:57.458840  3302 ts_tablet_manager.cc:1403] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:13:57.460569  3298 raft_consensus.cc:359] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.460731  3299 raft_consensus.cc:359] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.460839  3302 raft_consensus.cc:359] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.461361  3298 raft_consensus.cc:385] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.461563  3299 raft_consensus.cc:385] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.461684  3302 raft_consensus.cc:385] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.461724  3298 raft_consensus.cc:740] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.462020  3299 raft_consensus.cc:740] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9ae2270ad6409fbfb8c0425a4deb91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.462257  3302 raft_consensus.cc:740] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0c3540170da43998024395336dbf982, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.462802  3298 consensus_queue.cc:260] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.463143  3302 consensus_queue.cc:260] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.463819  3301 raft_consensus.cc:493] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.464413  3301 raft_consensus.cc:515] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.466727  3302 ts_tablet_manager.cc:1434] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:57.467314  3298 ts_tablet_manager.cc:1434] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:13:57.467720  3134 heartbeater.cc:499] Master 127.22.225.190:36251 was elected leader, sending a full tablet report...
I20260709 13:13:57.468650  3302 tablet_bootstrap.cc:492] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982: Bootstrap starting.
I20260709 13:13:57.469877  3301 leader_election.cc:290] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397), c0c3540170da43998024395336dbf982 (127.22.225.129:43373)
I20260709 13:13:57.462973  3299 consensus_queue.cc:260] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.483358  3302 tablet_bootstrap.cc:654] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.488001  3283 heartbeater.cc:499] Master 127.22.225.190:36251 was elected leader, sending a full tablet report...
I20260709 13:13:57.488602  3299 ts_tablet_manager.cc:1434] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.014s
I20260709 13:13:57.490024  3258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90beb429ac4415eb14ec37c4acfe319" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" is_pre_election: true
I20260709 13:13:57.490536  3299 tablet_bootstrap.cc:492] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91: Bootstrap starting.
I20260709 13:13:57.490720  3258 raft_consensus.cc:2468] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 0.
I20260709 13:13:57.493010  3149 leader_election.cc:304] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9ae2270ad6409fbfb8c0425a4deb91, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:57.493875  3301 raft_consensus.cc:2804] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.494262  3301 raft_consensus.cc:493] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.494598  3301 raft_consensus.cc:3060] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.496083  3302 tablet_bootstrap.cc:492] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982: No bootstrap required, opened a new log
I20260709 13:13:57.496698  3302 ts_tablet_manager.cc:1403] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 13:13:57.497809  3299 tablet_bootstrap.cc:654] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.499939  3302 raft_consensus.cc:359] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.500883  3302 raft_consensus.cc:385] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.501332  3302 raft_consensus.cc:740] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0c3540170da43998024395336dbf982, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.502240  3301 raft_consensus.cc:515] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.502432  3302 consensus_queue.cc:260] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.504300  3301 leader_election.cc:290] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 1 election: Requested vote from peers cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397), c0c3540170da43998024395336dbf982 (127.22.225.129:43373)
I20260709 13:13:57.505952  3258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90beb429ac4415eb14ec37c4acfe319" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91"
I20260709 13:13:57.506057  3302 ts_tablet_manager.cc:1434] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:13:57.506528  3258 raft_consensus.cc:3060] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.509675  3109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90beb429ac4415eb14ec37c4acfe319" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0c3540170da43998024395336dbf982" is_pre_election: true
I20260709 13:13:57.510537  3109 raft_consensus.cc:2468] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 0.
I20260709 13:13:57.511128  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90beb429ac4415eb14ec37c4acfe319" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0c3540170da43998024395336dbf982"
I20260709 13:13:57.511759  3108 raft_consensus.cc:3060] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.514324  3258 raft_consensus.cc:2468] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 1.
I20260709 13:13:57.515415  3299 tablet_bootstrap.cc:492] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91: No bootstrap required, opened a new log
I20260709 13:13:57.515547  3149 leader_election.cc:304] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9ae2270ad6409fbfb8c0425a4deb91, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:57.516064  3299 ts_tablet_manager.cc:1403] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.006s
I20260709 13:13:57.516388  3301 raft_consensus.cc:2804] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.516901  3301 raft_consensus.cc:697] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Becoming Leader. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Running, Role: LEADER
I20260709 13:13:57.517937  3301 consensus_queue.cc:237] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:57.518549  3108 raft_consensus.cc:2468] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 1.
I20260709 13:13:57.519297  3299 raft_consensus.cc:359] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.520052  3299 raft_consensus.cc:385] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.520339  3299 raft_consensus.cc:740] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9ae2270ad6409fbfb8c0425a4deb91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.521049  3299 consensus_queue.cc:260] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.523671  3299 ts_tablet_manager.cc:1434] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:57.527688  3007 catalog_manager.cc:5697] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 reported cstate change: term changed from 0 to 1, leader changed from <none> to d23280a2dc894ded92998dcd223e9276 (127.22.225.130). New cstate: current_term: 1 leader_uuid: "d23280a2dc894ded92998dcd223e9276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.635721  3308 raft_consensus.cc:493] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.636245  3308 raft_consensus.cc:515] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.638307  3308 leader_election.cc:290] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0c3540170da43998024395336dbf982 (127.22.225.129:43373), d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853)
I20260709 13:13:57.646090  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35663ac3c09b4bd68fdb1930996eccb2" candidate_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0c3540170da43998024395336dbf982" is_pre_election: true
I20260709 13:13:57.646859  3108 raft_consensus.cc:2468] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9ae2270ad6409fbfb8c0425a4deb91 in term 0.
I20260709 13:13:57.647770  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35663ac3c09b4bd68fdb1930996eccb2" candidate_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23280a2dc894ded92998dcd223e9276" is_pre_election: true
I20260709 13:13:57.647809  3223 leader_election.cc:304] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c3540170da43998024395336dbf982, cc9ae2270ad6409fbfb8c0425a4deb91; no voters: 
I20260709 13:13:57.648504  3184 raft_consensus.cc:2468] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9ae2270ad6409fbfb8c0425a4deb91 in term 0.
I20260709 13:13:57.648713  3308 raft_consensus.cc:2804] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.649160  3308 raft_consensus.cc:493] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.649526  3308 raft_consensus.cc:3060] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.654793  3308 raft_consensus.cc:515] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.656224  3308 leader_election.cc:290] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [CANDIDATE]: Term 1 election: Requested vote from peers c0c3540170da43998024395336dbf982 (127.22.225.129:43373), d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853)
I20260709 13:13:57.656937  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35663ac3c09b4bd68fdb1930996eccb2" candidate_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0c3540170da43998024395336dbf982"
I20260709 13:13:57.657258  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35663ac3c09b4bd68fdb1930996eccb2" candidate_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23280a2dc894ded92998dcd223e9276"
I20260709 13:13:57.657538  3108 raft_consensus.cc:3060] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.657826  3184 raft_consensus.cc:3060] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.662163  3108 raft_consensus.cc:2468] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9ae2270ad6409fbfb8c0425a4deb91 in term 1.
I20260709 13:13:57.662772  3184 raft_consensus.cc:2468] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9ae2270ad6409fbfb8c0425a4deb91 in term 1.
I20260709 13:13:57.663170  3223 leader_election.cc:304] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c3540170da43998024395336dbf982, cc9ae2270ad6409fbfb8c0425a4deb91; no voters: 
I20260709 13:13:57.663904  3308 raft_consensus.cc:2804] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.664681  3308 raft_consensus.cc:697] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 LEADER]: Becoming Leader. State: Replica: cc9ae2270ad6409fbfb8c0425a4deb91, State: Running, Role: LEADER
I20260709 13:13:57.665382  3308 consensus_queue.cc:237] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.671494  3007 catalog_manager.cc:5697] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.712931  3007 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38770:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:57.714845  3007 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:57.736709  3098 tablet_service.cc:1511] Processing CreateTablet for tablet cbd59505519d4086aafc9b637149cb10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f72efdb8de6f48a68b4654046a25246b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:57.738041  3098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd59505519d4086aafc9b637149cb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.738159  3174 tablet_service.cc:1511] Processing CreateTablet for tablet cbd59505519d4086aafc9b637149cb10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f72efdb8de6f48a68b4654046a25246b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:57.739424  3174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd59505519d4086aafc9b637149cb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.739516  3248 tablet_service.cc:1511] Processing CreateTablet for tablet cbd59505519d4086aafc9b637149cb10 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f72efdb8de6f48a68b4654046a25246b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:57.740834  3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd59505519d4086aafc9b637149cb10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.744731  3173 tablet_service.cc:1511] Processing CreateTablet for tablet 920aa9b4fca442bfbc53b65444945e30 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f72efdb8de6f48a68b4654046a25246b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:57.745030  3247 tablet_service.cc:1511] Processing CreateTablet for tablet 920aa9b4fca442bfbc53b65444945e30 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f72efdb8de6f48a68b4654046a25246b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:57.746071  3173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920aa9b4fca442bfbc53b65444945e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.746308  3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920aa9b4fca442bfbc53b65444945e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.745057  3099 tablet_service.cc:1511] Processing CreateTablet for tablet 920aa9b4fca442bfbc53b65444945e30 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=f72efdb8de6f48a68b4654046a25246b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:57.749557  3099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920aa9b4fca442bfbc53b65444945e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.759580  3299 tablet_bootstrap.cc:492] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91: Bootstrap starting.
I20260709 13:13:57.765036  3302 tablet_bootstrap.cc:492] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982: Bootstrap starting.
I20260709 13:13:57.766022  3299 tablet_bootstrap.cc:654] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.772562  3298 tablet_bootstrap.cc:492] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276: Bootstrap starting.
I20260709 13:13:57.773818  3302 tablet_bootstrap.cc:654] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.777002  3299 tablet_bootstrap.cc:492] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91: No bootstrap required, opened a new log
I20260709 13:13:57.777496  3299 ts_tablet_manager.cc:1403] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:13:57.780359  3299 raft_consensus.cc:359] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.780884  3298 tablet_bootstrap.cc:654] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.781126  3299 raft_consensus.cc:385] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.781499  3299 raft_consensus.cc:740] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9ae2270ad6409fbfb8c0425a4deb91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.782292  3302 tablet_bootstrap.cc:492] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982: No bootstrap required, opened a new log
I20260709 13:13:57.782150  3299 consensus_queue.cc:260] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.782894  3302 ts_tablet_manager.cc:1403] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:13:57.786019  3299 ts_tablet_manager.cc:1434] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:13:57.787065  3299 tablet_bootstrap.cc:492] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91: Bootstrap starting.
I20260709 13:13:57.788105  3302 raft_consensus.cc:359] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.789094  3302 raft_consensus.cc:385] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.789460  3302 raft_consensus.cc:740] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0c3540170da43998024395336dbf982, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.790812  3302 consensus_queue.cc:260] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.793407  3302 ts_tablet_manager.cc:1434] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:13:57.794796  3302 tablet_bootstrap.cc:492] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982: Bootstrap starting.
I20260709 13:13:57.796727  3298 tablet_bootstrap.cc:492] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276: No bootstrap required, opened a new log
I20260709 13:13:57.797508  3298 ts_tablet_manager.cc:1403] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:13:57.800729  3298 raft_consensus.cc:359] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.801577  3298 raft_consensus.cc:385] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.801924  3298 raft_consensus.cc:740] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.802690  3298 consensus_queue.cc:260] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.803651  3302 tablet_bootstrap.cc:654] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.805207  3298 ts_tablet_manager.cc:1434] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:13:57.807385  3298 tablet_bootstrap.cc:492] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276: Bootstrap starting.
I20260709 13:13:57.807665  3299 tablet_bootstrap.cc:654] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.815024  3298 tablet_bootstrap.cc:654] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:57.817337  3302 tablet_bootstrap.cc:492] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982: No bootstrap required, opened a new log
I20260709 13:13:57.817991  3302 ts_tablet_manager.cc:1403] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:13:57.818143  3299 tablet_bootstrap.cc:492] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91: No bootstrap required, opened a new log
I20260709 13:13:57.818819  3299 ts_tablet_manager.cc:1403] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.003s
I20260709 13:13:57.821405  3302 raft_consensus.cc:359] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.822188  3302 raft_consensus.cc:385] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.822503  3302 raft_consensus.cc:740] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0c3540170da43998024395336dbf982, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.823257  3302 consensus_queue.cc:260] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.823402  3299 raft_consensus.cc:359] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.824682  3299 raft_consensus.cc:385] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.825130  3299 raft_consensus.cc:740] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9ae2270ad6409fbfb8c0425a4deb91, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.827208  3302 ts_tablet_manager.cc:1434] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:57.826720  3299 consensus_queue.cc:260] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.830018  3299 ts_tablet_manager.cc:1434] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:13:57.830667  3298 tablet_bootstrap.cc:492] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276: No bootstrap required, opened a new log
I20260709 13:13:57.831167  3298 ts_tablet_manager.cc:1403] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:13:57.833742  3298 raft_consensus.cc:359] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.834266  3298 raft_consensus.cc:385] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:57.834513  3298 raft_consensus.cc:740] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Initialized, Role: FOLLOWER
I20260709 13:13:57.835266  3298 consensus_queue.cc:260] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.837342  3307 raft_consensus.cc:493] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.837477  3298 ts_tablet_manager.cc:1434] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:13:57.837917  3307 raft_consensus.cc:515] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.839934  3301 raft_consensus.cc:493] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.840516  3307 leader_election.cc:290] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853), cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397)
I20260709 13:13:57.840433  3301 raft_consensus.cc:515] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.842607  3301 leader_election.cc:290] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0c3540170da43998024395336dbf982 (127.22.225.129:43373), cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397)
I20260709 13:13:57.843310  3308 raft_consensus.cc:493] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.843870  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd59505519d4086aafc9b637149cb10" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0c3540170da43998024395336dbf982" is_pre_election: true
I20260709 13:13:57.843803  3308 raft_consensus.cc:515] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.844118  3258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd59505519d4086aafc9b637149cb10" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" is_pre_election: true
I20260709 13:13:57.844588  3108 raft_consensus.cc:2468] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 0.
I20260709 13:13:57.844786  3258 raft_consensus.cc:2468] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 0.
I20260709 13:13:57.845957  3308 leader_election.cc:290] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0c3540170da43998024395336dbf982 (127.22.225.129:43373), d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853)
I20260709 13:13:57.847299  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23280a2dc894ded92998dcd223e9276" is_pre_election: true
I20260709 13:13:57.845889  3149 leader_election.cc:304] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c3540170da43998024395336dbf982, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:57.847980  3184 raft_consensus.cc:2468] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9ae2270ad6409fbfb8c0425a4deb91 in term 0.
I20260709 13:13:57.849856  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0c3540170da43998024395336dbf982" is_pre_election: true
I20260709 13:13:57.850484  3108 raft_consensus.cc:2468] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9ae2270ad6409fbfb8c0425a4deb91 in term 0.
I20260709 13:13:57.851691  3223 leader_election.cc:304] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9ae2270ad6409fbfb8c0425a4deb91, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:57.853933  3301 raft_consensus.cc:2804] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.854853  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "c0c3540170da43998024395336dbf982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23280a2dc894ded92998dcd223e9276" is_pre_election: true
I20260709 13:13:57.855085  3301 raft_consensus.cc:493] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.855263  3308 raft_consensus.cc:2804] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.855542  3184 raft_consensus.cc:2468] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0c3540170da43998024395336dbf982 in term 0.
I20260709 13:13:57.855676  3301 raft_consensus.cc:3060] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.855731  3308 raft_consensus.cc:493] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.856812  3074 leader_election.cc:304] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c3540170da43998024395336dbf982, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:57.856997  3308 raft_consensus.cc:3060] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.858104  3307 raft_consensus.cc:2804] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:57.858477  3307 raft_consensus.cc:493] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.858811  3307 raft_consensus.cc:3060] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.861898  3301 raft_consensus.cc:515] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.864545  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd59505519d4086aafc9b637149cb10" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0c3540170da43998024395336dbf982"
I20260709 13:13:57.864424  3308 raft_consensus.cc:515] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.865181  3108 raft_consensus.cc:3060] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.866174  3307 raft_consensus.cc:515] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.867219  3109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0c3540170da43998024395336dbf982"
I20260709 13:13:57.868202  3109 raft_consensus.cc:2393] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9ae2270ad6409fbfb8c0425a4deb91 in current term 1: Already voted for candidate c0c3540170da43998024395336dbf982 in this term.
I20260709 13:13:57.869240  3184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "c0c3540170da43998024395336dbf982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23280a2dc894ded92998dcd223e9276"
I20260709 13:13:57.869824  3184 raft_consensus.cc:3060] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.870221  3301 leader_election.cc:290] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 1 election: Requested vote from peers c0c3540170da43998024395336dbf982 (127.22.225.129:43373), cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397)
I20260709 13:13:57.871503  3258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd59505519d4086aafc9b637149cb10" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91"
I20260709 13:13:57.872181  3258 raft_consensus.cc:3060] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:57.872660  3308 leader_election.cc:290] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [CANDIDATE]: Term 1 election: Requested vote from peers c0c3540170da43998024395336dbf982 (127.22.225.129:43373), d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853)
I20260709 13:13:57.874342  3108 raft_consensus.cc:2468] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 1.
I20260709 13:13:57.875646  3184 raft_consensus.cc:2468] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0c3540170da43998024395336dbf982 in term 1.
I20260709 13:13:57.875854  3149 leader_election.cc:304] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c3540170da43998024395336dbf982, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:57.876700  3301 raft_consensus.cc:2804] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.877169  3183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d23280a2dc894ded92998dcd223e9276"
I20260709 13:13:57.877339  3074 leader_election.cc:304] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c3540170da43998024395336dbf982, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:57.878036  3183 raft_consensus.cc:2393] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9ae2270ad6409fbfb8c0425a4deb91 in current term 1: Already voted for candidate c0c3540170da43998024395336dbf982 in this term.
I20260709 13:13:57.877306  3301 raft_consensus.cc:697] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Becoming Leader. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Running, Role: LEADER
I20260709 13:13:57.879264  3223 leader_election.cc:304] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc9ae2270ad6409fbfb8c0425a4deb91; no voters: c0c3540170da43998024395336dbf982, d23280a2dc894ded92998dcd223e9276
I20260709 13:13:57.879935  3329 raft_consensus.cc:2804] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:57.880452  3308 raft_consensus.cc:2749] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:57.880096  3301 consensus_queue.cc:237] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.881547  3329 raft_consensus.cc:697] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 LEADER]: Becoming Leader. State: Replica: c0c3540170da43998024395336dbf982, State: Running, Role: LEADER
I20260709 13:13:57.882768  3329 consensus_queue.cc:237] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:57.881747  3258 raft_consensus.cc:2468] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 1.
I20260709 13:13:57.883775  3257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "c0c3540170da43998024395336dbf982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" is_pre_election: true
I20260709 13:13:57.884646  3257 raft_consensus.cc:2393] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0c3540170da43998024395336dbf982 in current term 1: Already voted for candidate cc9ae2270ad6409fbfb8c0425a4deb91 in this term.
I20260709 13:13:57.890060  3307 leader_election.cc:290] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [CANDIDATE]: Term 1 election: Requested vote from peers d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853), cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397)
I20260709 13:13:57.890293  3257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "c0c3540170da43998024395336dbf982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91"
I20260709 13:13:57.891287  3257 raft_consensus.cc:2393] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0c3540170da43998024395336dbf982 in current term 1: Already voted for candidate cc9ae2270ad6409fbfb8c0425a4deb91 in this term.
I20260709 13:13:57.894589  3007 catalog_manager.cc:5697] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 reported cstate change: term changed from 0 to 1, leader changed from <none> to d23280a2dc894ded92998dcd223e9276 (127.22.225.130). New cstate: current_term: 1 leader_uuid: "d23280a2dc894ded92998dcd223e9276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.895318  3005 catalog_manager.cc:5697] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0c3540170da43998024395336dbf982 (127.22.225.129). New cstate: current_term: 1 leader_uuid: "c0c3540170da43998024395336dbf982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:57.932502  3183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c90beb429ac4415eb14ec37c4acfe319"
dest_uuid: "d23280a2dc894ded92998dcd223e9276"
mode: GRACEFUL
new_leader_uuid: "c0c3540170da43998024395336dbf982"
 from {username='slave'} at 127.0.0.1:34168
I20260709 13:13:57.933032  3183 raft_consensus.cc:606] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Received request to transfer leadership to TS c0c3540170da43998024395336dbf982
I20260709 13:13:57.941133  3183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbd59505519d4086aafc9b637149cb10"
dest_uuid: "d23280a2dc894ded92998dcd223e9276"
mode: GRACEFUL
new_leader_uuid: "c0c3540170da43998024395336dbf982"
 from {username='slave'} at 127.0.0.1:34168
I20260709 13:13:57.941675  3183 raft_consensus.cc:606] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Received request to transfer leadership to TS c0c3540170da43998024395336dbf982
I20260709 13:13:58.045922  3301 consensus_queue.cc:1048] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.061554  3337 consensus_queue.cc:1048] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.071206  3306 raft_consensus.cc:993] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276: : Instructing follower c0c3540170da43998024395336dbf982 to start an election
I20260709 13:13:58.071697  3337 raft_consensus.cc:1081] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Signalling peer c0c3540170da43998024395336dbf982 to start an election
I20260709 13:13:58.073235  3108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c90beb429ac4415eb14ec37c4acfe319"
dest_uuid: "c0c3540170da43998024395336dbf982"
 from {username='slave'} at 127.0.0.1:33770
I20260709 13:13:58.073714  3108 raft_consensus.cc:493] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.074028  3108 raft_consensus.cc:3060] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.080824  3108 raft_consensus.cc:515] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:58.083542  3183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90beb429ac4415eb14ec37c4acfe319" candidate_uuid: "c0c3540170da43998024395336dbf982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d23280a2dc894ded92998dcd223e9276"
I20260709 13:13:58.084095  3183 raft_consensus.cc:3055] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.084415  3183 raft_consensus.cc:740] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Running, Role: LEADER
I20260709 13:13:58.084874  3108 leader_election.cc:290] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [CANDIDATE]: Term 2 election: Requested vote from peers d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853), cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397)
I20260709 13:13:58.085214  3183 consensus_queue.cc:260] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:58.088059  3308 consensus_queue.cc:1048] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.088501  3183 raft_consensus.cc:3060] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.086792  3257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90beb429ac4415eb14ec37c4acfe319" candidate_uuid: "c0c3540170da43998024395336dbf982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91"
I20260709 13:13:58.092497  3257 raft_consensus.cc:3060] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.095714  3183 raft_consensus.cc:2468] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0c3540170da43998024395336dbf982 in term 2.
I20260709 13:13:58.096909  3074 leader_election.cc:304] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c3540170da43998024395336dbf982, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:58.097826  3307 raft_consensus.cc:2804] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.098294  3307 raft_consensus.cc:697] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 2 LEADER]: Becoming Leader. State: Replica: c0c3540170da43998024395336dbf982, State: Running, Role: LEADER
I20260709 13:13:58.098953  3307 consensus_queue.cc:237] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } }
I20260709 13:13:58.099305  3257 raft_consensus.cc:2468] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0c3540170da43998024395336dbf982 in term 2.
I20260709 13:13:58.106813  3314 consensus_queue.cc:1048] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.107249  3007 catalog_manager.cc:5697] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 reported cstate change: term changed from 1 to 2, leader changed from d23280a2dc894ded92998dcd223e9276 (127.22.225.130) to c0c3540170da43998024395336dbf982 (127.22.225.129). New cstate: current_term: 2 leader_uuid: "c0c3540170da43998024395336dbf982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:58.334967  3337 consensus_queue.cc:1048] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.345559  3337 consensus_queue.cc:1048] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.352831  3301 raft_consensus.cc:993] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276: : Instructing follower c0c3540170da43998024395336dbf982 to start an election
I20260709 13:13:58.353320  3337 raft_consensus.cc:1081] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Signalling peer c0c3540170da43998024395336dbf982 to start an election
I20260709 13:13:58.354684  3108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbd59505519d4086aafc9b637149cb10"
dest_uuid: "c0c3540170da43998024395336dbf982"
 from {username='slave'} at 127.0.0.1:33770
I20260709 13:13:58.355266  3108 raft_consensus.cc:493] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:58.356034  3108 raft_consensus.cc:3060] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.362339  3108 raft_consensus.cc:515] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:58.364302  3108 leader_election.cc:290] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [CANDIDATE]: Term 2 election: Requested vote from peers d23280a2dc894ded92998dcd223e9276 (127.22.225.130:37853), cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397)
I20260709 13:13:58.365032  3183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd59505519d4086aafc9b637149cb10" candidate_uuid: "c0c3540170da43998024395336dbf982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d23280a2dc894ded92998dcd223e9276"
I20260709 13:13:58.365747  3183 raft_consensus.cc:3055] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:58.366096  3183 raft_consensus.cc:740] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Running, Role: LEADER
I20260709 13:13:58.366815  3183 consensus_queue.cc:260] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:58.367750  3183 raft_consensus.cc:3060] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.373816  3183 raft_consensus.cc:2468] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0c3540170da43998024395336dbf982 in term 2.
I20260709 13:13:58.373872  3257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbd59505519d4086aafc9b637149cb10" candidate_uuid: "c0c3540170da43998024395336dbf982" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91"
I20260709 13:13:58.374594  3257 raft_consensus.cc:3060] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:58.375124  3074 leader_election.cc:304] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0c3540170da43998024395336dbf982, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:58.376226  3307 raft_consensus.cc:2804] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:58.376744  3307 raft_consensus.cc:697] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 2 LEADER]: Becoming Leader. State: Replica: c0c3540170da43998024395336dbf982, State: Running, Role: LEADER
I20260709 13:13:58.377683  3307 consensus_queue.cc:237] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:58.381027  3257 raft_consensus.cc:2468] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0c3540170da43998024395336dbf982 in term 2.
I20260709 13:13:58.385875  3005 catalog_manager.cc:5697] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 reported cstate change: term changed from 1 to 2, leader changed from d23280a2dc894ded92998dcd223e9276 (127.22.225.130) to c0c3540170da43998024395336dbf982 (127.22.225.129). New cstate: current_term: 2 leader_uuid: "c0c3540170da43998024395336dbf982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.463515  3307 consensus_queue.cc:1048] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.473308  3329 consensus_queue.cc:1048] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:58.524226  3257 raft_consensus.cc:1275] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Refusing update from remote peer c0c3540170da43998024395336dbf982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.525436  3329 consensus_queue.cc:1048] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.533264  3183 raft_consensus.cc:1275] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Refusing update from remote peer c0c3540170da43998024395336dbf982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.535518  3348 consensus_queue.cc:1048] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.658427 23430 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:13:58.659946 23430 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:13:58.660326 23430 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:13:58.674472  3108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30"
dest_uuid: "c0c3540170da43998024395336dbf982"
mode: GRACEFUL
new_leader_uuid: "d23280a2dc894ded92998dcd223e9276"
 from {username='slave'} at 127.0.0.1:33778
I20260709 13:13:58.675093  3108 raft_consensus.cc:606] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 LEADER]: Received request to transfer leadership to TS d23280a2dc894ded92998dcd223e9276
I20260709 13:13:58.676611 23430 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:13:58.836607  3257 raft_consensus.cc:1275] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Refusing update from remote peer c0c3540170da43998024395336dbf982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.837881  3348 consensus_queue.cc:1048] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:58.845744  3183 raft_consensus.cc:1275] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Refusing update from remote peer c0c3540170da43998024395336dbf982: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:58.848349  3329 consensus_queue.cc:1048] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:59.010656  3307 raft_consensus.cc:993] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982: : Instructing follower d23280a2dc894ded92998dcd223e9276 to start an election
I20260709 13:13:59.011134  3329 raft_consensus.cc:1081] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 LEADER]: Signalling peer d23280a2dc894ded92998dcd223e9276 to start an election
I20260709 13:13:59.012558  3183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30"
dest_uuid: "d23280a2dc894ded92998dcd223e9276"
 from {username='slave'} at 127.0.0.1:34158
I20260709 13:13:59.013043  3183 raft_consensus.cc:493] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:59.013368  3183 raft_consensus.cc:3060] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:59.018450  3183 raft_consensus.cc:515] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:59.020150  3183 leader_election.cc:290] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 2 election: Requested vote from peers c0c3540170da43998024395336dbf982 (127.22.225.129:43373), cc9ae2270ad6409fbfb8c0425a4deb91 (127.22.225.131:45397)
I20260709 13:13:59.020864  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0c3540170da43998024395336dbf982"
I20260709 13:13:59.021335  3257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920aa9b4fca442bfbc53b65444945e30" candidate_uuid: "d23280a2dc894ded92998dcd223e9276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91"
I20260709 13:13:59.021564  3108 raft_consensus.cc:3055] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:59.021960  3257 raft_consensus.cc:3060] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:59.022058  3108 raft_consensus.cc:740] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0c3540170da43998024395336dbf982, State: Running, Role: LEADER
I20260709 13:13:59.022904  3108 consensus_queue.cc:260] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:59.024106  3108 raft_consensus.cc:3060] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:59.027923  3257 raft_consensus.cc:2468] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 2.
I20260709 13:13:59.029052  3149 leader_election.cc:304] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9ae2270ad6409fbfb8c0425a4deb91, d23280a2dc894ded92998dcd223e9276; no voters: 
I20260709 13:13:59.029781  3337 raft_consensus.cc:2804] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:59.030735  3337 raft_consensus.cc:697] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 2 LEADER]: Becoming Leader. State: Replica: d23280a2dc894ded92998dcd223e9276, State: Running, Role: LEADER
I20260709 13:13:59.030701  3108 raft_consensus.cc:2468] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d23280a2dc894ded92998dcd223e9276 in term 2.
I20260709 13:13:59.031839  3337 consensus_queue.cc:237] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } }
I20260709 13:13:59.038010  3007 catalog_manager.cc:5697] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 reported cstate change: term changed from 1 to 2, leader changed from c0c3540170da43998024395336dbf982 (127.22.225.129) to d23280a2dc894ded92998dcd223e9276 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "d23280a2dc894ded92998dcd223e9276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0c3540170da43998024395336dbf982" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 43373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d23280a2dc894ded92998dcd223e9276" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc9ae2270ad6409fbfb8c0425a4deb91" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 45397 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:59.293403 23430 tablet_server.cc:179] TabletServer@127.22.225.129:0 shutting down...
I20260709 13:13:59.311218 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:59.311870 23430 tablet_replica.cc:333] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982: stopping tablet replica
I20260709 13:13:59.312616 23430 raft_consensus.cc:2243] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.313125 23430 raft_consensus.cc:2272] T 920aa9b4fca442bfbc53b65444945e30 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.315630 23430 tablet_replica.cc:333] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982: stopping tablet replica
I20260709 13:13:59.316110 23430 raft_consensus.cc:2243] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:59.316804 23430 raft_consensus.cc:2272] T c90beb429ac4415eb14ec37c4acfe319 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.319018 23430 tablet_replica.cc:333] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982: stopping tablet replica
I20260709 13:13:59.319468 23430 raft_consensus.cc:2243] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:59.320309 23430 raft_consensus.cc:2272] T cbd59505519d4086aafc9b637149cb10 P c0c3540170da43998024395336dbf982 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.322489 23430 tablet_replica.cc:333] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982: stopping tablet replica
I20260709 13:13:59.322966 23430 raft_consensus.cc:2243] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.323348 23430 raft_consensus.cc:2272] T 35663ac3c09b4bd68fdb1930996eccb2 P c0c3540170da43998024395336dbf982 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.335588 23430 tablet_server.cc:196] TabletServer@127.22.225.129:0 shutdown complete.
I20260709 13:13:59.347159 23430 tablet_server.cc:179] TabletServer@127.22.225.130:0 shutting down...
I20260709 13:13:59.364686 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:59.365273 23430 tablet_replica.cc:333] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276: stopping tablet replica
I20260709 13:13:59.365769 23430 raft_consensus.cc:2243] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.366171 23430 raft_consensus.cc:2272] T cbd59505519d4086aafc9b637149cb10 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.368450 23430 tablet_replica.cc:333] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276: stopping tablet replica
I20260709 13:13:59.368894 23430 raft_consensus.cc:2243] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.369292 23430 raft_consensus.cc:2272] T 35663ac3c09b4bd68fdb1930996eccb2 P d23280a2dc894ded92998dcd223e9276 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.371030 23430 tablet_replica.cc:333] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276: stopping tablet replica
I20260709 13:13:59.371435 23430 raft_consensus.cc:2243] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:59.371925 23430 pending_rounds.cc:70] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276: Trying to abort 1 pending ops.
I20260709 13:13:59.372071 23430 pending_rounds.cc:77] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637228681576448 op_type: NO_OP noop_request { }
I20260709 13:13:59.372304 23430 raft_consensus.cc:2889] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:59.372551 23430 raft_consensus.cc:2272] T 920aa9b4fca442bfbc53b65444945e30 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.374665 23430 tablet_replica.cc:333] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276: stopping tablet replica
I20260709 13:13:59.375070 23430 raft_consensus.cc:2243] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.375417 23430 raft_consensus.cc:2272] T c90beb429ac4415eb14ec37c4acfe319 P d23280a2dc894ded92998dcd223e9276 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.396720 23430 tablet_server.cc:196] TabletServer@127.22.225.130:0 shutdown complete.
I20260709 13:13:59.408430 23430 tablet_server.cc:179] TabletServer@127.22.225.131:0 shutting down...
I20260709 13:13:59.425798 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:59.426436 23430 tablet_replica.cc:333] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91: stopping tablet replica
I20260709 13:13:59.426975 23430 raft_consensus.cc:2243] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.427433 23430 raft_consensus.cc:2272] T cbd59505519d4086aafc9b637149cb10 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.429689 23430 tablet_replica.cc:333] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91: stopping tablet replica
I20260709 13:13:59.430187 23430 raft_consensus.cc:2243] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:59.430929 23430 raft_consensus.cc:2272] T 35663ac3c09b4bd68fdb1930996eccb2 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.432647 23430 tablet_replica.cc:333] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91: stopping tablet replica
I20260709 13:13:59.433198 23430 raft_consensus.cc:2243] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.433595 23430 raft_consensus.cc:2272] T 920aa9b4fca442bfbc53b65444945e30 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.435554 23430 tablet_replica.cc:333] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91: stopping tablet replica
I20260709 13:13:59.436013 23430 raft_consensus.cc:2243] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:59.436609 23430 raft_consensus.cc:2272] T c90beb429ac4415eb14ec37c4acfe319 P cc9ae2270ad6409fbfb8c0425a4deb91 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.457804 23430 tablet_server.cc:196] TabletServer@127.22.225.131:0 shutdown complete.
I20260709 13:13:59.469755 23430 master.cc:562] Master@127.22.225.190:36251 shutting down...
I20260709 13:13:59.484571 23430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:59.485200 23430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:59.485541 23430 tablet_replica.cc:333] T 00000000000000000000000000000000 P ffe3fe9263114be4adfb4b7d0b0a89f8: stopping tablet replica
I20260709 13:13:59.503167 23430 master.cc:584] Master@127.22.225.190:36251 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2736 ms)
[----------] 6 tests from LeaderRebalancerTest (397935 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:13:59.530093 23430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.225.190:34431
I20260709 13:13:59.531080 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:59.536039  3355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.536171  3356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.537308  3358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.538283 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:59.539031 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:59.539193 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:59.539301 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602839539290 us; error 0 us; skew 500 ppm
I20260709 13:13:59.539865 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:59.541991 23430 webserver.cc:533] Webserver started at http://127.22.225.190:45161/ using document root <none> and password file <none>
I20260709 13:13:59.542398 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:59.542541 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:59.542738 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:59.543705 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/master-0-root/instance:
uuid: "20fa4fa85286407a9d73b86a460534a9"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-fx0m"
I20260709 13:13:59.548000 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:59.551134  3363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.551844 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:13:59.552120 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/master-0-root
uuid: "20fa4fa85286407a9d73b86a460534a9"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-fx0m"
I20260709 13:13:59.552374 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:59.572988 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:59.574326 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:59.609596 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.190:34431
I20260709 13:13:59.609699  3414 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.190:34431 every 8 connection(s)
I20260709 13:13:59.613286  3415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:59.624193  3415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9: Bootstrap starting.
I20260709 13:13:59.628894  3415 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:59.633117  3415 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9: No bootstrap required, opened a new log
I20260709 13:13:59.635290  3415 raft_consensus.cc:359] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20fa4fa85286407a9d73b86a460534a9" member_type: VOTER }
I20260709 13:13:59.635696  3415 raft_consensus.cc:385] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:59.635946  3415 raft_consensus.cc:740] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20fa4fa85286407a9d73b86a460534a9, State: Initialized, Role: FOLLOWER
I20260709 13:13:59.636543  3415 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20fa4fa85286407a9d73b86a460534a9" member_type: VOTER }
I20260709 13:13:59.637024  3415 raft_consensus.cc:399] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:59.637334  3415 raft_consensus.cc:493] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:59.637622  3415 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:59.642503  3415 raft_consensus.cc:515] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20fa4fa85286407a9d73b86a460534a9" member_type: VOTER }
I20260709 13:13:59.643036  3415 leader_election.cc:304] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20fa4fa85286407a9d73b86a460534a9; no voters: 
I20260709 13:13:59.644164  3415 leader_election.cc:290] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:59.644469  3418 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:59.645869  3418 raft_consensus.cc:697] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 1 LEADER]: Becoming Leader. State: Replica: 20fa4fa85286407a9d73b86a460534a9, State: Running, Role: LEADER
I20260709 13:13:59.646498  3418 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20fa4fa85286407a9d73b86a460534a9" member_type: VOTER }
I20260709 13:13:59.647193  3415 sys_catalog.cc:565] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:59.650974  3420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20fa4fa85286407a9d73b86a460534a9. Latest consensus state: current_term: 1 leader_uuid: "20fa4fa85286407a9d73b86a460534a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20fa4fa85286407a9d73b86a460534a9" member_type: VOTER } }
I20260709 13:13:59.651760  3420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:59.652841  3419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20fa4fa85286407a9d73b86a460534a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20fa4fa85286407a9d73b86a460534a9" member_type: VOTER } }
I20260709 13:13:59.653510  3419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:59.653811  3425 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:59.658844  3425 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:59.662153 23430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:59.667307  3425 catalog_manager.cc:1383] Generated new cluster ID: 1f937da604da4ff0b091de344f915bc2
I20260709 13:13:59.667574  3425 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:59.682783  3425 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:59.684038  3425 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:59.695960  3425 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9: Generated new TSK 0
I20260709 13:13:59.696516  3425 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:59.728633 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:59.734277  3436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.735229  3437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.736732  3439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.737181 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:59.738709 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:59.738929 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:59.739101 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602839739081 us; error 0 us; skew 500 ppm
I20260709 13:13:59.739620 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:59.741884 23430 webserver.cc:533] Webserver started at http://127.22.225.129:42703/ using document root <none> and password file <none>
I20260709 13:13:59.742373 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:59.742569 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:59.742828 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:59.743896 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-0-root/instance:
uuid: "8a572121143a4a5aa0dc8b9998a8762a"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-fx0m"
I20260709 13:13:59.748163 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:59.751397  3444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.752157 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:59.752466 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "8a572121143a4a5aa0dc8b9998a8762a"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-fx0m"
I20260709 13:13:59.752746 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:59.762286 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:59.763317 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:59.764608 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:59.766819 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:59.767032 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.767277 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:59.767447 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.806450 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:46593
I20260709 13:13:59.806566  3506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:46593 every 8 connection(s)
I20260709 13:13:59.811393 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:59.818397  3511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.820055  3512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.822849 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:59.823905  3507 heartbeater.cc:344] Connected to a master server at 127.22.225.190:34431
I20260709 13:13:59.824401  3507 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:59.824501  3514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.825328  3507 heartbeater.cc:507] Master 127.22.225.190:34431 requested a full tablet report, sending...
I20260709 13:13:59.825510 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:59.825830 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:59.826005 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602839825970 us; error 0 us; skew 500 ppm
I20260709 13:13:59.826593 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:59.827560  3380 ts_manager.cc:194] Registered new tserver with Master: 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593)
I20260709 13:13:59.829442 23430 webserver.cc:533] Webserver started at http://127.22.225.130:44149/ using document root <none> and password file <none>
I20260709 13:13:59.829663  3380 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42464
I20260709 13:13:59.829998 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:59.830253 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:59.830529 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:59.831570 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-1-root/instance:
uuid: "8896457506f045a18c8201317192789e"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-fx0m"
I20260709 13:13:59.835744 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:13:59.838817  3519 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.839550 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:59.839830 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-1-root
uuid: "8896457506f045a18c8201317192789e"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-fx0m"
I20260709 13:13:59.840126 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:59.879040 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:59.880187 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:59.881639 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:59.883868 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:59.884104 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.884359 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:59.884547 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.922135 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.130:33645
I20260709 13:13:59.922236  3581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.130:33645 every 8 connection(s)
I20260709 13:13:59.927127 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:59.934746  3585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.936730  3586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:59.937641  3588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:59.937948  3582 heartbeater.cc:344] Connected to a master server at 127.22.225.190:34431
I20260709 13:13:59.938555  3582 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:59.939646 23430 server_base.cc:1061] running on GCE node
I20260709 13:13:59.939666  3582 heartbeater.cc:507] Master 127.22.225.190:34431 requested a full tablet report, sending...
I20260709 13:13:59.940697 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:59.940996 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:59.941269 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602839941249 us; error 0 us; skew 500 ppm
I20260709 13:13:59.941922 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:59.942157  3380 ts_manager.cc:194] Registered new tserver with Master: 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:13:59.943653  3380 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42466
I20260709 13:13:59.944784 23430 webserver.cc:533] Webserver started at http://127.22.225.131:38041/ using document root <none> and password file <none>
I20260709 13:13:59.945360 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:59.945564 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:59.945840 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:59.946923 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-2-root/instance:
uuid: "f38a26f090154cacb4c9ce88319b1019"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-fx0m"
I20260709 13:13:59.951504 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:59.955020  3593 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.955756 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:59.956063 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-2-root
uuid: "f38a26f090154cacb4c9ce88319b1019"
format_stamp: "Formatted at 2026-07-09 13:13:59 on dist-test-slave-fx0m"
I20260709 13:13:59.956362 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602441430441-23430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:59.970830 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:59.971791 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:59.973333 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:59.975463 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:59.975666 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:59.975934 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:59.976074 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:00.012454 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.131:39821
I20260709 13:14:00.012548  3655 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.131:39821 every 8 connection(s)
I20260709 13:14:00.025836  3656 heartbeater.cc:344] Connected to a master server at 127.22.225.190:34431
I20260709 13:14:00.026309  3656 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:00.027081  3656 heartbeater.cc:507] Master 127.22.225.190:34431 requested a full tablet report, sending...
I20260709 13:14:00.029070  3380 ts_manager.cc:194] Registered new tserver with Master: f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.029203 23430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013609884s
I20260709 13:14:00.030835  3380 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42480
I20260709 13:14:00.054347  3380 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42494:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:00.056926  3380 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:00.133313  3621 tablet_service.cc:1511] Processing CreateTablet for tablet b514773e7047432aa818545c7c9e712e (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:00.134732  3621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b514773e7047432aa818545c7c9e712e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.140300  3620 tablet_service.cc:1511] Processing CreateTablet for tablet ec8b3ddeb76d4b629bdfecd77945d9b5 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:00.141395  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 398e000912b348938027ed51ba5e9948 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:00.142153  3617 tablet_service.cc:1511] Processing CreateTablet for tablet fdb37472dca84bb68e5a8c29f6aa391d (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:00.142850  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398e000912b348938027ed51ba5e9948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.143507  3617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb37472dca84bb68e5a8c29f6aa391d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.144443  3472 tablet_service.cc:1511] Processing CreateTablet for tablet b514773e7047432aa818545c7c9e712e (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:00.144898  3619 tablet_service.cc:1511] Processing CreateTablet for tablet 3490e0e10b8048e2804f811413edf1de (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:00.145813  3472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b514773e7047432aa818545c7c9e712e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.146253  3619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3490e0e10b8048e2804f811413edf1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.146178  3616 tablet_service.cc:1511] Processing CreateTablet for tablet aae3fb4e7a0c4517b854f6b57767e4c4 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:00.147543  3616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae3fb4e7a0c4517b854f6b57767e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.151883  3615 tablet_service.cc:1511] Processing CreateTablet for tablet c61c6dfd18d344939f230997d7e4a4e2 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:00.153270  3615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61c6dfd18d344939f230997d7e4a4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.155253  3620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8b3ddeb76d4b629bdfecd77945d9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.158550  3471 tablet_service.cc:1511] Processing CreateTablet for tablet ec8b3ddeb76d4b629bdfecd77945d9b5 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:00.159467  3470 tablet_service.cc:1511] Processing CreateTablet for tablet 3490e0e10b8048e2804f811413edf1de (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:00.159931  3471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8b3ddeb76d4b629bdfecd77945d9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.164888  3545 tablet_service.cc:1511] Processing CreateTablet for tablet 3490e0e10b8048e2804f811413edf1de (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:00.165807  3469 tablet_service.cc:1511] Processing CreateTablet for tablet 398e000912b348938027ed51ba5e9948 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:00.165956  3546 tablet_service.cc:1511] Processing CreateTablet for tablet ec8b3ddeb76d4b629bdfecd77945d9b5 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:00.166381  3545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3490e0e10b8048e2804f811413edf1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.167140  3546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec8b3ddeb76d4b629bdfecd77945d9b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.168253  3544 tablet_service.cc:1511] Processing CreateTablet for tablet 398e000912b348938027ed51ba5e9948 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:00.168876  3468 tablet_service.cc:1511] Processing CreateTablet for tablet fdb37472dca84bb68e5a8c29f6aa391d (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:00.169641  3544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398e000912b348938027ed51ba5e9948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.171030  3467 tablet_service.cc:1511] Processing CreateTablet for tablet aae3fb4e7a0c4517b854f6b57767e4c4 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:00.171293  3542 tablet_service.cc:1511] Processing CreateTablet for tablet aae3fb4e7a0c4517b854f6b57767e4c4 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:00.172497  3542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae3fb4e7a0c4517b854f6b57767e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.162245  3547 tablet_service.cc:1511] Processing CreateTablet for tablet b514773e7047432aa818545c7c9e712e (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:00.173477  3547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b514773e7047432aa818545c7c9e712e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.174455  3540 tablet_service.cc:1511] Processing CreateTablet for tablet 3883e1cebd1b420ea07c6580db6006bb (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:00.175781  3540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3883e1cebd1b420ea07c6580db6006bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.178135  3541 tablet_service.cc:1511] Processing CreateTablet for tablet c61c6dfd18d344939f230997d7e4a4e2 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:00.179500  3541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61c6dfd18d344939f230997d7e4a4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.164978  3543 tablet_service.cc:1511] Processing CreateTablet for tablet fdb37472dca84bb68e5a8c29f6aa391d (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:00.181247  3539 tablet_service.cc:1511] Processing CreateTablet for tablet a100cd4f1d874db29dbbe65f37a1d8ed (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:00.182413  3543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb37472dca84bb68e5a8c29f6aa391d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.182987  3539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a100cd4f1d874db29dbbe65f37a1d8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.184490  3468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb37472dca84bb68e5a8c29f6aa391d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.190428  3469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398e000912b348938027ed51ba5e9948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.193400  3467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae3fb4e7a0c4517b854f6b57767e4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.201109  3470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3490e0e10b8048e2804f811413edf1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.202026  3466 tablet_service.cc:1511] Processing CreateTablet for tablet c61c6dfd18d344939f230997d7e4a4e2 (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:00.202924  3617 tablet_service.cc:1511] Processing CreateTablet for tablet 3883e1cebd1b420ea07c6580db6006bb (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:00.204300  3617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3883e1cebd1b420ea07c6580db6006bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.205145  3465 tablet_service.cc:1511] Processing CreateTablet for tablet 3883e1cebd1b420ea07c6580db6006bb (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:00.203382  3466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61c6dfd18d344939f230997d7e4a4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.209429  3465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3883e1cebd1b420ea07c6580db6006bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.214336  3614 tablet_service.cc:1511] Processing CreateTablet for tablet a100cd4f1d874db29dbbe65f37a1d8ed (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:00.214519  3464 tablet_service.cc:1511] Processing CreateTablet for tablet a100cd4f1d874db29dbbe65f37a1d8ed (DEFAULT_TABLE table=test-workload [id=29bbeb5b763a416a9c6e8cee8b306b67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:00.215687  3614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a100cd4f1d874db29dbbe65f37a1d8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.216307  3464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a100cd4f1d874db29dbbe65f37a1d8ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:00.246114  3671 tablet_bootstrap.cc:492] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.290661  3671 tablet_bootstrap.cc:654] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.330518  3673 tablet_bootstrap.cc:492] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.336192  3673 tablet_bootstrap.cc:654] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.344632  3671 tablet_bootstrap.cc:492] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.345007  3672 tablet_bootstrap.cc:492] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.345252  3671 ts_tablet_manager.cc:1403] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.100s	user 0.030s	sys 0.005s
I20260709 13:14:00.347179  3673 tablet_bootstrap.cc:492] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.347683  3673 ts_tablet_manager.cc:1403] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.005s
I20260709 13:14:00.348371  3671 raft_consensus.cc:359] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.349277  3671 raft_consensus.cc:385] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.349586  3671 raft_consensus.cc:740] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.350485  3672 tablet_bootstrap.cc:654] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.350293  3671 consensus_queue.cc:260] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.350572  3673 raft_consensus.cc:359] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.351418  3673 raft_consensus.cc:385] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.351948  3673 raft_consensus.cc:740] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.352633  3656 heartbeater.cc:499] Master 127.22.225.190:34431 was elected leader, sending a full tablet report...
I20260709 13:14:00.352840  3673 consensus_queue.cc:260] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.354573  3671 ts_tablet_manager.cc:1434] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:14:00.356007  3672 tablet_bootstrap.cc:492] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.357483  3672 ts_tablet_manager.cc:1403] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:14:00.358431  3671 tablet_bootstrap.cc:492] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.360351  3582 heartbeater.cc:499] Master 127.22.225.190:34431 was elected leader, sending a full tablet report...
I20260709 13:14:00.360913  3673 ts_tablet_manager.cc:1434] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.004s
I20260709 13:14:00.362026  3673 tablet_bootstrap.cc:492] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.367254  3671 tablet_bootstrap.cc:654] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.368112  3673 tablet_bootstrap.cc:654] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.370850  3672 raft_consensus.cc:359] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.371980  3672 raft_consensus.cc:385] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.372429  3672 raft_consensus.cc:740] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.373661  3672 consensus_queue.cc:260] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.378814  3507 heartbeater.cc:499] Master 127.22.225.190:34431 was elected leader, sending a full tablet report...
I20260709 13:14:00.379575  3671 tablet_bootstrap.cc:492] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.379951  3672 ts_tablet_manager.cc:1434] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:14:00.380174  3671 ts_tablet_manager.cc:1403] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:14:00.381109  3672 tablet_bootstrap.cc:492] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.383126  3671 raft_consensus.cc:359] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.383903  3671 raft_consensus.cc:385] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.384318  3671 raft_consensus.cc:740] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.385262  3671 consensus_queue.cc:260] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.387008  3672 tablet_bootstrap.cc:654] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.388530  3671 ts_tablet_manager.cc:1434] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:14:00.389732  3671 tablet_bootstrap.cc:492] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.391654  3673 tablet_bootstrap.cc:492] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.392246  3673 ts_tablet_manager.cc:1403] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.009s
I20260709 13:14:00.395033  3673 raft_consensus.cc:359] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.395555  3671 tablet_bootstrap.cc:654] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.395810  3673 raft_consensus.cc:385] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.396189  3673 raft_consensus.cc:740] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.396965  3673 consensus_queue.cc:260] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.398622  3672 tablet_bootstrap.cc:492] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.399207  3673 ts_tablet_manager.cc:1434] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:00.399917  3672 ts_tablet_manager.cc:1403] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:14:00.400233  3673 tablet_bootstrap.cc:492] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.402881  3672 raft_consensus.cc:359] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.403626  3672 raft_consensus.cc:385] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.403964  3672 raft_consensus.cc:740] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.404668  3672 consensus_queue.cc:260] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.406416  3671 tablet_bootstrap.cc:492] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.406625  3673 tablet_bootstrap.cc:654] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.406965  3671 ts_tablet_manager.cc:1403] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:14:00.407102  3672 ts_tablet_manager.cc:1434] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:00.408226  3672 tablet_bootstrap.cc:492] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.409996  3671 raft_consensus.cc:359] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.410761  3671 raft_consensus.cc:385] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.411056  3671 raft_consensus.cc:740] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.412122  3671 consensus_queue.cc:260] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.414393  3671 ts_tablet_manager.cc:1434] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:14:00.415395  3671 tablet_bootstrap.cc:492] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.417477  3672 tablet_bootstrap.cc:654] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.423712  3671 tablet_bootstrap.cc:654] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.425318  3672 tablet_bootstrap.cc:492] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.426358  3678 raft_consensus.cc:493] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.426863  3678 raft_consensus.cc:515] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.427911  3673 tablet_bootstrap.cc:492] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.428426  3673 ts_tablet_manager.cc:1403] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.002s
I20260709 13:14:00.431373  3673 raft_consensus.cc:359] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.431818  3678 leader_election.cc:290] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.432204  3673 raft_consensus.cc:385] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.432569  3673 raft_consensus.cc:740] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.433532  3673 consensus_queue.cc:260] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.426391  3672 ts_tablet_manager.cc:1403] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:14:00.436174  3673 ts_tablet_manager.cc:1434] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:00.437228  3673 tablet_bootstrap.cc:492] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.437247  3671 tablet_bootstrap.cc:492] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.437947  3671 ts_tablet_manager.cc:1403] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:14:00.438238  3672 raft_consensus.cc:359] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.439026  3672 raft_consensus.cc:385] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.439361  3672 raft_consensus.cc:740] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.440150  3672 consensus_queue.cc:260] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.441071  3671 raft_consensus.cc:359] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.441938  3671 raft_consensus.cc:385] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.442284  3671 raft_consensus.cc:740] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.442480  3672 ts_tablet_manager.cc:1434] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:00.443671  3672 tablet_bootstrap.cc:492] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.443208  3671 consensus_queue.cc:260] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.445945  3671 ts_tablet_manager.cc:1434] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:00.446960  3671 tablet_bootstrap.cc:492] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.448503  3676 raft_consensus.cc:493] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.449031  3676 raft_consensus.cc:515] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.451583  3672 tablet_bootstrap.cc:654] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.451969  3676 leader_election.cc:290] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.453332  3673 tablet_bootstrap.cc:654] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.457691  3676 raft_consensus.cc:493] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.458336  3676 raft_consensus.cc:515] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.460774  3676 leader_election.cc:290] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.464792  3671 tablet_bootstrap.cc:654] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.467746  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
W20260709 13:14:00.469399  3522 leader_election.cc:343] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.471171  3672 tablet_bootstrap.cc:492] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.471668  3672 ts_tablet_manager.cc:1403] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:14:00.474665  3672 raft_consensus.cc:359] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.475394  3672 raft_consensus.cc:385] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.475692  3672 raft_consensus.cc:740] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.477658  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3883e1cebd1b420ea07c6580db6006bb" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
W20260709 13:14:00.482739  3596 leader_election.cc:343] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.483601  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.476411  3672 consensus_queue.cc:260] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.486169  3673 tablet_bootstrap.cc:492] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.486020  3557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3883e1cebd1b420ea07c6580db6006bb" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.488497  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.487301  3671 tablet_bootstrap.cc:492] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.487926  3681 raft_consensus.cc:493] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.486043  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.489426  3681 raft_consensus.cc:515] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
W20260709 13:14:00.490759  3594 leader_election.cc:343] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.491146  3594 leader_election.cc:304] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:00.491393  3678 raft_consensus.cc:493] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.488611  3482 raft_consensus.cc:2468] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
W20260709 13:14:00.492005  3522 leader_election.cc:343] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.491911  3678 raft_consensus.cc:515] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.492672  3522 leader_election.cc:304] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8896457506f045a18c8201317192789e; no voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:00.494256  3676 raft_consensus.cc:2749] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.491940  3681 leader_election.cc:290] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.495154  3596 leader_election.cc:304] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:00.495764  3671 ts_tablet_manager.cc:1403] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.002s
I20260709 13:14:00.495985  3676 raft_consensus.cc:2804] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.496575  3676 raft_consensus.cc:493] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.496604  3678 leader_election.cc:290] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821), 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593)
I20260709 13:14:00.497242  3676 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.497381  3678 raft_consensus.cc:2749] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.499092  3671 raft_consensus.cc:359] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.500085  3671 raft_consensus.cc:385] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.500447  3671 raft_consensus.cc:740] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
W20260709 13:14:00.496044  3594 leader_election.cc:343] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.501423  3671 consensus_queue.cc:260] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.505395  3673 ts_tablet_manager.cc:1403] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.068s	user 0.000s	sys 0.021s
I20260709 13:14:00.507355  3672 ts_tablet_manager.cc:1434] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:14:00.508258  3672 tablet_bootstrap.cc:492] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.512207  3676 raft_consensus.cc:515] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.514780  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b514773e7047432aa818545c7c9e712e" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.515100  3676 leader_election.cc:290] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.515467  3631 raft_consensus.cc:2468] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:00.515991  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:00.517068  3482 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.517309  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b514773e7047432aa818545c7c9e712e" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.518190  3481 raft_consensus.cc:2468] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:00.520193  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:00.521528  3522 leader_election.cc:304] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:00.522446  3694 raft_consensus.cc:2804] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.522840  3694 raft_consensus.cc:493] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.523204  3694 raft_consensus.cc:3060] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.527653  3681 raft_consensus.cc:493] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.528187  3681 raft_consensus.cc:515] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.530318  3681 leader_election.cc:290] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.531653  3482 raft_consensus.cc:2468] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:00.515026  3672 tablet_bootstrap.cc:654] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.534170  3671 ts_tablet_manager.cc:1434] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.014s
I20260709 13:14:00.535998  3694 raft_consensus.cc:515] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.537258  3671 tablet_bootstrap.cc:492] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.538847  3694 leader_election.cc:290] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Requested vote from peers f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821), 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593)
I20260709 13:14:00.539546  3596 leader_election.cc:304] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:00.540211  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b514773e7047432aa818545c7c9e712e" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:00.544240  3696 raft_consensus.cc:2804] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.544875  3696 raft_consensus.cc:697] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:00.546133  3671 tablet_bootstrap.cc:654] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.545783  3696 consensus_queue.cc:237] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.548031  3672 tablet_bootstrap.cc:492] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.544322  3631 raft_consensus.cc:3060] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.512485  3673 raft_consensus.cc:359] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.549492  3673 raft_consensus.cc:385] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.549706  3673 raft_consensus.cc:740] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.550302  3673 consensus_queue.cc:260] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.550987  3556 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.552332  3673 ts_tablet_manager.cc:1434] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.046s	user 0.002s	sys 0.002s
I20260709 13:14:00.556608  3673 tablet_bootstrap.cc:492] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.557305  3672 ts_tablet_manager.cc:1403] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.007s
I20260709 13:14:00.557902  3676 raft_consensus.cc:493] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.558178  3629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.558465  3676 raft_consensus.cc:515] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
W20260709 13:14:00.559816  3447 leader_election.cc:343] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.560600  3676 leader_election.cc:290] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.542035  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b514773e7047432aa818545c7c9e712e" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:00.567140  3671 tablet_bootstrap.cc:492] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.567233  3482 raft_consensus.cc:3060] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.567780  3673 tablet_bootstrap.cc:654] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.567705  3554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3490e0e10b8048e2804f811413edf1de" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.561388  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3490e0e10b8048e2804f811413edf1de" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.563526  3631 raft_consensus.cc:2468] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:00.560500  3672 raft_consensus.cc:359] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
W20260709 13:14:00.570247  3596 leader_election.cc:343] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.570338  3672 raft_consensus.cc:385] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.570753  3672 raft_consensus.cc:740] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.564102  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b514773e7047432aa818545c7c9e712e" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.565992  3557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b514773e7047432aa818545c7c9e712e" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.572760  3630 raft_consensus.cc:2393] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a572121143a4a5aa0dc8b9998a8762a in current term 1: Already voted for candidate 8896457506f045a18c8201317192789e in this term.
I20260709 13:14:00.572870  3557 raft_consensus.cc:2393] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8a572121143a4a5aa0dc8b9998a8762a in current term 1: Already voted for candidate 8896457506f045a18c8201317192789e in this term.
W20260709 13:14:00.574167  3594 leader_election.cc:343] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.574685  3445 leader_election.cc:304] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a; no voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:00.571732  3672 consensus_queue.cc:260] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.566303  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.576612  3522 leader_election.cc:304] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:00.567710  3671 ts_tablet_manager.cc:1403] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260709 13:14:00.577747  3678 raft_consensus.cc:2804] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:14:00.577891  3445 leader_election.cc:343] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.578286  3678 raft_consensus.cc:697] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:00.578357  3445 leader_election.cc:304] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a; no voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:00.579224  3678 consensus_queue.cc:237] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:00.574776  3594 leader_election.cc:304] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:00.580745  3671 raft_consensus.cc:359] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.581570  3676 raft_consensus.cc:2749] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.583283  3701 raft_consensus.cc:2749] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.581808  3671 raft_consensus.cc:385] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.584259  3671 raft_consensus.cc:740] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.584367  3703 raft_consensus.cc:493] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.585750  3703 raft_consensus.cc:515] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.586733  3556 raft_consensus.cc:2468] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:00.586072  3671 consensus_queue.cc:260] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.591265  3671 ts_tablet_manager.cc:1434] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:14:00.592337  3671 tablet_bootstrap.cc:492] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.594885  3672 ts_tablet_manager.cc:1434] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:14:00.598860  3671 tablet_bootstrap.cc:654] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.599397  3672 tablet_bootstrap.cc:492] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.603847  3482 raft_consensus.cc:2468] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:00.604542  3681 raft_consensus.cc:2749] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.610986  3671 tablet_bootstrap.cc:492] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.611616  3671 ts_tablet_manager.cc:1403] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:14:00.612385  3672 tablet_bootstrap.cc:654] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.614836  3671 raft_consensus.cc:359] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.615783  3671 raft_consensus.cc:385] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.616209  3673 tablet_bootstrap.cc:492] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.616158  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398e000912b348938027ed51ba5e9948" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.617659  3671 raft_consensus.cc:740] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.618345  3673 ts_tablet_manager.cc:1403] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.008s
I20260709 13:14:00.615963  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398e000912b348938027ed51ba5e9948" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
W20260709 13:14:00.620507  3445 leader_election.cc:343] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.620258  3671 consensus_queue.cc:260] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.621289  3630 raft_consensus.cc:2468] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:00.621944  3673 raft_consensus.cc:359] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.622973  3673 raft_consensus.cc:385] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.623742  3673 raft_consensus.cc:740] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.624440  3671 ts_tablet_manager.cc:1434] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:14:00.624788  3447 leader_election.cc:304] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e
I20260709 13:14:00.624723  3673 consensus_queue.cc:260] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.625556  3671 tablet_bootstrap.cc:492] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.625938  3681 raft_consensus.cc:2804] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.626330  3681 raft_consensus.cc:493] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.626688  3681 raft_consensus.cc:3060] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.627905  3673 ts_tablet_manager.cc:1434] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:14:00.628922  3672 tablet_bootstrap.cc:492] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.628923  3673 tablet_bootstrap.cc:492] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.629725  3672 ts_tablet_manager.cc:1403] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.004s
I20260709 13:14:00.624490  3378 catalog_manager.cc:5697] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 1 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.632789  3671 tablet_bootstrap.cc:654] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.633313  3672 raft_consensus.cc:359] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.634112  3672 raft_consensus.cc:385] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.634482  3672 raft_consensus.cc:740] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.635421  3672 consensus_queue.cc:260] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.636401  3673 tablet_bootstrap.cc:654] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.637732  3672 ts_tablet_manager.cc:1434] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:00.639343  3672 tablet_bootstrap.cc:492] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.646961  3672 tablet_bootstrap.cc:654] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.647930  3673 tablet_bootstrap.cc:492] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.648546  3673 ts_tablet_manager.cc:1403] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:14:00.650262  3379 catalog_manager.cc:5697] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 0 to 1, leader changed from <none> to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.652339  3673 raft_consensus.cc:359] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.653599  3673 raft_consensus.cc:385] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.654158  3673 raft_consensus.cc:740] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.655359  3696 raft_consensus.cc:493] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.655995  3696 raft_consensus.cc:515] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.658203  3696 leader_election.cc:290] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.658452  3672 tablet_bootstrap.cc:492] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.658954  3672 ts_tablet_manager.cc:1403] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
W20260709 13:14:00.660272  3428 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:00.662364  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.662762  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.663012  3482 raft_consensus.cc:2468] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:00.662706  3673 consensus_queue.cc:260] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.663334  3681 raft_consensus.cc:515] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.664470  3596 leader_election.cc:304] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
W20260709 13:14:00.667021  3594 leader_election.cc:343] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.667315  3696 raft_consensus.cc:2804] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.667729  3696 raft_consensus.cc:493] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.668099  3696 raft_consensus.cc:3060] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.669620  3681 leader_election.cc:290] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.670189  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398e000912b348938027ed51ba5e9948" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:00.670696  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398e000912b348938027ed51ba5e9948" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:00.671279  3630 raft_consensus.cc:3060] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:00.671689  3445 leader_election.cc:343] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.675875  3696 raft_consensus.cc:515] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.661827  3672 raft_consensus.cc:359] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.677277  3672 raft_consensus.cc:385] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.677767  3672 raft_consensus.cc:740] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.665578  3703 leader_election.cc:290] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.678714  3672 consensus_queue.cc:260] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.681522  3672 ts_tablet_manager.cc:1434] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:14:00.665517  3673 ts_tablet_manager.cc:1434] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:14:00.682616  3678 raft_consensus.cc:493] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.683298  3678 raft_consensus.cc:515] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.685613  3678 leader_election.cc:290] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.686621  3630 raft_consensus.cc:2468] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:00.688407  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3883e1cebd1b420ea07c6580db6006bb" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.689797  3673 tablet_bootstrap.cc:492] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.691895  3631 raft_consensus.cc:2468] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:00.693526  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3883e1cebd1b420ea07c6580db6006bb" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.693922  3522 leader_election.cc:304] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:00.694211  3482 raft_consensus.cc:2468] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:00.695010  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:00.695604  3481 raft_consensus.cc:3060] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.695899  3678 raft_consensus.cc:2804] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.696295  3678 raft_consensus.cc:493] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.696666  3678 raft_consensus.cc:3060] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.697611  3672 tablet_bootstrap.cc:492] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.697906  3447 leader_election.cc:304] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e
I20260709 13:14:00.700424  3673 tablet_bootstrap.cc:654] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.701398  3703 raft_consensus.cc:2804] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.701933  3703 raft_consensus.cc:697] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:00.702776  3703 consensus_queue.cc:237] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.703598  3694 raft_consensus.cc:493] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.704087  3694 raft_consensus.cc:515] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.706204  3694 leader_election.cc:290] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.707669  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.698608  3671 tablet_bootstrap.cc:492] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.709298  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.709623  3671 ts_tablet_manager.cc:1403] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.038s
I20260709 13:14:00.709954  3482 raft_consensus.cc:2468] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:00.711190  3522 leader_election.cc:304] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:00.711911  3694 raft_consensus.cc:2804] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.712248  3694 raft_consensus.cc:493] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.712587  3694 raft_consensus.cc:3060] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.712456  3671 raft_consensus.cc:359] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.713176  3671 raft_consensus.cc:385] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.713490  3671 raft_consensus.cc:740] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.714176  3671 consensus_queue.cc:260] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.716113  3671 ts_tablet_manager.cc:1434] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:00.716594  3676 raft_consensus.cc:493] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.717000  3671 tablet_bootstrap.cc:492] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:00.717106  3676 raft_consensus.cc:515] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.720036  3672 tablet_bootstrap.cc:654] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.721607  3676 leader_election.cc:290] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
W20260709 13:14:00.722415  3522 leader_election.cc:343] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.723497  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.726233  3556 raft_consensus.cc:2468] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:00.727432  3594 leader_election.cc:304] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:00.727864  3671 tablet_bootstrap.cc:654] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.724304  3696 leader_election.cc:290] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.724346  3481 raft_consensus.cc:2468] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:00.720670  3694 raft_consensus.cc:515] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.731499  3596 leader_election.cc:304] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:00.724385  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.725482  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:00.732847  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:00.733529  3480 raft_consensus.cc:3060] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.733642  3678 raft_consensus.cc:515] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
W20260709 13:14:00.733914  3594 leader_election.cc:343] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:00.736135  3596 leader_election.cc:343] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.736644  3694 leader_election.cc:290] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.730051  3696 raft_consensus.cc:2804] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.738610  3673 tablet_bootstrap.cc:492] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.738756  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:00.739140  3673 ts_tablet_manager.cc:1403] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.000s
W20260709 13:14:00.741128  3522 leader_election.cc:343] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.742136  3673 raft_consensus.cc:359] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.742364  3694 raft_consensus.cc:493] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.743400  3694 raft_consensus.cc:515] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.745764  3678 leader_election.cc:290] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.746075  3694 leader_election.cc:290] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.746542  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3883e1cebd1b420ea07c6580db6006bb" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:00.747148  3481 raft_consensus.cc:3060] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.749624  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3883e1cebd1b420ea07c6580db6006bb" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:00.750433  3631 raft_consensus.cc:3060] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.753468  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.754168  3482 raft_consensus.cc:2468] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:00.754151  3481 raft_consensus.cc:2468] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:00.754580  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.742908  3673 raft_consensus.cc:385] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.756213  3673 raft_consensus.cc:740] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.756624  3522 leader_election.cc:304] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:00.755505  3630 raft_consensus.cc:2468] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:00.757167  3673 consensus_queue.cc:260] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.757622  3522 leader_election.cc:304] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:00.755579  3696 raft_consensus.cc:493] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.761626  3696 raft_consensus.cc:3060] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.757658  3676 raft_consensus.cc:2804] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.764410  3678 raft_consensus.cc:2804] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.765822  3678 raft_consensus.cc:493] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.766237  3678 raft_consensus.cc:3060] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.767855  3673 ts_tablet_manager.cc:1434] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:14:00.768922  3673 tablet_bootstrap.cc:492] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.770107  3378 catalog_manager.cc:5697] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 1 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.776156  3673 tablet_bootstrap.cc:654] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.757512  3694 raft_consensus.cc:2804] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.781702  3694 raft_consensus.cc:697] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:00.782567  3694 consensus_queue.cc:237] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.783051  3631 raft_consensus.cc:2468] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:00.784274  3676 raft_consensus.cc:697] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:00.785302  3676 consensus_queue.cc:237] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.785844  3672 tablet_bootstrap.cc:492] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.786540  3672 ts_tablet_manager.cc:1403] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.089s	user 0.028s	sys 0.016s
I20260709 13:14:00.786895  3720 raft_consensus.cc:493] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.787451  3720 raft_consensus.cc:515] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.790035  3672 raft_consensus.cc:359] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.790453  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.791285  3481 raft_consensus.cc:2468] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:00.792562  3596 leader_election.cc:304] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:00.793565  3718 raft_consensus.cc:2804] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.793977  3718 raft_consensus.cc:493] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.794363  3718 raft_consensus.cc:3060] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.794545  3678 raft_consensus.cc:515] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.783504  3696 raft_consensus.cc:515] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.795220  3671 tablet_bootstrap.cc:492] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:00.796355  3671 ts_tablet_manager.cc:1403] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.080s	user 0.004s	sys 0.012s
I20260709 13:14:00.797252  3720 leader_election.cc:290] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.797711  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
W20260709 13:14:00.802201  3596 leader_election.cc:343] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:00.798230  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.803126  3671 raft_consensus.cc:359] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.798627  3696 leader_election.cc:290] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.799635  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:00.803974  3673 tablet_bootstrap.cc:492] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.804555  3673 ts_tablet_manager.cc:1403] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.009s
I20260709 13:14:00.803869  3671 raft_consensus.cc:385] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.804435  3556 raft_consensus.cc:3060] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.807516  3673 raft_consensus.cc:359] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.790771  3672 raft_consensus.cc:385] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.800091  3480 raft_consensus.cc:2468] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:00.808319  3672 raft_consensus.cc:740] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.808113  3378 catalog_manager.cc:5697] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 1 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.804023  3555 raft_consensus.cc:2393] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f38a26f090154cacb4c9ce88319b1019 in current term 1: Already voted for candidate 8896457506f045a18c8201317192789e in this term.
I20260709 13:14:00.809238  3671 raft_consensus.cc:740] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.810249  3522 leader_election.cc:304] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:00.811244  3719 raft_consensus.cc:2804] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.810313  3671 consensus_queue.cc:260] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.811941  3556 raft_consensus.cc:2468] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:00.813375  3671 ts_tablet_manager.cc:1434] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:14:00.808177  3673 raft_consensus.cc:385] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.814620  3673 raft_consensus.cc:740] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.809228  3672 consensus_queue.cc:260] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.817483  3673 consensus_queue.cc:260] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.816840  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:00.818485  3480 raft_consensus.cc:3060] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.818583  3379 catalog_manager.cc:5697] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 0 to 1, leader changed from <none> to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.819548  3673 ts_tablet_manager.cc:1434] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:14:00.820482  3673 tablet_bootstrap.cc:492] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:00.826035  3673 tablet_bootstrap.cc:654] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.826434  3678 leader_election.cc:290] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.826701  3672 ts_tablet_manager.cc:1434] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:14:00.826117  3718 raft_consensus.cc:515] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.828120  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:00.828907  3631 raft_consensus.cc:2393] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8896457506f045a18c8201317192789e in current term 1: Already voted for candidate f38a26f090154cacb4c9ce88319b1019 in this term.
I20260709 13:14:00.829939  3718 leader_election.cc:290] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.831504  3480 raft_consensus.cc:2468] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:00.832505  3522 leader_election.cc:304] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:00.831542  3594 leader_election.cc:304] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:00.832931  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:00.833519  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61c6dfd18d344939f230997d7e4a4e2" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:00.833810  3481 raft_consensus.cc:2393] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f38a26f090154cacb4c9ce88319b1019 in current term 1: Already voted for candidate 8896457506f045a18c8201317192789e in this term.
I20260709 13:14:00.834626  3556 raft_consensus.cc:2393] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f38a26f090154cacb4c9ce88319b1019 in current term 1: Already voted for candidate 8896457506f045a18c8201317192789e in this term.
I20260709 13:14:00.835582  3678 raft_consensus.cc:2804] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.836149  3678 raft_consensus.cc:697] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:00.835711  3672 tablet_bootstrap.cc:492] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:00.837116  3678 consensus_queue.cc:237] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.838824  3696 raft_consensus.cc:2804] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.838857  3594 leader_election.cc:304] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:00.840250  3696 raft_consensus.cc:697] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:00.840422  3720 raft_consensus.cc:2749] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.841532  3696 consensus_queue.cc:237] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.873389  3719 raft_consensus.cc:697] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:00.875227  3379 catalog_manager.cc:5697] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 0 to 1, leader changed from <none> to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.881196  3719 consensus_queue.cc:237] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.878750  3672 tablet_bootstrap.cc:654] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.886746  3673 tablet_bootstrap.cc:492] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:00.887313  3673 ts_tablet_manager.cc:1403] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.067s	user 0.025s	sys 0.040s
I20260709 13:14:00.890214  3673 raft_consensus.cc:359] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.892165  3673 raft_consensus.cc:385] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.892423  3673 raft_consensus.cc:740] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.893030  3673 consensus_queue.cc:260] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.895243  3673 ts_tablet_manager.cc:1434] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:14:00.898248  3672 tablet_bootstrap.cc:492] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:00.898684  3672 ts_tablet_manager.cc:1403] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.003s
I20260709 13:14:00.899037  3379 catalog_manager.cc:5697] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 1 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.900413  3379 catalog_manager.cc:5697] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 1 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.900671  3672 raft_consensus.cc:359] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.901340  3672 raft_consensus.cc:385] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.901578  3672 raft_consensus.cc:740] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.902182  3672 consensus_queue.cc:260] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.904006  3672 ts_tablet_manager.cc:1434] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:14:00.926946  3696 consensus_queue.cc:1048] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.938663  3718 consensus_queue.cc:1048] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.952188  3718 raft_consensus.cc:493] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.952643  3718 raft_consensus.cc:515] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.954675  3718 leader_election.cc:290] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:00.955456  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.955847  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:00.956459  3481 raft_consensus.cc:2393] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f38a26f090154cacb4c9ce88319b1019 in current term 1: Already voted for candidate 8896457506f045a18c8201317192789e in this term.
I20260709 13:14:00.957636  3596 leader_election.cc:304] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:00.958348  3718 raft_consensus.cc:3060] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.963156  3718 raft_consensus.cc:2749] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.977702  3719 raft_consensus.cc:493] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.978230  3719 raft_consensus.cc:515] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.979869  3719 leader_election.cc:290] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.980553  3719 raft_consensus.cc:493] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.980749  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.980968  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.981019  3719 raft_consensus.cc:515] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:00.981803  3481 raft_consensus.cc:2393] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8896457506f045a18c8201317192789e in current term 1: Already voted for candidate f38a26f090154cacb4c9ce88319b1019 in this term.
I20260709 13:14:00.983296  3522 leader_election.cc:304] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8896457506f045a18c8201317192789e; no voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:00.983841  3719 leader_election.cc:290] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:00.984151  3678 raft_consensus.cc:3060] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.985311  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398e000912b348938027ed51ba5e9948" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:00.985409  3719 consensus_queue.cc:1048] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:00.986001  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398e000912b348938027ed51ba5e9948" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:00.986876  3631 raft_consensus.cc:2393] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8896457506f045a18c8201317192789e in current term 1: Already voted for candidate 8a572121143a4a5aa0dc8b9998a8762a in this term.
I20260709 13:14:00.987862  3522 leader_election.cc:304] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8896457506f045a18c8201317192789e; no voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:00.988515  3719 raft_consensus.cc:3060] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.991199  3678 raft_consensus.cc:2749] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.994639  3719 raft_consensus.cc:2749] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:01.001255  3724 consensus_queue.cc:1048] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.166105  3703 raft_consensus.cc:493] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.166649  3703 raft_consensus.cc:515] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.168434  3703 leader_election.cc:290] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:01.169226  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3490e0e10b8048e2804f811413edf1de" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:01.169437  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3490e0e10b8048e2804f811413edf1de" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:01.169873  3556 raft_consensus.cc:2468] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:01.170083  3631 raft_consensus.cc:2468] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:01.170888  3445 leader_election.cc:304] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:01.171622  3703 raft_consensus.cc:2804] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:01.172006  3703 raft_consensus.cc:493] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.172268  3703 raft_consensus.cc:3060] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.177699  3703 raft_consensus.cc:515] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.179692  3703 leader_election.cc:290] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:01.180409  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3490e0e10b8048e2804f811413edf1de" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:01.180758  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3490e0e10b8048e2804f811413edf1de" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:01.181059  3556 raft_consensus.cc:3060] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.181401  3631 raft_consensus.cc:3060] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.188033  3556 raft_consensus.cc:2468] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:01.188032  3631 raft_consensus.cc:2468] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:01.189510  3445 leader_election.cc:304] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:01.190163  3703 raft_consensus.cc:2804] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:01.190557  3703 raft_consensus.cc:697] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:01.191315  3703 consensus_queue.cc:237] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.198081  3378 catalog_manager.cc:5697] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 1 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.210657  3724 consensus_queue.cc:1048] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.221832  3719 consensus_queue.cc:1048] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.227445  3718 consensus_queue.cc:1048] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.238363  3480 raft_consensus.cc:3060] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:01.246037  3703 consensus_queue.cc:1048] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.249739  3676 consensus_queue.cc:1048] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.252902  3703 consensus_queue.cc:1048] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.266575  3556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b514773e7047432aa818545c7c9e712e"
dest_uuid: "8896457506f045a18c8201317192789e"
mode: GRACEFUL
new_leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:50004
I20260709 13:14:01.267176  3556 raft_consensus.cc:606] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 LEADER]: Received request to transfer leadership to TS 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:01.290567  3719 consensus_queue.cc:1048] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.294971  3631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
mode: GRACEFUL
new_leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:46484
I20260709 13:14:01.295629  3631 raft_consensus.cc:606] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Received request to transfer leadership to TS 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:01.304207  3719 consensus_queue.cc:1048] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.312817  3719 consensus_queue.cc:1048] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.312969  3630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
mode: GRACEFUL
new_leader_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:46484
I20260709 13:14:01.313784  3630 raft_consensus.cc:606] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Received request to transfer leadership to TS 8896457506f045a18c8201317192789e
I20260709 13:14:01.322482  3631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
mode: GRACEFUL
new_leader_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:46484
I20260709 13:14:01.323244  3631 raft_consensus.cc:606] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Received request to transfer leadership to TS 8896457506f045a18c8201317192789e
I20260709 13:14:01.334888  3556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed"
dest_uuid: "8896457506f045a18c8201317192789e"
mode: GRACEFUL
new_leader_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:50004
I20260709 13:14:01.335500  3556 raft_consensus.cc:606] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 1 LEADER]: Received request to transfer leadership to TS f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:01.339401  3694 consensus_queue.cc:1048] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.345605  3676 consensus_queue.cc:1048] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.349573  3724 raft_consensus.cc:993] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e: : Instructing follower f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:01.350062  3694 raft_consensus.cc:1081] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 1 LEADER]: Signalling peer f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:01.351495  3631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:46478
I20260709 13:14:01.351965  3631 raft_consensus.cc:493] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.352267  3631 raft_consensus.cc:3060] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.358610  3676 raft_consensus.cc:993] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019: : Instructing follower 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:01.359112  3676 raft_consensus.cc:1081] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Signalling peer 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:01.358973  3631 raft_consensus.cc:515] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.362293  3631 leader_election.cc:290] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:01.363541  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:01.364116  3555 raft_consensus.cc:3055] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.364439  3555 raft_consensus.cc:740] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:01.364355  3696 consensus_queue.cc:1048] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:01.365263  3555 consensus_queue.cc:260] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.366262  3480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:38934
I20260709 13:14:01.366582  3555 raft_consensus.cc:3060] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.366859  3480 raft_consensus.cc:493] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.367298  3480 raft_consensus.cc:3060] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.367200  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a100cd4f1d874db29dbbe65f37a1d8ed" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:01.368597  3481 raft_consensus.cc:3060] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.374524  3555 raft_consensus.cc:2468] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 2.
I20260709 13:14:01.374627  3480 raft_consensus.cc:515] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.376134  3594 leader_election.cc:304] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:01.377344  3676 raft_consensus.cc:2804] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.377471  3480 leader_election.cc:290] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:01.378149  3676 raft_consensus.cc:697] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 2 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:01.379146  3557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:01.379290  3676 consensus_queue.cc:237] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.380369  3694 raft_consensus.cc:993] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e: : Instructing follower 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:01.380853  3678 raft_consensus.cc:1081] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 LEADER]: Signalling peer 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:01.382582  3480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b514773e7047432aa818545c7c9e712e"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:38924
I20260709 13:14:01.382547  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec8b3ddeb76d4b629bdfecd77945d9b5" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:01.383527  3480 raft_consensus.cc:493] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.384009  3480 raft_consensus.cc:3060] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.384863  3481 raft_consensus.cc:2468] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 2.
I20260709 13:14:01.383850  3631 raft_consensus.cc:3055] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.388320  3631 raft_consensus.cc:740] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:01.389250  3631 consensus_queue.cc:260] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.390419  3631 raft_consensus.cc:3060] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.391274  3480 raft_consensus.cc:515] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:01.394131  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b514773e7047432aa818545c7c9e712e" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:01.394706  3630 raft_consensus.cc:3060] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.394728  3480 leader_election.cc:290] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Requested vote from peers f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:01.400710  3630 raft_consensus.cc:2468] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 2.
I20260709 13:14:01.400864  3631 raft_consensus.cc:2468] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 2.
I20260709 13:14:01.402009  3447 leader_election.cc:304] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:01.402818  3681 raft_consensus.cc:2804] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.403294  3681 raft_consensus.cc:697] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:01.404203  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b514773e7047432aa818545c7c9e712e" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:01.404001  3681 consensus_queue.cc:237] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:01.404659  3556 raft_consensus.cc:3055] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.404904  3556 raft_consensus.cc:740] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:01.405738  3556 consensus_queue.cc:260] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } }
I20260709 13:14:01.405975  3447 leader_election.cc:304] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e
I20260709 13:14:01.407003  3556 raft_consensus.cc:3060] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.407146  3703 raft_consensus.cc:2804] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.407699  3377 catalog_manager.cc:5697] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 1 to 2, leader changed from 8896457506f045a18c8201317192789e (127.22.225.130) to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.413772  3379 catalog_manager.cc:5697] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 1 to 2, leader changed from 8896457506f045a18c8201317192789e (127.22.225.130) to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 2 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:01.416641  3556 raft_consensus.cc:2468] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 2.
I20260709 13:14:01.417204  3703 raft_consensus.cc:697] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:01.418190  3703 consensus_queue.cc:237] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.427211  3379 catalog_manager.cc:5697] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 1 to 2, leader changed from f38a26f090154cacb4c9ce88319b1019 (127.22.225.131) to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 2 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.441596  3696 raft_consensus.cc:993] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019: : Instructing follower 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:01.442112  3676 raft_consensus.cc:1081] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Signalling peer 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:01.443531  3556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d"
dest_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:49984
I20260709 13:14:01.444000  3556 raft_consensus.cc:493] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.444289  3556 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.449213  3556 raft_consensus.cc:515] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.450863  3556 leader_election.cc:290] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:01.451596  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:01.451911  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:01.452242  3480 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.452535  3631 raft_consensus.cc:3055] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.452840  3631 raft_consensus.cc:740] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:01.453500  3631 consensus_queue.cc:260] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.454658  3631 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.457837  3480 raft_consensus.cc:2468] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:01.458994  3522 leader_election.cc:304] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:01.459753  3678 raft_consensus.cc:2804] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.459874  3631 raft_consensus.cc:2468] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:01.460189  3678 raft_consensus.cc:697] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 2 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:01.461054  3678 consensus_queue.cc:237] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.466813  3379 catalog_manager.cc:5697] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e reported cstate change: term changed from 1 to 2, leader changed from f38a26f090154cacb4c9ce88319b1019 (127.22.225.131) to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 2 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.645854  3703 consensus_queue.cc:1048] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.658015  3755 consensus_queue.cc:1048] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.710207  3696 raft_consensus.cc:993] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019: : Instructing follower 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:01.710664  3676 raft_consensus.cc:1081] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Signalling peer 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:01.711997  3556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4"
dest_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:49984
I20260709 13:14:01.712487  3556 raft_consensus.cc:493] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:01.712811  3556 raft_consensus.cc:3060] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.717706  3556 raft_consensus.cc:515] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.719378  3556 leader_election.cc:290] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:01.720083  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:01.720374  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aae3fb4e7a0c4517b854f6b57767e4c4" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:01.720726  3480 raft_consensus.cc:3060] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.720966  3631 raft_consensus.cc:3055] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:01.721335  3631 raft_consensus.cc:740] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:01.722141  3631 consensus_queue.cc:260] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.723421  3631 raft_consensus.cc:3060] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.727787  3480 raft_consensus.cc:2468] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:01.729118  3522 leader_election.cc:304] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:01.729853  3678 raft_consensus.cc:2804] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:01.730259  3631 raft_consensus.cc:2468] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:01.730273  3678 raft_consensus.cc:697] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:01.731747  3678 consensus_queue.cc:237] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:01.737995  3377 catalog_manager.cc:5697] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e reported cstate change: term changed from 1 to 2, leader changed from f38a26f090154cacb4c9ce88319b1019 (127.22.225.131) to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 2 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.798669  3631 raft_consensus.cc:1275] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.799916  3755 consensus_queue.cc:1048] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.808046  3556 raft_consensus.cc:1275] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.810496  3753 consensus_queue.cc:1048] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.831116  3631 raft_consensus.cc:1275] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.832341  3755 consensus_queue.cc:1048] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.841949  3556 raft_consensus.cc:3060] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:01.848647  3556 raft_consensus.cc:1275] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.849835  3755 consensus_queue.cc:1048] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.938112  3480 raft_consensus.cc:1275] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.939589  3676 consensus_queue.cc:1048] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.948526  3556 raft_consensus.cc:1275] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.950620  3696 consensus_queue.cc:1048] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.968449  3631 raft_consensus.cc:1275] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.969597  3724 consensus_queue.cc:1048] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.978145  3480 raft_consensus.cc:1275] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.980110  3724 consensus_queue.cc:1048] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.146056  3631 raft_consensus.cc:1275] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.147184  3724 consensus_queue.cc:1048] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.155408  3480 raft_consensus.cc:1275] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.156754  3694 consensus_queue.cc:1048] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:04.384928  3379 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41342:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:04.389202  3379 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:04.439769  3472 tablet_service.cc:1511] Processing CreateTablet for tablet 1eccd04f06354585b4e48b6083303bf2 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:04.441346  3539 tablet_service.cc:1511] Processing CreateTablet for tablet 1eccd04f06354585b4e48b6083303bf2 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:04.442044  3472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eccd04f06354585b4e48b6083303bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.443384  3539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eccd04f06354585b4e48b6083303bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.445118  3614 tablet_service.cc:1511] Processing CreateTablet for tablet 1eccd04f06354585b4e48b6083303bf2 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:04.446700  3614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eccd04f06354585b4e48b6083303bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.447201  3546 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef057f6113348ee8616abcbe089761a (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:04.448918  3546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef057f6113348ee8616abcbe089761a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.451077  3541 tablet_service.cc:1511] Processing CreateTablet for tablet 456e8a5728f042c6985acdd27073be61 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:04.452826  3615 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef057f6113348ee8616abcbe089761a (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:04.453022  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 456e8a5728f042c6985acdd27073be61 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:04.454998  3470 tablet_service.cc:1511] Processing CreateTablet for tablet 456e8a5728f042c6985acdd27073be61 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:04.455369  3467 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef057f6113348ee8616abcbe089761a (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:04.456540  3470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456e8a5728f042c6985acdd27073be61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.457988  3620 tablet_service.cc:1511] Processing CreateTablet for tablet b83411514a9c480d87e0ac3175181e30 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:04.460664  3467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef057f6113348ee8616abcbe089761a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.462849  3545 tablet_service.cc:1511] Processing CreateTablet for tablet aa7f89221e744f428014037200deb5e7 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:04.464488  3545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7f89221e744f428014037200deb5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.465363  3617 tablet_service.cc:1511] Processing CreateTablet for tablet 9fbef5d9c42943fdb5657c68965d8160 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:04.460553  3544 tablet_service.cc:1511] Processing CreateTablet for tablet b83411514a9c480d87e0ac3175181e30 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:04.460915  3616 tablet_service.cc:1511] Processing CreateTablet for tablet aa7f89221e744f428014037200deb5e7 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:04.468266  3468 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:04.469805  3468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcd97cbad9e4d1fbd4b6cfc5ee30b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.469965  3464 tablet_service.cc:1511] Processing CreateTablet for tablet aa7f89221e744f428014037200deb5e7 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:04.471550  3464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7f89221e744f428014037200deb5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.468191  3544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83411514a9c480d87e0ac3175181e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.473490  3541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456e8a5728f042c6985acdd27073be61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.473704  3543 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:04.475199  3543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcd97cbad9e4d1fbd4b6cfc5ee30b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.475781  3619 tablet_service.cc:1511] Processing CreateTablet for tablet 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:04.477897  3471 tablet_service.cc:1511] Processing CreateTablet for tablet 9fbef5d9c42943fdb5657c68965d8160 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:04.478334  3466 tablet_service.cc:1511] Processing CreateTablet for tablet 22a2f22fdae842e7a369d30e4e53872b (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:04.479393  3471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbef5d9c42943fdb5657c68965d8160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.461728  3615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef057f6113348ee8616abcbe089761a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.481259  3613 tablet_service.cc:1511] Processing CreateTablet for tablet 83838501b9c24acf831b8ed2616945a5 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:04.482797  3613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83838501b9c24acf831b8ed2616945a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.485484  3616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7f89221e744f428014037200deb5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.486464  3621 tablet_service.cc:1511] Processing CreateTablet for tablet 22a2f22fdae842e7a369d30e4e53872b (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:04.471626  3540 tablet_service.cc:1511] Processing CreateTablet for tablet 9fbef5d9c42943fdb5657c68965d8160 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:04.487012  3619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dcd97cbad9e4d1fbd4b6cfc5ee30b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.488634  3540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbef5d9c42943fdb5657c68965d8160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.489182  3469 tablet_service.cc:1511] Processing CreateTablet for tablet 83838501b9c24acf831b8ed2616945a5 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:04.487545  3466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a2f22fdae842e7a369d30e4e53872b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.468181  3465 tablet_service.cc:1511] Processing CreateTablet for tablet b83411514a9c480d87e0ac3175181e30 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:04.492637  3465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83411514a9c480d87e0ac3175181e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.493459  3469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83838501b9c24acf831b8ed2616945a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.494612  3547 tablet_service.cc:1511] Processing CreateTablet for tablet 22a2f22fdae842e7a369d30e4e53872b (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:04.495203  3621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a2f22fdae842e7a369d30e4e53872b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.495921  3547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a2f22fdae842e7a369d30e4e53872b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.496990  3617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbef5d9c42943fdb5657c68965d8160. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.498767  3542 tablet_service.cc:1511] Processing CreateTablet for tablet 83838501b9c24acf831b8ed2616945a5 (DEFAULT_TABLE table=soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:04.500128  3542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83838501b9c24acf831b8ed2616945a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.498824  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456e8a5728f042c6985acdd27073be61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:04.502589  3620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b83411514a9c480d87e0ac3175181e30. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:04.705643  3428 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:04.714071  3774 tablet_bootstrap.cc:492] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:04.714577  3772 tablet_bootstrap.cc:492] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:04.717898  3773 tablet_bootstrap.cc:492] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:04.726115  3773 tablet_bootstrap.cc:654] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.730679  3772 tablet_bootstrap.cc:654] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.748265  3772 tablet_bootstrap.cc:492] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:04.748457  3773 tablet_bootstrap.cc:492] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:04.748769  3772 ts_tablet_manager.cc:1403] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.006s
I20260709 13:14:04.749053  3773 ts_tablet_manager.cc:1403] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.007s
I20260709 13:14:04.749607  3774 tablet_bootstrap.cc:654] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.751721  3772 raft_consensus.cc:359] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.752461  3772 raft_consensus.cc:385] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.752775  3772 raft_consensus.cc:740] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.752516  3773 raft_consensus.cc:359] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.753733  3773 raft_consensus.cc:385] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.753532  3772 consensus_queue.cc:260] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.754172  3773 raft_consensus.cc:740] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.755227  3773 consensus_queue.cc:260] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.761659  3774 tablet_bootstrap.cc:492] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:04.762241  3774 ts_tablet_manager.cc:1403] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.004s
I20260709 13:14:04.762486  3773 ts_tablet_manager.cc:1434] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:04.763612  3773 tablet_bootstrap.cc:492] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:04.765223  3774 raft_consensus.cc:359] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.766026  3774 raft_consensus.cc:385] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.766315  3774 raft_consensus.cc:740] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.767074  3774 consensus_queue.cc:260] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.756577  3772 ts_tablet_manager.cc:1434] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:14:04.769721  3774 ts_tablet_manager.cc:1434] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:04.770263  3772 tablet_bootstrap.cc:492] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:04.770802  3774 tablet_bootstrap.cc:492] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:04.775254  3773 tablet_bootstrap.cc:654] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.777908  3772 tablet_bootstrap.cc:654] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.783449  3774 tablet_bootstrap.cc:654] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.783668  3772 tablet_bootstrap.cc:492] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:04.784180  3772 ts_tablet_manager.cc:1403] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.005s
I20260709 13:14:04.787505  3773 tablet_bootstrap.cc:492] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:04.787459  3772 raft_consensus.cc:359] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.788071  3773 ts_tablet_manager.cc:1403] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.008s
I20260709 13:14:04.788236  3772 raft_consensus.cc:385] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.788610  3772 raft_consensus.cc:740] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.789179  3774 tablet_bootstrap.cc:492] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:04.789695  3774 ts_tablet_manager.cc:1403] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:14:04.789438  3772 consensus_queue.cc:260] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.791035  3773 raft_consensus.cc:359] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.791740  3773 raft_consensus.cc:385] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.791922  3772 ts_tablet_manager.cc:1434] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:14:04.792008  3773 raft_consensus.cc:740] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.793169  3772 tablet_bootstrap.cc:492] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:04.792834  3774 raft_consensus.cc:359] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.792904  3773 consensus_queue.cc:260] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.793691  3774 raft_consensus.cc:385] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.794037  3774 raft_consensus.cc:740] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.794796  3774 consensus_queue.cc:260] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.797232  3774 ts_tablet_manager.cc:1434] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:04.798195  3774 tablet_bootstrap.cc:492] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:04.798842  3773 ts_tablet_manager.cc:1434] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:14:04.799850  3773 tablet_bootstrap.cc:492] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:04.800594  3772 tablet_bootstrap.cc:654] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.805433  3774 tablet_bootstrap.cc:654] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.806130  3773 tablet_bootstrap.cc:654] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.840291  3772 tablet_bootstrap.cc:492] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:04.840911  3772 ts_tablet_manager.cc:1403] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.001s
I20260709 13:14:04.841918  3773 tablet_bootstrap.cc:492] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:04.842468  3773 ts_tablet_manager.cc:1403] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.024s
I20260709 13:14:04.842875  3774 tablet_bootstrap.cc:492] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:04.843369  3774 ts_tablet_manager.cc:1403] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.032s
I20260709 13:14:04.844372  3772 raft_consensus.cc:359] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.845196  3772 raft_consensus.cc:385] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.845484  3772 raft_consensus.cc:740] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.845377  3773 raft_consensus.cc:359] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.845880  3774 raft_consensus.cc:359] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.846282  3773 raft_consensus.cc:385] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.846668  3774 raft_consensus.cc:385] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.846415  3772 consensus_queue.cc:260] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.846699  3773 raft_consensus.cc:740] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.847102  3774 raft_consensus.cc:740] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.847720  3773 consensus_queue.cc:260] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.848037  3774 consensus_queue.cc:260] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.850328  3773 ts_tablet_manager.cc:1434] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:04.850525  3774 ts_tablet_manager.cc:1434] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:14:04.851454  3773 tablet_bootstrap.cc:492] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:04.851581  3774 tablet_bootstrap.cc:492] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:04.858304  3773 tablet_bootstrap.cc:654] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.858610  3774 tablet_bootstrap.cc:654] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.859259  3772 ts_tablet_manager.cc:1434] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:14:04.860387  3772 tablet_bootstrap.cc:492] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:04.867244  3774 tablet_bootstrap.cc:492] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:04.867730  3774 ts_tablet_manager.cc:1403] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:14:04.869990  3772 tablet_bootstrap.cc:654] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.875892  3774 raft_consensus.cc:359] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.876624  3774 raft_consensus.cc:385] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.876910  3774 raft_consensus.cc:740] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.879226  3774 consensus_queue.cc:260] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.881002  3773 tablet_bootstrap.cc:492] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:04.881587  3774 ts_tablet_manager.cc:1434] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 13:14:04.881721  3773 ts_tablet_manager.cc:1403] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.011s
I20260709 13:14:04.883275  3774 tablet_bootstrap.cc:492] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:04.894229  3774 tablet_bootstrap.cc:654] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.896363  3773 raft_consensus.cc:359] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.897693  3773 raft_consensus.cc:385] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.897934  3773 raft_consensus.cc:740] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.898743  3773 consensus_queue.cc:260] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.899824  3772 tablet_bootstrap.cc:492] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:04.900418  3772 ts_tablet_manager.cc:1403] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.016s
I20260709 13:14:04.900501  3774 tablet_bootstrap.cc:492] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:04.901094  3774 ts_tablet_manager.cc:1403] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:14:04.901125  3773 ts_tablet_manager.cc:1434] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:14:04.902328  3773 tablet_bootstrap.cc:492] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:04.904307  3774 raft_consensus.cc:359] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.904973  3774 raft_consensus.cc:385] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.905267  3774 raft_consensus.cc:740] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.905916  3774 consensus_queue.cc:260] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.908238  3774 ts_tablet_manager.cc:1434] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:04.909335  3773 tablet_bootstrap.cc:654] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.909463  3774 tablet_bootstrap.cc:492] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:04.908087  3772 raft_consensus.cc:359] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.910403  3772 raft_consensus.cc:385] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.910786  3772 raft_consensus.cc:740] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.911722  3772 consensus_queue.cc:260] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.916505  3772 ts_tablet_manager.cc:1434] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:14:04.917362  3772 tablet_bootstrap.cc:492] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:04.918116  3774 tablet_bootstrap.cc:654] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.922123  3772 tablet_bootstrap.cc:654] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.926965  3773 tablet_bootstrap.cc:492] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:04.927412  3773 ts_tablet_manager.cc:1403] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.009s
I20260709 13:14:04.930393  3773 raft_consensus.cc:359] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.931104  3773 raft_consensus.cc:385] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.931391  3773 raft_consensus.cc:740] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.932150  3774 tablet_bootstrap.cc:492] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:04.932066  3773 consensus_queue.cc:260] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.933583  3774 ts_tablet_manager.cc:1403] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.001s
I20260709 13:14:04.935104  3773 ts_tablet_manager.cc:1434] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:04.936480  3773 tablet_bootstrap.cc:492] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:04.936355  3787 raft_consensus.cc:493] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.937229  3787 raft_consensus.cc:515] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.940022  3787 leader_election.cc:290] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:04.942780  3774 raft_consensus.cc:359] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.944222  3773 tablet_bootstrap.cc:654] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.943457  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:04.944495  3755 raft_consensus.cc:493] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.944250  3774 raft_consensus.cc:385] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.943638  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:04.945013  3755 raft_consensus.cc:515] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.945554  3774 raft_consensus.cc:740] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
W20260709 13:14:04.946113  3522 leader_election.cc:343] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:04.946859  3522 leader_election.cc:343] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.947293  3522 leader_election.cc:304] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8896457506f045a18c8201317192789e; no voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:04.946419  3774 consensus_queue.cc:260] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.949676  3694 raft_consensus.cc:2749] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:04.949888  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f89221e744f428014037200deb5e7" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:04.951110  3774 ts_tablet_manager.cc:1434] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:14:04.951303  3772 tablet_bootstrap.cc:492] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:04.951828  3772 ts_tablet_manager.cc:1403] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.011s
I20260709 13:14:04.952373  3774 tablet_bootstrap.cc:492] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:04.953011  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f89221e744f428014037200deb5e7" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
W20260709 13:14:04.953769  3445 leader_election.cc:343] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:04.954798  3447 leader_election.cc:343] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:04.955202  3447 leader_election.cc:304] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a; no voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:04.955127  3772 raft_consensus.cc:359] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.955968  3772 raft_consensus.cc:385] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.956264  3772 raft_consensus.cc:740] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.947289  3755 leader_election.cc:290] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:04.957163  3772 consensus_queue.cc:260] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.956387  3760 raft_consensus.cc:2749] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:04.959697  3772 ts_tablet_manager.cc:1434] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:14:04.962129  3772 tablet_bootstrap.cc:492] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:04.962316  3760 raft_consensus.cc:493] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.962932  3760 raft_consensus.cc:515] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.966603  3773 tablet_bootstrap.cc:492] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:04.967186  3773 ts_tablet_manager.cc:1403] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.011s
I20260709 13:14:04.968941  3772 tablet_bootstrap.cc:654] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.970501  3773 raft_consensus.cc:359] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.971284  3773 raft_consensus.cc:385] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.971580  3773 raft_consensus.cc:740] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.972323  3773 consensus_queue.cc:260] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.974067  3760 leader_election.cc:290] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:04.974812  3773 ts_tablet_manager.cc:1434] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:04.974771  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456e8a5728f042c6985acdd27073be61" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:04.975574  3556 raft_consensus.cc:2468] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:04.976032  3773 tablet_bootstrap.cc:492] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:04.981174  3772 tablet_bootstrap.cc:492] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:04.981727  3772 ts_tablet_manager.cc:1403] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:14:04.982555  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456e8a5728f042c6985acdd27073be61" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:04.983254  3630 raft_consensus.cc:2468] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:04.983862  3773 tablet_bootstrap.cc:654] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.984472  3774 tablet_bootstrap.cc:654] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:04.985138  3772 raft_consensus.cc:359] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.985957  3772 raft_consensus.cc:385] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:04.986253  3772 raft_consensus.cc:740] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:04.986546  3445 leader_election.cc:304] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:04.987083  3772 consensus_queue.cc:260] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:04.987706  3755 raft_consensus.cc:2804] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:04.988094  3755 raft_consensus.cc:493] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.988406  3755 raft_consensus.cc:3060] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:04.989692  3772 ts_tablet_manager.cc:1434] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:14:04.990751  3772 tablet_bootstrap.cc:492] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:04.996079  3773 tablet_bootstrap.cc:492] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:04.996750  3773 ts_tablet_manager.cc:1403] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:14:04.997478  3772 tablet_bootstrap.cc:654] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:05.005470  3773 raft_consensus.cc:359] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.006304  3773 raft_consensus.cc:385] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.006639  3773 raft_consensus.cc:740] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.007449  3773 consensus_queue.cc:260] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.009232  3772 tablet_bootstrap.cc:492] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:05.009754  3772 ts_tablet_manager.cc:1403] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:14:05.009876  3773 ts_tablet_manager.cc:1434] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:05.010035  3755 raft_consensus.cc:515] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.010970  3773 tablet_bootstrap.cc:492] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:05.013178  3755 leader_election.cc:290] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.012861  3772 raft_consensus.cc:359] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.013695  3772 raft_consensus.cc:385] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.014081  3772 raft_consensus.cc:740] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.015008  3772 consensus_queue.cc:260] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.017881  3773 tablet_bootstrap.cc:654] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:05.018442  3772 ts_tablet_manager.cc:1434] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:14:05.019464  3772 tablet_bootstrap.cc:492] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:05.023291  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456e8a5728f042c6985acdd27073be61" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.024123  3630 raft_consensus.cc:3060] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.025776  3772 tablet_bootstrap.cc:654] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:05.029145  3773 tablet_bootstrap.cc:492] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:05.029635  3773 ts_tablet_manager.cc:1403] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:14:05.032142  3773 raft_consensus.cc:359] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.032823  3773 raft_consensus.cc:385] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.033092  3773 raft_consensus.cc:740] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.033769  3773 consensus_queue.cc:260] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.035800  3773 ts_tablet_manager.cc:1434] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:05.036720  3773 tablet_bootstrap.cc:492] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019: Bootstrap starting.
I20260709 13:14:05.037163  3772 tablet_bootstrap.cc:492] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:05.037693  3772 ts_tablet_manager.cc:1403] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:14:05.038829  3630 raft_consensus.cc:2468] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:05.041378  3774 tablet_bootstrap.cc:492] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:05.041941  3774 ts_tablet_manager.cc:1403] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.090s	user 0.002s	sys 0.013s
I20260709 13:14:05.042704  3447 leader_election.cc:304] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.042974  3773 tablet_bootstrap.cc:654] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:05.044767  3774 raft_consensus.cc:359] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.045562  3774 raft_consensus.cc:385] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.046191  3755 raft_consensus.cc:2804] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.046682  3755 raft_consensus.cc:697] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:05.047204  3772 raft_consensus.cc:359] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.048060  3772 raft_consensus.cc:385] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.047600  3755 consensus_queue.cc:237] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.048485  3772 raft_consensus.cc:740] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.049256  3772 consensus_queue.cc:260] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.051838  3772 ts_tablet_manager.cc:1434] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
W20260709 13:14:05.052664  3445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:33645, user_credentials={real_user=slave}} blocked reactor thread for 60502.7us
I20260709 13:14:05.054737  3773 tablet_bootstrap.cc:492] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019: No bootstrap required, opened a new log
I20260709 13:14:05.054917  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456e8a5728f042c6985acdd27073be61" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.055234  3773 ts_tablet_manager.cc:1403] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:14:05.055562  3556 raft_consensus.cc:3060] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.052980  3772 tablet_bootstrap.cc:492] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a: Bootstrap starting.
I20260709 13:14:05.058248  3773 raft_consensus.cc:359] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.058993  3773 raft_consensus.cc:385] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.059279  3773 raft_consensus.cc:740] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.060002  3773 consensus_queue.cc:260] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.062053  3773 ts_tablet_manager.cc:1434] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:14:05.065637  3772 tablet_bootstrap.cc:654] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:05.066936  3556 raft_consensus.cc:2468] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:05.046005  3774 raft_consensus.cc:740] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.068606  3774 consensus_queue.cc:260] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.071125  3774 ts_tablet_manager.cc:1434] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:14:05.073208  3696 raft_consensus.cc:493] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.073717  3696 raft_consensus.cc:515] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.075719  3378 catalog_manager.cc:5697] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 1 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.076957  3696 leader_election.cc:290] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.077143  3772 tablet_bootstrap.cc:492] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a: No bootstrap required, opened a new log
I20260709 13:14:05.077033  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a2f22fdae842e7a369d30e4e53872b" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:05.077852  3772 ts_tablet_manager.cc:1403] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:14:05.077955  3480 raft_consensus.cc:2468] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.079434  3596 leader_election.cc:304] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.078030  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a2f22fdae842e7a369d30e4e53872b" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:05.081724  3696 raft_consensus.cc:2804] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.082221  3696 raft_consensus.cc:493] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.082581  3696 raft_consensus.cc:3060] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.080822  3772 raft_consensus.cc:359] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.085402  3694 raft_consensus.cc:493] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.085546  3772 raft_consensus.cc:385] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.086139  3772 raft_consensus.cc:740] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.086180  3694 raft_consensus.cc:515] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.087044  3772 consensus_queue.cc:260] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.089560  3772 ts_tablet_manager.cc:1434] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:14:05.090143  3696 raft_consensus.cc:515] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.091864  3696 leader_election.cc:290] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.092586  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a2f22fdae842e7a369d30e4e53872b" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.093137  3480 raft_consensus.cc:3060] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.094448  3694 leader_election.cc:290] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.094786  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a2f22fdae842e7a369d30e4e53872b" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.097537  3774 tablet_bootstrap.cc:492] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e: Bootstrap starting.
I20260709 13:14:05.097781  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83411514a9c480d87e0ac3175181e30" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:05.098713  3481 raft_consensus.cc:2468] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:05.081869  3556 raft_consensus.cc:2468] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.100860  3480 raft_consensus.cc:2468] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:05.102144  3596 leader_election.cc:304] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.105211  3755 raft_consensus.cc:493] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.105736  3755 raft_consensus.cc:515] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.107537  3774 tablet_bootstrap.cc:654] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:05.107933  3755 leader_election.cc:290] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.109753  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:05.112975  3556 raft_consensus.cc:2468] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:05.114281  3445 leader_election.cc:304] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:05.109962  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83411514a9c480d87e0ac3175181e30" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:05.115262  3755 raft_consensus.cc:2804] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.115567  3630 raft_consensus.cc:2468] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:05.115623  3755 raft_consensus.cc:493] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.116122  3755 raft_consensus.cc:3060] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.117053  3522 leader_election.cc:304] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.118901  3787 raft_consensus.cc:2804] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.119400  3787 raft_consensus.cc:493] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.119865  3787 raft_consensus.cc:3060] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.111773  3696 raft_consensus.cc:2804] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.124071  3696 raft_consensus.cc:697] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:05.125217  3696 consensus_queue.cc:237] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.123703  3755 raft_consensus.cc:515] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.128407  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.128942  3556 raft_consensus.cc:3060] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.132426  3787 raft_consensus.cc:515] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.136087  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83411514a9c480d87e0ac3175181e30" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.136718  3481 raft_consensus.cc:3060] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.138336  3787 leader_election.cc:290] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.139467  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83411514a9c480d87e0ac3175181e30" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.140049  3630 raft_consensus.cc:3060] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.140708  3774 tablet_bootstrap.cc:492] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:05.141242  3774 ts_tablet_manager.cc:1403] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.003s
I20260709 13:14:05.144230  3774 raft_consensus.cc:359] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.146374  3481 raft_consensus.cc:2468] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:05.144870  3774 raft_consensus.cc:385] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.147460  3774 raft_consensus.cc:740] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.147572  3522 leader_election.cc:304] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:05.147693  3630 raft_consensus.cc:2468] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:05.148515  3787 raft_consensus.cc:2804] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.149760  3787 raft_consensus.cc:697] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:05.150588  3787 consensus_queue.cc:237] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.150831  3774 consensus_queue.cc:260] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.151559  3696 raft_consensus.cc:493] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.152072  3696 raft_consensus.cc:515] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.152737  3774 ts_tablet_manager.cc:1434] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:14:05.153527  3774 tablet_bootstrap.cc:492] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e: Bootstrap starting.
W20260709 13:14:05.154462  3596 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.225.129:46593, user_credentials={real_user=slave}} blocked reactor thread for 52430.9us
I20260709 13:14:05.155055  3760 raft_consensus.cc:493] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.155175  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:05.155601  3760 raft_consensus.cc:515] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.154091  3696 leader_election.cc:290] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.157033  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:05.157703  3760 leader_election.cc:290] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.157864  3482 raft_consensus.cc:2393] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f38a26f090154cacb4c9ce88319b1019 in current term 1: Already voted for candidate 8a572121143a4a5aa0dc8b9998a8762a in this term.
I20260709 13:14:05.159211  3696 raft_consensus.cc:493] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.160014  3804 raft_consensus.cc:493] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.160471  3804 raft_consensus.cc:515] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.160851  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:05.161463  3774 tablet_bootstrap.cc:654] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:05.161762  3630 raft_consensus.cc:2468] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:05.162875  3804 leader_election.cc:290] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.163934  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f89221e744f428014037200deb5e7" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:05.164490  3694 raft_consensus.cc:493] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.164243  3696 raft_consensus.cc:515] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.164966  3694 raft_consensus.cc:515] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.166462  3696 leader_election.cc:290] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.167099  3694 leader_election.cc:290] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.150727  3556 raft_consensus.cc:2468] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:05.167644  3774 tablet_bootstrap.cc:492] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e: No bootstrap required, opened a new log
I20260709 13:14:05.168171  3774 ts_tablet_manager.cc:1403] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:14:05.168422  3755 leader_election.cc:290] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.168715  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:05.164498  3555 raft_consensus.cc:2468] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.169374  3630 raft_consensus.cc:2468] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:05.170651  3445 leader_election.cc:304] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:05.170919  3594 leader_election.cc:304] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.171226  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:05.170994  3774 raft_consensus.cc:359] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.171868  3804 raft_consensus.cc:493] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.172151  3522 leader_election.cc:304] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.172392  3804 raft_consensus.cc:515] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.174175  3482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:05.174629  3694 raft_consensus.cc:2804] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.175115  3482 raft_consensus.cc:2468] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 0.
I20260709 13:14:05.175184  3694 raft_consensus.cc:493] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.174482  3760 raft_consensus.cc:2804] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.175746  3694 raft_consensus.cc:3060] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.175860  3557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83838501b9c24acf831b8ed2616945a5" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:05.176183  3760 raft_consensus.cc:697] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:05.176599  3557 raft_consensus.cc:2468] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.173206  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:05.177134  3760 consensus_queue.cc:237] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.177767  3594 leader_election.cc:304] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.174269  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f89221e744f428014037200deb5e7" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:05.171926  3555 raft_consensus.cc:2468] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:05.179667  3480 raft_consensus.cc:2468] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.174415  3804 leader_election.cc:290] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.179850  3810 raft_consensus.cc:2804] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.180511  3804 raft_consensus.cc:2804] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.180732  3810 raft_consensus.cc:493] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.180893  3804 raft_consensus.cc:493] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.171861  3774 raft_consensus.cc:385] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:05.181327  3804 raft_consensus.cc:3060] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.181783  3774 raft_consensus.cc:740] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Initialized, Role: FOLLOWER
I20260709 13:14:05.172894  3378 catalog_manager.cc:5697] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 0 to 1, leader changed from <none> to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.182547  3774 consensus_queue.cc:260] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.185132  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83838501b9c24acf831b8ed2616945a5" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:05.185254  3445 leader_election.cc:304] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:05.185845  3480 raft_consensus.cc:2468] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.186142  3795 raft_consensus.cc:2804] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.186548  3795 raft_consensus.cc:493] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.186903  3795 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.181130  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:05.181327  3810 raft_consensus.cc:3060] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.189448  3596 leader_election.cc:304] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:05.188593  3481 raft_consensus.cc:2468] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.194221  3696 raft_consensus.cc:3060] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.200848  3694 raft_consensus.cc:515] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.200181  3795 raft_consensus.cc:515] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.202371  3556 raft_consensus.cc:2393] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f38a26f090154cacb4c9ce88319b1019 in current term 1: Already voted for candidate 8896457506f045a18c8201317192789e in this term.
I20260709 13:14:05.204679  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.204964  3774 ts_tablet_manager.cc:1434] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.017s
I20260709 13:14:05.205436  3555 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.203085  3804 raft_consensus.cc:515] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.207922  3804 leader_election.cc:290] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.208988  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83838501b9c24acf831b8ed2616945a5" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.201061  3810 raft_consensus.cc:515] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.209717  3556 raft_consensus.cc:3060] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.209893  3596 leader_election.cc:304] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e
I20260709 13:14:05.211650  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019" is_pre_election: true
I20260709 13:14:05.212102  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.212262  3630 raft_consensus.cc:2468] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 0.
I20260709 13:14:05.212658  3557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f89221e744f428014037200deb5e7" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.213266  3557 raft_consensus.cc:3060] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.213383  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83838501b9c24acf831b8ed2616945a5" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.214018  3481 raft_consensus.cc:3060] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.214051  3694 leader_election.cc:290] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.212668  3814 raft_consensus.cc:2804] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.215044  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.216327  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.216914  3480 raft_consensus.cc:3060] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.217923  3555 raft_consensus.cc:2468] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:05.219144  3445 leader_election.cc:304] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:05.220570  3556 raft_consensus.cc:2468] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:05.220695  3810 leader_election.cc:290] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.221319  3755 raft_consensus.cc:2804] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.225323  3795 leader_election.cc:290] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 1 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.226198  3481 raft_consensus.cc:2468] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:05.220607  3557 raft_consensus.cc:2468] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:05.228569  3594 leader_election.cc:304] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.229794  3755 raft_consensus.cc:697] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:05.228569  3378 catalog_manager.cc:5697] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 1 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.215081  3814 raft_consensus.cc:493] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.230492  3814 raft_consensus.cc:3060] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.231025  3755 consensus_queue.cc:237] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.233866  3480 raft_consensus.cc:2468] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 1.
I20260709 13:14:05.234771  3804 raft_consensus.cc:2804] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.236101  3594 leader_election.cc:304] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.238196  3810 raft_consensus.cc:2804] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.238036  3522 leader_election.cc:304] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:05.239717  3812 raft_consensus.cc:2804] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.242051  3810 raft_consensus.cc:697] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:05.243265  3810 consensus_queue.cc:237] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.240063  3377 catalog_manager.cc:5697] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 1 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.265120  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f89221e744f428014037200deb5e7" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.270843  3480 raft_consensus.cc:3060] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.236711  3696 raft_consensus.cc:2749] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:05.276795  3480 raft_consensus.cc:2468] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:05.270455  3804 raft_consensus.cc:697] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:05.278247  3812 raft_consensus.cc:697] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:05.279707  3804 consensus_queue.cc:237] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.280251  3812 consensus_queue.cc:237] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.279450  3377 catalog_manager.cc:5697] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 1 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.284006  3629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.284680  3629 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.310300  3814 raft_consensus.cc:515] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.312309  3630 raft_consensus.cc:2393] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8896457506f045a18c8201317192789e in current term 1: Already voted for candidate f38a26f090154cacb4c9ce88319b1019 in this term.
I20260709 13:14:05.313412  3696 raft_consensus.cc:493] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.314203  3696 raft_consensus.cc:515] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.318544  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.320709  3814 leader_election.cc:290] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.321822  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.323088  3481 raft_consensus.cc:2393] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f38a26f090154cacb4c9ce88319b1019 in current term 1: Already voted for candidate 8896457506f045a18c8201317192789e in this term.
I20260709 13:14:05.324352  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef057f6113348ee8616abcbe089761a" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a" is_pre_election: true
I20260709 13:14:05.325301  3480 raft_consensus.cc:2468] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.327636  3596 leader_election.cc:304] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:05.328843  3814 raft_consensus.cc:2749] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:05.329525  3596 leader_election.cc:304] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.345503  3629 raft_consensus.cc:2468] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:05.330871  3696 leader_election.cc:290] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.332623  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef057f6113348ee8616abcbe089761a" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e" is_pre_election: true
I20260709 13:14:05.337965  3631 raft_consensus.cc:2468] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 1.
I20260709 13:14:05.330718  3814 raft_consensus.cc:2804] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:05.347429  3377 catalog_manager.cc:5697] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 0 to 1, leader changed from <none> to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.359603  3556 raft_consensus.cc:2468] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 0.
I20260709 13:14:05.360126  3377 catalog_manager.cc:5697] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 0 to 1, leader changed from <none> to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.350450  3380 catalog_manager.cc:5697] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 1 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.359222  3814 raft_consensus.cc:493] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.362789  3814 raft_consensus.cc:3060] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.368163  3814 raft_consensus.cc:515] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.370043  3814 leader_election.cc:290] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:05.371212  3556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef057f6113348ee8616abcbe089761a" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.371773  3556 raft_consensus.cc:3060] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.371680  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef057f6113348ee8616abcbe089761a" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.372449  3480 raft_consensus.cc:3060] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.376344  3556 raft_consensus.cc:2468] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:05.377216  3480 raft_consensus.cc:2468] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 1.
I20260709 13:14:05.377322  3594 leader_election.cc:304] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.378281  3814 raft_consensus.cc:2804] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:05.378713  3814 raft_consensus.cc:697] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:05.379487  3814 consensus_queue.cc:237] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.388118  3380 catalog_manager.cc:5697] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 0 to 1, leader changed from <none> to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:05.432000  3556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2"
dest_uuid: "8896457506f045a18c8201317192789e"
mode: GRACEFUL
new_leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:50004
I20260709 13:14:05.432544  3556 raft_consensus.cc:606] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Received request to transfer leadership to TS 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:05.437646  3629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ef057f6113348ee8616abcbe089761a"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
mode: GRACEFUL
new_leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:46484
I20260709 13:14:05.438205  3629 raft_consensus.cc:606] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Received request to transfer leadership to TS 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:05.445312  3556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b83411514a9c480d87e0ac3175181e30"
dest_uuid: "8896457506f045a18c8201317192789e"
mode: GRACEFUL
new_leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:50004
I20260709 13:14:05.445750  3556 raft_consensus.cc:606] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Received request to transfer leadership to TS 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:05.450284  3629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa7f89221e744f428014037200deb5e7"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
mode: GRACEFUL
new_leader_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:46484
I20260709 13:14:05.450763  3629 raft_consensus.cc:606] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Received request to transfer leadership to TS 8896457506f045a18c8201317192789e
I20260709 13:14:05.466590  3480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
mode: GRACEFUL
new_leader_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:54552
I20260709 13:14:05.467089  3480 raft_consensus.cc:606] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Received request to transfer leadership to TS 8896457506f045a18c8201317192789e
I20260709 13:14:05.471738  3480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
mode: GRACEFUL
new_leader_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:54552
I20260709 13:14:05.472183  3480 raft_consensus.cc:606] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Received request to transfer leadership to TS 8896457506f045a18c8201317192789e
I20260709 13:14:05.477245  3629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a2f22fdae842e7a369d30e4e53872b"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
mode: GRACEFUL
new_leader_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:46484
I20260709 13:14:05.477872  3629 raft_consensus.cc:606] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Received request to transfer leadership to TS 8896457506f045a18c8201317192789e
I20260709 13:14:05.532757  3556 raft_consensus.cc:3060] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:05.538370  3814 consensus_queue.cc:1048] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.544754  3696 raft_consensus.cc:993] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019: : Instructing follower 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:05.545272  3810 raft_consensus.cc:1081] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Signalling peer 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:05.547108  3557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22a2f22fdae842e7a369d30e4e53872b"
dest_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:49984
I20260709 13:14:05.549834  3557 raft_consensus.cc:493] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.550233  3557 raft_consensus.cc:3060] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.556102  3557 raft_consensus.cc:515] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.560465  3814 consensus_queue.cc:1048] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:05.566155  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a2f22fdae842e7a369d30e4e53872b" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.569535  3557 leader_election.cc:290] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.571105  3629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a2f22fdae842e7a369d30e4e53872b" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.571780  3629 raft_consensus.cc:3055] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.572085  3629 raft_consensus.cc:740] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:05.573124  3629 consensus_queue.cc:260] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.574407  3629 raft_consensus.cc:3060] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.579938  3629 raft_consensus.cc:2468] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:05.580914  3522 leader_election.cc:304] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:05.581782  3812 raft_consensus.cc:2804] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.582175  3812 raft_consensus.cc:697] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 2 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:05.582882  3812 consensus_queue.cc:237] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.589335  3380 catalog_manager.cc:5697] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e reported cstate change: term changed from 1 to 2, leader changed from f38a26f090154cacb4c9ce88319b1019 (127.22.225.131) to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 2 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.605471  3812 consensus_queue.cc:1048] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.616122  3787 consensus_queue.cc:1048] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.623843  3815 consensus_queue.cc:1048] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.624356  3819 raft_consensus.cc:993] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: : Instructing follower 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:05.624851  3819 raft_consensus.cc:1081] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Signalling peer 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:05.625254  3755 consensus_queue.cc:1048] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.626724  3481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b83411514a9c480d87e0ac3175181e30"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:38924
I20260709 13:14:05.627317  3481 raft_consensus.cc:493] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.628969  3481 raft_consensus.cc:3060] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.644064  3795 consensus_queue.cc:1048] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:05.647704  3755 consensus_queue.cc:1048] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.648279  3481 raft_consensus.cc:515] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.652189  3555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83411514a9c480d87e0ac3175181e30" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.652812  3555 raft_consensus.cc:3055] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.654656  3555 raft_consensus.cc:740] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:05.655670  3555 consensus_queue.cc:260] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.658159  3555 raft_consensus.cc:3060] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.653746  3481 leader_election.cc:290] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.668855  3795 raft_consensus.cc:993] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a: : Instructing follower 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:05.669358  3795 raft_consensus.cc:1081] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Signalling peer 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:05.671165  3554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160"
dest_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:50000
I20260709 13:14:05.671515  3555 raft_consensus.cc:2468] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 2.
I20260709 13:14:05.671751  3554 raft_consensus.cc:493] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.672830  3445 leader_election.cc:304] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: 
I20260709 13:14:05.672245  3554 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.673825  3755 raft_consensus.cc:2804] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.674417  3755 raft_consensus.cc:697] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:05.675272  3755 consensus_queue.cc:237] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.680063  3629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b83411514a9c480d87e0ac3175181e30" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.680763  3629 raft_consensus.cc:3060] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.684393  3554 raft_consensus.cc:515] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.686652  3554 leader_election.cc:290] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.687453  3629 raft_consensus.cc:2468] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 2.
I20260709 13:14:05.687844  3630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.688501  3630 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.694234  3481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.694872  3481 raft_consensus.cc:3055] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.695180  3481 raft_consensus.cc:740] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:05.696082  3481 consensus_queue.cc:260] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.698138  3819 consensus_queue.cc:1048] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.697296  3378 catalog_manager.cc:5697] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 1 to 2, leader changed from 8896457506f045a18c8201317192789e (127.22.225.130) to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 2 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.697382  3481 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.701905  3630 raft_consensus.cc:2468] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:05.703259  3522 leader_election.cc:304] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:05.707677  3815 consensus_queue.cc:1048] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.709843  3819 raft_consensus.cc:2804] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.710371  3819 raft_consensus.cc:697] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:05.711190  3819 consensus_queue.cc:237] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.715699  3819 raft_consensus.cc:993] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e: : Instructing follower 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:05.716105  3819 raft_consensus.cc:1081] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Signalling peer 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:05.719758  3482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:38924
I20260709 13:14:05.720314  3482 raft_consensus.cc:493] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.720657  3482 raft_consensus.cc:3060] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.722044  3694 consensus_queue.cc:1048] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.722501  3760 raft_consensus.cc:993] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a: : Instructing follower 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:05.723003  3760 raft_consensus.cc:1081] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Signalling peer 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:05.729532  3554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62"
dest_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:50000
I20260709 13:14:05.728224  3481 raft_consensus.cc:2468] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:05.730139  3554 raft_consensus.cc:493] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.730548  3554 raft_consensus.cc:3060] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.731698  3378 catalog_manager.cc:5697] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e reported cstate change: term changed from 1 to 2, leader changed from 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129) to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 2 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.734407  3795 consensus_queue.cc:1048] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.735296  3482 raft_consensus.cc:515] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.737505  3480 raft_consensus.cc:1240] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Rejecting Update request from peer 8896457506f045a18c8201317192789e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.737603  3554 raft_consensus.cc:515] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.739749  3554 leader_election.cc:290] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.741168  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.741746  3694 consensus_queue.cc:1059] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.742548  3694 raft_consensus.cc:3055] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.742866  3694 raft_consensus.cc:740] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:05.743477  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dcd97cbad9e4d1fbd4b6cfc5ee30b62" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.744059  3480 raft_consensus.cc:3055] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.743630  3694 consensus_queue.cc:260] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.744361  3480 raft_consensus.cc:740] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:05.744643  3694 raft_consensus.cc:3060] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.746457  3814 consensus_queue.cc:1048] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.750319  3482 leader_election.cc:290] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.745270  3480 consensus_queue.cc:260] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.752310  3631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.752625  3554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eccd04f06354585b4e48b6083303bf2" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.755561  3480 raft_consensus.cc:3060] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.760462  3814 consensus_queue.cc:1048] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.768632  3554 raft_consensus.cc:2468] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 2.
I20260709 13:14:05.770406  3445 leader_election.cc:304] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:05.771256  3795 raft_consensus.cc:2804] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.772009  3480 raft_consensus.cc:2468] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:05.773285  3795 raft_consensus.cc:697] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:05.775774  3522 leader_election.cc:304] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8896457506f045a18c8201317192789e, 8a572121143a4a5aa0dc8b9998a8762a; no voters: f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:05.775651  3795 consensus_queue.cc:237] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.777506  3694 raft_consensus.cc:2804] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.778183  3694 raft_consensus.cc:697] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:05.779090  3694 consensus_queue.cc:237] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.791572  3696 consensus_queue.cc:1048] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:05.792999  3696 raft_consensus.cc:993] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019: : Instructing follower 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:05.797394  3810 raft_consensus.cc:1081] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Signalling peer 8896457506f045a18c8201317192789e to start an election
I20260709 13:14:05.799357  3554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa7f89221e744f428014037200deb5e7"
dest_uuid: "8896457506f045a18c8201317192789e"
 from {username='slave'} at 127.0.0.1:49984
I20260709 13:14:05.799924  3554 raft_consensus.cc:493] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.800280  3554 raft_consensus.cc:3060] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.800110  3380 catalog_manager.cc:5697] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e reported cstate change: term changed from 1 to 2, leader changed from 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129) to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 2 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.804510  3810 consensus_queue.cc:1048] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.808065  3554 raft_consensus.cc:515] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.811304  3480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f89221e744f428014037200deb5e7" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:05.814237  3629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7f89221e744f428014037200deb5e7" candidate_uuid: "8896457506f045a18c8201317192789e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.814811  3629 raft_consensus.cc:3055] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.815133  3629 raft_consensus.cc:740] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:05.815901  3629 consensus_queue.cc:260] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.816617  3554 leader_election.cc:290] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.815538  3378 catalog_manager.cc:5697] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 1 to 2, leader changed from 8896457506f045a18c8201317192789e (127.22.225.130) to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 2 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.816886  3629 raft_consensus.cc:3060] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.823732  3629 raft_consensus.cc:2468] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8896457506f045a18c8201317192789e in term 2.
I20260709 13:14:05.824754  3522 leader_election.cc:304] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 8a572121143a4a5aa0dc8b9998a8762a
I20260709 13:14:05.825722  3694 raft_consensus.cc:2804] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.826208  3694 raft_consensus.cc:697] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Becoming Leader. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:05.827031  3694 consensus_queue.cc:237] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.836284  3377 catalog_manager.cc:5697] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e reported cstate change: term changed from 1 to 2, leader changed from f38a26f090154cacb4c9ce88319b1019 (127.22.225.131) to 8896457506f045a18c8201317192789e (127.22.225.130). New cstate: current_term: 2 leader_uuid: "8896457506f045a18c8201317192789e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:05.846349  3804 consensus_queue.cc:1048] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.852674  3810 raft_consensus.cc:993] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019: : Instructing follower 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:05.853152  3810 raft_consensus.cc:1081] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Signalling peer 8a572121143a4a5aa0dc8b9998a8762a to start an election
I20260709 13:14:05.854799  3480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ef057f6113348ee8616abcbe089761a"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
 from {username='slave'} at 127.0.0.1:38934
I20260709 13:14:05.855340  3480 raft_consensus.cc:493] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:05.855671  3480 raft_consensus.cc:3060] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.857683  3696 consensus_queue.cc:1048] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.861824  3480 raft_consensus.cc:515] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.864518  3481 raft_consensus.cc:1240] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Rejecting Update request from peer f38a26f090154cacb4c9ce88319b1019 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:05.864691  3557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef057f6113348ee8616abcbe089761a" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:05.865056  3629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef057f6113348ee8616abcbe089761a" candidate_uuid: "8a572121143a4a5aa0dc8b9998a8762a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
I20260709 13:14:05.865747  3629 raft_consensus.cc:3055] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:05.866053  3629 raft_consensus.cc:740] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:05.866811  3810 consensus_queue.cc:1059] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:05.867034  3480 leader_election.cc:290] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Requested vote from peers 8896457506f045a18c8201317192789e (127.22.225.130:33645), f38a26f090154cacb4c9ce88319b1019 (127.22.225.131:39821)
I20260709 13:14:05.867796  3629 consensus_queue.cc:260] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.868863  3629 raft_consensus.cc:3060] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:05.874979  3629 raft_consensus.cc:2468] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8a572121143a4a5aa0dc8b9998a8762a in term 2.
W20260709 13:14:05.875370  3696 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:14:05.875943  3447 leader_election.cc:304] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 8896457506f045a18c8201317192789e
I20260709 13:14:05.876864  3795 raft_consensus.cc:2804] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:05.877403  3795 raft_consensus.cc:697] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Becoming Leader. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:05.878176  3795 consensus_queue.cc:237] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:05.885210  3377 catalog_manager.cc:5697] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a reported cstate change: term changed from 1 to 2, leader changed from f38a26f090154cacb4c9ce88319b1019 (127.22.225.131) to 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129). New cstate: current_term: 2 leader_uuid: "8a572121143a4a5aa0dc8b9998a8762a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.003602  3480 raft_consensus.cc:3060] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:06.008404  3480 raft_consensus.cc:1275] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.009651  3694 consensus_queue.cc:1048] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.017975  3629 raft_consensus.cc:1275] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.020232  3787 consensus_queue.cc:1048] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.180823  3554 raft_consensus.cc:1275] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.182268  3760 consensus_queue.cc:1048] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.189947  3629 raft_consensus.cc:3060] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:06.197038  3480 raft_consensus.cc:1275] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.197278  3629 raft_consensus.cc:1275] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.198536  3787 consensus_queue.cc:1048] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.198504  3760 consensus_queue.cc:1048] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.205780  3629 raft_consensus.cc:3060] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:06.214401  3629 raft_consensus.cc:1275] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.215557  3812 consensus_queue.cc:1048] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.241225  3629 raft_consensus.cc:1275] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.242539  3760 consensus_queue.cc:1048] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.249960  3554 raft_consensus.cc:1275] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.252097  3755 consensus_queue.cc:1048] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.267525  3629 raft_consensus.cc:1275] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.268610  3812 consensus_queue.cc:1048] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.275451  3480 raft_consensus.cc:1275] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.276827  3694 consensus_queue.cc:1048] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.282128  3629 raft_consensus.cc:1275] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.283453  3694 consensus_queue.cc:1048] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.290647  3480 raft_consensus.cc:3060] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:06.298276  3630 raft_consensus.cc:1275] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.299693  3755 consensus_queue.cc:1048] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.301544  3480 raft_consensus.cc:1275] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer 8896457506f045a18c8201317192789e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.302944  3694 consensus_queue.cc:1048] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:06.311009  3554 raft_consensus.cc:3060] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:06.318478  3554 raft_consensus.cc:1275] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Refusing update from remote peer 8a572121143a4a5aa0dc8b9998a8762a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:06.319658  3755 consensus_queue.cc:1048] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:08.483695  3380 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41342:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:08.501499  3380 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41342:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:08.580680 23430 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:14:08.766713  3892 tablet.cc:1724] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:08.771610  3898 tablet.cc:1724] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:08.779479  3883 log.cc:927] Time spent T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:14:08.686708  3879 tablet.cc:1724] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:08.846318  3893 log.cc:927] Time spent T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:14:08.880048  3905 tablet.cc:1724] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:08.802075  3891 tablet.cc:1724] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:08.853377  3900 tablet.cc:1724] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:08.907140  3583 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1eccd04f06354585b4e48b6083303bf2)
W20260709 13:14:08.924984  3522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:46593, user_credentials={real_user=slave}} blocked reactor thread for 74348.1us
W20260709 13:14:08.913897  3583 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:1eccd04f06354585b4e48b6083303bf2)
W20260709 13:14:08.937937  3583 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:1eccd04f06354585b4e48b6083303bf2)
I20260709 13:14:08.951999  3916 tablet.cc:1724] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:08.960474  3914 tablet.cc:1724] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:08.981957  3909 log.cc:927] Time spent T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:08.913895  3910 tablet.cc:1724] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:09.010812  3522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:46593, user_credentials={real_user=slave}} blocked reactor thread for 52526.1us
I20260709 13:14:09.020965  3480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "456e8a5728f042c6985acdd27073be61"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
mode: GRACEFUL
new_leader_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:54564
I20260709 13:14:09.021632  3480 raft_consensus.cc:606] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Received request to transfer leadership to TS f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:09.022957  3905 tablet.cc:1724] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.029317  3913 tablet.cc:1724] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.053035  3900 tablet.cc:1724] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.065941  3892 tablet.cc:1724] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.066344  3898 tablet.cc:1724] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.038852  3905 tablet.cc:1724] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.083695  3891 tablet.cc:1724] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.085529  3916 tablet.cc:1724] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:09.086707  3522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:46593, user_credentials={real_user=slave}} blocked reactor thread for 67999.7us
I20260709 13:14:09.088294  3879 tablet.cc:1724] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.090497  3919 tablet.cc:1724] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.104939  3925 tablet.cc:1724] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.123977  3898 tablet.cc:1724] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.125820  3913 tablet.cc:1724] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.132665  3914 tablet.cc:1724] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.135056  3891 tablet.cc:1724] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.154877  3925 tablet.cc:1724] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.139392  3900 tablet.cc:1724] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.142467  3910 tablet.cc:1724] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:09.196516  3553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160"
dest_uuid: "8896457506f045a18c8201317192789e"
mode: GRACEFUL
new_leader_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:48046
I20260709 13:14:09.197052  3553 raft_consensus.cc:606] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Received request to transfer leadership to TS f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:09.198302 23430 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:14:09.198873 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:09.199028  3377 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9: soft_deleted_table [id=0d57d5215e9c4ba79835b17bfecbd5f8] alter complete (version 1)
I20260709 13:14:09.208688  3479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "398e000912b348938027ed51ba5e9948"
dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
mode: GRACEFUL
new_leader_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:54564
I20260709 13:14:09.209318  3479 raft_consensus.cc:606] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Received request to transfer leadership to TS f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:09.211946  3553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d"
dest_uuid: "8896457506f045a18c8201317192789e"
mode: GRACEFUL
new_leader_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:48046
I20260709 13:14:09.212554  3553 raft_consensus.cc:606] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 2 LEADER]: Received request to transfer leadership to TS f38a26f090154cacb4c9ce88319b1019
I20260709 13:14:09.213689 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:09.214129 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:09.262653  3889 raft_consensus.cc:993] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a: : Instructing follower f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:09.263268  3888 raft_consensus.cc:1081] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Signalling peer f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:09.264708  3625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "456e8a5728f042c6985acdd27073be61"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:46480
I20260709 13:14:09.265226  3625 raft_consensus.cc:493] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:09.265575  3625 raft_consensus.cc:3060] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:09.270723  3625 raft_consensus.cc:515] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.272410  3625 leader_election.cc:290] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:09.273178  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456e8a5728f042c6985acdd27073be61" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:09.273474  3557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "456e8a5728f042c6985acdd27073be61" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:09.273828  3479 raft_consensus.cc:3055] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:09.274111  3557 raft_consensus.cc:3060] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:09.274228  3479 raft_consensus.cc:740] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:09.275205  3479 consensus_queue.cc:260] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.276186  3479 raft_consensus.cc:3060] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:09.280323  3557 raft_consensus.cc:2468] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 2.
I20260709 13:14:09.281421  3594 leader_election.cc:304] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:09.282305  3922 raft_consensus.cc:2804] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:09.282363  3479 raft_consensus.cc:2468] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 2.
I20260709 13:14:09.282739  3922 raft_consensus.cc:697] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 2 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:09.283557  3922 consensus_queue.cc:237] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.290092  3379 catalog_manager.cc:5697] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 1 to 2, leader changed from 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129) to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.379113  3927 raft_consensus.cc:993] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e: : Instructing follower f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:09.379734  3920 raft_consensus.cc:1081] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 2 LEADER]: Signalling peer f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:09.381421  3625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:46478
I20260709 13:14:09.381893  3625 raft_consensus.cc:493] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:09.382202  3625 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.387550  3625 raft_consensus.cc:515] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.389350  3625 leader_election.cc:290] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 3 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:09.390210  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:09.390897  3479 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.391402  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb37472dca84bb68e5a8c29f6aa391d" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:09.392020  3553 raft_consensus.cc:3055] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:09.392341  3553 raft_consensus.cc:740] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:09.393066  3553 consensus_queue.cc:260] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.394061  3553 raft_consensus.cc:3060] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.396205  3479 raft_consensus.cc:2468] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 3.
I20260709 13:14:09.397300  3596 leader_election.cc:304] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:09.397936  3922 raft_consensus.cc:2804] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:09.398350  3922 raft_consensus.cc:697] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 3 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:09.399127  3922 consensus_queue.cc:237] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.399297  3553 raft_consensus.cc:2468] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 3.
I20260709 13:14:09.405632  3379 catalog_manager.cc:5697] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 2 to 3, leader changed from 8896457506f045a18c8201317192789e (127.22.225.130) to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.513800  3927 raft_consensus.cc:993] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e: : Instructing follower f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:09.514278  3920 raft_consensus.cc:1081] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Signalling peer f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:09.515627  3625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:46478
I20260709 13:14:09.516050  3625 raft_consensus.cc:493] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:09.516305  3625 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.521373  3625 raft_consensus.cc:515] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.523041  3625 leader_election.cc:290] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 3 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:09.524084  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:09.524176  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fbef5d9c42943fdb5657c68965d8160" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:09.524714  3553 raft_consensus.cc:3055] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:09.524801  3479 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.525018  3553 raft_consensus.cc:740] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8896457506f045a18c8201317192789e, State: Running, Role: LEADER
I20260709 13:14:09.525838  3553 consensus_queue.cc:260] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.526893  3553 raft_consensus.cc:3060] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:09.531040  3479 raft_consensus.cc:2468] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 3.
I20260709 13:14:09.532413  3596 leader_election.cc:304] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a572121143a4a5aa0dc8b9998a8762a, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:09.533200  3553 raft_consensus.cc:2468] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 3.
I20260709 13:14:09.533242  3922 raft_consensus.cc:2804] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:09.533883  3922 raft_consensus.cc:697] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 3 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:09.534686  3922 consensus_queue.cc:237] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.540910  3379 catalog_manager.cc:5697] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 2 to 3, leader changed from 8896457506f045a18c8201317192789e (127.22.225.130) to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.663267  3889 raft_consensus.cc:993] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a: : Instructing follower f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:09.663714  3888 raft_consensus.cc:1081] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Signalling peer f38a26f090154cacb4c9ce88319b1019 to start an election
I20260709 13:14:09.665136  3625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "398e000912b348938027ed51ba5e9948"
dest_uuid: "f38a26f090154cacb4c9ce88319b1019"
 from {username='slave'} at 127.0.0.1:46480
I20260709 13:14:09.665604  3625 raft_consensus.cc:493] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:09.665918  3625 raft_consensus.cc:3060] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:09.670765  3625 raft_consensus.cc:515] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.672293  3625 leader_election.cc:290] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 2 election: Requested vote from peers 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593), 8896457506f045a18c8201317192789e (127.22.225.130:33645)
I20260709 13:14:09.673208  3479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398e000912b348938027ed51ba5e9948" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8a572121143a4a5aa0dc8b9998a8762a"
I20260709 13:14:09.673972  3479 raft_consensus.cc:3055] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:09.674216  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398e000912b348938027ed51ba5e9948" candidate_uuid: "f38a26f090154cacb4c9ce88319b1019" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8896457506f045a18c8201317192789e"
I20260709 13:14:09.674405  3479 raft_consensus.cc:740] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8a572121143a4a5aa0dc8b9998a8762a, State: Running, Role: LEADER
I20260709 13:14:09.675024  3553 raft_consensus.cc:3060] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:09.675477  3479 consensus_queue.cc:260] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.677014  3479 raft_consensus.cc:3060] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:09.683063  3553 raft_consensus.cc:2468] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 2.
I20260709 13:14:09.684280  3594 leader_election.cc:304] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8896457506f045a18c8201317192789e, f38a26f090154cacb4c9ce88319b1019; no voters: 
I20260709 13:14:09.684530  3479 raft_consensus.cc:2468] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f38a26f090154cacb4c9ce88319b1019 in term 2.
I20260709 13:14:09.684957  3922 raft_consensus.cc:2804] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:09.685511  3922 raft_consensus.cc:697] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 2 LEADER]: Becoming Leader. State: Replica: f38a26f090154cacb4c9ce88319b1019, State: Running, Role: LEADER
I20260709 13:14:09.686411  3922 consensus_queue.cc:237] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } }
I20260709 13:14:09.693400  3379 catalog_manager.cc:5697] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 reported cstate change: term changed from 1 to 2, leader changed from 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129) to f38a26f090154cacb4c9ce88319b1019 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "f38a26f090154cacb4c9ce88319b1019" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f38a26f090154cacb4c9ce88319b1019" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 39821 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:09.798292  3553 raft_consensus.cc:1275] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 3 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:09.799686  3922 consensus_queue.cc:1048] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.809387  3479 raft_consensus.cc:1275] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 3 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:09.811247  3936 consensus_queue.cc:1048] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.854534  3557 raft_consensus.cc:1275] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:09.854544  3479 raft_consensus.cc:1275] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:14:09.856063  3922 consensus_queue.cc:1048] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:09.856621  3936 consensus_queue.cc:1048] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:10.081821  3557 raft_consensus.cc:1275] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 3 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:10.083288  3848 consensus_queue.cc:1048] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.088195  3479 raft_consensus.cc:1275] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 3 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:14:10.090673  3922 consensus_queue.cc:1048] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:10.102931  3557 raft_consensus.cc:1275] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:10.104431  3848 consensus_queue.cc:1048] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8896457506f045a18c8201317192789e" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 33645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.117486  3479 raft_consensus.cc:1275] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Refusing update from remote peer f38a26f090154cacb4c9ce88319b1019: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:10.119645  3936 consensus_queue.cc:1048] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a572121143a4a5aa0dc8b9998a8762a" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:10.266268 23430 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:14:10.272006 23430 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:14:10.272584 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:10.279167 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:14:10.279557 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:11.307225 23430 tablet_server.cc:179] TabletServer@127.22.225.129:0 shutting down...
I20260709 13:14:11.335572 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:11.336249 23430 tablet_replica.cc:333] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.336871 23430 raft_consensus.cc:2243] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.337713 23430 raft_consensus.cc:2272] T 3ef057f6113348ee8616abcbe089761a P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.339596 23430 tablet_replica.cc:333] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.340162 23430 raft_consensus.cc:2243] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.340916 23430 raft_consensus.cc:2272] T b83411514a9c480d87e0ac3175181e30 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.342880 23430 tablet_replica.cc:333] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.343427 23430 raft_consensus.cc:2243] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.343905 23430 raft_consensus.cc:2272] T 22a2f22fdae842e7a369d30e4e53872b P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.345686 23430 tablet_replica.cc:333] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.346519 23430 raft_consensus.cc:2243] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.347029 23430 raft_consensus.cc:2272] T 83838501b9c24acf831b8ed2616945a5 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.349349 23430 tablet_replica.cc:333] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.349924 23430 raft_consensus.cc:2243] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.350379 23430 raft_consensus.cc:2272] T 9fbef5d9c42943fdb5657c68965d8160 P 8a572121143a4a5aa0dc8b9998a8762a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.352550 23430 tablet_replica.cc:333] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.353154 23430 raft_consensus.cc:2243] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.353940 23430 raft_consensus.cc:2272] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.356094 23430 tablet_replica.cc:333] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.356959 23430 raft_consensus.cc:2243] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.357481 23430 raft_consensus.cc:2272] T aa7f89221e744f428014037200deb5e7 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.359053 23430 tablet_replica.cc:333] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.359531 23430 raft_consensus.cc:2243] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.359903 23430 raft_consensus.cc:2272] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.361701 23430 tablet_replica.cc:333] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.362174 23430 raft_consensus.cc:2243] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.362857 23430 raft_consensus.cc:2272] T 3490e0e10b8048e2804f811413edf1de P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.364951 23430 tablet_replica.cc:333] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.365501 23430 raft_consensus.cc:2243] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.365890 23430 raft_consensus.cc:2272] T 3883e1cebd1b420ea07c6580db6006bb P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.367808 23430 tablet_replica.cc:333] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.368283 23430 raft_consensus.cc:2243] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.368922 23430 raft_consensus.cc:2272] T 1eccd04f06354585b4e48b6083303bf2 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.370646 23430 tablet_replica.cc:333] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.371191 23430 raft_consensus.cc:2243] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.371584 23430 raft_consensus.cc:2272] T a100cd4f1d874db29dbbe65f37a1d8ed P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.373548 23430 tablet_replica.cc:333] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.374122 23430 raft_consensus.cc:2243] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.374481 23430 raft_consensus.cc:2272] T fdb37472dca84bb68e5a8c29f6aa391d P 8a572121143a4a5aa0dc8b9998a8762a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.376245 23430 tablet_replica.cc:333] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.376694 23430 raft_consensus.cc:2243] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.377044 23430 raft_consensus.cc:2272] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:11.379243  3596 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 13:14:11.379314 23430 tablet_replica.cc:333] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.380239 23430 raft_consensus.cc:2243] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.380754 23430 raft_consensus.cc:2272] T c61c6dfd18d344939f230997d7e4a4e2 P 8a572121143a4a5aa0dc8b9998a8762a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:11.382974  3596 consensus_peers.cc:597] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 -> Peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Couldn't send request to peer 8a572121143a4a5aa0dc8b9998a8762a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.383700 23430 tablet_replica.cc:333] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.384274 23430 raft_consensus.cc:2243] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:11.384358  3522 consensus_peers.cc:597] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e -> Peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Couldn't send request to peer 8a572121143a4a5aa0dc8b9998a8762a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.384722 23430 raft_consensus.cc:2272] T 398e000912b348938027ed51ba5e9948 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.386804 23430 tablet_replica.cc:333] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.387296 23430 raft_consensus.cc:2243] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.387722 23430 raft_consensus.cc:2272] T 456e8a5728f042c6985acdd27073be61 P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.389488 23430 tablet_replica.cc:333] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a: stopping tablet replica
I20260709 13:14:11.389988 23430 raft_consensus.cc:2243] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.390710 23430 raft_consensus.cc:2272] T b514773e7047432aa818545c7c9e712e P 8a572121143a4a5aa0dc8b9998a8762a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:11.408550  3596 consensus_peers.cc:597] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 -> Peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Couldn't send request to peer 8a572121143a4a5aa0dc8b9998a8762a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.429054 23430 tablet_server.cc:196] TabletServer@127.22.225.129:0 shutdown complete.
I20260709 13:14:11.458077 23430 tablet_server.cc:179] TabletServer@127.22.225.130:0 shutting down...
I20260709 13:14:11.487272 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:11.488093 23430 tablet_replica.cc:333] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.488932 23430 raft_consensus.cc:2243] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.489446 23430 raft_consensus.cc:2272] T 3ef057f6113348ee8616abcbe089761a P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.491482 23430 tablet_replica.cc:333] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.492077 23430 raft_consensus.cc:2243] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.492548 23430 raft_consensus.cc:2272] T b83411514a9c480d87e0ac3175181e30 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:11.493825  3594 consensus_peers.cc:597] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 -> Peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Couldn't send request to peer 8896457506f045a18c8201317192789e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.494588 23430 tablet_replica.cc:333] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.495187 23430 raft_consensus.cc:2243] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.495597 23430 raft_consensus.cc:2272] T a100cd4f1d874db29dbbe65f37a1d8ed P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.497556 23430 tablet_replica.cc:333] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.498173 23430 raft_consensus.cc:2243] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.498755 23430 raft_consensus.cc:2272] T 1eccd04f06354585b4e48b6083303bf2 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.500636 23430 tablet_replica.cc:333] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.501240 23430 raft_consensus.cc:2243] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.501943 23430 raft_consensus.cc:2272] T 22a2f22fdae842e7a369d30e4e53872b P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.503952 23430 tablet_replica.cc:333] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.504529 23430 raft_consensus.cc:2243] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.505018 23430 raft_consensus.cc:2272] T 3490e0e10b8048e2804f811413edf1de P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.507009 23430 tablet_replica.cc:333] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.507566 23430 raft_consensus.cc:2243] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.508275 23430 raft_consensus.cc:2272] T aa7f89221e744f428014037200deb5e7 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.509964 23430 tablet_replica.cc:333] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.510495 23430 raft_consensus.cc:2243] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.510892 23430 raft_consensus.cc:2272] T 83838501b9c24acf831b8ed2616945a5 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.512478 23430 tablet_replica.cc:333] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.512974 23430 raft_consensus.cc:2243] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.513387 23430 raft_consensus.cc:2272] T 9fbef5d9c42943fdb5657c68965d8160 P 8896457506f045a18c8201317192789e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.514938 23430 tablet_replica.cc:333] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.515462 23430 raft_consensus.cc:2243] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.515884 23430 raft_consensus.cc:2272] T ec8b3ddeb76d4b629bdfecd77945d9b5 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.517735 23430 tablet_replica.cc:333] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.518227 23430 raft_consensus.cc:2243] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.518936 23430 raft_consensus.cc:2272] T 3883e1cebd1b420ea07c6580db6006bb P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.520862 23430 tablet_replica.cc:333] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.521371 23430 raft_consensus.cc:2243] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.522054 23430 raft_consensus.cc:2272] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.523677 23430 tablet_replica.cc:333] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.524349 23430 raft_consensus.cc:2243] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.524984 23430 raft_consensus.cc:2272] T 398e000912b348938027ed51ba5e9948 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.527382 23430 tablet_replica.cc:333] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e: stopping tablet replica
W20260709 13:14:11.527850  3522 consensus_peers.cc:597] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e -> Peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Couldn't send request to peer 8a572121143a4a5aa0dc8b9998a8762a. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:46593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.528051 23430 raft_consensus.cc:2243] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.528910 23430 raft_consensus.cc:2272] T c61c6dfd18d344939f230997d7e4a4e2 P 8896457506f045a18c8201317192789e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.530893 23430 tablet_replica.cc:333] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.531414 23430 raft_consensus.cc:2243] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.531793 23430 raft_consensus.cc:2272] T fdb37472dca84bb68e5a8c29f6aa391d P 8896457506f045a18c8201317192789e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.533624 23430 tablet_replica.cc:333] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.534124 23430 raft_consensus.cc:2243] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.534863 23430 raft_consensus.cc:2272] T aae3fb4e7a0c4517b854f6b57767e4c4 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.536792 23430 tablet_replica.cc:333] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.537330 23430 raft_consensus.cc:2243] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.537763 23430 raft_consensus.cc:2272] T 456e8a5728f042c6985acdd27073be61 P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.539446 23430 tablet_replica.cc:333] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e: stopping tablet replica
I20260709 13:14:11.539906 23430 raft_consensus.cc:2243] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.540330 23430 raft_consensus.cc:2272] T b514773e7047432aa818545c7c9e712e P 8896457506f045a18c8201317192789e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:11.544234  3594 consensus_peers.cc:597] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 -> Peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Couldn't send request to peer 8896457506f045a18c8201317192789e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.581447 23430 tablet_server.cc:196] TabletServer@127.22.225.130:0 shutdown complete.
W20260709 13:14:11.592631  3594 consensus_peers.cc:597] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 -> Peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Couldn't send request to peer 8896457506f045a18c8201317192789e. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:11.601003  3596 consensus_peers.cc:597] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 -> Peer 8a572121143a4a5aa0dc8b9998a8762a (127.22.225.129:46593): Couldn't send request to peer 8a572121143a4a5aa0dc8b9998a8762a. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:46593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.614176 23430 tablet_server.cc:179] TabletServer@127.22.225.131:0 shutting down...
I20260709 13:14:11.640821 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:11.641544 23430 tablet_replica.cc:333] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.642171 23430 raft_consensus.cc:2243] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.642660 23430 raft_consensus.cc:2272] T 3ef057f6113348ee8616abcbe089761a P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.644573 23430 tablet_replica.cc:333] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.645169 23430 raft_consensus.cc:2243] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.645587 23430 raft_consensus.cc:2272] T 22a2f22fdae842e7a369d30e4e53872b P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.647282 23430 tablet_replica.cc:333] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.647823 23430 raft_consensus.cc:2243] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.648258 23430 raft_consensus.cc:2272] T b83411514a9c480d87e0ac3175181e30 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.650096 23430 tablet_replica.cc:333] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.650621 23430 raft_consensus.cc:2243] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.651373 23430 raft_consensus.cc:2272] T a100cd4f1d874db29dbbe65f37a1d8ed P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.653236 23430 tablet_replica.cc:333] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.653738 23430 raft_consensus.cc:2243] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.654139 23430 raft_consensus.cc:2272] T 1eccd04f06354585b4e48b6083303bf2 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.656195 23430 tablet_replica.cc:333] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.656929 23430 raft_consensus.cc:2243] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.658082 23430 raft_consensus.cc:2272] T 5dcd97cbad9e4d1fbd4b6cfc5ee30b62 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:11.659566  3594 consensus_peers.cc:597] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 -> Peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Couldn't send request to peer 8896457506f045a18c8201317192789e. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.660209 23430 tablet_replica.cc:333] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.660760 23430 raft_consensus.cc:2243] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.661180 23430 raft_consensus.cc:2272] T c61c6dfd18d344939f230997d7e4a4e2 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.662967 23430 tablet_replica.cc:333] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.663436 23430 raft_consensus.cc:2243] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.664112 23430 raft_consensus.cc:2272] T 398e000912b348938027ed51ba5e9948 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.666015 23430 tablet_replica.cc:333] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.666497 23430 raft_consensus.cc:2243] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.666848 23430 raft_consensus.cc:2272] T aa7f89221e744f428014037200deb5e7 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.668402 23430 tablet_replica.cc:333] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.668854 23430 raft_consensus.cc:2243] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.669586 23430 raft_consensus.cc:2272] T 9fbef5d9c42943fdb5657c68965d8160 P f38a26f090154cacb4c9ce88319b1019 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.671190 23430 tablet_replica.cc:333] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.671636 23430 raft_consensus.cc:2243] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.672282 23430 raft_consensus.cc:2272] T 83838501b9c24acf831b8ed2616945a5 P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.674067 23430 tablet_replica.cc:333] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.674552 23430 raft_consensus.cc:2243] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.674914 23430 raft_consensus.cc:2272] T ec8b3ddeb76d4b629bdfecd77945d9b5 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.676890 23430 tablet_replica.cc:333] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.677544 23430 raft_consensus.cc:2243] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.678099 23430 raft_consensus.cc:2272] T 3883e1cebd1b420ea07c6580db6006bb P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.680480 23430 tablet_replica.cc:333] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.681216 23430 raft_consensus.cc:2243] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.681685 23430 raft_consensus.cc:2272] T 3490e0e10b8048e2804f811413edf1de P f38a26f090154cacb4c9ce88319b1019 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:11.681746  3594 consensus_peers.cc:597] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 -> Peer 8896457506f045a18c8201317192789e (127.22.225.130:33645): Couldn't send request to peer 8896457506f045a18c8201317192789e. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:33645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:11.683755 23430 tablet_replica.cc:333] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.684235 23430 raft_consensus.cc:2243] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.684592 23430 raft_consensus.cc:2272] T b514773e7047432aa818545c7c9e712e P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.686592 23430 tablet_replica.cc:333] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.687016 23430 raft_consensus.cc:2243] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.687656 23430 raft_consensus.cc:2272] T 456e8a5728f042c6985acdd27073be61 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.689419 23430 tablet_replica.cc:333] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.690009 23430 raft_consensus.cc:2243] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:11.690383 23430 raft_consensus.cc:2272] T aae3fb4e7a0c4517b854f6b57767e4c4 P f38a26f090154cacb4c9ce88319b1019 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.692148 23430 tablet_replica.cc:333] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019: stopping tablet replica
I20260709 13:14:11.692518 23430 raft_consensus.cc:2243] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.693208 23430 raft_consensus.cc:2272] T fdb37472dca84bb68e5a8c29f6aa391d P f38a26f090154cacb4c9ce88319b1019 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.732347 23430 tablet_server.cc:196] TabletServer@127.22.225.131:0 shutdown complete.
I20260709 13:14:11.762120 23430 master.cc:562] Master@127.22.225.190:34431 shutting down...
I20260709 13:14:11.782665 23430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:11.783263 23430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:11.783604 23430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 20fa4fa85286407a9d73b86a460534a9: stopping tablet replica
I20260709 13:14:11.803996 23430 master.cc:584] Master@127.22.225.190:34431 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12322 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:14:11.852752 23430 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.225.190:34251
I20260709 13:14:11.853994 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:11.859367  3948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.859439  3949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:11.860914  3951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:11.861816 23430 server_base.cc:1061] running on GCE node
I20260709 13:14:11.862663 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:11.862833 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:11.862946 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602851862935 us; error 0 us; skew 500 ppm
I20260709 13:14:11.863379 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:11.865799 23430 webserver.cc:533] Webserver started at http://127.22.225.190:45001/ using document root <none> and password file <none>
I20260709 13:14:11.866204 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:11.866346 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:11.866569 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:11.867574 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/master-0-root/instance:
uuid: "4550e9f2ae3d47538417b3657f2b9c41"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-fx0m"
I20260709 13:14:11.871650 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:11.874691  3956 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:11.875398 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:14:11.875635 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/master-0-root
uuid: "4550e9f2ae3d47538417b3657f2b9c41"
format_stamp: "Formatted at 2026-07-09 13:14:11 on dist-test-slave-fx0m"
I20260709 13:14:11.875860 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:11.888388 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:11.889626 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:11.925817 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.190:34251
I20260709 13:14:11.925973  4007 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.190:34251 every 8 connection(s)
I20260709 13:14:11.929690  4008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:11.939957  4008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41: Bootstrap starting.
I20260709 13:14:11.944639  4008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:11.948565  4008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41: No bootstrap required, opened a new log
I20260709 13:14:11.950685  4008 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4550e9f2ae3d47538417b3657f2b9c41" member_type: VOTER }
I20260709 13:14:11.951056  4008 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:11.951236  4008 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4550e9f2ae3d47538417b3657f2b9c41, State: Initialized, Role: FOLLOWER
I20260709 13:14:11.951709  4008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4550e9f2ae3d47538417b3657f2b9c41" member_type: VOTER }
I20260709 13:14:11.952118  4008 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:11.952301  4008 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:11.952497  4008 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:11.956948  4008 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4550e9f2ae3d47538417b3657f2b9c41" member_type: VOTER }
I20260709 13:14:11.957463  4008 leader_election.cc:304] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4550e9f2ae3d47538417b3657f2b9c41; no voters: 
I20260709 13:14:11.958544  4008 leader_election.cc:290] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:11.958842  4011 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:11.960150  4011 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 1 LEADER]: Becoming Leader. State: Replica: 4550e9f2ae3d47538417b3657f2b9c41, State: Running, Role: LEADER
I20260709 13:14:11.960780  4011 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4550e9f2ae3d47538417b3657f2b9c41" member_type: VOTER }
I20260709 13:14:11.961442  4008 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:11.965476  4013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4550e9f2ae3d47538417b3657f2b9c41. Latest consensus state: current_term: 1 leader_uuid: "4550e9f2ae3d47538417b3657f2b9c41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4550e9f2ae3d47538417b3657f2b9c41" member_type: VOTER } }
I20260709 13:14:11.966202  4013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:11.965996  4012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4550e9f2ae3d47538417b3657f2b9c41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4550e9f2ae3d47538417b3657f2b9c41" member_type: VOTER } }
I20260709 13:14:11.966826  4012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:11.968825  4018 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:11.973658  4018 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:11.978333 23430 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:11.982558  4018 catalog_manager.cc:1383] Generated new cluster ID: ac5a23e7d74147f89b528bc328f45871
I20260709 13:14:11.982844  4018 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:12.004768  4018 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:12.006147  4018 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:12.021646  4018 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41: Generated new TSK 0
I20260709 13:14:12.022423  4018 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:12.045660 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:12.051204  4029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.052531  4030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.054123  4032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:12.054442 23430 server_base.cc:1061] running on GCE node
I20260709 13:14:12.055316 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:12.055508 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:12.055626 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602852055615 us; error 0 us; skew 500 ppm
I20260709 13:14:12.056042 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:12.058090 23430 webserver.cc:533] Webserver started at http://127.22.225.129:41581/ using document root <none> and password file <none>
I20260709 13:14:12.058501 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:12.058645 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:12.058840 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:12.059805 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-0-root/instance:
uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-fx0m"
I20260709 13:14:12.064057 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:14:12.067222  4037 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.067927 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:14:12.068156 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-0-root
uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-fx0m"
I20260709 13:14:12.068380 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:12.083071 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:12.084159 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:12.085542 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:12.087708 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:12.087878 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.088178 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:12.088346 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.125862 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.129:45757
I20260709 13:14:12.125973  4099 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.129:45757 every 8 connection(s)
I20260709 13:14:12.130791 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:12.137351  4104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.138199  4105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.140393  4107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:12.140650 23430 server_base.cc:1061] running on GCE node
I20260709 13:14:12.142216 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:12.142480 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:12.142701 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602852142681 us; error 0 us; skew 500 ppm
I20260709 13:14:12.143185 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:12.145702 23430 webserver.cc:533] Webserver started at http://127.22.225.130:38945/ using document root <none> and password file <none>
I20260709 13:14:12.145934  4100 heartbeater.cc:344] Connected to a master server at 127.22.225.190:34251
I20260709 13:14:12.146191 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:12.146351  4100 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:12.146488 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:12.146898 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:12.147248  4100 heartbeater.cc:507] Master 127.22.225.190:34251 requested a full tablet report, sending...
I20260709 13:14:12.148022 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-1-root/instance:
uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-fx0m"
I20260709 13:14:12.149422  3973 ts_manager.cc:194] Registered new tserver with Master: b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757)
I20260709 13:14:12.151791  3973 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43562
I20260709 13:14:12.153894 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:12.157346  4112 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.158053 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:14:12.158353 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-1-root
uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-fx0m"
I20260709 13:14:12.158617 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:12.170912 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:12.171967 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:12.173434 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:12.175544 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:12.175712 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.175997 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:12.176131 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.214577 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.130:45667
I20260709 13:14:12.214680  4174 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.130:45667 every 8 connection(s)
I20260709 13:14:12.219367 23430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:12.226728  4178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.228343  4179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:12.231709  4181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:12.232012 23430 server_base.cc:1061] running on GCE node
I20260709 13:14:12.232921  4175 heartbeater.cc:344] Connected to a master server at 127.22.225.190:34251
I20260709 13:14:12.233296 23430 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:14:12.233376  4175 heartbeater.cc:461] Registering TS with master...
W20260709 13:14:12.233574 23430 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:12.233860 23430 hybrid_clock.cc:648] HybridClock initialized: now 1783602852233842 us; error 0 us; skew 500 ppm
I20260709 13:14:12.234367  4175 heartbeater.cc:507] Master 127.22.225.190:34251 requested a full tablet report, sending...
I20260709 13:14:12.234478 23430 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:12.236493  3973 ts_manager.cc:194] Registered new tserver with Master: 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:12.237316 23430 webserver.cc:533] Webserver started at http://127.22.225.131:35825/ using document root <none> and password file <none>
I20260709 13:14:12.238027 23430 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:12.238276 23430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:12.238644  3973 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43576
I20260709 13:14:12.238649 23430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:12.240288 23430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-2-root/instance:
uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-fx0m"
I20260709 13:14:12.244656 23430 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:14:12.247846  4186 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.248726 23430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:14:12.248970 23430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-2-root
uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
format_stamp: "Formatted at 2026-07-09 13:14:12 on dist-test-slave-fx0m"
I20260709 13:14:12.249272 23430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskVjupsR/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602441430441-23430-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:12.278723 23430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:12.279805 23430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:12.281283 23430 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:12.283433 23430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:12.283628 23430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.283895 23430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:12.284050 23430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:12.323370 23430 rpc_server.cc:307] RPC server started. Bound to: 127.22.225.131:33975
I20260709 13:14:12.323472  4248 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.225.131:33975 every 8 connection(s)
I20260709 13:14:12.336580  4249 heartbeater.cc:344] Connected to a master server at 127.22.225.190:34251
I20260709 13:14:12.337045  4249 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:12.337814  4249 heartbeater.cc:507] Master 127.22.225.190:34251 requested a full tablet report, sending...
I20260709 13:14:12.339623  3973 ts_manager.cc:194] Registered new tserver with Master: d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:12.339748 23430 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013351621s
I20260709 13:14:12.340934  3973 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43592
I20260709 13:14:12.363366  3973 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43606:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:12.365998  3973 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:12.446417  4214 tablet_service.cc:1511] Processing CreateTablet for tablet aabd8e32cb9f430d8254d8e85c2f0b59 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:12.447714  4214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabd8e32cb9f430d8254d8e85c2f0b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.450153  4213 tablet_service.cc:1511] Processing CreateTablet for tablet 660e4fdffc9b4b589f3cd6c6e9a7695e (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:12.450361  4209 tablet_service.cc:1511] Processing CreateTablet for tablet b27057494ea342df93841957e2166ed3 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:12.451613  4213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660e4fdffc9b4b589f3cd6c6e9a7695e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.452171  4210 tablet_service.cc:1511] Processing CreateTablet for tablet 49a404b87c07448b8b758ec6a4fd5cce (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:12.452306  4140 tablet_service.cc:1511] Processing CreateTablet for tablet aabd8e32cb9f430d8254d8e85c2f0b59 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:12.453658  4140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabd8e32cb9f430d8254d8e85c2f0b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.453339  4137 tablet_service.cc:1511] Processing CreateTablet for tablet dc03f73721624afb835f4a7cf2ca57cd (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:12.454021  4211 tablet_service.cc:1511] Processing CreateTablet for tablet dc03f73721624afb835f4a7cf2ca57cd (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:12.454635  4137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc03f73721624afb835f4a7cf2ca57cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.455596  4139 tablet_service.cc:1511] Processing CreateTablet for tablet 660e4fdffc9b4b589f3cd6c6e9a7695e (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:12.456846  4139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660e4fdffc9b4b589f3cd6c6e9a7695e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.458206  4138 tablet_service.cc:1511] Processing CreateTablet for tablet b3ed36eee79e4fe5bbe080ce34b8256f (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:12.459476  4138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ed36eee79e4fe5bbe080ce34b8256f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.461843  4136 tablet_service.cc:1511] Processing CreateTablet for tablet 49a404b87c07448b8b758ec6a4fd5cce (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:12.463166  4136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a404b87c07448b8b758ec6a4fd5cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.463606  4065 tablet_service.cc:1511] Processing CreateTablet for tablet aabd8e32cb9f430d8254d8e85c2f0b59 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:12.464870  4065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabd8e32cb9f430d8254d8e85c2f0b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.466105  4064 tablet_service.cc:1511] Processing CreateTablet for tablet 660e4fdffc9b4b589f3cd6c6e9a7695e (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:12.467281  4135 tablet_service.cc:1511] Processing CreateTablet for tablet b27057494ea342df93841957e2166ed3 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:12.468715  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b27057494ea342df93841957e2166ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.470023  4062 tablet_service.cc:1511] Processing CreateTablet for tablet dc03f73721624afb835f4a7cf2ca57cd (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:12.468354  4063 tablet_service.cc:1511] Processing CreateTablet for tablet b3ed36eee79e4fe5bbe080ce34b8256f (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:12.450150  4212 tablet_service.cc:1511] Processing CreateTablet for tablet b3ed36eee79e4fe5bbe080ce34b8256f (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:12.472625  4210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a404b87c07448b8b758ec6a4fd5cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.472492  4208 tablet_service.cc:1511] Processing CreateTablet for tablet 597070b4f9d745528ba9b9ac873788cc (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:12.474630  4059 tablet_service.cc:1511] Processing CreateTablet for tablet 597070b4f9d745528ba9b9ac873788cc (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:12.476392  4208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597070b4f9d745528ba9b9ac873788cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.476763  4060 tablet_service.cc:1511] Processing CreateTablet for tablet b27057494ea342df93841957e2166ed3 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:12.477627  4211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc03f73721624afb835f4a7cf2ca57cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.479684  4062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc03f73721624afb835f4a7cf2ca57cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.483533  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 7edf022abc5f433d9269a58e1275c080 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:12.485201  4207 tablet_service.cc:1511] Processing CreateTablet for tablet 16efd7a5efa04634a613229ea920da19 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:12.489024  4134 tablet_service.cc:1511] Processing CreateTablet for tablet 597070b4f9d745528ba9b9ac873788cc (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:12.490314  4134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597070b4f9d745528ba9b9ac873788cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.479542  4061 tablet_service.cc:1511] Processing CreateTablet for tablet 49a404b87c07448b8b758ec6a4fd5cce (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:12.494007  4064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660e4fdffc9b4b589f3cd6c6e9a7695e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.494343  4133 tablet_service.cc:1511] Processing CreateTablet for tablet 16efd7a5efa04634a613229ea920da19 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:12.495548  4061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a404b87c07448b8b758ec6a4fd5cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.495992  4133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16efd7a5efa04634a613229ea920da19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.497051  4063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ed36eee79e4fe5bbe080ce34b8256f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.498394  4132 tablet_service.cc:1511] Processing CreateTablet for tablet 7edf022abc5f433d9269a58e1275c080 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:12.499989  4132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edf022abc5f433d9269a58e1275c080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.501334  4059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597070b4f9d745528ba9b9ac873788cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.502410  4060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b27057494ea342df93841957e2166ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.504101  4058 tablet_service.cc:1511] Processing CreateTablet for tablet 16efd7a5efa04634a613229ea920da19 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:12.505828  4058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16efd7a5efa04634a613229ea920da19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.508122  4057 tablet_service.cc:1511] Processing CreateTablet for tablet 7edf022abc5f433d9269a58e1275c080 (DEFAULT_TABLE table=test-workload [id=7803278cfa68445ba3050d0bb677f3c2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:12.509554  4057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edf022abc5f433d9269a58e1275c080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.533833  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ed36eee79e4fe5bbe080ce34b8256f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.537186  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b27057494ea342df93841957e2166ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.541654  4207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16efd7a5efa04634a613229ea920da19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.543020  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7edf022abc5f433d9269a58e1275c080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:12.564549  4265 tablet_bootstrap.cc:492] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:12.604543  4265 tablet_bootstrap.cc:654] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.613148  4264 tablet_bootstrap.cc:492] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:12.628885  4266 tablet_bootstrap.cc:492] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:12.635433  4266 tablet_bootstrap.cc:654] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.641748  4264 tablet_bootstrap.cc:654] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.674896  4264 tablet_bootstrap.cc:492] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:12.675460  4264 ts_tablet_manager.cc:1403] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.013s
I20260709 13:14:12.678279  4264 raft_consensus.cc:359] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:12.678519  4265 tablet_bootstrap.cc:492] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:12.678884  4264 raft_consensus.cc:385] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.679123  4265 ts_tablet_manager.cc:1403] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.000s
I20260709 13:14:12.679199  4264 raft_consensus.cc:740] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.680102  4264 consensus_queue.cc:260] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:12.683107  4266 tablet_bootstrap.cc:492] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:12.682713  4265 raft_consensus.cc:359] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.683686  4266 ts_tablet_manager.cc:1403] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.055s	user 0.001s	sys 0.009s
I20260709 13:14:12.683899  4265 raft_consensus.cc:385] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.684460  4265 raft_consensus.cc:740] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.686323  4265 consensus_queue.cc:260] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.686753  4175 heartbeater.cc:499] Master 127.22.225.190:34251 was elected leader, sending a full tablet report...
I20260709 13:14:12.687256  4264 ts_tablet_manager.cc:1434] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 13:14:12.687227  4266 raft_consensus.cc:359] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:12.687817  4266 raft_consensus.cc:385] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.688027  4266 raft_consensus.cc:740] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.688426  4264 tablet_bootstrap.cc:492] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:12.688589  4266 consensus_queue.cc:260] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:12.694715  4264 tablet_bootstrap.cc:654] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.695725  4266 ts_tablet_manager.cc:1434] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 13:14:12.696704  4249 heartbeater.cc:499] Master 127.22.225.190:34251 was elected leader, sending a full tablet report...
I20260709 13:14:12.707590  4266 tablet_bootstrap.cc:492] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:12.714745  4266 tablet_bootstrap.cc:654] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.716272  4100 heartbeater.cc:499] Master 127.22.225.190:34251 was elected leader, sending a full tablet report...
I20260709 13:14:12.716835  4265 ts_tablet_manager.cc:1434] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.037s	user 0.016s	sys 0.014s
I20260709 13:14:12.717851  4265 tablet_bootstrap.cc:492] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:12.723803  4265 tablet_bootstrap.cc:654] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.731002  4264 tablet_bootstrap.cc:492] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:12.731588  4264 ts_tablet_manager.cc:1403] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.028s
I20260709 13:14:12.734498  4264 raft_consensus.cc:359] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.735203  4264 raft_consensus.cc:385] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.735528  4264 raft_consensus.cc:740] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.736347  4266 tablet_bootstrap.cc:492] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:12.736289  4264 consensus_queue.cc:260] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.737010  4266 ts_tablet_manager.cc:1403] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.006s
I20260709 13:14:12.738533  4264 ts_tablet_manager.cc:1434] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:12.739059  4265 tablet_bootstrap.cc:492] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:12.739486  4264 tablet_bootstrap.cc:492] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:12.741472  4265 ts_tablet_manager.cc:1403] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 13:14:12.744305  4265 raft_consensus.cc:359] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.745025  4265 raft_consensus.cc:385] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.745352  4265 raft_consensus.cc:740] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.740229  4266 raft_consensus.cc:359] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.746445  4266 raft_consensus.cc:385] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.746086  4265 consensus_queue.cc:260] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.746812  4266 raft_consensus.cc:740] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.747323  4264 tablet_bootstrap.cc:654] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.747769  4266 consensus_queue.cc:260] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.748679  4265 ts_tablet_manager.cc:1434] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:14:12.750041  4265 tablet_bootstrap.cc:492] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:12.750057  4266 ts_tablet_manager.cc:1434] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:14:12.756887  4265 tablet_bootstrap.cc:654] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.761063  4266 tablet_bootstrap.cc:492] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:12.774693  4266 tablet_bootstrap.cc:654] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.776389  4264 tablet_bootstrap.cc:492] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:12.776453  4265 tablet_bootstrap.cc:492] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:12.777190  4264 ts_tablet_manager.cc:1403] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.013s
I20260709 13:14:12.777246  4265 ts_tablet_manager.cc:1403] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.008s
I20260709 13:14:12.779927  4265 raft_consensus.cc:359] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.780473  4265 raft_consensus.cc:385] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.780704  4265 raft_consensus.cc:740] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.781214  4264 raft_consensus.cc:359] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.781636  4265 consensus_queue.cc:260] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.782215  4264 raft_consensus.cc:385] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.782657  4264 raft_consensus.cc:740] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.783950  4265 ts_tablet_manager.cc:1434] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:12.783725  4264 consensus_queue.cc:260] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.785046  4265 tablet_bootstrap.cc:492] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:12.785773  4266 tablet_bootstrap.cc:492] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:12.786273  4264 ts_tablet_manager.cc:1434] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:14:12.786347  4266 ts_tablet_manager.cc:1403] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 13:14:12.787511  4264 tablet_bootstrap.cc:492] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:12.789438  4266 raft_consensus.cc:359] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.790198  4266 raft_consensus.cc:385] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.790530  4266 raft_consensus.cc:740] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.791623  4265 tablet_bootstrap.cc:654] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.791477  4266 consensus_queue.cc:260] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.794091  4264 tablet_bootstrap.cc:654] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.795755  4266 ts_tablet_manager.cc:1434] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 13:14:12.796947  4266 tablet_bootstrap.cc:492] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:12.805028  4266 tablet_bootstrap.cc:654] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.811260  4264 tablet_bootstrap.cc:492] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:12.811856  4264 ts_tablet_manager.cc:1403] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.013s
I20260709 13:14:12.812398  4266 tablet_bootstrap.cc:492] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:12.812922  4266 ts_tablet_manager.cc:1403] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:14:12.814725  4264 raft_consensus.cc:359] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.815531  4264 raft_consensus.cc:385] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.815908  4264 raft_consensus.cc:740] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.815626  4266 raft_consensus.cc:359] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.816399  4266 raft_consensus.cc:385] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.816694  4266 raft_consensus.cc:740] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.816805  4264 consensus_queue.cc:260] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.817487  4266 consensus_queue.cc:260] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.819630  4264 ts_tablet_manager.cc:1434] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:14:12.819630  4266 ts_tablet_manager.cc:1434] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:14:12.820736  4264 tablet_bootstrap.cc:492] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:12.821280  4266 tablet_bootstrap.cc:492] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:12.829344  4264 tablet_bootstrap.cc:654] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.829608  4266 tablet_bootstrap.cc:654] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.845293  4266 tablet_bootstrap.cc:492] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:12.845880  4264 tablet_bootstrap.cc:492] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:12.845896  4266 ts_tablet_manager.cc:1403] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:14:12.845966  4265 tablet_bootstrap.cc:492] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:12.846362  4264 ts_tablet_manager.cc:1403] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:14:12.846839  4265 ts_tablet_manager.cc:1403] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.036s
I20260709 13:14:12.848837  4264 raft_consensus.cc:359] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.849472  4264 raft_consensus.cc:385] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.849382  4266 raft_consensus.cc:359] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.849943  4264 raft_consensus.cc:740] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.850344  4266 raft_consensus.cc:385] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.849869  4265 raft_consensus.cc:359] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.850723  4266 raft_consensus.cc:740] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.850836  4265 raft_consensus.cc:385] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.851475  4265 raft_consensus.cc:740] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.850975  4264 consensus_queue.cc:260] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.851840  4270 raft_consensus.cc:493] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.852002  4266 consensus_queue.cc:260] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.852249  4265 consensus_queue.cc:260] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.852443  4270 raft_consensus.cc:515] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.855403  4265 ts_tablet_manager.cc:1434] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:12.856896  4265 tablet_bootstrap.cc:492] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:12.859954  4272 raft_consensus.cc:493] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.860469  4272 raft_consensus.cc:515] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.865044  4265 tablet_bootstrap.cc:654] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.865767  4270 leader_election.cc:290] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:12.874296  4272 leader_election.cc:290] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:12.887058  4265 tablet_bootstrap.cc:492] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:12.887682  4265 ts_tablet_manager.cc:1403] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.012s
I20260709 13:14:12.888346  4264 ts_tablet_manager.cc:1434] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.020s
I20260709 13:14:12.890746  4265 raft_consensus.cc:359] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.891573  4265 raft_consensus.cc:385] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.891546  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edf022abc5f433d9269a58e1275c080" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:12.892252  4265 raft_consensus.cc:740] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.892658  4075 raft_consensus.cc:2468] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:12.893041  4265 consensus_queue.cc:260] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.894397  4115 leader_election.cc:304] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:12.895283  4270 raft_consensus.cc:2804] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.895718  4270 raft_consensus.cc:493] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.895833  4264 tablet_bootstrap.cc:492] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:12.896040  4265 ts_tablet_manager.cc:1434] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:12.896202  4270 raft_consensus.cc:3060] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.899999  4265 tablet_bootstrap.cc:492] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:12.902693  4264 tablet_bootstrap.cc:654] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.906780  4271 raft_consensus.cc:493] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.907182  4265 tablet_bootstrap.cc:654] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.907307  4271 raft_consensus.cc:515] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.909263  4270 raft_consensus.cc:515] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.911906  4271 leader_election.cc:290] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:12.920848  4265 tablet_bootstrap.cc:492] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:12.921576  4265 ts_tablet_manager.cc:1403] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:14:12.922971  4270 leader_election.cc:290] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:12.912611  4266 ts_tablet_manager.cc:1434] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
I20260709 13:14:12.925531  4265 raft_consensus.cc:359] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.929927  4265 raft_consensus.cc:385] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.930363  4265 raft_consensus.cc:740] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.931200  4265 consensus_queue.cc:260] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.937575  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edf022abc5f433d9269a58e1275c080" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:12.936270  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edf022abc5f433d9269a58e1275c080" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:12.939195  4265 ts_tablet_manager.cc:1434] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:14:12.936986  4266 tablet_bootstrap.cc:492] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:12.940284  4265 tablet_bootstrap.cc:492] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:12.948041  4265 tablet_bootstrap.cc:654] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.949597  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
W20260709 13:14:12.953958  4189 leader_election.cc:343] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.958794  4272 raft_consensus.cc:493] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:12.960276  4113 leader_election.cc:343] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.960901  4272 raft_consensus.cc:515] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
W20260709 13:14:12.961650  4113 leader_election.cc:343] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:12.960798  4265 tablet_bootstrap.cc:492] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:12.962180  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edf022abc5f433d9269a58e1275c080" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:12.962815  4265 ts_tablet_manager.cc:1403] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.012s
I20260709 13:14:12.962785  4075 raft_consensus.cc:3060] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.964028  4272 leader_election.cc:290] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:12.966238  4265 raft_consensus.cc:359] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.967034  4265 raft_consensus.cc:385] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.967360  4265 raft_consensus.cc:740] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.968153  4265 consensus_queue.cc:260] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.970613  4265 ts_tablet_manager.cc:1434] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:14:12.971683  4265 tablet_bootstrap.cc:492] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
W20260709 13:14:12.973629  4021 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:12.974679  4075 raft_consensus.cc:2468] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 1.
I20260709 13:14:12.976141  4115 leader_election.cc:304] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:12.977439  4270 raft_consensus.cc:2804] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:12.977948  4270 raft_consensus.cc:697] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:12.978613  4265 tablet_bootstrap.cc:654] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.978832  4270 consensus_queue.cc:237] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:12.983883  4265 tablet_bootstrap.cc:492] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:12.983865  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597070b4f9d745528ba9b9ac873788cc" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:12.984552  4265 ts_tablet_manager.cc:1403] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.008s
I20260709 13:14:12.985628  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597070b4f9d745528ba9b9ac873788cc" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:12.986339  4150 raft_consensus.cc:2468] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:12.987668  4041 leader_election.cc:304] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:12.988574  4271 raft_consensus.cc:2804] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:12.988945  4271 raft_consensus.cc:493] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.989295  4271 raft_consensus.cc:3060] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:12.990492  4265 raft_consensus.cc:359] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:12.991199  4265 raft_consensus.cc:385] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:12.991477  4265 raft_consensus.cc:740] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:12.992269  4265 consensus_queue.cc:260] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:12.993091  4266 tablet_bootstrap.cc:654] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:12.999166  4264 tablet_bootstrap.cc:492] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:12.999657  4264 ts_tablet_manager.cc:1403] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.104s	user 0.034s	sys 0.050s
I20260709 13:14:13.002506  4264 raft_consensus.cc:359] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.003216  4264 raft_consensus.cc:385] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.003504  4264 raft_consensus.cc:740] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.004914  4264 consensus_queue.cc:260] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
W20260709 13:14:13.003552  4038 leader_election.cc:343] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.007366  4264 ts_tablet_manager.cc:1434] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:14:13.007961  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16efd7a5efa04634a613229ea920da19" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:13.009598  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16efd7a5efa04634a613229ea920da19" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.010401  4266 tablet_bootstrap.cc:492] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:13.010624  4075 raft_consensus.cc:2468] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:13.011142  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.009285  4271 raft_consensus.cc:515] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.011014  4266 ts_tablet_manager.cc:1403] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.004s
I20260709 13:14:13.014458  4271 leader_election.cc:290] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.008450  4264 tablet_bootstrap.cc:492] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:13.015307  4266 raft_consensus.cc:359] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.016083  4266 raft_consensus.cc:385] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.016368  4266 raft_consensus.cc:740] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.017103  4266 consensus_queue.cc:260] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.019788  4189 leader_election.cc:304] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.021191  4272 raft_consensus.cc:2804] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:13.022799  4190 leader_election.cc:343] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.023418  4265 ts_tablet_manager.cc:1434] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.039s	user 0.017s	sys 0.018s
I20260709 13:14:13.023283  4190 leader_election.cc:304] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1040e069dd74a0ab9517aa0698ce3a4; no voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:13.024439  4265 tablet_bootstrap.cc:492] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:13.021733  4272 raft_consensus.cc:493] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.010692  4149 raft_consensus.cc:2468] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:13.025794  4272 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.026239  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597070b4f9d745528ba9b9ac873788cc" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.026858  4224 raft_consensus.cc:3060] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.026532  3972 catalog_manager.cc:5697] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 1 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.030622  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597070b4f9d745528ba9b9ac873788cc" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.031240  4150 raft_consensus.cc:3060] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.032516  4264 tablet_bootstrap.cc:654] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.036816  4265 tablet_bootstrap.cc:654] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.040558  4266 ts_tablet_manager.cc:1434] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:14:13.041136  4302 raft_consensus.cc:2749] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.042341  4224 raft_consensus.cc:2468] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:13.044020  4038 leader_election.cc:304] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.043675  4272 raft_consensus.cc:515] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.044996  4150 raft_consensus.cc:2468] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:13.045315  4266 tablet_bootstrap.cc:492] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:13.047035  4272 leader_election.cc:290] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:13.047224  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16efd7a5efa04634a613229ea920da19" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.047801  4075 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.050416  4265 tablet_bootstrap.cc:492] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:13.050892  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16efd7a5efa04634a613229ea920da19" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.051497  4149 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.052188  4266 tablet_bootstrap.cc:654] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.050943  4265 ts_tablet_manager.cc:1403] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.003s
I20260709 13:14:13.052935  4300 raft_consensus.cc:2804] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.054706  4300 raft_consensus.cc:697] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.055500  4265 raft_consensus.cc:359] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.056239  4265 raft_consensus.cc:385] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.056566  4265 raft_consensus.cc:740] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.055913  4300 consensus_queue.cc:237] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.058749  4149 raft_consensus.cc:2468] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:13.060036  4190 leader_election.cc:304] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.060935  4272 raft_consensus.cc:2804] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.061435  4272 raft_consensus.cc:697] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:13.062207  4272 consensus_queue.cc:237] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.063800  4075 raft_consensus.cc:2468] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:13.064723  4265 consensus_queue.cc:260] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.066414  4264 tablet_bootstrap.cc:492] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:13.066947  4265 ts_tablet_manager.cc:1434] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:14:13.067209  4264 ts_tablet_manager.cc:1403] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.015s
I20260709 13:14:13.071128  4264 raft_consensus.cc:359] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.071950  4264 raft_consensus.cc:385] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.072316  4264 raft_consensus.cc:740] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.073056  4264 consensus_queue.cc:260] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.078326  4264 ts_tablet_manager.cc:1434] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:14:13.079403  4264 tablet_bootstrap.cc:492] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:13.085310  4264 tablet_bootstrap.cc:654] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.084467  3972 catalog_manager.cc:5697] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 0 to 1, leader changed from <none> to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 1 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.086777  4272 raft_consensus.cc:493] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.087283  4272 raft_consensus.cc:515] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:13.083438  3973 catalog_manager.cc:5697] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.097465  4300 raft_consensus.cc:493] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.098134  4300 raft_consensus.cc:515] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.100427  4300 leader_election.cc:290] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.101785  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed36eee79e4fe5bbe080ce34b8256f" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
W20260709 13:14:13.103535  4038 leader_election.cc:343] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.104115  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed36eee79e4fe5bbe080ce34b8256f" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.104979  4150 raft_consensus.cc:2468] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:13.106527  4041 leader_election.cc:304] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:13.107968  4300 raft_consensus.cc:2804] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.108021  4284 raft_consensus.cc:493] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.109123  4284 raft_consensus.cc:515] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:13.114578  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:13.114678  4284 leader_election.cc:290] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975), b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757)
I20260709 13:14:13.115389  4075 raft_consensus.cc:2468] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:13.116490  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:13.117596  4074 raft_consensus.cc:2468] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:13.117794  4189 leader_election.cc:304] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.119010  4302 raft_consensus.cc:2804] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.119446  4302 raft_consensus.cc:493] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.119349  4115 leader_election.cc:304] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:13.120146  4302 raft_consensus.cc:3060] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.121062  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:13.122575  4284 raft_consensus.cc:2804] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.123147  4284 raft_consensus.cc:493] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.123633  4284 raft_consensus.cc:3060] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.108598  4300 raft_consensus.cc:493] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.116695  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.125336  4300 raft_consensus.cc:3060] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.131791  4272 leader_election.cc:290] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757)
I20260709 13:14:13.137985  4302 raft_consensus.cc:515] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:13.140056  4224 raft_consensus.cc:2393] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in current term 1: Already voted for candidate d1040e069dd74a0ab9517aa0698ce3a4 in this term.
I20260709 13:14:13.145740  4300 raft_consensus.cc:515] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.147858  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.151417  4302 leader_election.cc:290] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757)
I20260709 13:14:13.152765  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.153673  4074 raft_consensus.cc:3060] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.160995  4284 raft_consensus.cc:515] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:13.162135  4150 raft_consensus.cc:2393] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1040e069dd74a0ab9517aa0698ce3a4 in current term 1: Already voted for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in this term.
I20260709 13:14:13.164500  4264 tablet_bootstrap.cc:492] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:13.164412  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.164593  4074 raft_consensus.cc:2468] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:13.164985  4264 ts_tablet_manager.cc:1403] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.086s	user 0.026s	sys 0.050s
I20260709 13:14:13.165181  4224 raft_consensus.cc:2393] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in current term 1: Already voted for candidate d1040e069dd74a0ab9517aa0698ce3a4 in this term.
I20260709 13:14:13.165762  4189 leader_election.cc:304] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:13.166687  4302 raft_consensus.cc:2804] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.167650  4302 raft_consensus.cc:697] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:13.168602  4302 consensus_queue.cc:237] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:13.170272  4284 leader_election.cc:290] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Requested vote from peers d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975), b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757)
I20260709 13:14:13.167546  4264 raft_consensus.cc:359] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.171348  4264 raft_consensus.cc:385] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.171303  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed36eee79e4fe5bbe080ce34b8256f" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.171886  4264 raft_consensus.cc:740] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.172322  4266 tablet_bootstrap.cc:492] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:13.172652  4264 consensus_queue.cc:260] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
W20260709 13:14:13.172866  4038 leader_election.cc:343] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:13.172456  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed36eee79e4fe5bbe080ce34b8256f" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.173892  4150 raft_consensus.cc:3060] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.172952  4266 ts_tablet_manager.cc:1403] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.128s	user 0.034s	sys 0.052s
I20260709 13:14:13.175750  4264 ts_tablet_manager.cc:1434] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:14:13.176720  4264 tablet_bootstrap.cc:492] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:13.171303  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.178436  4074 raft_consensus.cc:2393] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in current term 1: Already voted for candidate d1040e069dd74a0ab9517aa0698ce3a4 in this term.
I20260709 13:14:13.177017  4266 raft_consensus.cc:359] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.179153  4266 raft_consensus.cc:385] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.179462  4266 raft_consensus.cc:740] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.179548  4115 leader_election.cc:304] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2; no voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:13.180241  4266 consensus_queue.cc:260] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.180822  4284 raft_consensus.cc:2749] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.182708  4150 raft_consensus.cc:2468] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:13.182934  4264 tablet_bootstrap.cc:654] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.171416  4300 leader_election.cc:290] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.182734  4266 ts_tablet_manager.cc:1434] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:13.186239  4266 tablet_bootstrap.cc:492] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:13.186725  4041 leader_election.cc:304] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:13.188006  4300 raft_consensus.cc:2804] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.189340  4300 raft_consensus.cc:697] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.190340  4300 consensus_queue.cc:237] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.192713  4266 tablet_bootstrap.cc:654] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.192773  4272 raft_consensus.cc:493] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.193544  4272 raft_consensus.cc:515] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.196208  4272 leader_election.cc:290] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:13.197490  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.198024  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:13.198203  4150 raft_consensus.cc:2468] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:13.198946  4074 raft_consensus.cc:2468] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:13.199595  4190 leader_election.cc:304] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.199980  4264 tablet_bootstrap.cc:492] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:13.200449  4264 ts_tablet_manager.cc:1403] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:14:13.200778  4272 raft_consensus.cc:2804] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.201298  4272 raft_consensus.cc:493] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.201696  4272 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.203670  4271 raft_consensus.cc:493] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.203491  4264 raft_consensus.cc:359] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.204248  4264 raft_consensus.cc:385] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.204180  4271 raft_consensus.cc:515] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.204631  4264 raft_consensus.cc:740] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.205387  4264 consensus_queue.cc:260] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.206346  4271 leader_election.cc:290] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.207439  4264 ts_tablet_manager.cc:1434] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:13.208400  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a404b87c07448b8b758ec6a4fd5cce" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:13.208070  3969 catalog_manager.cc:5697] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.209028  4224 raft_consensus.cc:2468] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:13.211295  4038 leader_election.cc:304] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.212594  4271 raft_consensus.cc:2804] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.213073  4271 raft_consensus.cc:493] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.213692  4271 raft_consensus.cc:3060] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.217682  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a404b87c07448b8b758ec6a4fd5cce" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.218726  4150 raft_consensus.cc:2468] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:13.224398  4272 raft_consensus.cc:515] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.226507  4272 leader_election.cc:290] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:13.229398  4266 tablet_bootstrap.cc:492] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:13.229911  4266 ts_tablet_manager.cc:1403] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.020s
I20260709 13:14:13.230430  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.231022  4074 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.232740  4266 raft_consensus.cc:359] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.233451  4266 raft_consensus.cc:385] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.233721  4266 raft_consensus.cc:740] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.234490  4266 consensus_queue.cc:260] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.228300  3973 catalog_manager.cc:5697] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 0 to 1, leader changed from <none> to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 1 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.236562  4266 ts_tablet_manager.cc:1434] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:13.237550  4266 tablet_bootstrap.cc:492] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:13.238489  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.239086  4150 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.240387  4074 raft_consensus.cc:2468] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:13.241671  4189 leader_election.cc:304] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.242595  4272 raft_consensus.cc:2804] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.242882  4266 tablet_bootstrap.cc:654] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:13.243412  4272 raft_consensus.cc:697] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:13.244601  4272 consensus_queue.cc:237] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.246037  4150 raft_consensus.cc:2468] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:13.250733  4271 raft_consensus.cc:515] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.252876  4271 leader_election.cc:290] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.254009  4266 tablet_bootstrap.cc:492] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:13.254568  4266 ts_tablet_manager.cc:1403] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:14:13.254122  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a404b87c07448b8b758ec6a4fd5cce" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.255028  4224 raft_consensus.cc:3060] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.257309  4266 raft_consensus.cc:359] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.254109  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a404b87c07448b8b758ec6a4fd5cce" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.258035  4266 raft_consensus.cc:385] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:13.258279  4150 raft_consensus.cc:3060] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.258416  4266 raft_consensus.cc:740] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:13.259531  4266 consensus_queue.cc:260] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.261593  4266 ts_tablet_manager.cc:1434] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:13.264202  4224 raft_consensus.cc:2468] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:13.265434  4038 leader_election.cc:304] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.265548  4150 raft_consensus.cc:2468] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:13.266247  4271 raft_consensus.cc:2804] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.266829  4271 raft_consensus.cc:697] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.267685  4271 consensus_queue.cc:237] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.269583  3973 catalog_manager.cc:5697] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.276047  3970 catalog_manager.cc:5697] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 0 to 1, leader changed from <none> to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 1 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.281997  4271 raft_consensus.cc:493] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.283025  4271 raft_consensus.cc:515] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.285202  4271 leader_election.cc:290] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.286259  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27057494ea342df93841957e2166ed3" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:13.286301  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27057494ea342df93841957e2166ed3" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.286875  4224 raft_consensus.cc:2468] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:13.287407  4150 raft_consensus.cc:2468] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:13.288013  4038 leader_election.cc:304] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.288791  4271 raft_consensus.cc:2804] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.289135  4271 raft_consensus.cc:493] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.289417  4271 raft_consensus.cc:3060] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.293984  4271 raft_consensus.cc:515] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.295471  4271 leader_election.cc:290] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.295586  4284 raft_consensus.cc:493] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.296160  4284 raft_consensus.cc:515] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.296258  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27057494ea342df93841957e2166ed3" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.296537  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27057494ea342df93841957e2166ed3" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.296876  4150 raft_consensus.cc:3060] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.297156  4224 raft_consensus.cc:3060] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.298136  4284 leader_election.cc:290] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.298434  4271 raft_consensus.cc:493] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.299000  4271 raft_consensus.cc:515] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.300077  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:13.300709  4223 raft_consensus.cc:2468] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:13.301815  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.301962  4113 leader_election.cc:304] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.302479  4149 raft_consensus.cc:2468] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:13.303130  4284 raft_consensus.cc:2804] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.303527  4284 raft_consensus.cc:493] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.303650  4150 raft_consensus.cc:2468] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:13.303650  4224 raft_consensus.cc:2468] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:13.303887  4041 leader_election.cc:304] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:13.304272  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:13.304881  4074 raft_consensus.cc:2468] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:13.305054  4041 leader_election.cc:304] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:13.305388  4271 leader_election.cc:290] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.303926  4284 raft_consensus.cc:3060] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.305632  4300 raft_consensus.cc:2804] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:13.306221  4300 raft_consensus.cc:493] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:13.306227  4271 raft_consensus.cc:2804] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.306699  4300 raft_consensus.cc:3060] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.306932  4271 raft_consensus.cc:697] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.307861  4271 consensus_queue.cc:237] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.311590  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:13.312215  4224 raft_consensus.cc:2468] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:13.313786  4284 raft_consensus.cc:515] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.315047  4300 raft_consensus.cc:515] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.316861  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.317387  4284 leader_election.cc:290] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.317689  4074 raft_consensus.cc:2393] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in current term 1: Already voted for candidate b4b9775ef24c4dd3b8286e93b2dac58e in this term.
I20260709 13:14:13.320276  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.318485  4300 leader_election.cc:290] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.320612  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.320884  4223 raft_consensus.cc:3060] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.321437  4150 raft_consensus.cc:2393] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b4b9775ef24c4dd3b8286e93b2dac58e in current term 1: Already voted for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in this term.
I20260709 13:14:13.321946  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660e4fdffc9b4b589f3cd6c6e9a7695e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.323289  4113 leader_election.cc:304] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2; no voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:13.324075  4284 raft_consensus.cc:2749] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.323866  3970 catalog_manager.cc:5697] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 0 to 1, leader changed from <none> to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 1 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.327585  4223 raft_consensus.cc:2468] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:13.328650  4038 leader_election.cc:304] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:13.329366  4300 raft_consensus.cc:2804] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:13.329835  4300 raft_consensus.cc:697] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.330623  4300 consensus_queue.cc:237] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.337867  3970 catalog_manager.cc:5697] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 0 to 1, leader changed from <none> to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 1 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.427337  4223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
mode: GRACEFUL
new_leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:34054
I20260709 13:14:13.427805  4223 raft_consensus.cc:606] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Received request to transfer leadership to TS b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:13.437734  4223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
mode: GRACEFUL
new_leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:34054
I20260709 13:14:13.438165  4223 raft_consensus.cc:606] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Received request to transfer leadership to TS b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:13.449730  4074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49a404b87c07448b8b758ec6a4fd5cce"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
mode: GRACEFUL
new_leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:38676
I20260709 13:14:13.450162  4074 raft_consensus.cc:606] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Received request to transfer leadership to TS 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:13.454768  4272 raft_consensus.cc:493] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.454994  4074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b27057494ea342df93841957e2166ed3"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
mode: GRACEFUL
new_leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:38676
I20260709 13:14:13.455245  4272 raft_consensus.cc:515] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.455593  4074 raft_consensus.cc:606] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Received request to transfer leadership to TS 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:13.456986  4272 leader_election.cc:290] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:13.457680  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed36eee79e4fe5bbe080ce34b8256f" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:13.458540  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed36eee79e4fe5bbe080ce34b8256f" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:13.459262  4150 raft_consensus.cc:2393] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1040e069dd74a0ab9517aa0698ce3a4 in current term 1: Already voted for candidate b4b9775ef24c4dd3b8286e93b2dac58e in this term.
I20260709 13:14:13.460109  4190 leader_election.cc:304] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1040e069dd74a0ab9517aa0698ce3a4; no voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:13.460870  4272 raft_consensus.cc:3060] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.461028  4074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "597070b4f9d745528ba9b9ac873788cc"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
mode: GRACEFUL
new_leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:38676
I20260709 13:14:13.461695  4074 raft_consensus.cc:606] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Received request to transfer leadership to TS 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:13.466610  4223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16efd7a5efa04634a613229ea920da19"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
mode: GRACEFUL
new_leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:34054
I20260709 13:14:13.466830  4272 raft_consensus.cc:2749] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:13.467090  4223 raft_consensus.cc:606] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Received request to transfer leadership to TS 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:13.480175  4150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7edf022abc5f433d9269a58e1275c080"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
mode: GRACEFUL
new_leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
 from {username='slave'} at 127.0.0.1:56218
I20260709 13:14:13.480618  4150 raft_consensus.cc:606] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Received request to transfer leadership to TS d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:13.494235  4272 consensus_queue.cc:1048] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.494911  4300 consensus_queue.cc:1048] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.503203  4272 raft_consensus.cc:993] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4: : Instructing follower 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:13.503643  4272 raft_consensus.cc:1081] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Signalling peer 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:13.506309  4149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16efd7a5efa04634a613229ea920da19"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:56202
I20260709 13:14:13.507063  4149 raft_consensus.cc:493] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.507506  4149 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.511499  4284 consensus_queue.cc:1048] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.511806  4272 consensus_queue.cc:1048] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.518795  4149 raft_consensus.cc:515] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.519356  4271 consensus_queue.cc:1048] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.521930  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16efd7a5efa04634a613229ea920da19" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.524148  4150 raft_consensus.cc:1240] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Rejecting Update request from peer d1040e069dd74a0ab9517aa0698ce3a4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:13.527081  4149 leader_election.cc:290] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.529152  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16efd7a5efa04634a613229ea920da19" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.529953  4223 raft_consensus.cc:3055] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.530347  4223 raft_consensus.cc:740] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:13.541566  4224 raft_consensus.cc:3060] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:13.543732  4300 raft_consensus.cc:993] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e: : Instructing follower 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:13.544569  4300 raft_consensus.cc:1081] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Signalling peer 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:13.545213  4223 consensus_queue.cc:260] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.546408  4148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "597070b4f9d745528ba9b9ac873788cc"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:56212
I20260709 13:14:13.546859  4223 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.547030  4148 raft_consensus.cc:493] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.547724  4148 raft_consensus.cc:3060] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:14:13.546860  4272 consensus_queue.cc:1175] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d1040e069dd74a0ab9517aa0698ce3a4 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:13.554836  4148 raft_consensus.cc:515] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.556886  4148 leader_election.cc:290] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.558663  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597070b4f9d745528ba9b9ac873788cc" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.558727  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597070b4f9d745528ba9b9ac873788cc" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.559100  4223 raft_consensus.cc:2468] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:13.559257  4222 raft_consensus.cc:3060] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.559722  4074 raft_consensus.cc:3055] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.560328  4074 raft_consensus.cc:740] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.561362  4074 consensus_queue.cc:260] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.564052  4334 consensus_queue.cc:1048] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.563580  4113 leader_election.cc:304] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:13.564679  4222 raft_consensus.cc:2468] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:13.565623  4074 raft_consensus.cc:3060] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.565985  4113 leader_election.cc:304] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.569833  4333 raft_consensus.cc:2804] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:13.576215  4337 raft_consensus.cc:2804] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:13.576786  4337 raft_consensus.cc:697] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:13.577667  4337 consensus_queue.cc:237] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.579850  4074 raft_consensus.cc:2468] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:13.583479  4333 raft_consensus.cc:697] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:13.584864  4337 raft_consensus.cc:993] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2: : Instructing follower d1040e069dd74a0ab9517aa0698ce3a4 to start an election
I20260709 13:14:13.584400  4333 consensus_queue.cc:237] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.585429  4337 raft_consensus.cc:1081] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Signalling peer d1040e069dd74a0ab9517aa0698ce3a4 to start an election
I20260709 13:14:13.587011  4222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7edf022abc5f433d9269a58e1275c080"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
 from {username='slave'} at 127.0.0.1:34042
I20260709 13:14:13.587518  4222 raft_consensus.cc:493] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.587929  4222 raft_consensus.cc:3060] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.593061  3970 catalog_manager.cc:5697] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 1 to 2, leader changed from d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131) to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.594187  4222 raft_consensus.cc:515] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.597736  4150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edf022abc5f433d9269a58e1275c080" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.598318  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7edf022abc5f433d9269a58e1275c080" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.598466  4271 consensus_queue.cc:1048] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.599141  4074 raft_consensus.cc:3060] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.598315  4150 raft_consensus.cc:3055] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.599784  4150 raft_consensus.cc:740] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:13.600472  4150 consensus_queue.cc:260] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.601462  4150 raft_consensus.cc:3060] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.604095  4222 leader_election.cc:290] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:13.606767  4074 raft_consensus.cc:2468] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 2.
I20260709 13:14:13.608101  4189 leader_election.cc:304] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.608965  4272 raft_consensus.cc:2804] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:13.609441  4272 raft_consensus.cc:697] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:13.609686  4150 raft_consensus.cc:2468] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 2.
I20260709 13:14:13.610302  4272 consensus_queue.cc:237] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.616917  3973 catalog_manager.cc:5697] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 1 to 2, leader changed from b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129) to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.618964  4300 consensus_queue.cc:1048] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.630043  3970 catalog_manager.cc:5697] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 1 to 2, leader changed from 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130) to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.643503  4272 consensus_queue.cc:1048] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.655352  4342 consensus_queue.cc:1048] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.663969  4272 raft_consensus.cc:993] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4: : Instructing follower b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:13.664427  4342 raft_consensus.cc:1081] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Signalling peer b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:13.665825  4074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:38672
I20260709 13:14:13.666378  4074 raft_consensus.cc:493] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.666749  4074 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.671913  4074 raft_consensus.cc:515] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.674011  4074 leader_election.cc:290] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.674227  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.674597  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.674896  4148 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.675208  4222 raft_consensus.cc:3055] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.675513  4222 raft_consensus.cc:740] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:13.676312  4222 consensus_queue.cc:260] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.677618  4222 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.681830  4148 raft_consensus.cc:2468] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:13.682945  4041 leader_election.cc:304] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:13.683583  4300 raft_consensus.cc:2804] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:13.684034  4300 raft_consensus.cc:697] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.684491  4222 raft_consensus.cc:2468] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:13.684885  4300 consensus_queue.cc:237] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.690887  3973 catalog_manager.cc:5697] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 1 to 2, leader changed from d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131) to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 2 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.720218  4300 consensus_queue.cc:1048] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.726133  4319 raft_consensus.cc:993] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e: : Instructing follower 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:13.726617  4271 raft_consensus.cc:1081] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Signalling peer 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:13.728475  4150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49a404b87c07448b8b758ec6a4fd5cce"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:56212
I20260709 13:14:13.730975  4150 raft_consensus.cc:493] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.731372  4150 raft_consensus.cc:3060] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.731772  4271 consensus_queue.cc:1048] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.738461  4150 raft_consensus.cc:515] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.742523  4150 leader_election.cc:290] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.743623  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a404b87c07448b8b758ec6a4fd5cce" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.744238  4074 raft_consensus.cc:3055] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.744242  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a404b87c07448b8b758ec6a4fd5cce" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.744678  4074 raft_consensus.cc:740] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.744938  4223 raft_consensus.cc:3060] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.745553  4074 consensus_queue.cc:260] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.746829  4074 raft_consensus.cc:3060] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.750864  4271 consensus_queue.cc:1048] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.751955  4223 raft_consensus.cc:2468] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:13.752962  4113 leader_election.cc:304] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.753890  4074 raft_consensus.cc:2468] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:13.754138  4336 raft_consensus.cc:2804] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:13.754637  4336 raft_consensus.cc:697] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:13.755415  4336 consensus_queue.cc:237] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.760255  4342 consensus_queue.cc:1048] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.766094  3970 catalog_manager.cc:5697] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 1 to 2, leader changed from b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129) to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:13.768550  4300 consensus_queue.cc:1048] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:13.773501  4342 consensus_queue.cc:1048] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.783165  4343 raft_consensus.cc:993] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4: : Instructing follower b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:13.783645  4343 raft_consensus.cc:1081] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Signalling peer b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:13.785941  4075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:38672
I20260709 13:14:13.788941  4075 raft_consensus.cc:493] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.789407  4075 raft_consensus.cc:3060] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.798827  4075 raft_consensus.cc:515] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:13.799953  4271 consensus_queue.cc:1048] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.805255  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.805881  4222 raft_consensus.cc:3055] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.806227  4222 raft_consensus.cc:740] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:13.807053  4222 consensus_queue.cc:260] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:13.808319  4222 raft_consensus.cc:3060] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.810781  4319 raft_consensus.cc:993] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e: : Instructing follower 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:13.811252  4319 raft_consensus.cc:1081] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Signalling peer 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:13.812341  4075 leader_election.cc:290] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Requested vote from peers d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:13.813665  4148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b27057494ea342df93841957e2166ed3"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:56212
I20260709 13:14:13.814309  4148 raft_consensus.cc:493] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:13.814675  4148 raft_consensus.cc:3060] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.817507  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aabd8e32cb9f430d8254d8e85c2f0b59" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:13.818140  4149 raft_consensus.cc:3060] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.820462  4222 raft_consensus.cc:2468] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:13.821774  4038 leader_election.cc:304] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:13.821761  4148 raft_consensus.cc:515] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.823074  4271 raft_consensus.cc:2804] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:13.823617  4271 raft_consensus.cc:697] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.824473  4271 consensus_queue.cc:237] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } }
I20260709 13:14:13.825024  4149 raft_consensus.cc:2468] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:13.827636  4319 consensus_queue.cc:1048] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:13.829698  4148 leader_election.cc:290] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:13.830288  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27057494ea342df93841957e2166ed3" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:13.830622  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b27057494ea342df93841957e2166ed3" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:13.831259  4075 raft_consensus.cc:3055] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:13.831554  4075 raft_consensus.cc:740] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:13.832512  4075 consensus_queue.cc:260] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.833922  4075 raft_consensus.cc:3060] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:13.835943  3969 catalog_manager.cc:5697] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 1 to 2, leader changed from d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131) to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 2 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:13.841542  4075 raft_consensus.cc:2468] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:13.842610  4115 leader_election.cc:304] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:13.843699  4336 raft_consensus.cc:2804] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:13.844184  4336 raft_consensus.cc:697] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:13.844988  4336 consensus_queue.cc:237] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:13.851902  3970 catalog_manager.cc:5697] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 1 to 2, leader changed from b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129) to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:14.027245  4222 raft_consensus.cc:1275] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.028527  4337 consensus_queue.cc:1048] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.029800  4075 raft_consensus.cc:1275] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.031103  4337 consensus_queue.cc:1048] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.037061  4074 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.044728  4222 raft_consensus.cc:1275] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.046326  4074 raft_consensus.cc:1275] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.047041  4333 consensus_queue.cc:1048] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.049193  4337 consensus_queue.cc:1048] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.085662  4148 raft_consensus.cc:1275] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Refusing update from remote peer d1040e069dd74a0ab9517aa0698ce3a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.086833  4342 consensus_queue.cc:1048] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.096745  4075 raft_consensus.cc:1275] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer d1040e069dd74a0ab9517aa0698ce3a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.099043  4302 consensus_queue.cc:1048] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.133733  4222 raft_consensus.cc:1275] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.134902  4300 consensus_queue.cc:1048] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.141789  4148 raft_consensus.cc:1275] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.143707  4319 consensus_queue.cc:1048] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.311416  4148 raft_consensus.cc:1275] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.313030  4319 consensus_queue.cc:1048] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:14.318677  4222 raft_consensus.cc:1275] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.320439  4337 consensus_queue.cc:1048] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:14.330485  4223 raft_consensus.cc:1275] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.332373  4271 consensus_queue.cc:1048] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:14.341933  4074 raft_consensus.cc:1275] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.344020  4337 consensus_queue.cc:1048] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:14.347470  4074 raft_consensus.cc:1275] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.349402  4337 consensus_queue.cc:1048] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:14.371975  4223 raft_consensus.cc:3060] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:14.384017  4223 raft_consensus.cc:1275] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:14.385463  4354 consensus_queue.cc:1048] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:16.510120  3969 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52136:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:16.512552  3969 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:16.563649  4063 tablet_service.cc:1511] Processing CreateTablet for tablet e65b0a70f5fa4d8eabaa181f6c5e596e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:16.565632  4063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65b0a70f5fa4d8eabaa181f6c5e596e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.567067  4212 tablet_service.cc:1511] Processing CreateTablet for tablet e65b0a70f5fa4d8eabaa181f6c5e596e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:16.567620  4065 tablet_service.cc:1511] Processing CreateTablet for tablet 37f604f762814e0886d6cc34c23ac10e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:16.568444  4139 tablet_service.cc:1511] Processing CreateTablet for tablet 37f604f762814e0886d6cc34c23ac10e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:16.568753  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65b0a70f5fa4d8eabaa181f6c5e596e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.569172  4065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f604f762814e0886d6cc34c23ac10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.565114  4135 tablet_service.cc:1511] Processing CreateTablet for tablet e65b0a70f5fa4d8eabaa181f6c5e596e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:16.569875  4139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f604f762814e0886d6cc34c23ac10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.570672  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e65b0a70f5fa4d8eabaa181f6c5e596e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.587952  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 37f604f762814e0886d6cc34c23ac10e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:16.589481  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f604f762814e0886d6cc34c23ac10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.595332  4138 tablet_service.cc:1511] Processing CreateTablet for tablet 6c87e7ca0ef44ddeb8146ad2345880eb (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:16.596010  4064 tablet_service.cc:1511] Processing CreateTablet for tablet 6c87e7ca0ef44ddeb8146ad2345880eb (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:16.596830  4138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c87e7ca0ef44ddeb8146ad2345880eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.597380  4064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c87e7ca0ef44ddeb8146ad2345880eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.604156  4209 tablet_service.cc:1511] Processing CreateTablet for tablet 6c87e7ca0ef44ddeb8146ad2345880eb (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:16.605592  4209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c87e7ca0ef44ddeb8146ad2345880eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.622948  4063 tablet_service.cc:1511] Processing CreateTablet for tablet 0492c0b4543e44e7b34db9da7a2c1140 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:16.624329  4063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0492c0b4543e44e7b34db9da7a2c1140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.624629  4138 tablet_service.cc:1511] Processing CreateTablet for tablet 0492c0b4543e44e7b34db9da7a2c1140 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:16.625968  4138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0492c0b4543e44e7b34db9da7a2c1140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.625943  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 0492c0b4543e44e7b34db9da7a2c1140 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:16.627331  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0492c0b4543e44e7b34db9da7a2c1140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.629801  4366 tablet_bootstrap.cc:492] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:16.633867  4367 tablet_bootstrap.cc:492] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:16.642067  4060 tablet_service.cc:1511] Processing CreateTablet for tablet e3b2e00478c547cbab57a6eea41c7429 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:16.642674  4139 tablet_service.cc:1511] Processing CreateTablet for tablet e3b2e00478c547cbab57a6eea41c7429 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:16.643602  4060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b2e00478c547cbab57a6eea41c7429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.644061  4139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b2e00478c547cbab57a6eea41c7429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.643833  4212 tablet_service.cc:1511] Processing CreateTablet for tablet e3b2e00478c547cbab57a6eea41c7429 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:16.645089  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b2e00478c547cbab57a6eea41c7429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.650305  4368 tablet_bootstrap.cc:492] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:16.661293  4135 tablet_service.cc:1511] Processing CreateTablet for tablet bb9912e99f574e38b598eb0574e92e66 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:16.662777  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9912e99f574e38b598eb0574e92e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.662606  4214 tablet_service.cc:1511] Processing CreateTablet for tablet bb9912e99f574e38b598eb0574e92e66 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:16.663941  4214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9912e99f574e38b598eb0574e92e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.668576  4368 tablet_bootstrap.cc:654] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.671011  4064 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6ddbe0eb354644916d2ae4b65d5d6e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:16.673362  4064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6ddbe0eb354644916d2ae4b65d5d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.673030  4065 tablet_service.cc:1511] Processing CreateTablet for tablet bb9912e99f574e38b598eb0574e92e66 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:16.692206  4366 tablet_bootstrap.cc:654] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.701661  4065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9912e99f574e38b598eb0574e92e66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.705754  4367 tablet_bootstrap.cc:654] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.672137  4139 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6ddbe0eb354644916d2ae4b65d5d6e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:16.713292  4139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6ddbe0eb354644916d2ae4b65d5d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.716310  4206 tablet_service.cc:1511] Processing CreateTablet for tablet 6a6ddbe0eb354644916d2ae4b65d5d6e (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:16.718288  4206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a6ddbe0eb354644916d2ae4b65d5d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.725378  4060 tablet_service.cc:1511] Processing CreateTablet for tablet 2d84cf43d8b741f7ab94db7e0b97d961 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:16.726713  4060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d84cf43d8b741f7ab94db7e0b97d961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.730031  4138 tablet_service.cc:1511] Processing CreateTablet for tablet 2d84cf43d8b741f7ab94db7e0b97d961 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:16.731402  4138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d84cf43d8b741f7ab94db7e0b97d961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.732075  4368 tablet_bootstrap.cc:492] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:16.734264  4368 ts_tablet_manager.cc:1403] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.084s	user 0.004s	sys 0.009s
I20260709 13:14:16.737629  4063 tablet_service.cc:1511] Processing CreateTablet for tablet 99d6b263d7cc43799adbb1a546847b11 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:16.740121  4063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d6b263d7cc43799adbb1a546847b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.742445  4368 raft_consensus.cc:359] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.743198  4368 raft_consensus.cc:385] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.743496  4368 raft_consensus.cc:740] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.744244  4368 consensus_queue.cc:260] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.738756  4135 tablet_service.cc:1511] Processing CreateTablet for tablet 99d6b263d7cc43799adbb1a546847b11 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:16.746141  4135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d6b263d7cc43799adbb1a546847b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.733349  4214 tablet_service.cc:1511] Processing CreateTablet for tablet 2d84cf43d8b741f7ab94db7e0b97d961 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:16.747797  4214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d84cf43d8b741f7ab94db7e0b97d961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.751989  4368 ts_tablet_manager.cc:1434] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:14:16.753327  4368 tablet_bootstrap.cc:492] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:16.755024  4212 tablet_service.cc:1511] Processing CreateTablet for tablet 99d6b263d7cc43799adbb1a546847b11 (DEFAULT_TABLE table=soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:16.756325  4212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99d6b263d7cc43799adbb1a546847b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:16.759815  4368 tablet_bootstrap.cc:654] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.764305  4367 tablet_bootstrap.cc:492] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:16.764801  4367 ts_tablet_manager.cc:1403] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.000s
I20260709 13:14:16.772769  4367 raft_consensus.cc:359] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.773589  4367 raft_consensus.cc:385] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.773950  4367 raft_consensus.cc:740] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.774905  4367 consensus_queue.cc:260] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.786015  4366 tablet_bootstrap.cc:492] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:16.798138  4367 ts_tablet_manager.cc:1434] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.005s
I20260709 13:14:16.787623  4366 ts_tablet_manager.cc:1403] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.005s
I20260709 13:14:16.801611  4366 raft_consensus.cc:359] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.802325  4366 raft_consensus.cc:385] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.802647  4366 raft_consensus.cc:740] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.803258  4366 consensus_queue.cc:260] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.807587  4368 tablet_bootstrap.cc:492] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:16.808151  4367 tablet_bootstrap.cc:492] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:16.808224  4368 ts_tablet_manager.cc:1403] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.008s
I20260709 13:14:16.811877  4368 raft_consensus.cc:359] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.812674  4368 raft_consensus.cc:385] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.813048  4368 raft_consensus.cc:740] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.813854  4368 consensus_queue.cc:260] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.814299  4366 ts_tablet_manager.cc:1434] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:14:16.815390  4367 tablet_bootstrap.cc:654] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.815451  4366 tablet_bootstrap.cc:492] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:16.816397  4368 ts_tablet_manager.cc:1434] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:16.817441  4368 tablet_bootstrap.cc:492] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:16.823520  4366 tablet_bootstrap.cc:654] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.825923  4368 tablet_bootstrap.cc:654] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.830566  4367 tablet_bootstrap.cc:492] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:16.830979  4367 ts_tablet_manager.cc:1403] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:14:16.831195  4368 tablet_bootstrap.cc:492] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:16.831656  4368 ts_tablet_manager.cc:1403] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 13:14:16.833968  4367 raft_consensus.cc:359] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.834172  4368 raft_consensus.cc:359] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.834883  4367 raft_consensus.cc:385] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.834961  4368 raft_consensus.cc:385] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.835337  4367 raft_consensus.cc:740] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.835398  4368 raft_consensus.cc:740] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.836197  4368 consensus_queue.cc:260] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.837929  4366 tablet_bootstrap.cc:492] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:16.838392  4366 ts_tablet_manager.cc:1403] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:14:16.838608  4368 ts_tablet_manager.cc:1434] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:14:16.836197  4367 consensus_queue.cc:260] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.839635  4368 tablet_bootstrap.cc:492] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:16.841751  4367 ts_tablet_manager.cc:1434] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:14:16.843526  4366 raft_consensus.cc:359] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.844195  4367 tablet_bootstrap.cc:492] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:16.844357  4366 raft_consensus.cc:385] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.844820  4366 raft_consensus.cc:740] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.845753  4366 consensus_queue.cc:260] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.847033  4368 tablet_bootstrap.cc:654] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.852456  4370 raft_consensus.cc:493] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.853199  4370 raft_consensus.cc:515] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.854316  4366 ts_tablet_manager.cc:1434] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:14:16.857278  4370 leader_election.cc:290] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:16.852222  4367 tablet_bootstrap.cc:654] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.857765  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b0a70f5fa4d8eabaa181f6c5e596e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:16.858611  4074 raft_consensus.cc:2468] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:16.862123  4115 leader_election.cc:304] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:16.863034  4370 raft_consensus.cc:2804] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.863392  4370 raft_consensus.cc:493] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.863698  4370 raft_consensus.cc:3060] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.869038  4368 tablet_bootstrap.cc:492] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:16.869673  4368 ts_tablet_manager.cc:1403] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.008s
I20260709 13:14:16.870059  4367 tablet_bootstrap.cc:492] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:16.870018  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b0a70f5fa4d8eabaa181f6c5e596e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:16.870805  4223 raft_consensus.cc:2468] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:16.872891  4367 ts_tablet_manager.cc:1403] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.007s
I20260709 13:14:16.872902  4368 raft_consensus.cc:359] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.873845  4368 raft_consensus.cc:385] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.874202  4368 raft_consensus.cc:740] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.875218  4366 tablet_bootstrap.cc:492] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:16.875023  4368 consensus_queue.cc:260] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.874020  4370 raft_consensus.cc:515] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.876111  4367 raft_consensus.cc:359] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.876881  4367 raft_consensus.cc:385] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.877235  4367 raft_consensus.cc:740] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.878131  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b0a70f5fa4d8eabaa181f6c5e596e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:16.878734  4074 raft_consensus.cc:3060] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.880043  4368 ts_tablet_manager.cc:1434] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:14:16.881130  4368 tablet_bootstrap.cc:492] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:16.882745  4366 tablet_bootstrap.cc:654] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.878108  4367 consensus_queue.cc:260] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.887493  4368 tablet_bootstrap.cc:654] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.888355  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b0a70f5fa4d8eabaa181f6c5e596e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:16.888962  4223 raft_consensus.cc:3060] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.898152  4366 tablet_bootstrap.cc:492] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:16.898699  4366 ts_tablet_manager.cc:1403] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.012s
I20260709 13:14:16.898775  4367 ts_tablet_manager.cc:1434] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 13:14:16.887977  4074 raft_consensus.cc:2468] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 1.
I20260709 13:14:16.900606  4115 leader_election.cc:304] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:16.901497  4354 raft_consensus.cc:2804] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:16.901945  4354 raft_consensus.cc:697] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:16.901820  4366 raft_consensus.cc:359] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.902655  4366 raft_consensus.cc:385] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.902966  4366 raft_consensus.cc:740] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.902907  4354 consensus_queue.cc:237] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.903765  4366 consensus_queue.cc:260] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.905524  4366 ts_tablet_manager.cc:1434] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:16.906565  4366 tablet_bootstrap.cc:492] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:16.908144  4367 tablet_bootstrap.cc:492] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:16.913352  4366 tablet_bootstrap.cc:654] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.918144  4367 tablet_bootstrap.cc:654] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.921001  4368 tablet_bootstrap.cc:492] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:16.921718  4368 ts_tablet_manager.cc:1403] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.015s
I20260709 13:14:16.922171  4223 raft_consensus.cc:2468] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 1.
I20260709 13:14:16.923928  4370 leader_election.cc:290] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:16.924867  4368 raft_consensus.cc:359] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.925721  4368 raft_consensus.cc:385] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.926128  4368 raft_consensus.cc:740] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.927278  4366 tablet_bootstrap.cc:492] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:16.927989  4366 ts_tablet_manager.cc:1403] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.013s
I20260709 13:14:16.927284  4368 consensus_queue.cc:260] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.928483  3972 catalog_manager.cc:5697] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 1 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:16.931208  4368 ts_tablet_manager.cc:1434] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:14:16.932471  4368 tablet_bootstrap.cc:492] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:16.940400  4368 tablet_bootstrap.cc:654] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.948191  4302 raft_consensus.cc:493] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.948722  4302 raft_consensus.cc:515] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.948858  4366 raft_consensus.cc:359] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.951020  4302 leader_election.cc:290] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:16.951292  4366 raft_consensus.cc:385] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.951637  4366 raft_consensus.cc:740] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.951865  4367 tablet_bootstrap.cc:492] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:16.952558  4367 ts_tablet_manager.cc:1403] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.008s
I20260709 13:14:16.952430  4366 consensus_queue.cc:260] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.953884  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c87e7ca0ef44ddeb8146ad2345880eb" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:16.954880  4366 ts_tablet_manager.cc:1434] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.006s
I20260709 13:14:16.954761  4074 raft_consensus.cc:2468] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:16.956076  4366 tablet_bootstrap.cc:492] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:16.955993  4271 raft_consensus.cc:493] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.956822  4271 raft_consensus.cc:515] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.959671  4271 leader_election.cc:290] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:16.960708  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f604f762814e0886d6cc34c23ac10e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:16.961396  4223 raft_consensus.cc:2468] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:16.962777  4038 leader_election.cc:304] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:16.963768  4374 raft_consensus.cc:2804] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.964146  4374 raft_consensus.cc:493] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.964453  4374 raft_consensus.cc:3060] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.965667  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f604f762814e0886d6cc34c23ac10e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:16.966535  4148 raft_consensus.cc:2468] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:16.968449  4189 leader_election.cc:304] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:16.969375  4302 raft_consensus.cc:2804] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:16.971014  4302 raft_consensus.cc:493] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.971365  4302 raft_consensus.cc:3060] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.972685  4374 raft_consensus.cc:515] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.974249  4367 raft_consensus.cc:359] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.976990  4367 raft_consensus.cc:385] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.976459  4368 tablet_bootstrap.cc:492] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:16.978108  4368 ts_tablet_manager.cc:1403] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.016s
I20260709 13:14:16.978983  4374 leader_election.cc:290] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:16.963713  4366 tablet_bootstrap.cc:654] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.979626  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f604f762814e0886d6cc34c23ac10e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:16.979954  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f604f762814e0886d6cc34c23ac10e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:16.980233  4223 raft_consensus.cc:3060] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.980568  4148 raft_consensus.cc:3060] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:16.981230  4368 raft_consensus.cc:359] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.982036  4368 raft_consensus.cc:385] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:16.982371  4368 raft_consensus.cc:740] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.983171  4368 consensus_queue.cc:260] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.984922  4368 ts_tablet_manager.cc:1434] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:16.986178  4368 tablet_bootstrap.cc:492] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:16.968396  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c87e7ca0ef44ddeb8146ad2345880eb" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:16.977366  4367 raft_consensus.cc:740] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:16.989868  4367 consensus_queue.cc:260] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:16.994303  4368 tablet_bootstrap.cc:654] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.994329  4367 ts_tablet_manager.cc:1434] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:14:16.995822  4367 tablet_bootstrap.cc:492] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:16.989820  4149 raft_consensus.cc:2468] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:17.000129  4148 raft_consensus.cc:2468] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:17.010437  4041 leader_election.cc:304] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:17.011314  4374 raft_consensus.cc:2804] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.011730  4368 tablet_bootstrap.cc:492] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:17.011826  4374 raft_consensus.cc:697] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:17.012416  4368 ts_tablet_manager.cc:1403] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
W20260709 13:14:17.013937  4021 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:17.015874  4368 raft_consensus.cc:359] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.016969  4368 raft_consensus.cc:385] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.017431  4368 raft_consensus.cc:740] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.018370  4368 consensus_queue.cc:260] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.019505  4302 raft_consensus.cc:515] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.020833  4368 ts_tablet_manager.cc:1434] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:14:17.022361  4368 tablet_bootstrap.cc:492] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:17.024897  4367 tablet_bootstrap.cc:654] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.029520  4368 tablet_bootstrap.cc:654] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:16.988678  4223 raft_consensus.cc:2468] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:17.030150  4374 consensus_queue.cc:237] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.030922  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c87e7ca0ef44ddeb8146ad2345880eb" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:17.031630  4074 raft_consensus.cc:3060] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.042441  4368 tablet_bootstrap.cc:492] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:17.043200  4368 ts_tablet_manager.cc:1403] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:14:17.045596  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c87e7ca0ef44ddeb8146ad2345880eb" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:17.046270  4149 raft_consensus.cc:3060] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.046949  4368 raft_consensus.cc:359] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.047906  4368 raft_consensus.cc:385] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.048236  4368 raft_consensus.cc:740] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.049285  4368 consensus_queue.cc:260] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.051999  4368 ts_tablet_manager.cc:1434] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:17.053362  4368 tablet_bootstrap.cc:492] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e: Bootstrap starting.
I20260709 13:14:17.054292  4271 raft_consensus.cc:493] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.054783  4271 raft_consensus.cc:515] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.056888  4271 leader_election.cc:290] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.058826  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b2e00478c547cbab57a6eea41c7429" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:17.059803  4368 tablet_bootstrap.cc:654] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.059733  4223 raft_consensus.cc:2468] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:17.060701  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b2e00478c547cbab57a6eea41c7429" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:17.061625  4148 raft_consensus.cc:2468] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:17.063833  4041 leader_election.cc:304] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:17.064944  4271 raft_consensus.cc:2804] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.065351  4271 raft_consensus.cc:493] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.065758  4271 raft_consensus.cc:3060] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.073239  4302 leader_election.cc:290] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:17.043092  4074 raft_consensus.cc:2468] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:17.076314  4189 leader_election.cc:304] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:17.076948  4366 tablet_bootstrap.cc:492] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:17.077239  4302 raft_consensus.cc:2804] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.077572  4366 ts_tablet_manager.cc:1403] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.122s	user 0.038s	sys 0.048s
I20260709 13:14:17.077630  4271 raft_consensus.cc:515] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.079731  4302 raft_consensus.cc:697] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:17.081300  4366 raft_consensus.cc:359] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.082290  4366 raft_consensus.cc:385] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.082695  4366 raft_consensus.cc:740] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.082501  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b2e00478c547cbab57a6eea41c7429" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:17.083477  4148 raft_consensus.cc:3060] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.082428  4302 consensus_queue.cc:237] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.087355  4271 leader_election.cc:290] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.086597  4367 tablet_bootstrap.cc:492] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:17.088304  4367 ts_tablet_manager.cc:1403] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.004s
I20260709 13:14:17.091634  4367 raft_consensus.cc:359] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.087419  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b2e00478c547cbab57a6eea41c7429" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:17.081284  4149 raft_consensus.cc:2468] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:17.098115  4223 raft_consensus.cc:3060] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.094305  4368 tablet_bootstrap.cc:492] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e: No bootstrap required, opened a new log
I20260709 13:14:17.094404  4148 raft_consensus.cc:2468] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:17.095007  4366 consensus_queue.cc:260] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.100056  4368 ts_tablet_manager.cc:1403] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.018s
I20260709 13:14:17.101719  4366 ts_tablet_manager.cc:1434] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:14:17.102383  4368 raft_consensus.cc:359] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.102793  4366 tablet_bootstrap.cc:492] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:17.102851  4368 raft_consensus.cc:385] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.103307  4368 raft_consensus.cc:740] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.103770  4368 consensus_queue.cc:260] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.104971  4367 raft_consensus.cc:385] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.105681  4368 ts_tablet_manager.cc:1434] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:14:17.105657  4367 raft_consensus.cc:740] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.108578  4367 consensus_queue.cc:260] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.110194  4366 tablet_bootstrap.cc:654] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.111172  4367 ts_tablet_manager.cc:1434] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:14:17.110858  3970 catalog_manager.cc:5697] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.112270  4367 tablet_bootstrap.cc:492] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:17.114379  4041 leader_election.cc:304] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:17.115243  4374 raft_consensus.cc:2804] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.115737  4374 raft_consensus.cc:697] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:17.116397  4374 consensus_queue.cc:237] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.117547  4366 tablet_bootstrap.cc:492] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:17.118209  4366 ts_tablet_manager.cc:1403] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.016s	user 0.002s	sys 0.010s
I20260709 13:14:17.122396  4366 raft_consensus.cc:359] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.123106  4366 raft_consensus.cc:385] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.123445  4366 raft_consensus.cc:740] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.124306  4366 consensus_queue.cc:260] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.125373  4367 tablet_bootstrap.cc:654] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.126642  4366 ts_tablet_manager.cc:1434] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:17.127701  4366 tablet_bootstrap.cc:492] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:17.107896  3972 catalog_manager.cc:5697] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 0 to 1, leader changed from <none> to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 1 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.134342  4366 tablet_bootstrap.cc:654] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.140249  4367 tablet_bootstrap.cc:492] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:17.141485  4367 ts_tablet_manager.cc:1403] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.029s	user 0.003s	sys 0.020s
I20260709 13:14:17.145336  4367 raft_consensus.cc:359] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.146279  4367 raft_consensus.cc:385] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.146652  4367 raft_consensus.cc:740] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.147639  4367 consensus_queue.cc:260] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.154122  4223 raft_consensus.cc:2468] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:17.155608  4366 tablet_bootstrap.cc:492] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:17.156316  4366 ts_tablet_manager.cc:1403] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 13:14:17.161478  4366 raft_consensus.cc:359] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.162235  4366 raft_consensus.cc:385] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.162482  4367 ts_tablet_manager.cc:1434] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:14:17.162660  4366 raft_consensus.cc:740] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.163753  4367 tablet_bootstrap.cc:492] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:17.163512  4366 consensus_queue.cc:260] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.165894  4366 ts_tablet_manager.cc:1434] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:14:17.166934  4366 tablet_bootstrap.cc:492] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:17.169757  4302 raft_consensus.cc:493] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.170274  4302 raft_consensus.cc:515] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.172698  4302 leader_election.cc:290] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:17.173978  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9912e99f574e38b598eb0574e92e66" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:17.174288  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9912e99f574e38b598eb0574e92e66" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:17.174656  4074 raft_consensus.cc:2468] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:17.174973  4366 tablet_bootstrap.cc:654] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.174925  4148 raft_consensus.cc:2468] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:17.176200  4367 tablet_bootstrap.cc:654] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.176435  4190 leader_election.cc:304] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:17.177567  4302 raft_consensus.cc:2804] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.178084  4302 raft_consensus.cc:493] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.178506  4302 raft_consensus.cc:3060] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.182416  4370 raft_consensus.cc:493] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.182899  4370 raft_consensus.cc:515] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.187168  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0492c0b4543e44e7b34db9da7a2c1140" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:17.187772  4074 raft_consensus.cc:2468] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:17.188930  4115 leader_election.cc:304] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:17.189762  4354 raft_consensus.cc:2804] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.190104  4354 raft_consensus.cc:493] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.190438  4354 raft_consensus.cc:3060] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.190614  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0492c0b4543e44e7b34db9da7a2c1140" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:17.191258  4223 raft_consensus.cc:2468] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:17.199324  4370 leader_election.cc:290] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.201458  4354 raft_consensus.cc:515] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.211203  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0492c0b4543e44e7b34db9da7a2c1140" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:17.211792  4074 raft_consensus.cc:3060] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.214259  4302 raft_consensus.cc:515] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.215824  4354 leader_election.cc:290] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.218976  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9912e99f574e38b598eb0574e92e66" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:17.219573  4075 raft_consensus.cc:3060] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.219808  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9912e99f574e38b598eb0574e92e66" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:17.220398  4148 raft_consensus.cc:3060] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.221460  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0492c0b4543e44e7b34db9da7a2c1140" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:17.222237  4223 raft_consensus.cc:3060] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.223613  4374 raft_consensus.cc:493] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.224310  4374 raft_consensus.cc:515] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.225157  4302 leader_election.cc:290] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:17.226884  3972 catalog_manager.cc:5697] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 0 to 1, leader changed from <none> to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 1 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.227784  4374 leader_election.cc:290] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.230252  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:17.231024  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
W20260709 13:14:17.231760  4041 leader_election.cc:343] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:14:17.232550  4038 leader_election.cc:343] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:17.232970  4038 leader_election.cc:304] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:17.233704  4374 raft_consensus.cc:2749] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.242784  4074 raft_consensus.cc:2468] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 1.
I20260709 13:14:17.244065  4115 leader_election.cc:304] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:17.244979  4354 raft_consensus.cc:2804] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.245612  4354 raft_consensus.cc:697] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:17.245823  4148 raft_consensus.cc:2468] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:17.246397  4354 consensus_queue.cc:237] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.246963  4366 tablet_bootstrap.cc:492] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:17.247499  4366 ts_tablet_manager.cc:1403] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.081s	user 0.037s	sys 0.030s
I20260709 13:14:17.248420  4190 leader_election.cc:304] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:17.249574  4223 raft_consensus.cc:2468] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 1.
I20260709 13:14:17.250233  4366 raft_consensus.cc:359] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.251001  4366 raft_consensus.cc:385] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.251320  4366 raft_consensus.cc:740] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.251963  4366 consensus_queue.cc:260] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.250612  4393 raft_consensus.cc:2804] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.255424  4366 ts_tablet_manager.cc:1434] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:17.256356  4366 tablet_bootstrap.cc:492] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4: Bootstrap starting.
I20260709 13:14:17.259073  4367 tablet_bootstrap.cc:492] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:17.259642  4367 ts_tablet_manager.cc:1403] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.096s	user 0.028s	sys 0.033s
I20260709 13:14:17.263394  4367 raft_consensus.cc:359] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.263969  4075 raft_consensus.cc:2468] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:17.264330  4367 raft_consensus.cc:385] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.264736  4367 raft_consensus.cc:740] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.265640  4367 consensus_queue.cc:260] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.267033  4366 tablet_bootstrap.cc:654] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.267221  4393 raft_consensus.cc:697] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:17.268034  4393 consensus_queue.cc:237] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.268330  4367 ts_tablet_manager.cc:1434] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:14:17.269637  4367 tablet_bootstrap.cc:492] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:17.276623  4367 tablet_bootstrap.cc:654] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.277688  3972 catalog_manager.cc:5697] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.283252  4366 tablet_bootstrap.cc:492] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4: No bootstrap required, opened a new log
I20260709 13:14:17.283963  4366 ts_tablet_manager.cc:1403] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:14:17.283981  3969 catalog_manager.cc:5697] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 1 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.287413  4366 raft_consensus.cc:359] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.288321  4366 raft_consensus.cc:385] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.288671  4366 raft_consensus.cc:740] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.289567  4366 consensus_queue.cc:260] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.292402  4366 ts_tablet_manager.cc:1434] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:17.299172  4367 tablet_bootstrap.cc:492] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:17.299687  4367 ts_tablet_manager.cc:1403] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.012s
I20260709 13:14:17.302556  4367 raft_consensus.cc:359] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.303236  4367 raft_consensus.cc:385] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.303488  4367 raft_consensus.cc:740] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.304101  4367 consensus_queue.cc:260] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.305560  4367 ts_tablet_manager.cc:1434] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:14:17.306427  4367 tablet_bootstrap.cc:492] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Bootstrap starting.
I20260709 13:14:17.310801  4367 tablet_bootstrap.cc:654] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:17.314998  4367 tablet_bootstrap.cc:492] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2: No bootstrap required, opened a new log
I20260709 13:14:17.315442  4367 ts_tablet_manager.cc:1403] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent bootstrapping tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:14:17.317589  4367 raft_consensus.cc:359] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.318114  4367 raft_consensus.cc:385] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:17.318346  4367 raft_consensus.cc:740] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Initialized, Role: FOLLOWER
I20260709 13:14:17.318990  4367 consensus_queue.cc:260] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.320588  4367 ts_tablet_manager.cc:1434] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:14:17.436738  4354 consensus_queue.cc:1048] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.437397  4370 raft_consensus.cc:493] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.438030  4370 raft_consensus.cc:515] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.440267  4370 leader_election.cc:290] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.441030  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d6b263d7cc43799adbb1a546847b11" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:17.441812  4075 raft_consensus.cc:2468] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:17.442437  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d6b263d7cc43799adbb1a546847b11" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:17.443055  4115 leader_election.cc:304] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:17.443189  4222 raft_consensus.cc:2468] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:17.444399  4370 raft_consensus.cc:2804] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.444743  4370 raft_consensus.cc:493] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.445053  4370 raft_consensus.cc:3060] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.455783  4370 raft_consensus.cc:515] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.458420  4370 leader_election.cc:290] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.459473  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d6b263d7cc43799adbb1a546847b11" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:17.463217  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d6b263d7cc43799adbb1a546847b11" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:17.463898  4075 raft_consensus.cc:3060] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.460371  4223 raft_consensus.cc:3060] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.483456  4075 raft_consensus.cc:2468] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 1.
I20260709 13:14:17.483557  4223 raft_consensus.cc:2468] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 1.
I20260709 13:14:17.487115  4113 leader_election.cc:304] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:17.488171  4370 raft_consensus.cc:2804] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.488699  4370 raft_consensus.cc:697] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:17.489657  4370 consensus_queue.cc:237] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.498052  4374 consensus_queue.cc:1048] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.508535  4374 raft_consensus.cc:493] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.509179  4374 raft_consensus.cc:515] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.518188  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:17.519011  4149 raft_consensus.cc:2468] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:17.514060  4374 leader_election.cc:290] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.645844  4393 raft_consensus.cc:493] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.646379  4393 raft_consensus.cc:515] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.648566  4393 leader_election.cc:290] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:17.673422  4224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:17.674032  4224 raft_consensus.cc:2468] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 0.
I20260709 13:14:17.681851  4041 leader_election.cc:304] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:17.683403  4414 consensus_queue.cc:1048] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.683773  4413 raft_consensus.cc:2804] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.684307  4413 raft_consensus.cc:493] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.684684  4413 raft_consensus.cc:3060] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.692077  4302 consensus_queue.cc:1048] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.692469  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:17.692811  4413 raft_consensus.cc:515] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.693130  4149 raft_consensus.cc:2468] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:17.694335  4190 leader_election.cc:304] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:17.695248  4302 raft_consensus.cc:2804] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.695559  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:17.695912  4413 leader_election.cc:290] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.696209  4148 raft_consensus.cc:3060] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.696852  4413 consensus_queue.cc:1048] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.700578  4222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:17.701222  4393 raft_consensus.cc:493] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.701736  4393 raft_consensus.cc:515] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.703711  4393 leader_election.cc:290] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:17.703711  4148 raft_consensus.cc:2468] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 1.
I20260709 13:14:17.710132  4041 leader_election.cc:304] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:17.710937  4413 raft_consensus.cc:2804] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.711462  4413 raft_consensus.cc:697] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:17.712718  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:17.717353  4354 raft_consensus.cc:493] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.717831  4354 raft_consensus.cc:515] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.713846  4413 consensus_queue.cc:237] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.695604  4302 raft_consensus.cc:493] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.719964  4302 raft_consensus.cc:3060] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.728922  4271 consensus_queue.cc:1048] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.730646  4369 consensus_queue.cc:1048] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.732429  4075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:17.734894  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" is_pre_election: true
I20260709 13:14:17.742233  4075 raft_consensus.cc:2468] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:17.760418  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" is_pre_election: true
I20260709 13:14:17.761741  4223 raft_consensus.cc:2468] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:17.751857  4354 leader_election.cc:290] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.764462  4113 leader_election.cc:304] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:17.765666  4354 consensus_queue.cc:1048] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.766891  4403 consensus_queue.cc:1048] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:17.774892  4302 raft_consensus.cc:515] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.775852  3970 catalog_manager.cc:5697] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 0 to 1, leader changed from <none> to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 1 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.782912  3972 catalog_manager.cc:5697] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 1 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.752290  4148 raft_consensus.cc:2468] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 0.
I20260709 13:14:17.789584  4222 raft_consensus.cc:2393] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b4b9775ef24c4dd3b8286e93b2dac58e in current term 1: Already voted for candidate d1040e069dd74a0ab9517aa0698ce3a4 in this term.
I20260709 13:14:17.791739  4189 leader_election.cc:304] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:17.792703  4354 raft_consensus.cc:2804] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.794365  4403 consensus_queue.cc:1048] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:17.797665  4393 raft_consensus.cc:2804] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:17.799041  4393 raft_consensus.cc:493] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.799386  4393 raft_consensus.cc:3060] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.799984  4354 raft_consensus.cc:493] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.800587  4354 raft_consensus.cc:3060] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.804750  4302 leader_election.cc:290] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:17.807992  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" is_pre_election: true
I20260709 13:14:17.808820  4074 raft_consensus.cc:2468] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 0.
I20260709 13:14:17.819952  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:17.821127  4149 raft_consensus.cc:2393] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d1040e069dd74a0ab9517aa0698ce3a4 in current term 1: Already voted for candidate b4b9775ef24c4dd3b8286e93b2dac58e in this term.
I20260709 13:14:17.821842  4393 raft_consensus.cc:515] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
W20260709 13:14:17.818986  4115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45757, user_credentials={real_user=slave}} blocked reactor thread for 67198.3us
I20260709 13:14:17.824482  4393 leader_election.cc:290] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:17.826506  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:17.829351  4071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:17.834765  4071 raft_consensus.cc:3060] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:17.830603  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:17.853883  4189 leader_election.cc:304] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1040e069dd74a0ab9517aa0698ce3a4; no voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:17.855650  4403 raft_consensus.cc:2749] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.859056  4071 raft_consensus.cc:2468] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 1.
I20260709 13:14:17.860278  4370 consensus_queue.cc:1048] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:14:17.862594  4189 leader_election.cc:304] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:17.863731  4302 consensus_queue.cc:1048] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:17.865911  4302 raft_consensus.cc:2804] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:17.866528  4302 raft_consensus.cc:697] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:17.866109  4354 raft_consensus.cc:515] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.870750  4302 consensus_queue.cc:237] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:17.871176  4148 raft_consensus.cc:2393] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d1040e069dd74a0ab9517aa0698ce3a4 in current term 1: Already voted for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in this term.
I20260709 13:14:17.895349  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:17.896572  4072 raft_consensus.cc:2393] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in current term 1: Already voted for candidate d1040e069dd74a0ab9517aa0698ce3a4 in this term.
I20260709 13:14:17.897769  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:17.898839  4354 leader_election.cc:290] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:17.899384  4113 leader_election.cc:304] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2; no voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:17.901203  4354 raft_consensus.cc:2749] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:17.919647  3969 catalog_manager.cc:5697] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 1 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:17.939510  4149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e65b0a70f5fa4d8eabaa181f6c5e596e"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
mode: GRACEFUL
new_leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:56218
I20260709 13:14:17.940271  4149 raft_consensus.cc:606] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Received request to transfer leadership to TS b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:17.947508  4223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c87e7ca0ef44ddeb8146ad2345880eb"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
mode: GRACEFUL
new_leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:34054
I20260709 13:14:17.947971  4223 raft_consensus.cc:606] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Received request to transfer leadership to TS b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:17.952296  4149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0492c0b4543e44e7b34db9da7a2c1140"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
mode: GRACEFUL
new_leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:56218
I20260709 13:14:17.952782  4149 raft_consensus.cc:606] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Received request to transfer leadership to TS b4b9775ef24c4dd3b8286e93b2dac58e
I20260709 13:14:17.957129  4072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3b2e00478c547cbab57a6eea41c7429"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
mode: GRACEFUL
new_leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:38676
I20260709 13:14:17.957594  4072 raft_consensus.cc:606] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Received request to transfer leadership to TS 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:17.962375  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb9912e99f574e38b598eb0574e92e66"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
mode: GRACEFUL
new_leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:34054
I20260709 13:14:17.962934  4221 raft_consensus.cc:606] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Received request to transfer leadership to TS 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:17.967377  4072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
mode: GRACEFUL
new_leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:38676
I20260709 13:14:17.967782  4072 raft_consensus.cc:606] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Received request to transfer leadership to TS 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:17.971978  4221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
mode: GRACEFUL
new_leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:34054
I20260709 13:14:17.972385  4221 raft_consensus.cc:606] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Received request to transfer leadership to TS 5b26d42d27604c4bb7b2e86d6bf6efe2
I20260709 13:14:17.976691  4149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99d6b263d7cc43799adbb1a546847b11"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
mode: GRACEFUL
new_leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
 from {username='slave'} at 127.0.0.1:56218
I20260709 13:14:17.977227  4149 raft_consensus.cc:606] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Received request to transfer leadership to TS d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:18.026602  4369 consensus_queue.cc:1048] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.036757  4354 consensus_queue.cc:1048] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.045678  4421 raft_consensus.cc:993] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2: : Instructing follower d1040e069dd74a0ab9517aa0698ce3a4 to start an election
I20260709 13:14:18.046167  4354 raft_consensus.cc:1081] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Signalling peer d1040e069dd74a0ab9517aa0698ce3a4 to start an election
I20260709 13:14:18.047768  4221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99d6b263d7cc43799adbb1a546847b11"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
 from {username='slave'} at 127.0.0.1:34042
I20260709 13:14:18.048420  4221 raft_consensus.cc:493] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.048692  4221 raft_consensus.cc:3060] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.054055  4221 raft_consensus.cc:515] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.055696  4221 leader_election.cc:290] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:18.056445  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d6b263d7cc43799adbb1a546847b11" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:18.057119  4072 raft_consensus.cc:3060] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.057675  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99d6b263d7cc43799adbb1a546847b11" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:18.058375  4149 raft_consensus.cc:3055] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.058689  4149 raft_consensus.cc:740] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:18.059491  4149 consensus_queue.cc:260] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.060786  4149 raft_consensus.cc:3060] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.064330  4072 raft_consensus.cc:2468] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 2.
I20260709 13:14:18.065455  4189 leader_election.cc:304] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:18.066233  4302 raft_consensus.cc:2804] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.066627  4302 raft_consensus.cc:697] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:18.067498  4149 raft_consensus.cc:2468] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 2.
I20260709 13:14:18.067334  4302 consensus_queue.cc:237] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.073770  3969 catalog_manager.cc:5697] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 1 to 2, leader changed from 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130) to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 2 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:18.106556  4414 consensus_queue.cc:1048] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.118077  4413 consensus_queue.cc:1048] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.127593  4374 raft_consensus.cc:993] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e: : Instructing follower 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:18.128116  4413 raft_consensus.cc:1081] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Signalling peer 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:18.130344  4149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:56212
I20260709 13:14:18.130959  4149 raft_consensus.cc:493] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.131434  4149 raft_consensus.cc:3060] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.132263  4413 raft_consensus.cc:993] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: : Instructing follower 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:18.132863  4374 raft_consensus.cc:1081] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Signalling peer 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:18.134510  4148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3b2e00478c547cbab57a6eea41c7429"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:56212
I20260709 13:14:18.135043  4148 raft_consensus.cc:493] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.135378  4148 raft_consensus.cc:3060] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.138898  4149 raft_consensus.cc:515] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.141342  4149 leader_election.cc:290] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:18.141067  4148 raft_consensus.cc:515] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.141634  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:18.142298  4072 raft_consensus.cc:3055] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.142603  4072 raft_consensus.cc:740] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:18.143298  4148 leader_election.cc:290] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:18.144268  4223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b2e00478c547cbab57a6eea41c7429" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:18.143394  4072 consensus_queue.cc:260] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.144043  4071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b2e00478c547cbab57a6eea41c7429" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:18.144814  4223 raft_consensus.cc:3060] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.144502  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a6ddbe0eb354644916d2ae4b65d5d6e" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:18.145207  4071 raft_consensus.cc:3055] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.145453  4221 raft_consensus.cc:3060] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.145573  4071 raft_consensus.cc:740] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:18.146417  4071 consensus_queue.cc:260] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.147657  4071 raft_consensus.cc:3060] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.150218  4072 raft_consensus.cc:3060] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.153220  4370 raft_consensus.cc:993] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2: : Instructing follower b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:18.149060  4223 raft_consensus.cc:2468] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:18.153702  4370 raft_consensus.cc:1081] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Signalling peer b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:18.155417  4113 leader_election.cc:304] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:18.155870  4071 raft_consensus.cc:2468] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:18.156498  4370 raft_consensus.cc:2804] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.156996  4370 raft_consensus.cc:697] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:18.158092  4072 raft_consensus.cc:2468] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:18.157874  4370 consensus_queue.cc:237] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.155448  4073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e65b0a70f5fa4d8eabaa181f6c5e596e"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:38664
I20260709 13:14:18.159248  4115 leader_election.cc:304] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:18.159636  4073 raft_consensus.cc:493] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.160029  4073 raft_consensus.cc:3060] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.161044  4221 raft_consensus.cc:2468] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:18.160051  4354 raft_consensus.cc:2804] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.164498  4354 raft_consensus.cc:697] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:18.165395  4354 consensus_queue.cc:237] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.166467  4073 raft_consensus.cc:515] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.166749  3969 catalog_manager.cc:5697] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 1 to 2, leader changed from b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129) to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.169672  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b0a70f5fa4d8eabaa181f6c5e596e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:18.170159  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e65b0a70f5fa4d8eabaa181f6c5e596e" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:18.170637  4073 leader_election.cc:290] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:18.170755  4149 raft_consensus.cc:3055] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.171207  4149 raft_consensus.cc:740] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:18.170265  4221 raft_consensus.cc:3060] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.171983  4149 consensus_queue.cc:260] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.173226  4149 raft_consensus.cc:3060] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.177471  4221 raft_consensus.cc:2468] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:18.178748  4038 leader_election.cc:304] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:18.179685  4397 raft_consensus.cc:2804] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.180202  4397 raft_consensus.cc:697] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:18.180341  4149 raft_consensus.cc:2468] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:18.181146  4397 consensus_queue.cc:237] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.182360  3969 catalog_manager.cc:5697] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 1 to 2, leader changed from b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129) to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.189327  3972 catalog_manager.cc:5697] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 1 to 2, leader changed from 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130) to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 2 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.311904  4403 raft_consensus.cc:993] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4: : Instructing follower 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:18.312356  4302 raft_consensus.cc:1081] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Signalling peer 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:18.313903  4149 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb9912e99f574e38b598eb0574e92e66"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:56202
I20260709 13:14:18.314379  4149 raft_consensus.cc:493] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.314762  4149 raft_consensus.cc:3060] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.319732  4149 raft_consensus.cc:515] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.322036  4149 leader_election.cc:290] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:18.322616  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9912e99f574e38b598eb0574e92e66" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:18.322845  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb9912e99f574e38b598eb0574e92e66" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:18.323304  4221 raft_consensus.cc:3055] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.323550  4073 raft_consensus.cc:3060] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.323684  4221 raft_consensus.cc:740] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:18.324625  4221 consensus_queue.cc:260] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.325779  4221 raft_consensus.cc:3060] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.325526  4302 consensus_queue.cc:1048] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.330022  4073 raft_consensus.cc:2468] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:18.332772  4115 leader_election.cc:304] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:18.333701  4354 raft_consensus.cc:2804] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.333961  4403 raft_consensus.cc:993] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4: : Instructing follower 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:18.334143  4354 raft_consensus.cc:697] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:18.334429  4403 raft_consensus.cc:1081] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Signalling peer 5b26d42d27604c4bb7b2e86d6bf6efe2 to start an election
I20260709 13:14:18.335111  4354 consensus_queue.cc:237] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.332803  4221 raft_consensus.cc:2468] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:18.340539  4148 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
 from {username='slave'} at 127.0.0.1:56202
I20260709 13:14:18.340618  4403 consensus_queue.cc:1048] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.341073  4148 raft_consensus.cc:493] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.341511  4148 raft_consensus.cc:3060] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.344959  3969 catalog_manager.cc:5697] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 1 to 2, leader changed from d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131) to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.348565  4148 raft_consensus.cc:515] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.350787  4149 raft_consensus.cc:1240] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Rejecting Update request from peer d1040e069dd74a0ab9517aa0698ce3a4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:18.351850  4148 leader_election.cc:290] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:18.352376  4403 consensus_queue.cc:1059] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:18.351881  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:18.353215  4403 raft_consensus.cc:3055] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.353286  4073 raft_consensus.cc:3060] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.353617  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d84cf43d8b741f7ab94db7e0b97d961" candidate_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:18.353612  4403 raft_consensus.cc:740] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:18.355079  4403 consensus_queue.cc:260] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.356112  4403 raft_consensus.cc:3060] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.359355  4073 raft_consensus.cc:2468] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:18.360390  4115 leader_election.cc:304] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:18.361168  4370 raft_consensus.cc:2804] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.361647  4370 raft_consensus.cc:697] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:18.362512  4370 consensus_queue.cc:237] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.368264  4221 raft_consensus.cc:2468] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b26d42d27604c4bb7b2e86d6bf6efe2 in term 2.
I20260709 13:14:18.370635  3969 catalog_manager.cc:5697] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 reported cstate change: term changed from 1 to 2, leader changed from d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131) to 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130). New cstate: current_term: 2 leader_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.414144  4354 raft_consensus.cc:993] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2: : Instructing follower b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:18.414613  4370 raft_consensus.cc:1081] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Signalling peer b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:18.415998  4073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0492c0b4543e44e7b34db9da7a2c1140"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:38664
I20260709 13:14:18.416467  4073 raft_consensus.cc:493] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.416867  4073 raft_consensus.cc:3060] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.422066  4073 raft_consensus.cc:515] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.423851  4073 leader_election.cc:290] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:18.424420  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0492c0b4543e44e7b34db9da7a2c1140" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:18.424836  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0492c0b4543e44e7b34db9da7a2c1140" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:18.425446  4221 raft_consensus.cc:3060] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.425441  4148 raft_consensus.cc:3055] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.425957  4148 raft_consensus.cc:740] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:18.426662  4148 consensus_queue.cc:260] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.427591  4148 raft_consensus.cc:3060] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.430393  4221 raft_consensus.cc:2468] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:18.431342  4038 leader_election.cc:304] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:18.431978  4397 raft_consensus.cc:2804] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.432449  4397 raft_consensus.cc:697] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:18.432689  4148 raft_consensus.cc:2468] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:18.433314  4397 consensus_queue.cc:237] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.439379  3969 catalog_manager.cc:5697] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 1 to 2, leader changed from 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130) to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 2 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:18.479410  4393 raft_consensus.cc:993] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4: : Instructing follower b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:18.479888  4403 raft_consensus.cc:1081] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Signalling peer b4b9775ef24c4dd3b8286e93b2dac58e to start an election
I20260709 13:14:18.481233  4073 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c87e7ca0ef44ddeb8146ad2345880eb"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
 from {username='slave'} at 127.0.0.1:38672
I20260709 13:14:18.481642  4073 raft_consensus.cc:493] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:18.481889  4073 raft_consensus.cc:3060] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.487669  4073 raft_consensus.cc:515] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.489187  4073 leader_election.cc:290] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Requested vote from peers 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667), d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131:33975)
I20260709 13:14:18.489866  4148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c87e7ca0ef44ddeb8146ad2345880eb" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:18.490114  4221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c87e7ca0ef44ddeb8146ad2345880eb" candidate_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
I20260709 13:14:18.490479  4148 raft_consensus.cc:3060] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.490706  4221 raft_consensus.cc:3055] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:18.491051  4221 raft_consensus.cc:740] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:18.491744  4221 consensus_queue.cc:260] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.492645  4221 raft_consensus.cc:3060] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:18.494928  4148 raft_consensus.cc:2468] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:18.495849  4041 leader_election.cc:304] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, b4b9775ef24c4dd3b8286e93b2dac58e; no voters: 
I20260709 13:14:18.496498  4397 raft_consensus.cc:2804] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:18.496877  4397 raft_consensus.cc:697] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Becoming Leader. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:18.497599  4397 consensus_queue.cc:237] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:18.497928  4221 raft_consensus.cc:2468] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4b9775ef24c4dd3b8286e93b2dac58e in term 2.
I20260709 13:14:18.503584  3969 catalog_manager.cc:5697] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e reported cstate change: term changed from 1 to 2, leader changed from d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131) to b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129). New cstate: current_term: 2 leader_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:18.529739  4004 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb7c0 after lost signal to thread 23433
W20260709 13:14:18.530705  4004 debug-util.cc:398] Leaking SignalData structure 0x7b08001664a0 after lost signal to thread 4007
W20260709 13:14:18.531703  4004 debug-util.cc:398] Leaking SignalData structure 0x7b080013d9c0 after lost signal to thread 4099
W20260709 13:14:18.532770  4004 debug-util.cc:398] Leaking SignalData structure 0x7b080009ce80 after lost signal to thread 4174
W20260709 13:14:18.533912  4004 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2b80 after lost signal to thread 4248
I20260709 13:14:18.589630  4073 raft_consensus.cc:1275] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.591369  4354 consensus_queue.cc:1048] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.602804  4221 raft_consensus.cc:1275] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.604794  4421 consensus_queue.cc:1048] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.607491  4148 raft_consensus.cc:1275] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.610551  4397 consensus_queue.cc:1048] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.626011  4148 raft_consensus.cc:1275] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Refusing update from remote peer d1040e069dd74a0ab9517aa0698ce3a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.627434  4393 consensus_queue.cc:1048] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.630086  4223 raft_consensus.cc:1275] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.631875  4374 consensus_queue.cc:1048] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.651336  4073 raft_consensus.cc:1275] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer d1040e069dd74a0ab9517aa0698ce3a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.653692  4403 consensus_queue.cc:1048] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.698129  4073 raft_consensus.cc:1275] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.700910  4370 consensus_queue.cc:1048] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.710949  4221 raft_consensus.cc:1275] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.712505  4421 consensus_queue.cc:1048] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.784281  4073 raft_consensus.cc:1275] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.785591  4370 consensus_queue.cc:1048] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.794175  4221 raft_consensus.cc:1275] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.795687  4354 consensus_queue.cc:1048] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.853408  4221 raft_consensus.cc:1275] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.855082  4397 consensus_queue.cc:1048] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.864753  4221 raft_consensus.cc:1275] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.866045  4149 raft_consensus.cc:1275] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.866302  4370 consensus_queue.cc:1048] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:18.867926  4073 raft_consensus.cc:1275] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Refusing update from remote peer 5b26d42d27604c4bb7b2e86d6bf6efe2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.869227  4374 consensus_queue.cc:1048] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.871613  4370 consensus_queue.cc:1048] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.931951  4223 raft_consensus.cc:1275] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.933149  4374 consensus_queue.cc:1048] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:18.943341  4149 raft_consensus.cc:1275] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Refusing update from remote peer b4b9775ef24c4dd3b8286e93b2dac58e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:18.944700  4397 consensus_queue.cc:1048] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:20.980265  3970 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52136:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:21.003849  3970 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52136:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:21.140257 23430 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:21.209522  4477 log.cc:927] Time spent T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:14:21.228137  4488 tablet.cc:1724] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:21.270424  4041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.130:45667, user_credentials={real_user=slave}} blocked reactor thread for 85215.5us
W20260709 13:14:21.275185  4038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:33975, user_credentials={real_user=slave}} blocked reactor thread for 63551.5us
I20260709 13:14:21.290829  4492 tablet.cc:1724] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:21.296872  4472 log.cc:927] Time spent T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 13:14:21.355242  4494 tablet.cc:1724] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:21.361539  4471 log.cc:927] Time spent T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 13:14:21.376114  4499 tablet.cc:1724] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.376550  4507 tablet.cc:1724] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.385633  4488 tablet.cc:1724] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.350462  4501 tablet.cc:1724] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.414762  4511 tablet.cc:1724] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.417649  4510 tablet.cc:1724] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.423398  4512 tablet.cc:1724] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.429395  4513 tablet.cc:1724] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:21.378788  4113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.131:33975, user_credentials={real_user=slave}} blocked reactor thread for 99934.3us
W20260709 13:14:21.394116  4115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.225.129:45757, user_credentials={real_user=slave}} blocked reactor thread for 56369us
I20260709 13:14:21.502942  4507 tablet.cc:1724] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.502998  4510 tablet.cc:1724] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.504549  4508 tablet.cc:1724] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.525151  4514 tablet.cc:1724] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.538911  4492 tablet.cc:1724] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.542062  4510 tablet.cc:1724] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.522339  4494 tablet.cc:1724] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.520995  4511 tablet.cc:1724] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.555716  4513 tablet.cc:1724] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.560503  4514 tablet.cc:1724] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.563390  4501 tablet.cc:1724] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.583359  4488 tablet.cc:1724] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.586572  4149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16efd7a5efa04634a613229ea920da19"
dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
mode: GRACEFUL
new_leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
 from {username='slave'} at 127.0.0.1:35884
I20260709 13:14:21.587229  4149 raft_consensus.cc:606] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Received request to transfer leadership to TS d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:21.589012  4492 tablet.cc:1724] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.595711  4494 tablet.cc:1724] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.601027  4499 tablet.cc:1724] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.621029  4512 tablet.cc:1724] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:21.630455  4497 raft_consensus.cc:993] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2: : Instructing follower d1040e069dd74a0ab9517aa0698ce3a4 to start an election
I20260709 13:14:21.631160  4497 raft_consensus.cc:1081] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Signalling peer d1040e069dd74a0ab9517aa0698ce3a4 to start an election
I20260709 13:14:21.635619  4224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16efd7a5efa04634a613229ea920da19"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
 from {username='slave'} at 127.0.0.1:34042
I20260709 13:14:21.636334  4224 raft_consensus.cc:493] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.636761  4224 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.661374  4224 raft_consensus.cc:515] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:21.667927  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16efd7a5efa04634a613229ea920da19" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:21.668722  4072 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.674482  4073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd"
dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
mode: GRACEFUL
new_leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
 from {username='slave'} at 127.0.0.1:52108
I20260709 13:14:21.675252  4073 raft_consensus.cc:606] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Received request to transfer leadership to TS d1040e069dd74a0ab9517aa0698ce3a4
I20260709 13:14:21.677131 23430 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:21.677918 23430 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:21.681789  4224 leader_election.cc:290] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 3 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:21.683105  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16efd7a5efa04634a613229ea920da19" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:21.683902  4149 raft_consensus.cc:3055] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:21.684253  4149 raft_consensus.cc:740] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b26d42d27604c4bb7b2e86d6bf6efe2, State: Running, Role: LEADER
I20260709 13:14:21.685228  4149 consensus_queue.cc:260] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:21.690837  4149 raft_consensus.cc:3060] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.696692  4072 raft_consensus.cc:2468] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 3.
I20260709 13:14:21.698645  4189 leader_election.cc:304] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4b9775ef24c4dd3b8286e93b2dac58e, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:21.699585  4149 raft_consensus.cc:2468] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 3.
I20260709 13:14:21.700153  4447 raft_consensus.cc:2804] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:21.700951  4447 raft_consensus.cc:697] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:21.702267  4447 consensus_queue.cc:237] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:21.711138  4495 raft_consensus.cc:993] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e: : Instructing follower d1040e069dd74a0ab9517aa0698ce3a4 to start an election
I20260709 13:14:21.711669  4495 raft_consensus.cc:1081] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Signalling peer d1040e069dd74a0ab9517aa0698ce3a4 to start an election
I20260709 13:14:21.711804  3969 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41: soft_deleted_table [id=a0a6ea2a26c74f5783fb3713d1fa86ec] alter complete (version 1)
I20260709 13:14:21.713888  4224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd"
dest_uuid: "d1040e069dd74a0ab9517aa0698ce3a4"
 from {username='slave'} at 127.0.0.1:34046
I20260709 13:14:21.714483  4224 raft_consensus.cc:493] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.714869  4224 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.720877  3969 catalog_manager.cc:5697] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 2 to 3, leader changed from 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130) to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.723719  4224 raft_consensus.cc:515] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:21.728468  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e"
I20260709 13:14:21.729137  4072 raft_consensus.cc:3055] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:21.729476  4072 raft_consensus.cc:740] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b4b9775ef24c4dd3b8286e93b2dac58e, State: Running, Role: LEADER
I20260709 13:14:21.729650  4149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc03f73721624afb835f4a7cf2ca57cd" candidate_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2"
I20260709 13:14:21.730345  4149 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.730453  4224 leader_election.cc:290] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 3 election: Requested vote from peers b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757), 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667)
I20260709 13:14:21.731632  4072 consensus_queue.cc:260] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:21.732661  4072 raft_consensus.cc:3060] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:21.738633  4149 raft_consensus.cc:2468] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 3.
I20260709 13:14:21.739843  4190 leader_election.cc:304] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b26d42d27604c4bb7b2e86d6bf6efe2, d1040e069dd74a0ab9517aa0698ce3a4; no voters: 
I20260709 13:14:21.740685  4447 raft_consensus.cc:2804] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:21.741402  4447 raft_consensus.cc:697] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 LEADER]: Becoming Leader. State: Replica: d1040e069dd74a0ab9517aa0698ce3a4, State: Running, Role: LEADER
I20260709 13:14:21.742123  4072 raft_consensus.cc:2468] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1040e069dd74a0ab9517aa0698ce3a4 in term 3.
I20260709 13:14:21.742308  4447 consensus_queue.cc:237] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } }
I20260709 13:14:21.751909  3969 catalog_manager.cc:5697] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 reported cstate change: term changed from 2 to 3, leader changed from b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129) to d1040e069dd74a0ab9517aa0698ce3a4 (127.22.225.131). New cstate: current_term: 3 leader_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1040e069dd74a0ab9517aa0698ce3a4" member_type: VOTER last_known_addr { host: "127.22.225.131" port: 33975 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:22.261696  4072 raft_consensus.cc:1275] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 3 FOLLOWER]: Refusing update from remote peer d1040e069dd74a0ab9517aa0698ce3a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:22.263164  4447 consensus_queue.cc:1048] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.278442  4149 raft_consensus.cc:1275] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 3 FOLLOWER]: Refusing update from remote peer d1040e069dd74a0ab9517aa0698ce3a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:22.279879  4447 consensus_queue.cc:1048] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.288440  4072 raft_consensus.cc:1275] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 3 FOLLOWER]: Refusing update from remote peer d1040e069dd74a0ab9517aa0698ce3a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:22.290484  4526 consensus_queue.cc:1048] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4b9775ef24c4dd3b8286e93b2dac58e" member_type: VOTER last_known_addr { host: "127.22.225.129" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.311241  4149 raft_consensus.cc:1275] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 3 FOLLOWER]: Refusing update from remote peer d1040e069dd74a0ab9517aa0698ce3a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:22.318776  4526 consensus_queue.cc:1048] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b26d42d27604c4bb7b2e86d6bf6efe2" member_type: VOTER last_known_addr { host: "127.22.225.130" port: 45667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:22.744634 23430 tablet_server.cc:179] TabletServer@127.22.225.129:0 shutting down...
I20260709 13:14:22.782593 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:22.783423 23430 tablet_replica.cc:333] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.784422 23430 raft_consensus.cc:2243] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.785548 23430 raft_consensus.cc:2272] T 99d6b263d7cc43799adbb1a546847b11 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.788424 23430 tablet_replica.cc:333] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.789837 23430 raft_consensus.cc:2243] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.790617 23430 raft_consensus.cc:2272] T 6a6ddbe0eb354644916d2ae4b65d5d6e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.793900  4115 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:14:22.794581 23430 tablet_replica.cc:333] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.795260 23430 raft_consensus.cc:2243] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.795723 23430 raft_consensus.cc:2272] T bb9912e99f574e38b598eb0574e92e66 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.797668 23430 tablet_replica.cc:333] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.798218 23430 raft_consensus.cc:2243] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.798979 23430 raft_consensus.cc:2272] T 6c87e7ca0ef44ddeb8146ad2345880eb P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.800895 23430 tablet_replica.cc:333] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.801975 23430 raft_consensus.cc:2243] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.802475 23430 raft_consensus.cc:2272] T 2d84cf43d8b741f7ab94db7e0b97d961 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.803517  4115 consensus_peers.cc:597] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 -> Peer b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757): Couldn't send request to peer b4b9775ef24c4dd3b8286e93b2dac58e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.804527 23430 tablet_replica.cc:333] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.805235 23430 raft_consensus.cc:2243] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.805668 23430 raft_consensus.cc:2272] T e3b2e00478c547cbab57a6eea41c7429 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.808230 23430 tablet_replica.cc:333] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.809158 23430 raft_consensus.cc:2243] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.810010 23430 raft_consensus.cc:2272] T 0492c0b4543e44e7b34db9da7a2c1140 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.810386  4115 consensus_peers.cc:597] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 -> Peer b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757): Couldn't send request to peer b4b9775ef24c4dd3b8286e93b2dac58e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.812335 23430 tablet_replica.cc:333] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.813059 23430 raft_consensus.cc:2243] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.814024 23430 raft_consensus.cc:2272] T e65b0a70f5fa4d8eabaa181f6c5e596e P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.816480 23430 tablet_replica.cc:333] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.817312 23430 raft_consensus.cc:2243] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.818218 23430 raft_consensus.cc:2272] T 660e4fdffc9b4b589f3cd6c6e9a7695e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.820331 23430 tablet_replica.cc:333] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.821002 23430 raft_consensus.cc:2243] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.821502 23430 raft_consensus.cc:2272] T 7edf022abc5f433d9269a58e1275c080 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.824312 23430 tablet_replica.cc:333] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.824862 23430 raft_consensus.cc:2243] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.825474 23430 raft_consensus.cc:2272] T 597070b4f9d745528ba9b9ac873788cc P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.827669 23430 tablet_replica.cc:333] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.828227 23430 raft_consensus.cc:2243] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.828959 23430 raft_consensus.cc:2272] T aabd8e32cb9f430d8254d8e85c2f0b59 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.831110 23430 tablet_replica.cc:333] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.831779 23430 raft_consensus.cc:2243] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.832293 23430 raft_consensus.cc:2272] T b27057494ea342df93841957e2166ed3 P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.835098 23430 tablet_replica.cc:333] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.835749 23430 raft_consensus.cc:2243] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.836612 23430 raft_consensus.cc:2272] T 37f604f762814e0886d6cc34c23ac10e P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.835763  4115 consensus_peers.cc:597] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 -> Peer b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757): Couldn't send request to peer b4b9775ef24c4dd3b8286e93b2dac58e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.839092 23430 tablet_replica.cc:333] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.839689 23430 raft_consensus.cc:2243] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.840200 23430 raft_consensus.cc:2272] T dc03f73721624afb835f4a7cf2ca57cd P b4b9775ef24c4dd3b8286e93b2dac58e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:22.841032  4189 consensus_peers.cc:597] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 -> Peer b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757): Couldn't send request to peer b4b9775ef24c4dd3b8286e93b2dac58e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.842883 23430 tablet_replica.cc:333] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.843703 23430 raft_consensus.cc:2243] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.844209 23430 raft_consensus.cc:2272] T 49a404b87c07448b8b758ec6a4fd5cce P b4b9775ef24c4dd3b8286e93b2dac58e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.846752 23430 tablet_replica.cc:333] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
W20260709 13:14:22.846781  4189 consensus_peers.cc:597] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 -> Peer b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757): Couldn't send request to peer b4b9775ef24c4dd3b8286e93b2dac58e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.847404 23430 raft_consensus.cc:2243] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.848217 23430 raft_consensus.cc:2272] T b3ed36eee79e4fe5bbe080ce34b8256f P b4b9775ef24c4dd3b8286e93b2dac58e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.850471 23430 tablet_replica.cc:333] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e: stopping tablet replica
I20260709 13:14:22.850970 23430 raft_consensus.cc:2243] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.851485 23430 raft_consensus.cc:2272] T 16efd7a5efa04634a613229ea920da19 P b4b9775ef24c4dd3b8286e93b2dac58e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.885717 23430 tablet_server.cc:196] TabletServer@127.22.225.129:0 shutdown complete.
W20260709 13:14:22.896152  4189 consensus_peers.cc:597] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 -> Peer b4b9775ef24c4dd3b8286e93b2dac58e (127.22.225.129:45757): Couldn't send request to peer b4b9775ef24c4dd3b8286e93b2dac58e. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.129:45757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:22.922416 23430 tablet_server.cc:179] TabletServer@127.22.225.130:0 shutting down...
I20260709 13:14:22.956748 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:22.957612 23430 tablet_replica.cc:333] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.958606 23430 raft_consensus.cc:2243] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.959316 23430 raft_consensus.cc:2272] T 99d6b263d7cc43799adbb1a546847b11 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.961349 23430 tablet_replica.cc:333] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.961905 23430 raft_consensus.cc:2243] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.962652 23430 raft_consensus.cc:2272] T 6a6ddbe0eb354644916d2ae4b65d5d6e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.964613 23430 tablet_replica.cc:333] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.965199 23430 raft_consensus.cc:2243] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.965991 23430 raft_consensus.cc:2272] T bb9912e99f574e38b598eb0574e92e66 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.967998 23430 tablet_replica.cc:333] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.968518 23430 raft_consensus.cc:2243] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.969276 23430 raft_consensus.cc:2272] T 2d84cf43d8b741f7ab94db7e0b97d961 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.970947 23430 tablet_replica.cc:333] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.971478 23430 raft_consensus.cc:2243] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.971896 23430 raft_consensus.cc:2272] T 0492c0b4543e44e7b34db9da7a2c1140 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.973688 23430 tablet_replica.cc:333] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.974231 23430 raft_consensus.cc:2243] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.974946 23430 raft_consensus.cc:2272] T e3b2e00478c547cbab57a6eea41c7429 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.976646 23430 tablet_replica.cc:333] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.977334 23430 raft_consensus.cc:2243] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.977767 23430 raft_consensus.cc:2272] T 6c87e7ca0ef44ddeb8146ad2345880eb P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.979554 23430 tablet_replica.cc:333] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.980096 23430 raft_consensus.cc:2243] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.980527 23430 raft_consensus.cc:2272] T e65b0a70f5fa4d8eabaa181f6c5e596e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.982239 23430 tablet_replica.cc:333] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.982805 23430 raft_consensus.cc:2243] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.983212 23430 raft_consensus.cc:2272] T 660e4fdffc9b4b589f3cd6c6e9a7695e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.985282 23430 tablet_replica.cc:333] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.985908 23430 raft_consensus.cc:2243] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.986382 23430 raft_consensus.cc:2272] T 7edf022abc5f433d9269a58e1275c080 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.988269 23430 tablet_replica.cc:333] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.988780 23430 raft_consensus.cc:2243] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.989563 23430 raft_consensus.cc:2272] T 597070b4f9d745528ba9b9ac873788cc P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.991585 23430 tablet_replica.cc:333] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.992133 23430 raft_consensus.cc:2243] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:22.992882 23430 raft_consensus.cc:2272] T b27057494ea342df93841957e2166ed3 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.995038 23430 tablet_replica.cc:333] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.995590 23430 raft_consensus.cc:2243] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:22.996009 23430 raft_consensus.cc:2272] T dc03f73721624afb835f4a7cf2ca57cd P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:22.998955 23430 tablet_replica.cc:333] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:22.999634 23430 raft_consensus.cc:2243] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.000073 23430 raft_consensus.cc:2272] T 37f604f762814e0886d6cc34c23ac10e P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.002532 23430 tablet_replica.cc:333] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:23.003254 23430 raft_consensus.cc:2243] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.003994 23430 raft_consensus.cc:2272] T 49a404b87c07448b8b758ec6a4fd5cce P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.006047 23430 tablet_replica.cc:333] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:23.006551 23430 raft_consensus.cc:2243] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.006975 23430 raft_consensus.cc:2272] T b3ed36eee79e4fe5bbe080ce34b8256f P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.008935 23430 tablet_replica.cc:333] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:23.009446 23430 raft_consensus.cc:2243] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.009850 23430 raft_consensus.cc:2272] T 16efd7a5efa04634a613229ea920da19 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.012282 23430 tablet_replica.cc:333] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2: stopping tablet replica
I20260709 13:14:23.012773 23430 raft_consensus.cc:2243] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.013216 23430 raft_consensus.cc:2272] T aabd8e32cb9f430d8254d8e85c2f0b59 P 5b26d42d27604c4bb7b2e86d6bf6efe2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.051649 23430 tablet_server.cc:196] TabletServer@127.22.225.130:0 shutdown complete.
W20260709 13:14:23.073349  4190 consensus_peers.cc:597] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 -> Peer 5b26d42d27604c4bb7b2e86d6bf6efe2 (127.22.225.130:45667): Couldn't send request to peer 5b26d42d27604c4bb7b2e86d6bf6efe2. Status: Network error: Client connection negotiation failed: client connection to 127.22.225.130:45667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:23.085449 23430 tablet_server.cc:179] TabletServer@127.22.225.131:0 shutting down...
I20260709 13:14:23.122221 23430 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:23.123108 23430 tablet_replica.cc:333] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.124078 23430 raft_consensus.cc:2243] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.124751 23430 raft_consensus.cc:2272] T 6a6ddbe0eb354644916d2ae4b65d5d6e P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.127570 23430 tablet_replica.cc:333] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.128399 23430 raft_consensus.cc:2243] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.129459 23430 raft_consensus.cc:2272] T 99d6b263d7cc43799adbb1a546847b11 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.132112 23430 tablet_replica.cc:333] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.132928 23430 raft_consensus.cc:2243] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.133512 23430 raft_consensus.cc:2272] T bb9912e99f574e38b598eb0574e92e66 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.135977 23430 tablet_replica.cc:333] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.136754 23430 raft_consensus.cc:2243] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.137343 23430 raft_consensus.cc:2272] T 2d84cf43d8b741f7ab94db7e0b97d961 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.139751 23430 tablet_replica.cc:333] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.140530 23430 raft_consensus.cc:2243] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.141052 23430 raft_consensus.cc:2272] T 0492c0b4543e44e7b34db9da7a2c1140 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.143416 23430 tablet_replica.cc:333] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.144165 23430 raft_consensus.cc:2243] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.144701 23430 raft_consensus.cc:2272] T e3b2e00478c547cbab57a6eea41c7429 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.147102 23430 tablet_replica.cc:333] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.147879 23430 raft_consensus.cc:2243] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.148427 23430 raft_consensus.cc:2272] T 6c87e7ca0ef44ddeb8146ad2345880eb P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.150949 23430 tablet_replica.cc:333] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.151790 23430 raft_consensus.cc:2243] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.152318 23430 raft_consensus.cc:2272] T e65b0a70f5fa4d8eabaa181f6c5e596e P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.154750 23430 tablet_replica.cc:333] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.155514 23430 raft_consensus.cc:2243] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.156569 23430 raft_consensus.cc:2272] T 7edf022abc5f433d9269a58e1275c080 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.159289 23430 tablet_replica.cc:333] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.160099 23430 raft_consensus.cc:2243] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.160658 23430 raft_consensus.cc:2272] T 597070b4f9d745528ba9b9ac873788cc P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.163491 23430 tablet_replica.cc:333] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.164213 23430 raft_consensus.cc:2243] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.164731 23430 raft_consensus.cc:2272] T b27057494ea342df93841957e2166ed3 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.167340 23430 tablet_replica.cc:333] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.168010 23430 raft_consensus.cc:2243] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.168439 23430 raft_consensus.cc:2272] T 37f604f762814e0886d6cc34c23ac10e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.170192 23430 tablet_replica.cc:333] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.170717 23430 raft_consensus.cc:2243] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.171444 23430 raft_consensus.cc:2272] T dc03f73721624afb835f4a7cf2ca57cd P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.173956 23430 tablet_replica.cc:333] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.174476 23430 raft_consensus.cc:2243] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.174888 23430 raft_consensus.cc:2272] T 49a404b87c07448b8b758ec6a4fd5cce P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.176750 23430 tablet_replica.cc:333] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.177366 23430 raft_consensus.cc:2243] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.177847 23430 raft_consensus.cc:2272] T b3ed36eee79e4fe5bbe080ce34b8256f P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.179970 23430 tablet_replica.cc:333] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.180509 23430 raft_consensus.cc:2243] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.181293 23430 raft_consensus.cc:2272] T 16efd7a5efa04634a613229ea920da19 P d1040e069dd74a0ab9517aa0698ce3a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.183579 23430 tablet_replica.cc:333] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.184047 23430 raft_consensus.cc:2243] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.184480 23430 raft_consensus.cc:2272] T 660e4fdffc9b4b589f3cd6c6e9a7695e P d1040e069dd74a0ab9517aa0698ce3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.186463 23430 tablet_replica.cc:333] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4: stopping tablet replica
I20260709 13:14:23.186900 23430 raft_consensus.cc:2243] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:23.187299 23430 raft_consensus.cc:2272] T aabd8e32cb9f430d8254d8e85c2f0b59 P d1040e069dd74a0ab9517aa0698ce3a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.225952 23430 tablet_server.cc:196] TabletServer@127.22.225.131:0 shutdown complete.
I20260709 13:14:23.254436 23430 master.cc:562] Master@127.22.225.190:34251 shutting down...
I20260709 13:14:23.273468 23430 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:23.274029 23430 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:23.274406 23430 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4550e9f2ae3d47538417b3657f2b9c41: stopping tablet replica
I20260709 13:14:23.315153 23430 master.cc:584] Master@127.22.225.190:34251 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11512 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23834 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (421771 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:14:23.368619 23430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:14:23.368865 23430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:14:23.369060 23430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 411 messages since previous log ~14 seconds ago
I20260709 13:14:23.369556 23430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:14:23.369757 23430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:14:23.369979 23430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~184 seconds ago
I20260709 13:14:23.370236 23430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:14:23.370549 23430 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 126 messages since previous log ~32 seconds ago
